2023-11-26T06:58:54.964 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-26T06:58:54.964 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --name rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346 --verbose --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} -- /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/orig.config.yaml 2023-11-26T06:58:55.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-26T06:58:55.089 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} email: null first_in_suite: false job_id: '7467346' kernel: flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 44c2237fe77713214148c1fd622c872f346f1b99 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44c2237fe77713214148c1fd622c872f346f1b99 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mgr-vol-misc sha1: 44c2237fe77713214148c1fd622c872f346f1b99 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1863 sha1: 44c2237fe77713214148c1fd622c872f346f1b99 sleep_before_teardown: 0 suite: fs:volumes suite_branch: rishabh-mgr-vol-misc suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 44c2237fe77713214148c1fd622c872f346f1b99 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwGcDeN5UlXSGnqynym5VAsLTSHUH7LxShj1NoMs32gDEDwy0kTaxFiO9TjtltR60M1fHcQeIvGsH2+9g7R0cM= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKiQk+cQB//La6reCq57mDNs3AvdXVORTXZhFOX0jQrLpZSdY63aoFJdfUBYt3XMQg67xHjNFJN/Y62QPaX7hs0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-26_06:51:12 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-26T06:58:55.089 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa; will attempt to use it 2023-11-26T06:58:55.090 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks 2023-11-26T06:58:55.090 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-26T06:58:55.092 INFO:teuthology.task.internal:Checking packages... 2023-11-26T06:58:55.114 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '44c2237fe77713214148c1fd622c872f346f1b99' 2023-11-26T06:58:55.114 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-26T06:58:55.114 INFO:teuthology.packaging:ref: None 2023-11-26T06:58:55.114 INFO:teuthology.packaging:tag: None 2023-11-26T06:58:55.114 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-26T06:58:55.114 INFO:teuthology.packaging:sha1: 44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T06:58:55.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-26T06:58:55.349 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484-g44c2237f-1jammy 2023-11-26T06:58:55.349 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-26T06:58:55.355 INFO:teuthology.task.internal:no buildpackages task found 2023-11-26T06:58:55.356 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-26T06:58:55.380 INFO:teuthology.task.internal:Saving configuration 2023-11-26T06:58:55.396 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-26T06:58:55.405 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T06:58:55.433 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:35.584132', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMDP3GUCHyeqtQmAshZ3g6ho4NFhR/dHypnQ2n2ApVnf'} 2023-11-26T06:58:55.453 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:35.585493', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJDH9z0KOezHapcKarlePy4kTxU1srNCKvAECD6dwk3h'} 2023-11-26T06:58:55.453 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-26T06:58:55.461 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-26T06:58:55.461 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-26T06:58:55.461 INFO:teuthology.run_tasks:Running task console_log... 2023-11-26T06:58:55.535 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff88d8c70d0>, signals=[15]) 2023-11-26T06:58:55.536 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-26T06:58:55.543 INFO:teuthology.task.internal:Opening connections... 2023-11-26T06:58:55.544 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T06:58:55.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T06:58:55.622 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T06:58:55.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T06:58:55.698 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-26T06:58:55.705 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-11-26T06:58:55.709 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-11-26T06:58:55.710 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-11-26T06:58:55.755 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-26T06:58:55.755 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2023-11-26T06:58:55.755 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2023-11-26T06:58:55.755 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-26T06:58:55.755 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2023-11-26T06:58:55.756 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2023-11-26T06:58:55.756 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2023-11-26T06:58:55.756 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-26T06:58:55.756 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-26T06:58:55.756 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-26T06:58:55.756 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-26T06:58:55.756 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2023-11-26T06:58:55.757 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-11-26T06:58:55.780 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-11-26T06:58:55.784 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-11-26T06:58:55.785 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="22.04" 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=jammy 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-26T06:58:55.830 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-26T06:58:55.831 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-26T06:58:55.831 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-26T06:58:55.831 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=jammy 2023-11-26T06:58:55.831 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-11-26T06:58:55.855 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-26T06:58:55.865 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-26T06:58:55.919 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-26T06:58:55.919 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2023-11-26T06:58:55.922 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2023-11-26T06:58:55.926 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-26T06:58:55.936 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-26T06:58:55.936 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2023-11-26T06:58:55.969 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2023-11-26T06:58:55.976 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-26T06:58:56.031 INFO:teuthology.run_tasks:Running task kernel... 2023-11-26T06:58:56.045 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-26T06:58:56.046 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, timeout 300 2023-11-26T06:58:56.046 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-26T06:58:56.046 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-26T06:58:56.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:58:56.051 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:58:56.051 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-26T06:58:56.051 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2023-11-26T06:58:56.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T06:58:56.052 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:58:56.052 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-26T06:58:56.052 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2023-11-26T06:58:56.096 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2023-11-26T06:58:56.097 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:58:56.097 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-26T06:58:56.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:58:56.101 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-56-generic 2023-11-26T06:58:56.101 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:58:56.101 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-26T06:58:56.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T06:58:56.238 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-26T06:58:56.238 DEBUG:teuthology.orchestra.run.smithi120:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-26T06:58:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-26T06:58:56.339 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-26T06:58:56.340 DEBUG:teuthology.orchestra.run.smithi070:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-26T06:58:56.357 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: git config --global init.defaultBranch 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: 2023-11-26T06:58:56.391 INFO:teuthology.orchestra.run.smithi120.stderr:hint: git branch -m 2023-11-26T06:58:56.392 INFO:teuthology.orchestra.run.smithi120.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-26T06:58:56.394 DEBUG:teuthology.orchestra.run.smithi120:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-26T06:58:56.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-26T06:58:56.494 INFO:teuthology.orchestra.run.smithi070.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: git config --global init.defaultBranch 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: 2023-11-26T06:58:56.495 INFO:teuthology.orchestra.run.smithi070.stderr:hint: git branch -m 2023-11-26T06:58:56.496 INFO:teuthology.orchestra.run.smithi070.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-26T06:58:56.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-26T06:58:56.515 DEBUG:teuthology.orchestra.run.smithi120:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-26T06:58:56.562 DEBUG:teuthology.orchestra.run.smithi070:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-26T06:58:56.617 DEBUG:teuthology.orchestra.run.smithi070:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-26T07:02:31.853 INFO:teuthology.orchestra.run.smithi120.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-26T07:02:31.853 INFO:teuthology.orchestra.run.smithi120.stderr: * [new branch] main -> origin/main 2023-11-26T07:02:31.884 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190312 -> 20190312 2023-11-26T07:02:31.885 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190416 -> 20190416 2023-11-26T07:02:31.885 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190514 -> 20190514 2023-11-26T07:02:31.886 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190618 -> 20190618 2023-11-26T07:02:31.886 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190717 -> 20190717 2023-11-26T07:02:31.886 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190815 -> 20190815 2023-11-26T07:02:31.886 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20190923 -> 20190923 2023-11-26T07:02:31.886 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20191022 -> 20191022 2023-11-26T07:02:31.886 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20191215 -> 20191215 2023-11-26T07:02:31.887 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200122 -> 20200122 2023-11-26T07:02:31.887 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200316 -> 20200316 2023-11-26T07:02:31.887 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200421 -> 20200421 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200519 -> 20200519 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200619 -> 20200619 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200721 -> 20200721 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200817 -> 20200817 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20200918 -> 20200918 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20201022 -> 20201022 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20201118 -> 20201118 2023-11-26T07:02:31.888 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20201218 -> 20201218 2023-11-26T07:02:31.889 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210208 -> 20210208 2023-11-26T07:02:31.889 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210315 -> 20210315 2023-11-26T07:02:31.889 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210511 -> 20210511 2023-11-26T07:02:31.889 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210716 -> 20210716 2023-11-26T07:02:31.889 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210818 -> 20210818 2023-11-26T07:02:31.890 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20210919 -> 20210919 2023-11-26T07:02:31.890 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20211027 -> 20211027 2023-11-26T07:02:31.890 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20211216 -> 20211216 2023-11-26T07:02:31.891 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220209 -> 20220209 2023-11-26T07:02:31.891 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220310 -> 20220310 2023-11-26T07:02:31.891 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220411 -> 20220411 2023-11-26T07:02:31.891 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220509 -> 20220509 2023-11-26T07:02:31.891 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220610 -> 20220610 2023-11-26T07:02:31.891 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220708 -> 20220708 2023-11-26T07:02:31.891 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220815 -> 20220815 2023-11-26T07:02:31.892 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20220913 -> 20220913 2023-11-26T07:02:31.892 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20221012 -> 20221012 2023-11-26T07:02:31.892 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20221109 -> 20221109 2023-11-26T07:02:31.892 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20221214 -> 20221214 2023-11-26T07:02:31.892 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230117 -> 20230117 2023-11-26T07:02:31.892 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230210 -> 20230210 2023-11-26T07:02:31.893 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230310 -> 20230310 2023-11-26T07:02:31.893 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230404 -> 20230404 2023-11-26T07:02:31.893 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230515 -> 20230515 2023-11-26T07:02:31.893 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230625 -> 20230625 2023-11-26T07:02:31.894 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230804 -> 20230804 2023-11-26T07:02:31.894 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20230919 -> 20230919 2023-11-26T07:02:31.894 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20231030 -> 20231030 2023-11-26T07:02:31.894 INFO:teuthology.orchestra.run.smithi120.stderr: * [new tag] 20231111 -> 20231111 2023-11-26T07:02:35.893 INFO:teuthology.orchestra.run.smithi120.stderr:Updating files: 50% (1632/3248) Updating files: 51% (1657/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 64% (2102/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2648/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-26T07:02:35.897 INFO:teuthology.orchestra.run.smithi120.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-26T07:02:35.918 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-26T07:02:35.919 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T07:02:36.070 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-26T07:02:36.070 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-26T07:02:36.073 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi120.front.sepia.ceph.com to complete... 2023-11-26T07:02:36.726 INFO:teuthology.orchestra.run.smithi070.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-26T07:02:36.726 INFO:teuthology.orchestra.run.smithi070.stderr: * [new branch] main -> origin/main 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20190312 -> 20190312 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20190416 -> 20190416 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20190514 -> 20190514 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20190618 -> 20190618 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20190717 -> 20190717 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20190815 -> 20190815 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20190923 -> 20190923 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20191022 -> 20191022 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20191215 -> 20191215 2023-11-26T07:02:36.763 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200122 -> 20200122 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200316 -> 20200316 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200421 -> 20200421 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200519 -> 20200519 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200619 -> 20200619 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200721 -> 20200721 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200817 -> 20200817 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20200918 -> 20200918 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20201022 -> 20201022 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20201118 -> 20201118 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20201218 -> 20201218 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20210208 -> 20210208 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20210315 -> 20210315 2023-11-26T07:02:36.764 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20210511 -> 20210511 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20210716 -> 20210716 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20210818 -> 20210818 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20210919 -> 20210919 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20211027 -> 20211027 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20211216 -> 20211216 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220209 -> 20220209 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220310 -> 20220310 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220411 -> 20220411 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220509 -> 20220509 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220610 -> 20220610 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220708 -> 20220708 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220815 -> 20220815 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20220913 -> 20220913 2023-11-26T07:02:36.765 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20221012 -> 20221012 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20221109 -> 20221109 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20221214 -> 20221214 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230117 -> 20230117 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230210 -> 20230210 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230310 -> 20230310 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230404 -> 20230404 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230515 -> 20230515 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230625 -> 20230625 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230804 -> 20230804 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20230919 -> 20230919 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20231030 -> 20231030 2023-11-26T07:02:36.766 INFO:teuthology.orchestra.run.smithi070.stderr: * [new tag] 20231111 -> 20231111 2023-11-26T07:02:37.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26 07:02:37 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-26T07:02:37.640 INFO:teuthology.orchestra.run.smithi120.stderr:FINISHED --2023-11-26 07:02:37-- 2023-11-26T07:02:37.640 INFO:teuthology.orchestra.run.smithi120.stderr:Total wall clock time: 1.5s 2023-11-26T07:02:37.640 INFO:teuthology.orchestra.run.smithi120.stderr:Downloaded: 1 files, 37M in 1.4s (26.2 MB/s) 2023-11-26T07:02:37.643 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-26T07:02:37.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo dpkg -i /tmp/linux-image.deb 2023-11-26T07:02:37.895 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-26T07:02:39.903 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-26T07:02:39.907 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-26T07:02:40.027 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-26T07:02:40.725 INFO:teuthology.orchestra.run.smithi070.stderr:Updating files: 51% (1680/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 65% (2120/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2653/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-26T07:02:40.729 INFO:teuthology.orchestra.run.smithi070.stdout:HEAD is now at 9552083a Merge branch 'robot/pr-0-1700470117' into 'main' 2023-11-26T07:02:40.750 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-26T07:02:40.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-26T07:02:40.999 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-26T07:02:41.000 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-26T07:02:41.003 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi070.front.sepia.ceph.com to complete... 2023-11-26T07:02:42.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26 07:02:42 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-26T07:02:42.913 INFO:teuthology.orchestra.run.smithi070.stderr:FINISHED --2023-11-26 07:02:42-- 2023-11-26T07:02:42.913 INFO:teuthology.orchestra.run.smithi070.stderr:Total wall clock time: 1.9s 2023-11-26T07:02:42.913 INFO:teuthology.orchestra.run.smithi070.stderr:Downloaded: 1 files, 37M in 1.8s (21.1 MB/s) 2023-11-26T07:02:42.916 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-26T07:02:42.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo dpkg -i /tmp/linux-image.deb 2023-11-26T07:02:43.190 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-26T07:02:43.228 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-26T07:02:43.332 INFO:teuthology.orchestra.run.smithi120.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-26T07:02:45.148 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-26T07:02:45.152 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-26T07:02:45.297 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-26T07:02:48.660 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-26T07:02:49.106 INFO:teuthology.orchestra.run.smithi070.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-26T07:03:03.411 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2023-11-26T07:03:07.132 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-26T07:03:07.132 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-26T07:03:07.133 INFO:teuthology.orchestra.run.smithi120.stderr:done 2023-11-26T07:03:07.134 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-deb -c /tmp/linux-image.deb 2023-11-26T07:03:07.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-26T07:03:07.141 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-26T07:03:07.141 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-26T07:03:07.153 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-26T07:03:07.154 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:03:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-26T07:03:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-26T07:03:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-26T07:03:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-26T07:03:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-26T07:03:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-26T07:03:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-26T07:03:07.178 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-26T07:03:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-26T07:03:07.180 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-26T07:03:07.180 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-26T07:03:07.180 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-26T07:03:07.180 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-26T07:03:07.180 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-26T07:03:07.180 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-26T07:03:07.181 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-26T07:03:07.181 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-26T07:03:07.181 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-26T07:03:07.181 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-26T07:03:07.181 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-26T07:03:07.182 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-26T07:03:07.194 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-26T07:03:07.195 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-26T07:03:07.195 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-26T07:03:07.195 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-26T07:03:07.195 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-26T07:03:07.195 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-26T07:03:07.195 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-26T07:03:07.195 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-26T07:03:07.196 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-26T07:03:07.196 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-26T07:03:07.196 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-26T07:03:07.196 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-26T07:03:07.196 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-26T07:03:07.196 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-26T07:03:07.197 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-26T07:03:07.198 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-26T07:03:07.198 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-26T07:03:07.198 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-26T07:03:07.198 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-26T07:03:07.198 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-26T07:03:07.198 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-26T07:03:07.199 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-26T07:03:07.199 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-26T07:03:07.199 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-26T07:03:07.199 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-26T07:03:07.199 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-26T07:03:07.199 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-26T07:03:07.200 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-26T07:03:07.200 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-26T07:03:07.200 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-26T07:03:07.200 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-26T07:03:07.200 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-26T07:03:07.200 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-26T07:03:07.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-26T07:03:07.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-26T07:03:07.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-26T07:03:07.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-26T07:03:07.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-26T07:03:07.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-26T07:03:07.201 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-26T07:03:07.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-26T07:03:07.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-26T07:03:07.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-26T07:03:07.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-26T07:03:07.202 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-26T07:03:07.202 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-26T07:03:07.202 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-26T07:03:07.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-26T07:03:07.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-26T07:03:07.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-26T07:03:07.203 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-26T07:03:07.203 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-26T07:03:07.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-26T07:03:07.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-26T07:03:07.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-26T07:03:07.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-26T07:03:07.204 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-26T07:03:07.204 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-26T07:03:07.205 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-26T07:03:07.206 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-26T07:03:07.207 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-26T07:03:07.208 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-26T07:03:07.209 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-26T07:03:07.210 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-26T07:03:07.211 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-26T07:03:07.212 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-26T07:03:07.372 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-26T07:03:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-26T07:03:07.374 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-26T07:03:07.375 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-26T07:03:07.376 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-26T07:03:07.377 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-26T07:03:07.378 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-26T07:03:07.379 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-26T07:03:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-26T07:03:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-26T07:03:07.382 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-26T07:03:07.383 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-26T07:03:07.384 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-26T07:03:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-26T07:03:07.386 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-26T07:03:07.387 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-26T07:03:07.388 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-26T07:03:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-26T07:03:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-26T07:03:07.391 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-26T07:03:07.392 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-26T07:03:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-26T07:03:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-26T07:03:07.395 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-26T07:03:07.396 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-26T07:03:07.397 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-26T07:03:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-26T07:03:07.399 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-26T07:03:07.400 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-26T07:03:07.401 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-26T07:03:07.402 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-26T07:03:07.403 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-26T07:03:07.404 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-26T07:03:07.405 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-26T07:03:07.406 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-26T07:03:07.407 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-26T07:03:07.408 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-26T07:03:07.409 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-26T07:03:07.410 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-26T07:03:07.411 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-26T07:03:07.412 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-26T07:03:07.413 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-26T07:03:07.414 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-26T07:03:07.415 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-26T07:03:07.416 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-26T07:03:07.417 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-26T07:03:07.418 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-26T07:03:07.419 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-26T07:03:07.420 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-26T07:03:07.421 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-26T07:03:07.422 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-26T07:03:07.423 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-26T07:03:07.424 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-26T07:03:07.425 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-26T07:03:07.426 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-26T07:03:07.427 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-26T07:03:07.428 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-26T07:03:07.429 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-26T07:03:07.430 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-26T07:03:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-26T07:03:07.432 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-26T07:03:07.433 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-26T07:03:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-26T07:03:07.435 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-26T07:03:07.436 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-26T07:03:07.437 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-26T07:03:07.438 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-26T07:03:07.439 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-26T07:03:07.440 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-26T07:03:07.441 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-26T07:03:07.442 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-26T07:03:07.443 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-26T07:03:07.444 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-26T07:03:07.445 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-26T07:03:07.446 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-26T07:03:07.447 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-26T07:03:07.448 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-26T07:03:07.449 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-26T07:03:07.450 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-26T07:03:07.451 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-26T07:03:07.452 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-26T07:03:07.453 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-26T07:03:07.454 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-26T07:03:07.455 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-26T07:03:07.456 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-26T07:03:07.457 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-26T07:03:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-26T07:03:07.459 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-26T07:03:07.460 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-26T07:03:07.461 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-26T07:03:07.462 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-26T07:03:07.463 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-26T07:03:07.464 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-26T07:03:07.465 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-26T07:03:07.466 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-26T07:03:07.467 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-26T07:03:07.468 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-26T07:03:07.469 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-26T07:03:07.470 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-26T07:03:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-26T07:03:07.472 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-26T07:03:07.473 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-26T07:03:07.474 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-26T07:03:07.475 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-26T07:03:07.476 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-26T07:03:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-26T07:03:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-26T07:03:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-26T07:03:07.480 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-26T07:03:07.481 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-26T07:03:07.482 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-26T07:03:07.483 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-26T07:03:07.484 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-26T07:03:07.485 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-26T07:03:07.486 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-26T07:03:07.487 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-26T07:03:07.488 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-26T07:03:07.489 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-26T07:03:07.490 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-26T07:03:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-26T07:03:07.492 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-26T07:03:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-26T07:03:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-26T07:03:07.495 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-26T07:03:07.496 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-26T07:03:07.497 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-26T07:03:07.498 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-26T07:03:07.499 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-26T07:03:07.500 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-26T07:03:07.501 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-26T07:03:07.502 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-26T07:03:07.503 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-26T07:03:07.504 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-26T07:03:07.505 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-26T07:03:07.506 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-26T07:03:07.507 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-26T07:03:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-26T07:03:07.509 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-26T07:03:07.510 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-26T07:03:07.511 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-26T07:03:07.512 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-26T07:03:07.513 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-26T07:03:07.514 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-26T07:03:07.515 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-26T07:03:07.516 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-26T07:03:07.517 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-26T07:03:07.517 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-26T07:03:07.517 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-26T07:03:07.566 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-26T07:03:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-26T07:03:07.568 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-26T07:03:07.569 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-26T07:03:07.570 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-26T07:03:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-26T07:03:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-26T07:03:07.573 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-26T07:03:07.574 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-26T07:03:07.575 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-26T07:03:07.576 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-26T07:03:07.577 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-26T07:03:07.578 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-26T07:03:07.579 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-26T07:03:07.580 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-26T07:03:07.581 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-26T07:03:07.582 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-26T07:03:07.583 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-26T07:03:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-26T07:03:07.585 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-26T07:03:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-26T07:03:07.587 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-26T07:03:07.588 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-26T07:03:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-26T07:03:07.590 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-26T07:03:07.591 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-26T07:03:07.592 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-26T07:03:07.593 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-26T07:03:07.594 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-26T07:03:07.595 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-26T07:03:07.596 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-26T07:03:07.597 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-26T07:03:07.598 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-26T07:03:07.599 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-26T07:03:07.600 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-26T07:03:07.601 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-26T07:03:07.602 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-26T07:03:07.603 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-26T07:03:07.604 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-26T07:03:07.605 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-26T07:03:07.606 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-26T07:03:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-26T07:03:07.608 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-26T07:03:07.609 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-26T07:03:07.610 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-26T07:03:07.611 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-26T07:03:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-26T07:03:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-26T07:03:07.614 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-26T07:03:07.615 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-26T07:03:07.616 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-26T07:03:07.617 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-26T07:03:07.618 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-26T07:03:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-26T07:03:07.620 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-26T07:03:07.621 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-26T07:03:07.622 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-26T07:03:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-26T07:03:07.624 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-26T07:03:07.625 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-26T07:03:07.626 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-26T07:03:07.627 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-26T07:03:07.628 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-26T07:03:07.629 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-26T07:03:07.629 DEBUG:teuthology.orchestra.run.smithi120:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-26T07:03:07.636 INFO:teuthology.orchestra.run.smithi120.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-26T07:03:07.636 INFO:teuthology.orchestra.run.smithi120.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-26T07:03:07.636 INFO:teuthology.orchestra.run.smithi120.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-26T07:03:07.637 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-26T07:03:07.637 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-26T07:03:07.637 DEBUG:teuthology.orchestra.run.smithi120:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-26T07:03:07.681 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi120.front.sepia.ceph.com to complete... 2023-11-26T07:03:08.013 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2023-11-26T07:03:08.014 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-26T07:03:08.041 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2023-11-26T07:03:08.206 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:03:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-26T07:03:08.428 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-26T07:03:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-26T07:03:08.475 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-26T07:03:08.480 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-26T07:03:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-26T07:03:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-26T07:03:08.633 INFO:teuthology.orchestra.run.smithi120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-26T07:03:08.648 INFO:teuthology.orchestra.run.smithi120.stderr:done 2023-11-26T07:03:10.026 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2023-11-26T07:03:10.040 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-26T07:03:10.071 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2023-11-26T07:03:10.423 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:03:10.440 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-26T07:03:10.711 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-26T07:03:10.718 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-26T07:03:10.781 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-26T07:03:10.786 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-26T07:03:10.921 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-26T07:03:10.921 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-26T07:03:10.921 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-26T07:03:10.959 INFO:teuthology.orchestra.run.smithi070.stderr:done 2023-11-26T07:03:11.150 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-deb -c /tmp/linux-image.deb 2023-11-26T07:03:11.158 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-26T07:03:11.158 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-26T07:03:11.158 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-26T07:03:11.170 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-26T07:03:11.170 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:03:11.189 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-26T07:03:11.189 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-26T07:03:11.190 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-26T07:03:11.191 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-26T07:03:11.193 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-26T07:03:11.193 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-26T07:03:11.193 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-26T07:03:11.193 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-26T07:03:11.193 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-26T07:03:11.194 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-26T07:03:11.195 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-26T07:03:11.196 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-26T07:03:11.254 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-26T07:03:11.255 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-26T07:03:11.256 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-26T07:03:11.257 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-26T07:03:11.258 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-26T07:03:11.259 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-26T07:03:11.260 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-26T07:03:11.261 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-26T07:03:11.262 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-26T07:03:11.263 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-26T07:03:11.264 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-26T07:03:11.265 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-26T07:03:11.266 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-26T07:03:11.267 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-26T07:03:11.268 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-26T07:03:11.269 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-26T07:03:11.270 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-26T07:03:11.271 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-26T07:03:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-26T07:03:11.273 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-26T07:03:11.274 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-26T07:03:11.275 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-26T07:03:11.276 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-26T07:03:11.277 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-26T07:03:11.278 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-26T07:03:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-26T07:03:11.280 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-26T07:03:11.281 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-26T07:03:11.282 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-26T07:03:11.283 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-26T07:03:11.284 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-26T07:03:11.285 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-26T07:03:11.286 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-26T07:03:11.287 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-26T07:03:11.288 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-26T07:03:11.289 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-26T07:03:11.290 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-26T07:03:11.291 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-26T07:03:11.292 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-26T07:03:11.293 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-26T07:03:11.294 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-26T07:03:11.295 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-26T07:03:11.296 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-26T07:03:11.297 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-26T07:03:11.298 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-26T07:03:11.299 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-26T07:03:11.300 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-26T07:03:11.301 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-26T07:03:11.302 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-26T07:03:11.303 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-26T07:03:11.304 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-26T07:03:11.305 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-26T07:03:11.306 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-26T07:03:11.307 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-26T07:03:11.308 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-26T07:03:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-26T07:03:11.310 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-26T07:03:11.311 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-26T07:03:11.312 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-26T07:03:11.313 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-26T07:03:11.314 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-26T07:03:11.394 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-26T07:03:11.394 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-26T07:03:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-26T07:03:11.396 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-26T07:03:11.397 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-26T07:03:11.398 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-26T07:03:11.399 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-26T07:03:11.400 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-26T07:03:11.401 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-26T07:03:11.402 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-26T07:03:11.403 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-26T07:03:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-26T07:03:11.405 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-26T07:03:11.406 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-26T07:03:11.407 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-26T07:03:11.408 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-26T07:03:11.409 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-26T07:03:11.410 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-26T07:03:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-26T07:03:11.412 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-26T07:03:11.413 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-26T07:03:11.414 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-26T07:03:11.415 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-26T07:03:11.416 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-26T07:03:11.417 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-26T07:03:11.418 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-26T07:03:11.419 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-26T07:03:11.420 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-26T07:03:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-26T07:03:11.422 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-26T07:03:11.423 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-26T07:03:11.424 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-26T07:03:11.425 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-26T07:03:11.426 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-26T07:03:11.427 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-26T07:03:11.428 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-26T07:03:11.429 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-26T07:03:11.430 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-26T07:03:11.431 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-26T07:03:11.432 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-26T07:03:11.433 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-26T07:03:11.434 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-26T07:03:11.435 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-26T07:03:11.436 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-26T07:03:11.437 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-26T07:03:11.438 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-26T07:03:11.439 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-26T07:03:11.440 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-26T07:03:11.441 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-26T07:03:11.442 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-26T07:03:11.443 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-26T07:03:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-26T07:03:11.445 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-26T07:03:11.446 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-26T07:03:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-26T07:03:11.448 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-26T07:03:11.449 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-26T07:03:11.450 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-26T07:03:11.451 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-26T07:03:11.452 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-26T07:03:11.453 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-26T07:03:11.454 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-26T07:03:11.455 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-26T07:03:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-26T07:03:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-26T07:03:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-26T07:03:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-26T07:03:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-26T07:03:11.461 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-26T07:03:11.462 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-26T07:03:11.463 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-26T07:03:11.464 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-26T07:03:11.465 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-26T07:03:11.466 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-26T07:03:11.467 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-26T07:03:11.468 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-26T07:03:11.469 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-26T07:03:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-26T07:03:11.471 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-26T07:03:11.472 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-26T07:03:11.473 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-26T07:03:11.474 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-26T07:03:11.475 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-26T07:03:11.476 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-26T07:03:11.477 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-26T07:03:11.478 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-26T07:03:11.479 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-26T07:03:11.480 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-26T07:03:11.481 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-26T07:03:11.482 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-26T07:03:11.483 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-26T07:03:11.484 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-26T07:03:11.484 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-26T07:03:11.528 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-26T07:03:11.528 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-26T07:03:11.528 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-26T07:03:11.529 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-26T07:03:11.530 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-26T07:03:11.531 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-26T07:03:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-26T07:03:11.533 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-26T07:03:11.534 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-26T07:03:11.535 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-26T07:03:11.536 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-26T07:03:11.537 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-26T07:03:11.538 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-26T07:03:11.539 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-26T07:03:11.540 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-26T07:03:11.541 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-26T07:03:11.542 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-26T07:03:11.543 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-26T07:03:11.544 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-26T07:03:11.545 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-26T07:03:11.546 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-26T07:03:11.547 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-26T07:03:11.548 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-26T07:03:11.549 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-26T07:03:11.550 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-26T07:03:11.551 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-26T07:03:11.552 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-26T07:03:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-26T07:03:11.554 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-26T07:03:11.555 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-26T07:03:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-26T07:03:11.557 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-26T07:03:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-26T07:03:11.559 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-26T07:03:11.560 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-26T07:03:11.561 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-26T07:03:11.562 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-26T07:03:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-26T07:03:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-26T07:03:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-26T07:03:11.566 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-26T07:03:11.567 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-26T07:03:11.568 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-26T07:03:11.569 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-26T07:03:11.570 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-26T07:03:11.571 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-26T07:03:11.572 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-26T07:03:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-26T07:03:11.574 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-26T07:03:11.575 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-26T07:03:11.576 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-26T07:03:11.577 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-26T07:03:11.578 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-26T07:03:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-26T07:03:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-26T07:03:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-26T07:03:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-26T07:03:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-26T07:03:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-26T07:03:11.579 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-26T07:03:11.580 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-26T07:03:11.580 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-26T07:03:11.580 DEBUG:teuthology.orchestra.run.smithi070:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-26T07:03:11.587 INFO:teuthology.orchestra.run.smithi070.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-26T07:03:11.587 INFO:teuthology.orchestra.run.smithi070.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-26T07:03:11.587 INFO:teuthology.orchestra.run.smithi070.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-26T07:03:11.587 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-26T07:03:11.587 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-26T07:03:11.588 DEBUG:teuthology.orchestra.run.smithi070:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-26T07:03:11.632 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi070.front.sepia.ceph.com to complete... 2023-11-26T07:03:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2023-11-26T07:03:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-26T07:03:12.033 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2023-11-26T07:03:12.260 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-26T07:03:12.265 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-26T07:03:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-26T07:03:12.482 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-26T07:03:12.524 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-26T07:03:12.529 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-26T07:03:12.665 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-26T07:03:12.665 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-26T07:03:12.665 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-26T07:03:12.683 INFO:teuthology.orchestra.run.smithi070.stderr:done 2023-11-26T07:03:13.802 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-11-26T07:03:39.854 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-26T07:03:39.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-26T07:03:39.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:03:43.806 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-26T07:03:43.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-26T07:03:43.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:04:14.434 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-11-26T07:04:23.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-26T07:04:23.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:04:41.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-11-26T07:04:43.810 DEBUG:teuthology.orchestra.remote:timed out 2023-11-26T07:04:52.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-26T07:04:52.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:04:53.448 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-11-26T07:04:53.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-26T07:04:53.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:04:54.221 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-11-26T07:04:54.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-26T07:04:54.602 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g8247bbb5b470"... 2023-11-26T07:04:54.602 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2023-11-26T07:04:54.653 INFO:teuthology.orchestra.run.smithi070.stdout:6.6.0-g8247bbb5b470 2023-11-26T07:04:54.653 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-26T07:04:54.653 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-26T07:04:54.653 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-26T07:04:54.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-26T07:04:54.957 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g8247bbb5b470"... 2023-11-26T07:04:54.957 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2023-11-26T07:04:55.013 INFO:teuthology.orchestra.run.smithi120.stdout:6.6.0-g8247bbb5b470 2023-11-26T07:04:55.013 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-26T07:04:55.013 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-26T07:04:55.013 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-26T07:04:55.655 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-26T07:04:55.655 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-26T07:04:56.015 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-26T07:04:56.015 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-26T07:04:56.117 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2023-11-26T07:04:56.123 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2023-11-26T07:04:56.166 DEBUG:teuthology.parallel:result is None 2023-11-26T07:04:56.198 DEBUG:teuthology.parallel:result is None 2023-11-26T07:04:56.198 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-26T07:04:56.208 INFO:teuthology.task.internal:Creating test directory... 2023-11-26T07:04:56.208 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-26T07:04:56.212 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-26T07:04:56.220 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-26T07:04:56.249 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-26T07:04:56.261 INFO:teuthology.task.internal:Creating archive directory... 2023-11-26T07:04:56.261 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-26T07:04:56.264 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-26T07:04:56.299 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-26T07:04:56.305 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-26T07:04:56.306 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-26T07:04:56.345 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-26T07:04:56.372 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:56.376 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:56.385 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:56.389 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-26T07:04:56.391 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-26T07:04:56.400 INFO:teuthology.task.internal:Configuring sudo... 2023-11-26T07:04:56.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-26T07:04:56.433 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-26T07:04:56.455 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-26T07:04:56.464 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-26T07:04:56.464 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-26T07:04:56.500 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-26T07:04:56.509 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T07:04:56.562 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T07:04:56.619 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:04:56.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-26T07:04:56.707 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-26T07:04:56.716 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-26T07:04:56.767 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:04:56.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-26T07:04:56.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2023-11-26T07:04:56.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2023-11-26T07:04:57.009 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-26T07:04:57.020 INFO:teuthology.task.internal:Starting timer... 2023-11-26T07:04:57.020 INFO:teuthology.run_tasks:Running task pcp... 2023-11-26T07:04:57.037 INFO:teuthology.run_tasks:Running task selinux... 2023-11-26T07:04:57.050 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2023-11-26T07:04:57.050 DEBUG:teuthology.task.selinux:Excluding smithi120: OS 'ubuntu' does not support SELinux 2023-11-26T07:04:57.050 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-26T07:04:57.050 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-26T07:04:57.050 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-26T07:04:57.051 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-26T07:04:57.065 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-26T07:04:57.065 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-26T07:04:57.081 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-26T07:04:57.082 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi120.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-26T07:13:32.197 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com')] 2023-11-26T07:13:32.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-26T07:13:32.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:13:32.275 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-11-26T07:13:32.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-26T07:13:32.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-26T07:13:32.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-26T07:13:32.464 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-11-26T07:13:32.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-26T07:13:32.581 INFO:teuthology.run_tasks:Running task clock... 2023-11-26T07:13:32.591 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-26T07:13:32.592 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-26T07:13:32.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:13:32.595 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-26T07:13:32.596 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:13:32.631 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-26T07:13:32.631 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Command line: ntpd -gq 2023-11-26T07:13:32.631 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: ---------------------------------------------------- 2023-11-26T07:13:32.632 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: ntp-4 is maintained by Network Time Foundation, 2023-11-26T07:13:32.632 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-26T07:13:32.632 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: corporation. Support and training for ntp-4 are 2023-11-26T07:13:32.632 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: available at https://www.nwtime.org/support 2023-11-26T07:13:32.632 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: ---------------------------------------------------- 2023-11-26T07:13:32.632 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: proto: precision = 0.042 usec (-24) 2023-11-26T07:13:32.633 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: basedate set to 2022-02-04 2023-11-26T07:13:32.633 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: gps base set to 2022-02-06 (week 2196) 2023-11-26T07:13:32.633 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-26T07:13:32.633 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-26T07:13:32.634 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: restrict ::: KOD does nothing without LIMITED. 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Listen and drop on 0 v6wildcard [::]:123 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Listen normally on 2 lo 127.0.0.1:123 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Listen normally on 4 lo [::1]:123 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2023-11-26T07:13:32.635 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:32 ntpd[27959]: Listening on routing socket on fd #22 for interface updates 2023-11-26T07:13:32.662 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-26T07:13:32.662 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Command line: ntpd -gq 2023-11-26T07:13:32.662 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: ---------------------------------------------------- 2023-11-26T07:13:32.662 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: ntp-4 is maintained by Network Time Foundation, 2023-11-26T07:13:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-26T07:13:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: corporation. Support and training for ntp-4 are 2023-11-26T07:13:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: available at https://www.nwtime.org/support 2023-11-26T07:13:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: ---------------------------------------------------- 2023-11-26T07:13:32.663 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: proto: precision = 0.041 usec (-24) 2023-11-26T07:13:32.664 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: basedate set to 2022-02-04 2023-11-26T07:13:32.664 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: gps base set to 2022-02-06 (week 2196) 2023-11-26T07:13:32.664 INFO:teuthology.orchestra.run.smithi120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-26T07:13:32.664 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-26T07:13:32.665 INFO:teuthology.orchestra.run.smithi120.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: restrict ::: KOD does nothing without LIMITED. 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Listen and drop on 0 v6wildcard [::]:123 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Listen normally on 2 lo 127.0.0.1:123 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Listen normally on 3 enp3s0f1 172.21.15.120:123 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Listen normally on 4 lo [::1]:123 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:478f%5]:123 2023-11-26T07:13:32.666 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:32 ntpd[27962]: Listening on routing socket on fd #22 for interface updates 2023-11-26T07:13:33.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:33 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:33.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:33 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:33.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:33.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:33.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:33.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:33.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:33.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:33 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:34.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:34 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:34.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:34 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:35.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:35 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:35.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:35 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:35.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:35 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:35.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:35 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:35.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:35 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:35.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:35 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:35 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:36 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:36 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:36.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:36 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:36.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:36 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:36.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:36 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:36.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:36 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:36.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:36.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:36.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:36 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:37 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:37 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:37 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:37.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:37 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:38.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:38.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:38 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:38.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:38.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:38 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:38.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:38 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:38.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:38 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:38 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:39.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:39.634 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:39.634 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:39 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:39.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:39.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:39.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:39.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:39.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:39.663 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:39.663 INFO:teuthology.orchestra.run.smithi120.stdout:26 Nov 07:13:39 ntpd[27962]: ntpd: time slew -0.002097 s 2023-11-26T07:13:39.664 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew -0.002097s 2023-11-26T07:13:39.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-26T07:13:39.664 INFO:teuthology.orchestra.run.smithi120.stderr:26 Nov 07:13:39 ntpd[27962]: can't open /var/log/ntpstats/loopstats.20231126: Permission denied 2023-11-26T07:13:39.772 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2023-11-26T07:13:39.772 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2023-11-26T07:13:39.772 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:39.772 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:39.772 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:39.772 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:40.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:40.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:40 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:40.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:40.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:40 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:40.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:40 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:40.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:40 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:41.632 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-26T07:13:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: can't open /var/log/ntpstats/rawstats.20231126: Permission denied 2023-11-26T07:13:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-26T07:13:41.633 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: can't open /var/log/ntpstats/peerstats.20231126: Permission denied 2023-11-26T07:13:41.634 INFO:teuthology.orchestra.run.smithi070.stdout:26 Nov 07:13:41 ntpd[27959]: ntpd: time slew -0.003289 s 2023-11-26T07:13:41.634 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.003289s 2023-11-26T07:13:41.634 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-26T07:13:41.634 INFO:teuthology.orchestra.run.smithi070.stderr:26 Nov 07:13:41 ntpd[27959]: can't open /var/log/ntpstats/loopstats.20231126: Permission denied 2023-11-26T07:13:41.757 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2023-11-26T07:13:41.757 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2023-11-26T07:13:41.758 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:41.758 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:41.758 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:41.758 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-26T07:13:41.759 INFO:teuthology.run_tasks:Running task install... 2023-11-26T07:13:41.768 DEBUG:teuthology.task.install:project ceph 2023-11-26T07:13:41.768 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}} 2023-11-26T07:13:41.769 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'} 2023-11-26T07:13:41.769 INFO:teuthology.task.install:Using flavor: default 2023-11-26T07:13:41.774 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-26T07:13:41.774 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-26T07:13:41.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2023-11-26T07:13:41.775 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-key list | grep Ceph 2023-11-26T07:13:41.884 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-26T07:13:41.904 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-26T07:13:41.937 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-26T07:13:41.937 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph.com (release key) 2023-11-26T07:13:41.938 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-26T07:13:41.938 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-26T07:13:41.939 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:13:41.956 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-26T07:13:41.957 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2023-11-26T07:13:41.957 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-26T07:13:41.958 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-26T07:13:41.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:13:42.094 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default/ 2023-11-26T07:13:42.094 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:13:42.168 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default/ 2023-11-26T07:13:42.168 INFO:teuthology.task.install.deb:Package version is 18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:13:42.350 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:13:42.350 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-26T07:13:42.370 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2023-11-26T07:13:42.476 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:13:42.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-26T07:13:42.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2023-11-26T07:13:42.555 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-26T07:13:42.672 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-26T07:13:42.689 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-26T07:13:42.695 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-26T07:13:42.712 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-26T07:13:42.754 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-26T07:13:42.806 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-26T07:13:42.816 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy InRelease 2023-11-26T07:13:42.835 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-26T07:13:42.891 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-26T07:13:42.894 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy InRelease 2023-11-26T07:13:42.954 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-26T07:13:42.967 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-26T07:13:43.015 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-26T07:13:43.044 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-26T07:13:43.076 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-11-26T07:13:43.148 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-26T07:13:43.206 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-11-26T07:13:43.312 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 28.5 kB in 1s (39.5 kB/s) 2023-11-26T07:13:43.317 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 28.5 kB in 1s (48.0 kB/s) 2023-11-26T07:13:44.229 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2023-11-26T07:13:44.242 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2023-11-26T07:13:44.243 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-g44c2237f-1jammy cephadm=18.0.0-7484-g44c2237f-1jammy ceph-mds=18.0.0-7484-g44c2237f-1jammy ceph-mgr=18.0.0-7484-g44c2237f-1jammy ceph-common=18.0.0-7484-g44c2237f-1jammy ceph-fuse=18.0.0-7484-g44c2237f-1jammy ceph-test=18.0.0-7484-g44c2237f-1jammy ceph-volume=18.0.0-7484-g44c2237f-1jammy radosgw=18.0.0-7484-g44c2237f-1jammy python3-rados=18.0.0-7484-g44c2237f-1jammy python3-rgw=18.0.0-7484-g44c2237f-1jammy python3-cephfs=18.0.0-7484-g44c2237f-1jammy python3-rbd=18.0.0-7484-g44c2237f-1jammy libcephfs2=18.0.0-7484-g44c2237f-1jammy libcephfs-dev=18.0.0-7484-g44c2237f-1jammy librados2=18.0.0-7484-g44c2237f-1jammy librbd1=18.0.0-7484-g44c2237f-1jammy rbd-fuse=18.0.0-7484-g44c2237f-1jammy python3-cephfs=18.0.0-7484-g44c2237f-1jammy cephfs-shell=18.0.0-7484-g44c2237f-1jammy cephfs-top=18.0.0-7484-g44c2237f-1jammy cephfs-mirror=18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:13:44.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7484-g44c2237f-1jammy cephadm=18.0.0-7484-g44c2237f-1jammy ceph-mds=18.0.0-7484-g44c2237f-1jammy ceph-mgr=18.0.0-7484-g44c2237f-1jammy ceph-common=18.0.0-7484-g44c2237f-1jammy ceph-fuse=18.0.0-7484-g44c2237f-1jammy ceph-test=18.0.0-7484-g44c2237f-1jammy ceph-volume=18.0.0-7484-g44c2237f-1jammy radosgw=18.0.0-7484-g44c2237f-1jammy python3-rados=18.0.0-7484-g44c2237f-1jammy python3-rgw=18.0.0-7484-g44c2237f-1jammy python3-cephfs=18.0.0-7484-g44c2237f-1jammy python3-rbd=18.0.0-7484-g44c2237f-1jammy libcephfs2=18.0.0-7484-g44c2237f-1jammy libcephfs-dev=18.0.0-7484-g44c2237f-1jammy librados2=18.0.0-7484-g44c2237f-1jammy librbd1=18.0.0-7484-g44c2237f-1jammy rbd-fuse=18.0.0-7484-g44c2237f-1jammy python3-cephfs=18.0.0-7484-g44c2237f-1jammy cephfs-shell=18.0.0-7484-g44c2237f-1jammy cephfs-top=18.0.0-7484-g44c2237f-1jammy cephfs-mirror=18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:13:44.317 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2023-11-26T07:13:44.330 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2023-11-26T07:13:44.483 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2023-11-26T07:13:44.483 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2023-11-26T07:13:44.494 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2023-11-26T07:13:44.495 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2023-11-26T07:13:44.636 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2023-11-26T07:13:44.636 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-26T07:13:44.636 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-26T07:13:44.636 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-26T07:13:44.636 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-26T07:13:44.637 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-26T07:13:44.637 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-26T07:13:44.637 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2023-11-26T07:13:44.637 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-26T07:13:44.638 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-26T07:13:44.638 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-26T07:13:44.638 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-26T07:13:44.639 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: socat xmlstarlet 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2023-11-26T07:13:44.640 INFO:teuthology.orchestra.run.smithi120.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout: python3-watchdog 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2023-11-26T07:13:44.641 INFO:teuthology.orchestra.run.smithi120.stdout: btrfs-tools 2023-11-26T07:13:44.645 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2023-11-26T07:13:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-26T07:13:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-26T07:13:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-26T07:13:44.645 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-26T07:13:44.646 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-26T07:13:44.646 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-26T07:13:44.646 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2023-11-26T07:13:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-26T07:13:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-26T07:13:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-26T07:13:44.647 INFO:teuthology.orchestra.run.smithi070.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-26T07:13:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-26T07:13:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-26T07:13:44.648 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-26T07:13:44.649 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: socat xmlstarlet 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout: python3-watchdog 2023-11-26T07:13:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2023-11-26T07:13:44.651 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2023-11-26T07:13:44.782 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2023-11-26T07:13:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-26T07:13:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-26T07:13:44.783 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-26T07:13:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-26T07:13:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-26T07:13:44.784 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-26T07:13:44.785 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-26T07:13:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-26T07:13:44.792 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2023-11-26T07:13:44.792 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-26T07:13:44.792 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-26T07:13:44.792 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-26T07:13:44.794 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-26T07:13:44.794 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-26T07:13:44.794 INFO:teuthology.orchestra.run.smithi070.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-26T07:13:44.794 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-26T07:13:44.794 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-26T07:13:44.794 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-26T07:13:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-26T07:13:44.796 INFO:teuthology.orchestra.run.smithi070.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-26T07:13:44.855 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-26T07:13:44.855 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 186 MB of archives. 2023-11-26T07:13:44.856 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-26T07:13:44.856 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-26T07:13:44.876 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-26T07:13:44.887 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-26T07:13:44.935 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-26T07:13:44.958 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-26T07:13:44.961 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-26T07:13:44.974 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-26T07:13:44.989 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-26T07:13:44.989 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 186 MB of archives. 2023-11-26T07:13:44.989 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-26T07:13:44.989 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-26T07:13:45.018 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-26T07:13:45.020 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-26T07:13:45.028 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-26T07:13:45.031 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-26T07:13:45.031 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-26T07:13:45.038 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-26T07:13:45.038 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-26T07:13:45.039 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-26T07:13:45.040 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-26T07:13:45.040 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-26T07:13:45.060 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-26T07:13:45.060 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-26T07:13:45.061 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-26T07:13:45.061 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-26T07:13:45.062 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-26T07:13:45.064 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-26T07:13:45.064 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-26T07:13:45.065 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-26T07:13:45.071 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-26T07:13:45.080 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-26T07:13:45.080 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-26T07:13:45.100 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-26T07:13:45.100 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-26T07:13:45.101 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-26T07:13:45.101 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-26T07:13:45.102 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-26T07:13:45.106 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-26T07:13:45.107 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-26T07:13:45.107 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-26T07:13:45.117 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-26T07:13:45.119 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-26T07:13:45.120 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-26T07:13:45.129 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-26T07:13:45.130 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-26T07:13:45.131 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-26T07:13:45.132 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-26T07:13:45.134 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-26T07:13:45.135 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-26T07:13:45.137 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-26T07:13:45.143 INFO:teuthology.orchestra.run.smithi120.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-g44c2237f-1jammy [3,468 kB] 2023-11-26T07:13:45.153 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7484-g44c2237f-1jammy [3,468 kB] 2023-11-26T07:13:45.188 INFO:teuthology.orchestra.run.smithi120.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-26T07:13:45.189 INFO:teuthology.orchestra.run.smithi120.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-26T07:13:45.191 INFO:teuthology.orchestra.run.smithi120.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-26T07:13:45.191 INFO:teuthology.orchestra.run.smithi120.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-26T07:13:45.191 INFO:teuthology.orchestra.run.smithi120.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-26T07:13:45.193 INFO:teuthology.orchestra.run.smithi120.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-26T07:13:45.213 INFO:teuthology.orchestra.run.smithi120.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-26T07:13:45.215 INFO:teuthology.orchestra.run.smithi120.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-26T07:13:45.216 INFO:teuthology.orchestra.run.smithi120.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-26T07:13:45.237 INFO:teuthology.orchestra.run.smithi120.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-26T07:13:45.238 INFO:teuthology.orchestra.run.smithi120.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-26T07:13:45.239 INFO:teuthology.orchestra.run.smithi120.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-26T07:13:45.239 INFO:teuthology.orchestra.run.smithi120.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-26T07:13:45.240 INFO:teuthology.orchestra.run.smithi120.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-26T07:13:45.240 INFO:teuthology.orchestra.run.smithi120.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-26T07:13:45.254 INFO:teuthology.orchestra.run.smithi120.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-26T07:13:45.254 INFO:teuthology.orchestra.run.smithi120.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-26T07:13:45.258 INFO:teuthology.orchestra.run.smithi120.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-26T07:13:45.273 INFO:teuthology.orchestra.run.smithi120.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-26T07:13:45.274 INFO:teuthology.orchestra.run.smithi120.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-26T07:13:45.275 INFO:teuthology.orchestra.run.smithi120.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-26T07:13:45.279 INFO:teuthology.orchestra.run.smithi120.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-26T07:13:45.282 INFO:teuthology.orchestra.run.smithi120.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-26T07:13:45.282 INFO:teuthology.orchestra.run.smithi120.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-26T07:13:45.287 INFO:teuthology.orchestra.run.smithi120.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-26T07:13:45.293 INFO:teuthology.orchestra.run.smithi120.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-26T07:13:45.293 INFO:teuthology.orchestra.run.smithi120.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-26T07:13:45.294 INFO:teuthology.orchestra.run.smithi120.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-26T07:13:45.313 INFO:teuthology.orchestra.run.smithi120.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-26T07:13:45.316 INFO:teuthology.orchestra.run.smithi120.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-26T07:13:45.317 INFO:teuthology.orchestra.run.smithi120.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-26T07:13:45.319 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-26T07:13:45.324 INFO:teuthology.orchestra.run.smithi120.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-26T07:13:45.325 INFO:teuthology.orchestra.run.smithi120.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-26T07:13:45.325 INFO:teuthology.orchestra.run.smithi120.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-26T07:13:45.327 INFO:teuthology.orchestra.run.smithi120.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-26T07:13:45.337 INFO:teuthology.orchestra.run.smithi120.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-26T07:13:45.412 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-26T07:13:45.426 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-26T07:13:45.477 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-26T07:13:45.651 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-26T07:13:45.660 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-26T07:13:45.687 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-26T07:13:45.695 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-26T07:13:45.860 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-26T07:13:46.444 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-26T07:13:46.447 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-26T07:13:46.448 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-26T07:13:46.455 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-26T07:13:46.455 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-26T07:13:46.457 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-26T07:13:46.458 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-26T07:13:46.459 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-26T07:13:46.460 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-26T07:13:46.525 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-26T07:13:46.608 INFO:teuthology.orchestra.run.smithi120.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-g44c2237f-1jammy [3,112 kB] 2023-11-26T07:13:46.708 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-26T07:13:46.747 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7484-g44c2237f-1jammy [3,112 kB] 2023-11-26T07:13:46.917 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-26T07:13:46.950 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-26T07:13:46.997 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-26T07:13:47.094 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-26T07:13:47.106 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-26T07:13:47.112 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-26T07:13:47.180 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-26T07:13:47.204 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-26T07:13:47.210 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-26T07:13:47.329 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-26T07:13:47.493 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-26T07:13:47.624 INFO:teuthology.orchestra.run.smithi120.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-g44c2237f-1jammy [691 kB] 2023-11-26T07:13:47.687 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-26T07:13:47.742 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-26T07:13:47.832 INFO:teuthology.orchestra.run.smithi120.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-g44c2237f-1jammy [356 kB] 2023-11-26T07:13:47.855 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7484-g44c2237f-1jammy [691 kB] 2023-11-26T07:13:47.901 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-26T07:13:47.974 INFO:teuthology.orchestra.run.smithi120.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-g44c2237f-1jammy [32.8 kB] 2023-11-26T07:13:47.978 INFO:teuthology.orchestra.run.smithi120.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-g44c2237f-1jammy [180 kB] 2023-11-26T07:13:48.002 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-26T07:13:48.022 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-26T07:13:48.049 INFO:teuthology.orchestra.run.smithi120.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-g44c2237f-1jammy [63.5 kB] 2023-11-26T07:13:48.053 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-26T07:13:48.067 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-26T07:13:48.107 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-26T07:13:48.111 INFO:teuthology.orchestra.run.smithi120.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-g44c2237f-1jammy [330 kB] 2023-11-26T07:13:48.114 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-26T07:13:48.138 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7484-g44c2237f-1jammy [356 kB] 2023-11-26T07:13:48.142 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-26T07:13:48.192 INFO:teuthology.orchestra.run.smithi120.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-g44c2237f-1jammy [6,230 kB] 2023-11-26T07:13:48.279 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7484-g44c2237f-1jammy [32.8 kB] 2023-11-26T07:13:48.280 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7484-g44c2237f-1jammy [180 kB] 2023-11-26T07:13:48.355 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7484-g44c2237f-1jammy [63.5 kB] 2023-11-26T07:13:48.361 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7484-g44c2237f-1jammy [330 kB] 2023-11-26T07:13:48.504 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7484-g44c2237f-1jammy [6,230 kB] 2023-11-26T07:13:48.531 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-26T07:13:48.868 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-26T07:13:48.955 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-26T07:13:48.980 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-26T07:13:48.992 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-26T07:13:49.041 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-26T07:13:49.292 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-26T07:13:49.301 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-26T07:13:49.301 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-26T07:13:49.367 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-26T07:13:49.368 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-26T07:13:49.532 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-26T07:13:49.730 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-26T07:13:49.777 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-26T07:13:49.893 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-26T07:13:49.912 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-26T07:13:49.943 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-26T07:13:50.111 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-26T07:13:50.150 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-26T07:13:50.171 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-26T07:13:50.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-26T07:13:50.220 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-26T07:13:50.407 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-26T07:13:50.602 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-26T07:13:50.618 INFO:teuthology.orchestra.run.smithi120.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-g44c2237f-1jammy [112 kB] 2023-11-26T07:13:50.677 INFO:teuthology.orchestra.run.smithi120.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-g44c2237f-1jammy [439 kB] 2023-11-26T07:13:50.841 INFO:teuthology.orchestra.run.smithi120.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-g44c2237f-1jammy [22.6 MB] 2023-11-26T07:13:50.989 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-26T07:13:51.050 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-26T07:13:51.051 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-26T07:13:51.059 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-26T07:13:51.061 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-26T07:13:51.081 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-26T07:13:51.088 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-26T07:13:51.149 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-26T07:13:51.151 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-26T07:13:51.161 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7484-g44c2237f-1jammy [112 kB] 2023-11-26T07:13:51.170 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7484-g44c2237f-1jammy [439 kB] 2023-11-26T07:13:51.316 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-26T07:13:51.380 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7484-g44c2237f-1jammy [22.6 MB] 2023-11-26T07:13:51.765 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-26T07:13:51.780 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-26T07:13:58.795 INFO:teuthology.orchestra.run.smithi120.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-g44c2237f-1jammy [6,900 kB] 2023-11-26T07:14:01.281 INFO:teuthology.orchestra.run.smithi120.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-g44c2237f-1jammy [238 kB] 2023-11-26T07:14:01.356 INFO:teuthology.orchestra.run.smithi120.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-g44c2237f-1jammy [124 kB] 2023-11-26T07:14:01.379 INFO:teuthology.orchestra.run.smithi120.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-g44c2237f-1jammy [1,496 kB] 2023-11-26T07:14:01.890 INFO:teuthology.orchestra.run.smithi120.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-g44c2237f-1jammy [9,955 kB] 2023-11-26T07:14:03.826 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7484-g44c2237f-1jammy [6,900 kB] 2023-11-26T07:14:04.847 INFO:teuthology.orchestra.run.smithi120.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-g44c2237f-1jammy [31.8 MB] 2023-11-26T07:14:06.652 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7484-g44c2237f-1jammy [238 kB] 2023-11-26T07:14:06.731 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7484-g44c2237f-1jammy [124 kB] 2023-11-26T07:14:06.795 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7484-g44c2237f-1jammy [1,496 kB] 2023-11-26T07:14:07.389 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7484-g44c2237f-1jammy [9,955 kB] 2023-11-26T07:14:10.754 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7484-g44c2237f-1jammy [31.8 MB] 2023-11-26T07:14:17.177 INFO:teuthology.orchestra.run.smithi120.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-g44c2237f-1jammy [14.0 kB] 2023-11-26T07:14:17.177 INFO:teuthology.orchestra.run.smithi120.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-g44c2237f-1jammy [839 kB] 2023-11-26T07:14:17.564 INFO:teuthology.orchestra.run.smithi120.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-g44c2237f-1jammy [2,144 kB] 2023-11-26T07:14:18.693 INFO:teuthology.orchestra.run.smithi120.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-g44c2237f-1jammy [805 kB] 2023-11-26T07:14:19.104 INFO:teuthology.orchestra.run.smithi120.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-g44c2237f-1jammy [139 kB] 2023-11-26T07:14:19.166 INFO:teuthology.orchestra.run.smithi120.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-g44c2237f-1jammy [1,900 kB] 2023-11-26T07:14:20.016 INFO:teuthology.orchestra.run.smithi120.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-g44c2237f-1jammy [8,625 kB] 2023-11-26T07:14:21.232 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7484-g44c2237f-1jammy [14.0 kB] 2023-11-26T07:14:21.233 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7484-g44c2237f-1jammy [839 kB] 2023-11-26T07:14:21.480 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7484-g44c2237f-1jammy [2,144 kB] 2023-11-26T07:14:22.078 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7484-g44c2237f-1jammy [805 kB] 2023-11-26T07:14:22.302 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7484-g44c2237f-1jammy [139 kB] 2023-11-26T07:14:22.352 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7484-g44c2237f-1jammy [1,900 kB] 2023-11-26T07:14:22.865 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7484-g44c2237f-1jammy [8,625 kB] 2023-11-26T07:14:23.634 INFO:teuthology.orchestra.run.smithi120.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-g44c2237f-1jammy [14.2 kB] 2023-11-26T07:14:23.635 INFO:teuthology.orchestra.run.smithi120.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-g44c2237f-1jammy [48.7 MB] 2023-11-26T07:14:25.204 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7484-g44c2237f-1jammy [14.2 kB] 2023-11-26T07:14:25.204 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7484-g44c2237f-1jammy [48.7 MB] 2023-11-26T07:14:35.285 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-g44c2237f-1jammy [121 kB] 2023-11-26T07:14:35.286 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-g44c2237f-1jammy [225 kB] 2023-11-26T07:14:35.313 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-g44c2237f-1jammy [34.0 kB] 2023-11-26T07:14:35.314 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-g44c2237f-1jammy [23.4 kB] 2023-11-26T07:14:35.315 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-g44c2237f-1jammy [38.3 kB] 2023-11-26T07:14:35.316 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-g44c2237f-1jammy [12.3 MB] 2023-11-26T07:14:35.617 INFO:teuthology.orchestra.run.smithi120.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7484-g44c2237f-1jammy [121 kB] 2023-11-26T07:14:35.618 INFO:teuthology.orchestra.run.smithi120.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7484-g44c2237f-1jammy [225 kB] 2023-11-26T07:14:35.642 INFO:teuthology.orchestra.run.smithi120.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7484-g44c2237f-1jammy [34.0 kB] 2023-11-26T07:14:35.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7484-g44c2237f-1jammy [23.4 kB] 2023-11-26T07:14:35.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7484-g44c2237f-1jammy [38.3 kB] 2023-11-26T07:14:35.648 INFO:teuthology.orchestra.run.smithi120.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7484-g44c2237f-1jammy [12.3 MB] 2023-11-26T07:14:36.408 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-g44c2237f-1jammy [91.2 kB] 2023-11-26T07:14:36.726 INFO:teuthology.orchestra.run.smithi120.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/44c2237fe77713214148c1fd622c872f346f1b99/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7484-g44c2237f-1jammy [91.2 kB] 2023-11-26T07:14:36.980 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 186 MB in 52s (3,600 kB/s) 2023-11-26T07:14:37.137 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-26T07:14:37.205 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-26T07:14:37.208 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-26T07:14:37.252 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-26T07:14:37.299 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 186 MB in 52s (3,577 kB/s) 2023-11-26T07:14:37.428 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-26T07:14:37.497 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-26T07:14:37.501 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-26T07:14:37.535 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-26T07:14:37.596 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-26T07:14:37.610 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-26T07:14:37.655 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-26T07:14:37.813 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-26T07:14:37.827 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-26T07:14:37.872 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-26T07:14:38.058 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cmd2. 2023-11-26T07:14:38.071 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-26T07:14:38.124 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-26T07:14:38.207 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cmd2. 2023-11-26T07:14:38.221 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-26T07:14:38.266 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-26T07:14:38.544 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-26T07:14:38.558 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-26T07:14:38.618 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-26T07:14:38.632 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-26T07:14:38.661 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-26T07:14:38.719 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-26T07:14:39.073 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-26T07:14:39.087 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-26T07:14:39.089 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-26T07:14:39.102 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-26T07:14:39.139 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-26T07:14:39.147 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-26T07:14:39.442 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-26T07:14:39.455 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-26T07:14:39.533 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-26T07:14:39.534 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-26T07:14:39.549 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-26T07:14:39.601 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-26T07:14:39.953 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-26T07:14:39.967 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-26T07:14:40.044 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:14:40.154 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-26T07:14:40.169 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-26T07:14:40.229 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:14:40.464 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-26T07:14:40.478 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-26T07:14:40.548 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:14:40.715 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-26T07:14:40.730 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-26T07:14:40.799 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:14:40.859 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-26T07:14:40.872 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-26T07:14:40.917 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:14:41.152 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-26T07:14:41.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-26T07:14:41.218 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:14:41.279 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-26T07:14:41.292 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-26T07:14:41.337 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-26T07:14:41.646 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-26T07:14:41.661 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-26T07:14:41.698 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librados2. 2023-11-26T07:14:41.711 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:41.713 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-26T07:14:41.756 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librados2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:42.107 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2023-11-26T07:14:42.122 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-librados2_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:42.174 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:42.318 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librbd1. 2023-11-26T07:14:42.331 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:42.368 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librbd1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:42.618 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2023-11-26T07:14:42.636 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-librbd1_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:42.677 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:42.786 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs2. 2023-11-26T07:14:42.800 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:42.845 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:43.147 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rados. 2023-11-26T07:14:43.161 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:43.206 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rados (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:43.254 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2023-11-26T07:14:43.269 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:43.338 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:43.508 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-26T07:14:43.522 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:14:43.567 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:43.657 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2023-11-26T07:14:43.672 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:43.740 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:43.827 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cephfs. 2023-11-26T07:14:43.841 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:43.877 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cephfs (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:44.110 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-26T07:14:44.125 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:14:44.176 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:44.197 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-26T07:14:44.210 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:14:44.255 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:44.445 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2023-11-26T07:14:44.460 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:44.504 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:44.566 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-prettytable. 2023-11-26T07:14:44.580 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-26T07:14:44.650 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-26T07:14:44.873 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-26T07:14:44.888 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:14:44.893 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rbd. 2023-11-26T07:14:44.907 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:44.939 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:44.952 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rbd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:45.330 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-26T07:14:45.344 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-26T07:14:45.351 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2023-11-26T07:14:45.366 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-26T07:14:45.388 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-26T07:14:45.418 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-26T07:14:45.728 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2023-11-26T07:14:45.740 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librgw2. 2023-11-26T07:14:45.743 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:45.754 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:45.795 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:45.799 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librgw2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:46.173 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-26T07:14:46.187 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-26T07:14:46.231 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-26T07:14:46.293 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rgw. 2023-11-26T07:14:46.307 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:46.343 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:46.650 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2023-11-26T07:14:46.665 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-librgw2_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:46.712 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-26T07:14:46.717 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:46.727 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-26T07:14:46.771 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-26T07:14:47.082 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libradosstriper1. 2023-11-26T07:14:47.096 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:47.140 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libradosstriper1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:47.212 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2023-11-26T07:14:47.226 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:47.278 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:47.585 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-common. 2023-11-26T07:14:47.600 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:47.643 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:47.681 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-26T07:14:47.695 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-26T07:14:47.747 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-26T07:14:48.083 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2023-11-26T07:14:48.098 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:48.158 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:48.687 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2023-11-26T07:14:48.701 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:48.753 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:48.832 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-base. 2023-11-26T07:14:48.847 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:48.900 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-base (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:49.602 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-26T07:14:49.616 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-26T07:14:49.661 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-26T07:14:49.876 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2023-11-26T07:14:49.891 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:14:49.943 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:14:49.980 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cheroot. 2023-11-26T07:14:49.994 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-26T07:14:50.039 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-26T07:14:50.383 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-26T07:14:50.397 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-26T07:14:50.441 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-26T07:14:50.629 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-26T07:14:50.643 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-26T07:14:50.688 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-26T07:14:50.710 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-26T07:14:50.724 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-26T07:14:50.760 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-26T07:14:50.966 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2023-11-26T07:14:50.980 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-26T07:14:51.016 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-26T07:14:51.080 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-26T07:14:51.095 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-26T07:14:51.138 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-26T07:14:51.327 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-26T07:14:51.341 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-26T07:14:51.377 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-26T07:14:51.466 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempora. 2023-11-26T07:14:51.481 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-26T07:14:51.524 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-26T07:14:51.679 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-26T07:14:51.694 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-26T07:14:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-26T07:14:51.827 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-portend. 2023-11-26T07:14:51.842 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-26T07:14:51.919 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-26T07:14:52.041 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-26T07:14:52.055 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-26T07:14:52.099 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-26T07:14:52.180 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-26T07:14:52.195 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-26T07:14:52.238 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-26T07:14:52.402 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2023-11-26T07:14:52.416 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-26T07:14:52.460 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-26T07:14:52.699 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-26T07:14:52.714 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-26T07:14:52.757 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-26T07:14:52.788 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2023-11-26T07:14:52.802 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-26T07:14:52.846 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-26T07:14:53.107 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-26T07:14:53.123 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-26T07:14:53.127 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-natsort. 2023-11-26T07:14:53.142 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-26T07:14:53.157 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-26T07:14:53.185 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-26T07:14:53.460 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-26T07:14:53.475 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-26T07:14:53.514 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-logutils. 2023-11-26T07:14:53.518 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-26T07:14:53.528 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-26T07:14:53.564 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-26T07:14:53.850 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-26T07:14:53.864 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-26T07:14:53.880 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2023-11-26T07:14:53.895 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-26T07:14:53.908 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-26T07:14:53.938 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-26T07:14:54.227 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-mako. 2023-11-26T07:14:54.242 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-26T07:14:54.250 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2023-11-26T07:14:54.265 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-26T07:14:54.285 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-26T07:14:54.300 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-26T07:14:54.586 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-26T07:14:54.601 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-26T07:14:54.644 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-26T07:14:54.647 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-26T07:14:54.661 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-26T07:14:54.705 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-26T07:14:54.947 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2023-11-26T07:14:54.962 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-26T07:14:55.005 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-26T07:14:55.008 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-26T07:14:55.023 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-26T07:14:55.066 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-26T07:14:55.317 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-26T07:14:55.319 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webob. 2023-11-26T07:14:55.332 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-26T07:14:55.332 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-26T07:14:55.375 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-26T07:14:55.377 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-26T07:14:55.678 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-26T07:14:55.693 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-26T07:14:55.721 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-waitress. 2023-11-26T07:14:55.727 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-26T07:14:55.735 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-26T07:14:55.782 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-26T07:14:55.980 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2023-11-26T07:14:55.995 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-26T07:14:56.038 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-26T07:14:56.109 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempita. 2023-11-26T07:14:56.124 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-26T07:14:56.159 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-26T07:14:56.391 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2023-11-26T07:14:56.406 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-26T07:14:56.438 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-paste. 2023-11-26T07:14:56.452 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-26T07:14:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-26T07:14:56.496 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-26T07:14:56.744 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2023-11-26T07:14:56.759 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-26T07:14:56.802 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-26T07:14:56.841 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-26T07:14:56.856 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-26T07:14:56.891 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-26T07:14:57.130 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2023-11-26T07:14:57.145 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-26T07:14:57.188 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-26T07:14:57.219 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-26T07:14:57.234 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-26T07:14:57.277 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-26T07:14:57.533 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-26T07:14:57.548 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-26T07:14:57.592 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-26T07:14:57.597 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webtest. 2023-11-26T07:14:57.612 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-26T07:14:57.655 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-26T07:14:57.895 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-26T07:14:57.909 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-26T07:14:57.952 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-26T07:14:57.959 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pecan. 2023-11-26T07:14:57.974 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-26T07:14:58.017 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-26T07:14:58.214 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2023-11-26T07:14:58.229 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-26T07:14:58.264 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-26T07:14:58.405 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-certifi. 2023-11-26T07:14:58.421 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-26T07:14:58.464 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-26T07:14:58.617 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2023-11-26T07:14:58.632 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-26T07:14:58.675 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-26T07:14:58.808 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-idna. 2023-11-26T07:14:58.823 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-26T07:14:58.858 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-26T07:14:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2023-11-26T07:14:59.027 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-26T07:14:59.071 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-26T07:14:59.186 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-urllib3. 2023-11-26T07:14:59.202 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-26T07:14:59.244 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-26T07:14:59.407 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2023-11-26T07:14:59.422 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-26T07:14:59.465 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-26T07:14:59.573 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests. 2023-11-26T07:14:59.587 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-26T07:14:59.648 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-26T07:14:59.768 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2023-11-26T07:14:59.783 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-26T07:14:59.826 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-26T07:14:59.960 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-26T07:14:59.975 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-26T07:15:00.018 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-26T07:15:00.163 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2023-11-26T07:15:00.177 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-26T07:15:00.221 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-26T07:15:00.329 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-26T07:15:00.343 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:00.388 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:00.524 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-26T07:15:00.538 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-26T07:15:00.582 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-26T07:15:00.776 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-26T07:15:00.790 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:00.834 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:00.885 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-26T07:15:00.899 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:00.943 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:01.188 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-openssl. 2023-11-26T07:15:01.202 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-26T07:15:01.246 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-26T07:15:01.373 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-26T07:15:01.388 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:01.583 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr. 2023-11-26T07:15:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:01.655 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:01.657 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:01.976 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2023-11-26T07:15:01.991 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-26T07:15:02.011 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mon. 2023-11-26T07:15:02.025 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:02.034 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-26T07:15:02.069 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mon (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:02.337 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2023-11-26T07:15:02.352 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:02.387 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:02.891 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2023-11-26T07:15:02.905 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:02.949 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:03.040 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-osd. 2023-11-26T07:15:03.055 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:03.098 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-osd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:03.760 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2023-11-26T07:15:08.165 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2023-11-26T07:15:08.166 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:08.167 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph. 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../060-ceph_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-fuse. 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mds. 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mds (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephadm. 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../063-cephadm_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-26T07:15:08.168 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-babel. 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jinja2. 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-26T07:15:08.169 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-26T07:15:08.318 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2023-11-26T07:15:08.332 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-26T07:15:08.376 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:08.489 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-26T07:15:08.502 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:08.572 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:08.696 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2023-11-26T07:15:08.709 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-26T07:15:08.754 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-26T07:15:08.892 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-26T07:15:08.906 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-26T07:15:08.951 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-26T07:15:09.149 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-26T07:15:09.163 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:09.207 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:09.296 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-26T07:15:09.309 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-26T07:15:09.353 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-26T07:15:09.544 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-26T07:15:09.559 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-26T07:15:09.594 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-26T07:15:09.632 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-routes. 2023-11-26T07:15:09.645 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-26T07:15:09.681 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-26T07:15:09.838 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-26T07:15:09.853 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-26T07:15:09.888 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-26T07:15:10.019 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-26T07:15:10.032 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:10.102 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:10.191 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2023-11-26T07:15:10.206 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-26T07:15:10.249 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-26T07:15:10.455 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-26T07:15:10.469 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-26T07:15:10.514 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-26T07:15:10.619 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-26T07:15:10.634 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:10.678 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:11.018 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-joblib. 2023-11-26T07:15:11.032 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-26T07:15:11.096 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-26T07:15:11.106 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-26T07:15:11.120 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-26T07:15:11.156 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-26T07:15:11.455 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-26T07:15:11.468 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-26T07:15:11.513 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-26T07:15:11.651 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2023-11-26T07:15:11.665 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-26T07:15:11.726 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-26T07:15:11.824 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn. 2023-11-26T07:15:11.838 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-26T07:15:11.891 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-26T07:15:12.104 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-26T07:15:12.118 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-26T07:15:12.163 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-26T07:15:12.441 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2023-11-26T07:15:12.455 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-26T07:15:12.490 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-26T07:15:12.576 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-26T07:15:12.590 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:12.634 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:13.141 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-26T07:15:13.155 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:13.199 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:13.654 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cachetools. 2023-11-26T07:15:13.670 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-26T07:15:13.729 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-26T07:15:13.990 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-26T07:15:14.006 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-26T07:15:14.040 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-26T07:15:14.169 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2023-11-26T07:15:14.184 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-26T07:15:14.219 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-26T07:15:14.352 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-26T07:15:14.368 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-26T07:15:14.402 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-26T07:15:14.488 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-26T07:15:14.504 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-26T07:15:14.546 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-26T07:15:14.672 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rsa. 2023-11-26T07:15:14.687 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-26T07:15:14.738 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-26T07:15:14.916 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-26T07:15:14.932 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-26T07:15:14.974 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-26T07:15:15.059 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-google-auth. 2023-11-26T07:15:15.075 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-26T07:15:15.117 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-26T07:15:15.285 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2023-11-26T07:15:15.300 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-26T07:15:15.343 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-26T07:15:15.497 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-26T07:15:15.512 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-26T07:15:15.547 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-26T07:15:15.655 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2023-11-26T07:15:15.671 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-26T07:15:15.713 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-26T07:15:15.884 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-websocket. 2023-11-26T07:15:15.899 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-26T07:15:15.943 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-26T07:15:16.093 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-26T07:15:16.109 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-26T07:15:16.151 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-26T07:15:16.305 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-26T07:15:16.320 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-26T07:15:16.363 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-26T07:15:16.488 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2023-11-26T07:15:16.503 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-26T07:15:16.546 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-26T07:15:16.874 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-26T07:15:16.890 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-26T07:15:16.932 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-26T07:15:17.077 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-26T07:15:17.091 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:17.135 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-26T07:15:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-26T07:15:17.538 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-26T07:15:17.638 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-26T07:15:17.652 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:17.696 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:17.866 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-26T07:15:17.880 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-26T07:15:17.916 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-26T07:15:17.974 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-26T07:15:17.987 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-26T07:15:18.032 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-26T07:15:18.361 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package jq. 2023-11-26T07:15:18.375 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-26T07:15:18.385 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-26T07:15:18.399 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-26T07:15:18.419 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-26T07:15:18.443 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-26T07:15:18.672 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package socat. 2023-11-26T07:15:18.686 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-26T07:15:18.713 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2023-11-26T07:15:18.728 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-26T07:15:18.730 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-26T07:15:18.771 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-26T07:15:18.982 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2023-11-26T07:15:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-26T07:15:19.031 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-26T07:15:19.075 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package xmlstarlet. 2023-11-26T07:15:19.089 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-26T07:15:19.134 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-26T07:15:19.335 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2023-11-26T07:15:19.350 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-26T07:15:19.393 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-26T07:15:19.521 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-test. 2023-11-26T07:15:19.535 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:19.580 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-test (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:19.739 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2023-11-26T07:15:19.753 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:19.797 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:21.476 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-volume. 2023-11-26T07:15:21.491 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:21.534 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-volume (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:21.651 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2023-11-26T07:15:21.666 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:21.700 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:21.930 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-26T07:15:21.946 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:21.988 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephfs-mirror (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:22.292 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-colorama. 2023-11-26T07:15:22.296 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-26T07:15:22.307 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-26T07:15:22.312 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:22.346 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-mirror (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:22.350 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-26T07:15:22.633 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-colorama. 2023-11-26T07:15:22.645 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephfs-shell. 2023-11-26T07:15:22.648 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-26T07:15:22.660 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:22.690 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-26T07:15:22.720 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephfs-shell (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:22.952 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-shell. 2023-11-26T07:15:22.968 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:23.006 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephfs-top. 2023-11-26T07:15:23.010 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-shell (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:23.021 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:23.064 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephfs-top (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:23.279 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-top. 2023-11-26T07:15:23.284 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-26T07:15:23.295 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7484-g44c2237f-1jammy_all.deb ... 2023-11-26T07:15:23.299 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:23.338 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-top (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:23.342 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs-dev (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:23.573 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-26T07:15:23.589 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:23.624 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:23.754 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package nvme-cli. 2023-11-26T07:15:23.769 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-26T07:15:23.812 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-26T07:15:23.993 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2023-11-26T07:15:24.009 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-26T07:15:24.052 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-26T07:15:24.176 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-26T07:15:24.191 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-26T07:15:24.234 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-26T07:15:24.381 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-26T07:15:24.396 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-26T07:15:24.439 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-26T07:15:24.687 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-26T07:15:24.702 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-26T07:15:24.746 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-26T07:15:24.851 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-26T07:15:24.866 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-26T07:15:24.909 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-26T07:15:25.057 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastescript. 2023-11-26T07:15:25.071 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-26T07:15:25.115 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-26T07:15:25.245 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2023-11-26T07:15:25.260 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-26T07:15:25.303 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-26T07:15:25.436 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pluggy. 2023-11-26T07:15:25.450 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-26T07:15:25.510 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-26T07:15:25.640 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2023-11-26T07:15:25.655 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-26T07:15:25.698 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-26T07:15:25.780 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-psutil. 2023-11-26T07:15:25.795 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-26T07:15:25.838 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-26T07:15:25.976 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2023-11-26T07:15:25.992 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-26T07:15:26.026 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-26T07:15:26.191 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-py. 2023-11-26T07:15:26.207 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-26T07:15:26.250 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-26T07:15:26.387 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2023-11-26T07:15:26.403 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-26T07:15:26.445 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-26T07:15:26.603 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pygments. 2023-11-26T07:15:26.618 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-26T07:15:26.662 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-26T07:15:26.782 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2023-11-26T07:15:26.798 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-26T07:15:26.831 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-26T07:15:27.099 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-26T07:15:27.113 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-26T07:15:27.157 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-26T07:15:27.294 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-26T07:15:27.309 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-26T07:15:27.352 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-26T07:15:27.477 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-toml. 2023-11-26T07:15:27.491 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-26T07:15:27.552 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-26T07:15:27.672 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2023-11-26T07:15:27.687 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-26T07:15:27.730 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-26T07:15:27.855 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pytest. 2023-11-26T07:15:27.869 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-26T07:15:27.913 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-26T07:15:28.033 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2023-11-26T07:15:28.048 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-26T07:15:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-26T07:15:28.436 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2023-11-26T07:15:28.452 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-26T07:15:28.475 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplejson. 2023-11-26T07:15:28.490 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-26T07:15:28.494 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-26T07:15:28.567 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-26T07:15:28.755 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-26T07:15:28.770 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-26T07:15:28.813 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-26T07:15:28.845 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-26T07:15:28.859 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-26T07:15:28.903 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-26T07:15:29.582 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package radosgw. 2023-11-26T07:15:29.597 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:29.601 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2023-11-26T07:15:29.615 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-radosgw_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:29.632 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking radosgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:29.659 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:30.261 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package rbd-fuse. 2023-11-26T07:15:30.261 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2023-11-26T07:15:30.276 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:30.276 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7484-g44c2237f-1jammy_amd64.deb ... 2023-11-26T07:15:30.319 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking rbd-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:30.320 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-26T07:15:30.654 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-26T07:15:30.883 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-26T07:15:30.925 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-26T07:15:31.034 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-26T07:15:31.050 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-26T07:15:31.291 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-26T07:15:31.339 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-26T07:15:31.705 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-26T07:15:31.734 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-26T07:15:32.287 INFO:teuthology.orchestra.run.smithi120.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-26T07:15:32.322 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-26T07:15:32.351 INFO:teuthology.orchestra.run.smithi120.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-26T07:15:32.380 INFO:teuthology.orchestra.run.smithi070.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-26T07:15:32.394 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:32.915 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:32.973 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user cephadm....done 2023-11-26T07:15:33.159 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-26T07:15:33.435 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-26T07:15:33.466 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2023-11-26T07:15:33.601 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-26T07:15:33.695 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-26T07:15:33.813 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-26T07:15:33.902 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-26T07:15:34.073 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-26T07:15:34.178 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-26T07:15:34.279 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-26T07:15:34.365 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-26T07:15:34.491 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-26T07:15:34.547 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-26T07:15:34.810 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-26T07:15:34.823 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-26T07:15:34.949 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-26T07:15:35.204 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-26T07:15:35.276 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-26T07:15:35.472 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-26T07:15:35.669 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-26T07:15:35.740 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-26T07:15:35.937 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-26T07:15:36.016 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-26T07:15:36.221 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-26T07:15:36.284 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-26T07:15:36.537 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-26T07:15:36.672 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-26T07:15:36.805 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-argparse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:36.932 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-26T07:15:37.081 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-26T07:15:37.207 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-26T07:15:37.258 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-26T07:15:37.492 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-26T07:15:37.534 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:37.776 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-26T07:15:37.819 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-26T07:15:37.902 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-26T07:15:37.936 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-26T07:15:38.187 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-26T07:15:38.295 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:38.421 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-26T07:15:38.488 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-26T07:15:38.614 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-26T07:15:38.914 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-26T07:15:38.991 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:39.141 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-26T07:15:39.190 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-26T07:15:39.435 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-26T07:15:39.533 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-26T07:15:39.719 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-26T07:15:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-26T07:15:40.219 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-26T07:15:40.512 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-26T07:15:40.638 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-26T07:15:40.739 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-26T07:15:40.764 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-26T07:15:41.015 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-26T07:15:41.090 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-26T07:15:41.149 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-26T07:15:41.275 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-26T07:15:41.475 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-26T07:15:41.627 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-26T07:15:41.743 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-26T07:15:42.044 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-26T07:15:42.153 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-26T07:15:42.304 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-26T07:15:42.437 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-26T07:15:42.764 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-26T07:15:42.930 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-26T07:15:43.165 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-26T07:15:43.240 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-26T07:15:43.433 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-26T07:15:43.583 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-26T07:15:43.584 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:43.944 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-idna (3.3-1) ... 2023-11-26T07:15:43.960 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-26T07:15:44.235 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-26T07:15:44.279 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-26T07:15:44.403 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:44.721 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1) ... 2023-11-26T07:15:45.064 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-26T07:15:45.502 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:15:45.636 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-26T07:15:45.912 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-26T07:15:46.063 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-26T07:15:46.189 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-26T07:15:46.286 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:15:46.445 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-26T07:15:46.499 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-26T07:15:46.730 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-26T07:15:46.775 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-26T07:15:46.856 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-26T07:15:47.007 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-26T07:15:47.052 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:15:47.169 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-26T07:15:47.342 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-26T07:15:47.504 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-26T07:15:47.618 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-26T07:15:47.772 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-26T07:15:47.894 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:15:48.011 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-26T07:15:48.040 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-26T07:15:48.308 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-26T07:15:48.321 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-26T07:15:48.576 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-26T07:15:48.581 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-26T07:15:48.843 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-26T07:15:48.865 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-26T07:15:48.953 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-26T07:15:49.150 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-26T07:15:49.271 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-26T07:15:49.397 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-26T07:15:49.417 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-26T07:15:49.698 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-26T07:15:49.711 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-26T07:15:49.819 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-26T07:15:50.008 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-26T07:15:50.112 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-26T07:15:50.263 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-26T07:15:50.318 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:50.557 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-26T07:15:50.778 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-26T07:15:50.874 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-26T07:15:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-26T07:15:51.167 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-26T07:15:51.205 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-26T07:15:51.596 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-26T07:15:51.607 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-26T07:15:51.845 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-26T07:15:51.892 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-26T07:15:51.971 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-26T07:15:52.159 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:15:52.285 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-26T07:15:52.372 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-26T07:15:52.628 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-26T07:15:52.649 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-26T07:15:52.933 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-26T07:15:52.938 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-26T07:15:53.059 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-26T07:15:53.222 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-26T07:15:53.348 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-26T07:15:53.410 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-26T07:15:53.658 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-26T07:15:53.736 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-26T07:15:53.943 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-26T07:15:54.021 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-26T07:15:54.146 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-26T07:15:54.211 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-26T07:15:54.450 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-26T07:15:54.587 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-26T07:15:54.734 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-26T07:15:54.906 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-26T07:15:55.036 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-26T07:15:55.274 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-26T07:15:55.400 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librados2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:55.428 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-26T07:15:55.526 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librgw2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:55.687 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:55.729 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-26T07:15:55.889 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.015 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libradosstriper1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.090 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-26T07:15:56.142 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-26T07:15:56.267 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.417 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.460 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librbd1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.569 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.578 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.738 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.788 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.931 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:56.947 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-26T07:15:56.947 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-26T07:15:57.082 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-26T07:15:57.400 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:57.509 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:57.564 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs-dev (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:57.635 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:57.690 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rados (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:57.845 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-26T07:15:57.845 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-26T07:15:57.850 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephfs-top (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:57.976 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-26T07:15:58.486 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:58.612 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:58.738 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-top (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:58.864 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-26T07:15:59.298 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rbd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:59.424 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up rbd-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:59.550 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:59.676 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cephfs (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:59.827 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephfs-shell (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:15:59.953 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:00.144 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:00.286 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:00.412 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:00.524 INFO:teuthology.orchestra.run.smithi120.stdout:Adding group ceph....done 2023-11-26T07:16:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:00.714 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-shell (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:00.865 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:00.951 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user ceph....done 2023-11-26T07:16:01.136 INFO:teuthology.orchestra.run.smithi120.stdout:Setting system user ceph properties....done 2023-11-26T07:16:01.152 INFO:teuthology.orchestra.run.smithi120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-26T07:16:01.293 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-26T07:16:01.494 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2023-11-26T07:16:01.672 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-26T07:16:01.870 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2023-11-26T07:16:02.072 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2023-11-26T07:16:02.090 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-26T07:16:02.231 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-26T07:16:02.363 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephfs-mirror (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:02.572 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:02.572 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:02.646 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-26T07:16:03.240 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-test (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:03.374 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-mirror (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:03.399 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up radosgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:03.566 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:03.566 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-26T07:16:03.948 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:03.948 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:04.193 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:04.343 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:04.690 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-base (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:04.888 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:04.888 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-26T07:16:05.054 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-26T07:16:05.520 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:05.751 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mds (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:05.899 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-26T07:16:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-26T07:16:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-26T07:16:06.555 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:06.653 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:06.802 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-26T07:16:06.802 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-26T07:16:06.867 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-26T07:16:06.867 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-26T07:16:07.423 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:07.529 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-osd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:07.654 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-26T07:16:07.654 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-26T07:16:07.855 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-26T07:16:07.855 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-26T07:16:08.317 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:08.515 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:08.640 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-26T07:16:08.640 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-26T07:16:08.640 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:08.783 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mon (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:08.992 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-26T07:16:08.992 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-26T07:16:09.235 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:09.361 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:09.529 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:09.593 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:09.736 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:09.740 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-26T07:16:09.740 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-26T07:16:09.862 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:10.038 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-volume (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:10.363 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:10.399 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-26T07:16:10.523 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:10.624 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:10.775 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (18.0.0-7484-g44c2237f-1jammy) ... 2023-11-26T07:16:11.161 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-26T07:16:11.559 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-26T07:16:12.037 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-26T07:16:12.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-26T07:16:12.116 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2023-11-26T07:16:12.283 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2023-11-26T07:16:12.284 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-26T07:16:12.432 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-26T07:16:12.433 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-26T07:16:12.434 INFO:teuthology.orchestra.run.smithi120.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-26T07:16:12.435 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2023-11-26T07:16:12.435 INFO:teuthology.orchestra.run.smithi120.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-26T07:16:12.435 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-26T07:16:12.435 INFO:teuthology.orchestra.run.smithi120.stdout: libengine-pkcs11-openssl 2023-11-26T07:16:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2023-11-26T07:16:12.483 INFO:teuthology.orchestra.run.smithi120.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-26T07:16:12.484 INFO:teuthology.orchestra.run.smithi120.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-26T07:16:12.484 INFO:teuthology.orchestra.run.smithi120.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-26T07:16:12.484 INFO:teuthology.orchestra.run.smithi120.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-26T07:16:12.484 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-26T07:16:12.485 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-26T07:16:12.485 INFO:teuthology.orchestra.run.smithi120.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-26T07:16:12.485 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2023-11-26T07:16:12.486 INFO:teuthology.orchestra.run.smithi120.stdout: libssl3 2023-11-26T07:16:12.528 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-26T07:16:12.543 INFO:teuthology.orchestra.run.smithi120.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-26T07:16:12.543 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 54.6 MB of archives. 2023-11-26T07:16:12.543 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-26T07:16:12.543 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-26T07:16:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-26T07:16:12.730 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-26T07:16:12.738 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-26T07:16:12.739 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-26T07:16:12.740 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-26T07:16:12.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-26T07:16:12.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-26T07:16:12.743 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-26T07:16:12.744 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-26T07:16:12.744 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-26T07:16:12.752 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-26T07:16:12.765 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-26T07:16:12.985 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-26T07:16:12.988 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-26T07:16:12.988 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-26T07:16:12.990 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-26T07:16:12.991 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-26T07:16:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-26T07:16:12.995 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-26T07:16:12.997 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-26T07:16:12.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-26T07:16:13.005 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-26T07:16:13.005 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-26T07:16:13.026 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-26T07:16:13.083 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-26T07:16:13.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-26T07:16:13.085 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-26T07:16:13.225 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-26T07:16:13.225 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-26T07:16:13.225 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-26T07:16:13.226 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-26T07:16:13.226 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-26T07:16:13.226 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-26T07:16:13.239 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-26T07:16:13.239 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-26T07:16:13.241 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2023-11-26T07:16:13.242 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2023-11-26T07:16:13.398 INFO:teuthology.orchestra.run.smithi070.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-26T07:16:13.398 INFO:teuthology.orchestra.run.smithi070.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-26T07:16:13.398 INFO:teuthology.orchestra.run.smithi070.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-26T07:16:13.398 INFO:teuthology.orchestra.run.smithi070.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-26T07:16:13.399 INFO:teuthology.orchestra.run.smithi070.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-26T07:16:13.399 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2023-11-26T07:16:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-26T07:16:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-26T07:16:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-26T07:16:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-26T07:16:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-26T07:16:13.400 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-26T07:16:13.400 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2023-11-26T07:16:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-26T07:16:13.400 INFO:teuthology.orchestra.run.smithi070.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-26T07:16:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-26T07:16:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-26T07:16:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-26T07:16:13.401 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2023-11-26T07:16:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-26T07:16:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-26T07:16:13.401 INFO:teuthology.orchestra.run.smithi070.stdout: libengine-pkcs11-openssl 2023-11-26T07:16:13.450 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2023-11-26T07:16:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-26T07:16:13.450 INFO:teuthology.orchestra.run.smithi070.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-26T07:16:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-26T07:16:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-26T07:16:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-26T07:16:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-26T07:16:13.451 INFO:teuthology.orchestra.run.smithi070.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-26T07:16:13.452 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2023-11-26T07:16:13.452 INFO:teuthology.orchestra.run.smithi070.stdout: libssl3 2023-11-26T07:16:13.506 INFO:teuthology.orchestra.run.smithi070.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-26T07:16:13.506 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 54.6 MB of archives. 2023-11-26T07:16:13.507 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-26T07:16:13.507 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-26T07:16:13.608 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-26T07:16:13.615 INFO:teuthology.orchestra.run.smithi120.stdout:Preconfiguring packages ... 2023-11-26T07:16:13.662 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-26T07:16:13.669 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-26T07:16:13.670 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-26T07:16:13.671 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-26T07:16:13.672 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-26T07:16:13.673 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-26T07:16:13.674 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-26T07:16:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-26T07:16:13.675 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-26T07:16:13.680 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-26T07:16:13.692 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-26T07:16:13.767 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 54.6 MB in 1s (73.1 MB/s) 2023-11-26T07:16:13.901 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package flex. 2023-11-26T07:16:13.906 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-26T07:16:13.908 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-26T07:16:13.908 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-26T07:16:13.911 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-26T07:16:13.912 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-26T07:16:13.916 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-26T07:16:13.918 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-26T07:16:13.925 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-26T07:16:13.925 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-26T07:16:13.946 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-26T07:16:13.947 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-26T07:16:13.957 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-26T07:16:13.971 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-26T07:16:13.975 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-26T07:16:13.979 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-26T07:16:13.982 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-26T07:16:13.983 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-26T07:16:13.984 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-26T07:16:13.984 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-26T07:16:13.996 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-26T07:16:13.998 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-26T07:16:14.016 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-26T07:16:14.146 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-26T07:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-26T07:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-26T07:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-26T07:16:14.147 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-26T07:16:14.148 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-26T07:16:14.160 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-26T07:16:14.161 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-26T07:16:14.539 INFO:teuthology.orchestra.run.smithi070.stdout:Preconfiguring packages ... 2023-11-26T07:16:14.561 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-26T07:16:14.686 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 54.6 MB in 1s (77.8 MB/s) 2023-11-26T07:16:14.764 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-26T07:16:14.827 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package flex. 2023-11-26T07:16:14.899 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-26T07:16:14.903 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-26T07:16:14.943 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-26T07:16:15.154 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-26T07:16:15.554 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-26T07:16:15.732 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-26T07:16:15.732 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package bison. 2023-11-26T07:16:15.805 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-26T07:16:15.809 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-26T07:16:15.860 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-26T07:16:16.104 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-26T07:16:16.286 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-26T07:16:16.300 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-26T07:16:16.352 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-26T07:16:16.722 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package dump. 2023-11-26T07:16:16.737 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-26T07:16:16.756 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package bison. 2023-11-26T07:16:16.781 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking dump (0.4b47-3) ... 2023-11-26T07:16:16.829 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-26T07:16:16.832 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-26T07:16:16.876 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-26T07:16:17.076 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package indent. 2023-11-26T07:16:17.090 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:17.134 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-26T07:16:17.377 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-26T07:16:17.379 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-26T07:16:17.391 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-26T07:16:17.393 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-26T07:16:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-26T07:16:17.443 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-26T07:16:17.813 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package dump. 2023-11-26T07:16:17.827 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-26T07:16:17.871 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking dump (0.4b47-3) ... 2023-11-26T07:16:17.949 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-26T07:16:17.965 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-26T07:16:18.008 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-26T07:16:18.233 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package indent. 2023-11-26T07:16:18.243 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-26T07:16:18.247 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:18.259 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-26T07:16:18.299 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-26T07:16:18.327 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-26T07:16:18.589 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-26T07:16:18.604 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-26T07:16:18.647 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:18.703 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-26T07:16:18.718 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-26T07:16:18.770 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-26T07:16:18.916 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-26T07:16:18.932 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-26T07:16:18.974 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:19.124 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-26T07:16:19.139 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-26T07:16:19.182 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-26T07:16:19.227 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjson-perl. 2023-11-26T07:16:19.243 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-26T07:16:19.285 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-26T07:16:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-26T07:16:19.509 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-26T07:16:19.559 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-26T07:16:19.614 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-26T07:16:19.630 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-26T07:16:19.672 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-26T07:16:19.996 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-26T07:16:20.011 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-26T07:16:20.062 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:20.340 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-26T07:16:20.355 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-26T07:16:20.398 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:20.634 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjson-perl. 2023-11-26T07:16:20.649 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-26T07:16:20.683 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-26T07:16:20.978 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-26T07:16:20.994 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-26T07:16:21.036 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-26T07:16:21.100 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-26T07:16:21.116 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-26T07:16:21.159 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:21.453 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-26T07:16:21.469 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-26T07:16:21.511 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:21.814 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-26T07:16:21.830 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-26T07:16:21.872 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:22.234 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-26T07:16:22.249 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-26T07:16:22.292 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-26T07:16:22.431 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-26T07:16:22.446 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-26T07:16:22.489 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:22.662 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-26T07:16:22.677 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-26T07:16:22.720 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-26T07:16:22.766 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-26T07:16:22.782 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-26T07:16:22.825 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:23.081 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-26T07:16:23.095 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:23.102 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-26T07:16:23.117 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-26T07:16:23.139 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:23.152 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:23.442 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-26T07:16:23.457 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:23.488 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-26T07:16:23.503 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-26T07:16:23.526 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:23.546 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-26T07:16:23.829 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-26T07:16:23.843 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:23.887 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:23.900 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-26T07:16:23.915 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-26T07:16:23.957 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-26T07:16:24.164 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-26T07:16:24.179 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-26T07:16:24.222 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-26T07:16:24.285 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-26T07:16:24.300 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:24.335 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:24.646 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-26T07:16:24.662 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:24.704 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:24.735 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-26T07:16:24.749 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-26T07:16:24.793 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-26T07:16:24.990 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-26T07:16:25.006 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:25.048 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:25.146 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package modemmanager. 2023-11-26T07:16:25.161 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-26T07:16:25.204 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:25.292 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-26T07:16:25.308 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-26T07:16:25.350 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-26T07:16:25.819 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package network-manager. 2023-11-26T07:16:25.834 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-26T07:16:25.870 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-26T07:16:25.877 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-26T07:16:25.885 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-26T07:16:25.928 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-26T07:16:26.281 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package modemmanager. 2023-11-26T07:16:26.297 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-26T07:16:26.340 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:26.502 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ppp. 2023-11-26T07:16:26.517 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-26T07:16:26.894 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-26T07:16:26.937 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package network-manager. 2023-11-26T07:16:26.953 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-26T07:16:27.003 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-26T07:16:27.232 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package pptp-linux. 2023-11-26T07:16:27.246 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-26T07:16:27.282 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-26T07:16:27.537 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-26T07:16:27.549 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-26T07:16:27.609 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-26T07:16:27.627 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ppp. 2023-11-26T07:16:27.642 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-26T07:16:27.913 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-26T07:16:27.928 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-26T07:16:27.971 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-client-common (238) ... 2023-11-26T07:16:27.984 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-26T07:16:28.267 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-26T07:16:28.282 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:28.317 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:28.365 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pptp-linux. 2023-11-26T07:16:28.380 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-26T07:16:28.423 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-26T07:16:28.676 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-26T07:16:28.690 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-26T07:16:28.740 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-26T07:16:28.939 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-common. 2023-11-26T07:16:28.954 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-26T07:16:29.015 INFO:teuthology.orchestra.run.smithi120.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-26T07:16:29.046 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-common (238) ... 2023-11-26T07:16:29.189 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-26T07:16:29.204 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-26T07:16:29.281 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client-common (238) ... 2023-11-26T07:16:29.540 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-14. 2023-11-26T07:16:29.555 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:29.633 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:29.795 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-26T07:16:29.809 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:29.862 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:30.721 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-common. 2023-11-26T07:16:30.736 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-26T07:16:30.788 INFO:teuthology.orchestra.run.smithi070.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-26T07:16:30.818 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql. 2023-11-26T07:16:30.820 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-common (238) ... 2023-11-26T07:16:30.832 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-26T07:16:30.876 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql (14+238) ... 2023-11-26T07:16:31.120 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-client. 2023-11-26T07:16:31.134 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-26T07:16:31.178 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-client (14+238) ... 2023-11-26T07:16:31.270 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-14. 2023-11-26T07:16:31.284 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-26T07:16:31.331 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:31.455 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-26T07:16:31.470 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-26T07:16:31.514 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-26T07:16:31.950 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package tcl8.6. 2023-11-26T07:16:31.965 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-26T07:16:32.007 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-26T07:16:32.277 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package tcl. 2023-11-26T07:16:32.293 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-26T07:16:32.348 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-26T07:16:32.456 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql. 2023-11-26T07:16:32.471 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-26T07:16:32.522 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql (14+238) ... 2023-11-26T07:16:32.688 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package wpasupplicant. 2023-11-26T07:16:32.704 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-26T07:16:32.746 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-26T07:16:32.766 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client. 2023-11-26T07:16:32.780 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-26T07:16:32.851 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client (14+238) ... 2023-11-26T07:16:33.085 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-26T07:16:33.099 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-26T07:16:33.125 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-26T07:16:33.135 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-26T07:16:33.140 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-26T07:16:33.183 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-26T07:16:33.412 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package tcl8.6. 2023-11-26T07:16:33.427 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-26T07:16:33.470 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-26T07:16:33.586 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-26T07:16:33.602 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-26T07:16:33.653 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-26T07:16:33.962 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-client-common (238) ... 2023-11-26T07:16:34.200 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-26T07:16:34.326 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-26T07:16:34.356 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package tcl. 2023-11-26T07:16:34.372 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-26T07:16:34.421 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-26T07:16:34.460 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:34.570 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-26T07:16:34.696 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-26T07:16:34.769 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package wpasupplicant. 2023-11-26T07:16:34.785 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-26T07:16:34.822 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:34.827 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-26T07:16:35.164 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-26T07:16:35.180 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-26T07:16:35.214 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-26T07:16:35.559 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-26T07:16:35.575 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-26T07:16:35.626 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-26T07:16:35.863 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-26T07:16:35.909 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client-common (238) ... 2023-11-26T07:16:35.994 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-26T07:16:36.106 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-26T07:16:36.207 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-26T07:16:36.325 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:36.365 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-26T07:16:36.365 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-26T07:16:36.459 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-26T07:16:36.585 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-26T07:16:36.711 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-26T07:16:37.164 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-26T07:16:37.290 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-26T07:16:37.450 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-26T07:16:37.576 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:37.702 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-26T07:16:37.713 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-26T07:16:37.799 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-26T07:16:37.811 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-26T07:16:38.177 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-26T07:16:38.177 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-26T07:16:38.658 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-26T07:16:38.784 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up dump (0.4b47-3) ... 2023-11-26T07:16:38.811 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-26T07:16:38.879 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-26T07:16:38.943 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:38.961 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-26T07:16:39.078 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-26T07:16:39.087 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-26T07:16:39.187 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-26T07:16:39.213 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-26T07:16:39.313 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-26T07:16:39.323 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:39.423 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-26T07:16:39.439 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-26T07:16:39.525 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-26T07:16:39.562 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-26T07:16:39.632 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-26T07:16:39.758 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-26T07:16:39.934 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-26T07:16:40.085 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:40.188 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-26T07:16:40.203 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-26T07:16:40.341 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up dump (0.4b47-3) ... 2023-11-26T07:16:40.354 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-client (14+238) ... 2023-11-26T07:16:40.428 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-26T07:16:40.485 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:40.497 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-26T07:16:40.610 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-26T07:16:40.736 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-26T07:16:40.863 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-26T07:16:40.988 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-26T07:16:41.078 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-26T07:16:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:16:41.119 INFO:teuthology.orchestra.run.smithi120.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-26T07:16:41.119 INFO:teuthology.orchestra.run.smithi120.stdout:which means they are currently configured by ifupdown: 2023-11-26T07:16:41.119 INFO:teuthology.orchestra.run.smithi120.stdout:- enp3s0f1 2023-11-26T07:16:41.119 INFO:teuthology.orchestra.run.smithi120.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-26T07:16:41.119 INFO:teuthology.orchestra.run.smithi120.stdout:remove their configuration from /etc/network/interfaces. 2023-11-26T07:16:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:16:41.157 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-26T07:16:41.251 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-26T07:16:41.266 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-26T07:16:41.434 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-26T07:16:41.560 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:41.634 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-26T07:16:41.686 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-26T07:16:41.879 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client (14+238) ... 2023-11-26T07:16:42.005 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-26T07:16:42.037 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-26T07:16:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:16:42.569 INFO:teuthology.orchestra.run.smithi070.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-26T07:16:42.569 INFO:teuthology.orchestra.run.smithi070.stdout:which means they are currently configured by ifupdown: 2023-11-26T07:16:42.569 INFO:teuthology.orchestra.run.smithi070.stdout:- enp3s0f1 2023-11-26T07:16:42.569 INFO:teuthology.orchestra.run.smithi070.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-26T07:16:42.569 INFO:teuthology.orchestra.run.smithi070.stdout:remove their configuration from /etc/network/interfaces. 2023-11-26T07:16:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:16:42.702 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-26T07:16:42.749 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:42.893 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:43.018 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-26T07:16:43.087 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-26T07:16:43.170 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-common (238) ... 2023-11-26T07:16:43.523 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-26T07:16:44.134 INFO:teuthology.orchestra.run.smithi120.stdout:Adding user postgres to group ssl-cert 2023-11-26T07:16:44.191 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-26T07:16:44.374 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:16:44.374 INFO:teuthology.orchestra.run.smithi120.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-26T07:16:44.568 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-26T07:16:44.631 INFO:teuthology.orchestra.run.smithi120.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-26T07:16:44.631 INFO:teuthology.orchestra.run.smithi120.stdout:Removing obsolete dictionary files: 2023-11-26T07:16:44.828 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-26T07:16:44.979 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-common (238) ... 2023-11-26T07:16:45.361 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-26T07:16:45.954 INFO:teuthology.orchestra.run.smithi070.stdout:Adding user postgres to group ssl-cert 2023-11-26T07:16:45.995 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:46.200 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:16:46.200 INFO:teuthology.orchestra.run.smithi070.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-26T07:16:46.476 INFO:teuthology.orchestra.run.smithi070.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-26T07:16:46.476 INFO:teuthology.orchestra.run.smithi070.stdout:Removing obsolete dictionary files: 2023-11-26T07:16:46.508 INFO:teuthology.orchestra.run.smithi120.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-26T07:16:46.532 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-26T07:16:46.592 INFO:teuthology.orchestra.run.smithi120.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-26T07:16:46.592 INFO:teuthology.orchestra.run.smithi120.stdout:This user must also own the server process. 2023-11-26T07:16:46.592 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:16:46.593 INFO:teuthology.orchestra.run.smithi120.stdout:The database cluster will be initialized with locale "en_US". 2023-11-26T07:16:46.593 INFO:teuthology.orchestra.run.smithi120.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-26T07:16:46.593 INFO:teuthology.orchestra.run.smithi120.stdout:The default text search configuration will be set to "english". 2023-11-26T07:16:46.593 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:16:46.593 INFO:teuthology.orchestra.run.smithi120.stdout:Data page checksums are disabled. 2023-11-26T07:16:46.593 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:16:46.593 INFO:teuthology.orchestra.run.smithi120.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-26T07:16:46.594 INFO:teuthology.orchestra.run.smithi120.stdout:creating subdirectories ... ok 2023-11-26T07:16:46.594 INFO:teuthology.orchestra.run.smithi120.stdout:selecting dynamic shared memory implementation ... posix 2023-11-26T07:16:46.617 INFO:teuthology.orchestra.run.smithi120.stdout:selecting default max_connections ... 100 2023-11-26T07:16:46.653 INFO:teuthology.orchestra.run.smithi120.stdout:selecting default shared_buffers ... 128MB 2023-11-26T07:16:46.667 INFO:teuthology.orchestra.run.smithi120.stdout:selecting default time zone ... Etc/UTC 2023-11-26T07:16:46.668 INFO:teuthology.orchestra.run.smithi120.stdout:creating configuration files ... ok 2023-11-26T07:16:46.837 INFO:teuthology.orchestra.run.smithi120.stdout:running bootstrap script ... ok 2023-11-26T07:16:47.183 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-26T07:16:47.464 INFO:teuthology.orchestra.run.smithi120.stdout:performing post-bootstrap initialization ... ok 2023-11-26T07:16:47.664 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-26T07:16:48.001 INFO:teuthology.orchestra.run.smithi120.stdout:syncing data to disk ... ok 2023-11-26T07:16:48.041 INFO:teuthology.orchestra.run.smithi070.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-26T07:16:48.065 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-26T07:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-26T07:16:48.116 INFO:teuthology.orchestra.run.smithi070.stdout:This user must also own the server process. 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout:The database cluster will be initialized with locale "en_US". 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout:The default text search configuration will be set to "english". 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout:Data page checksums are disabled. 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:16:48.117 INFO:teuthology.orchestra.run.smithi070.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-26T07:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout:creating subdirectories ... ok 2023-11-26T07:16:48.118 INFO:teuthology.orchestra.run.smithi070.stdout:selecting dynamic shared memory implementation ... posix 2023-11-26T07:16:48.142 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default max_connections ... 100 2023-11-26T07:16:48.177 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default shared_buffers ... 128MB 2023-11-26T07:16:48.191 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default time zone ... Etc/UTC 2023-11-26T07:16:48.192 INFO:teuthology.orchestra.run.smithi070.stdout:creating configuration files ... ok 2023-11-26T07:16:48.362 INFO:teuthology.orchestra.run.smithi070.stdout:running bootstrap script ... ok 2023-11-26T07:16:48.529 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-26T07:16:48.989 INFO:teuthology.orchestra.run.smithi070.stdout:performing post-bootstrap initialization ... ok 2023-11-26T07:16:49.560 INFO:teuthology.orchestra.run.smithi070.stdout:syncing data to disk ... ok 2023-11-26T07:16:50.042 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-26T07:16:51.627 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:51.753 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-26T07:16:51.879 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up postgresql (14+238) ... 2023-11-26T07:16:52.013 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:52.131 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:52.391 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-26T07:16:52.391 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-26T07:16:53.122 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:53.141 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-26T07:16:53.240 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-26T07:16:53.349 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql (14+238) ... 2023-11-26T07:16:53.450 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-26T07:16:53.477 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-26T07:16:53.576 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-26T07:16:53.636 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-26T07:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-26T07:16:53.863 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-26T07:16:54.604 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-26T07:16:54.906 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-26T07:16:55.055 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-26T07:16:55.116 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-26T07:16:55.139 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-26T07:16:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-26T07:16:55.848 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:56.461 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-26T07:16:56.594 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-26T07:16:57.254 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-26T07:16:57.258 DEBUG:teuthology.parallel:result is None 2023-11-26T07:16:57.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:16:57.482 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2023-11-26T07:16:57.504 INFO:teuthology.orchestra.run.smithi070.stdout:18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:16:57.504 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:16:57.504 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-g44c2237f-1jammy is installed. 2023-11-26T07:16:57.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=44c2237fe77713214148c1fd622c872f346f1b99 2023-11-26T07:16:57.728 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-query -W -f '${Version}' ceph 2023-11-26T07:16:57.752 INFO:teuthology.orchestra.run.smithi120.stdout:18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:16:57.752 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484-g44c2237f-1jammy 2023-11-26T07:16:57.753 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484-g44c2237f-1jammy is installed. 2023-11-26T07:16:57.753 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-26T07:16:57.753 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:16:57.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-26T07:16:57.773 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:16:57.773 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-26T07:16:57.822 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-26T07:16:57.822 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:16:57.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2023-11-26T07:16:57.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-26T07:16:57.906 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:16:57.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2023-11-26T07:16:57.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-26T07:16:57.992 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-26T07:16:57.992 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:16:57.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-26T07:16:58.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-26T07:16:58.070 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:16:58.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-26T07:16:58.091 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-26T07:16:58.155 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-26T07:16:58.155 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:16:58.155 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2023-11-26T07:16:58.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-26T07:16:58.234 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:16:58.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2023-11-26T07:16:58.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-26T07:16:58.319 INFO:teuthology.run_tasks:Running task ceph... 2023-11-26T07:16:58.380 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-26T07:16:58.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2023-11-26T07:16:58.384 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2023-11-26T07:16:58.404 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-26T07:16:58.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-26T07:16:58.447 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-26T07:16:58.467 INFO:tasks.ceph:Creating extra log directories... 2023-11-26T07:16:58.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-26T07:16:58.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-26T07:16:58.537 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-26T07:16:58.537 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-26T07:16:58.538 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-26T07:16:58.538 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:16:58.538 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-26T07:16:58.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:58.661 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:16:58.661 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-26T07:16:58.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-26T07:16:58.764 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-26T07:16:58.764 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-26T07:16:58.764 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}}', 'email': None, 'first_in_suite': False, 'job_id': '7467346', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mgr-vol-misc', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1863, 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'rishabh-mgr-vol-misc', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwGcDeN5UlXSGnqynym5VAsLTSHUH7LxShj1NoMs32gDEDwy0kTaxFiO9TjtltR60M1fHcQeIvGsH2+9g7R0cM=', 'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKiQk+cQB//La6reCq57mDNs3AvdXVORTXZhFOX0jQrLpZSdY63aoFJdfUBYt3XMQg67xHjNFJN/Y62QPaX7hs0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '44c2237fe77713214148c1fd622c872f346f1b99', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-26_06:51:12', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-26T07:16:58.764 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-26T07:16:58.768 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-26T07:16:58.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2023-11-26T07:16:58.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2023-11-26T07:16:58.871 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:16:58.871 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2023-11-26T07:16:58.888 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-26T07:16:58.888 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-26 07:10:00.139864767 +0000 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-26 07:09:59.755895197 +0000 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-26 07:09:59.755895197 +0000 2023-11-26T07:16:58.940 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2023-11-26 07:09:59.755895197 +0000 2023-11-26T07:16:58.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-26T07:16:59.001 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:16:59.001 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:16:59.001 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000245625 s, 2.1 MB/s 2023-11-26T07:16:59.002 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-26T07:16:59.054 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2023-11-26T07:16:59.103 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-26T07:16:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:59.104 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 912 Links: 1 2023-11-26T07:16:59.104 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:59.104 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-26 07:10:00.739818008 +0000 2023-11-26T07:16:59.104 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-26 07:10:00.371846687 +0000 2023-11-26T07:16:59.104 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-26 07:10:00.371846687 +0000 2023-11-26T07:16:59.104 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2023-11-26 07:10:00.371846687 +0000 2023-11-26T07:16:59.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-26T07:16:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:16:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:16:59.161 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000243556 s, 2.1 MB/s 2023-11-26T07:16:59.162 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-26T07:16:59.213 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2023-11-26T07:16:59.267 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-26T07:16:59.268 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:59.268 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-11-26T07:16:59.268 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:59.268 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-26 07:10:01.383768574 +0000 2023-11-26T07:16:59.268 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-26 07:10:01.007797123 +0000 2023-11-26T07:16:59.268 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-26 07:10:01.007797123 +0000 2023-11-26T07:16:59.268 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2023-11-26 07:10:01.007797123 +0000 2023-11-26T07:16:59.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-26T07:16:59.333 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:16:59.333 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:16:59.333 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000238502 s, 2.1 MB/s 2023-11-26T07:16:59.335 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-26T07:16:59.385 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 948 Links: 1 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-26 07:10:02.043718565 +0000 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-26 07:10:01.659747616 +0000 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-26 07:10:01.659747616 +0000 2023-11-26T07:16:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2023-11-26 07:10:01.659747616 +0000 2023-11-26T07:16:59.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-26T07:16:59.496 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:16:59.497 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:16:59.497 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.00024696 s, 2.1 MB/s 2023-11-26T07:16:59.498 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-26T07:16:59.549 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:16:59.549 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:16:59.549 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2023-11-26T07:16:59.559 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-26T07:16:59.559 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2023-11-26T07:16:59.608 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-26T07:16:59.608 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:59.608 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 895 Links: 1 2023-11-26T07:16:59.608 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:59.608 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-11-26 07:09:59.792928232 +0000 2023-11-26T07:16:59.609 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-11-26 07:09:59.400931734 +0000 2023-11-26T07:16:59.609 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-11-26 07:09:59.400931734 +0000 2023-11-26T07:16:59.609 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-11-26 07:09:59.400931734 +0000 2023-11-26T07:16:59.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-26T07:16:59.675 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-11-26T07:16:59.675 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-11-26T07:16:59.675 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000387995 s, 1.3 MB/s 2023-11-26T07:16:59.677 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-26T07:16:59.730 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2023-11-26T07:16:59.780 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-26T07:16:59.780 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:59.781 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 912 Links: 1 2023-11-26T07:16:59.781 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:59.781 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-11-26 07:10:00.428922551 +0000 2023-11-26T07:16:59.781 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-11-26 07:10:00.048925946 +0000 2023-11-26T07:16:59.781 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-11-26 07:10:00.048925946 +0000 2023-11-26T07:16:59.781 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-11-26 07:10:00.048925946 +0000 2023-11-26T07:16:59.781 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-26T07:16:59.842 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-11-26T07:16:59.843 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-11-26T07:16:59.843 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00038275 s, 1.3 MB/s 2023-11-26T07:16:59.845 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-26T07:16:59.898 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2023-11-26T07:16:59.948 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-26T07:16:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:16:59.949 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 929 Links: 1 2023-11-26T07:16:59.949 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:16:59.949 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-11-26 07:10:01.072916800 +0000 2023-11-26T07:16:59.949 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-11-26 07:10:00.692920194 +0000 2023-11-26T07:16:59.949 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-11-26 07:10:00.692920194 +0000 2023-11-26T07:16:59.949 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-11-26 07:10:00.692920194 +0000 2023-11-26T07:16:59.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-26T07:17:00.015 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-11-26T07:17:00.015 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-11-26T07:17:00.015 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000384864 s, 1.3 MB/s 2023-11-26T07:17:00.017 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-26T07:17:00.073 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 946 Links: 1 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-11-26 07:10:01.728910941 +0000 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-11-26 07:10:01.336914441 +0000 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-11-26 07:10:01.336914441 +0000 2023-11-26T07:17:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-11-26 07:10:01.336914441 +0000 2023-11-26T07:17:00.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-26T07:17:00.194 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-11-26T07:17:00.194 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-11-26T07:17:00.195 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000656735 s, 780 kB/s 2023-11-26T07:17:00.196 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-26T07:17:00.249 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:00.250 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-26T07:17:00.250 INFO:tasks.ceph:Generating config... 2023-11-26T07:17:00.251 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-26T07:17:00.251 INFO:tasks.ceph:[client] debug client = 20 2023-11-26T07:17:00.251 INFO:tasks.ceph:[client] debug ms = 1 2023-11-26T07:17:00.251 INFO:tasks.ceph:[client] pid file = 2023-11-26T07:17:00.251 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-26T07:17:00.252 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-26T07:17:00.252 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-26T07:17:00.252 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-26T07:17:00.252 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-26T07:17:00.252 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-26T07:17:00.252 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-26T07:17:00.252 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-26T07:17:00.253 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-26T07:17:00.253 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-26T07:17:00.253 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-26T07:17:00.253 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-26T07:17:00.253 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-26T07:17:00.253 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-26T07:17:00.254 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-26T07:17:00.254 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-26T07:17:00.254 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-26T07:17:00.254 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-26T07:17:00.254 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-26T07:17:00.254 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-26T07:17:00.254 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-26T07:17:00.255 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-26T07:17:00.255 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-26T07:17:00.255 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-26T07:17:00.255 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-26T07:17:00.255 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-26T07:17:00.255 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-26T07:17:00.256 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-26T07:17:00.256 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-26T07:17:00.256 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-26T07:17:00.256 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-26T07:17:00.256 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-26T07:17:00.256 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-26T07:17:00.256 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-26T07:17:00.257 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-26T07:17:00.257 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-26T07:17:00.257 INFO:tasks.ceph:Setting up mon.a... 2023-11-26T07:17:00.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-26T07:17:00.299 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2023-11-26T07:17:00.311 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-26T07:17:00.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:17:00.467 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.b', '172.21.15.120'), ('mon.c', '[v2:172.21.15.120:3301,v1:172.21.15.120:6790]')] 2023-11-26T07:17:00.467 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-26T07:17:00.468 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:00.468 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-26T07:17:00.516 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --add b 172.21.15.120 --addv c '[v2:172.21.15.120:3301,v1:172.21.15.120:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:00.601 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:00.601 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid 35961970-1319-4bbb-b3aa-e783ca1e0d4a 2023-11-26T07:17:00.601 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = pacific 2023-11-26T07:17:00.601 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2023-11-26T07:17:00.601 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 35961970-1319-4bbb-b3aa-e783ca1e0d4a 2023-11-26T07:17:00.601 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2023-11-26T07:17:00.604431+0000 2023-11-26T07:17:00.602 INFO:teuthology.orchestra.run.smithi070.stdout:created 2023-11-26T07:17:00.604431+0000 2023-11-26T07:17:00.602 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 16 (pacific) 2023-11-26T07:17:00.602 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2023-11-26T07:17:00.602 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2023-11-26T07:17:00.602 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2023-11-26T07:17:00.602 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2023-11-26T07:17:00.603 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-26T07:17:00.604 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-26T07:17:00.612 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 35961970-1319-4bbb-b3aa-e783ca1e0d4a... 2023-11-26T07:17:00.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-26T07:17:00.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-26T07:17:00.703 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2023-11-26T07:17:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2023-11-26T07:17:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-26T07:17:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2023-11-26T07:17:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2023-11-26T07:17:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2023-11-26T07:17:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2023-11-26T07:17:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2023-11-26T07:17:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2023-11-26T07:17:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2023-11-26T07:17:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-26T07:17:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2023-11-26T07:17:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2023-11-26T07:17:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-26T07:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2023-11-26T07:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2023-11-26T07:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2023-11-26T07:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2023-11-26T07:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2023-11-26T07:17:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2023-11-26T07:17:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2023-11-26T07:17:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2023-11-26T07:17:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-26T07:17:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-26T07:17:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2023-11-26T07:17:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790]" 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 35961970-1319-4bbb-b3aa-e783ca1e0d4a 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2023-11-26T07:17:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2023-11-26T07:17:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2023-11-26T07:17:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-26T07:17:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2023-11-26T07:17:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2023-11-26T07:17:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2023-11-26T07:17:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2023-11-26T07:17:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2023-11-26T07:17:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2023-11-26T07:17:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2023-11-26T07:17:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2023-11-26T07:17:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.714 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2023-11-26T07:17:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-26T07:17:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2023-11-26T07:17:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-11-26T07:17:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-11-26T07:17:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:17:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:17:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2023-11-26T07:17:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2023-11-26T07:17:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: debug finisher = 20 2023-11-26T07:17:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.716 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2023-11-26T07:17:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-26T07:17:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-11-26T07:17:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2023-11-26T07:17:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-26T07:17:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2023-11-26T07:17:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2023-11-26T07:17:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2023-11-26T07:17:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-26T07:17:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-26T07:17:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2023-11-26T07:17:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2023-11-26T07:17:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2023-11-26T07:17:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: mon op complaint time = 120 2023-11-26T07:17:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:00.720 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2023-11-26T07:17:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2023-11-26T07:17:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2023-11-26T07:17:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2023-11-26T07:17:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-26T07:17:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-26T07:17:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: client mount timeout = 600 2023-11-26T07:17:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2023-11-26T07:17:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-26T07:17:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = "" 2023-11-26T07:17:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2023-11-26T07:17:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2023-11-26T07:17:00.721 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2023-11-26T07:17:00.721 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2023-11-26T07:17:00.722 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2023-11-26T07:17:00.722 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-11-26T07:17:00.722 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2023-11-26T07:17:00.722 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2023-11-26T07:17:00.722 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d] 2023-11-26T07:17:00.722 INFO:teuthology.orchestra.run.smithi070.stdout:[mds] 2023-11-26T07:17:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds = 20 2023-11-26T07:17:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds balancer = 20 2023-11-26T07:17:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-26T07:17:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug frag = True 2023-11-26T07:17:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug scatterstat = True 2023-11-26T07:17:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: mds op complaint time = 180 2023-11-26T07:17:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: mds verify scatter = True 2023-11-26T07:17:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2023-11-26T07:17:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2023-11-26T07:17:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2023-11-26T07:17:00.725 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2023-11-26T07:17:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2023-11-26T07:17:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-26T07:17:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2023-11-26T07:17:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2023-11-26T07:17:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2023-11-26T07:17:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2023-11-26T07:17:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2023-11-26T07:17:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-26T07:17:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2023-11-26T07:17:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2023-11-26T07:17:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2023-11-26T07:17:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2023-11-26T07:17:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2023-11-26T07:17:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2023-11-26T07:17:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2023-11-26T07:17:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2023-11-26T07:17:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-26T07:17:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-26T07:17:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2023-11-26T07:17:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-26T07:17:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2023-11-26T07:17:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2023-11-26T07:17:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2023-11-26T07:17:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2023-11-26T07:17:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2023-11-26T07:17:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.70,172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790]" 2023-11-26T07:17:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 35961970-1319-4bbb-b3aa-e783ca1e0d4a 2023-11-26T07:17:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2023-11-26T07:17:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2023-11-26T07:17:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2023-11-26T07:17:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2023-11-26T07:17:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2023-11-26T07:17:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2023-11-26T07:17:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2023-11-26T07:17:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2023-11-26T07:17:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2023-11-26T07:17:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2023-11-26T07:17:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2023-11-26T07:17:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2023-11-26T07:17:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2023-11-26T07:17:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2023-11-26T07:17:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2023-11-26T07:17:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2023-11-26T07:17:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2023-11-26T07:17:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2023-11-26T07:17:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2023-11-26T07:17:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2023-11-26T07:17:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2023-11-26T07:17:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2023-11-26T07:17:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-11-26T07:17:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2023-11-26T07:17:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2023-11-26T07:17:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2023-11-26T07:17:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2023-11-26T07:17:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2023-11-26T07:17:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2023-11-26T07:17:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2023-11-26T07:17:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2023-11-26T07:17:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.738 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2023-11-26T07:17:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-11-26T07:17:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2023-11-26T07:17:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2023-11-26T07:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2023-11-26T07:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2023-11-26T07:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2023-11-26T07:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: debug finisher = 20 2023-11-26T07:17:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2023-11-26T07:17:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2023-11-26T07:17:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2023-11-26T07:17:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2023-11-26T07:17:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2023-11-26T07:17:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2023-11-26T07:17:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-26T07:17:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2023-11-26T07:17:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2023-11-26T07:17:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2023-11-26T07:17:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-26T07:17:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-26T07:17:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2023-11-26T07:17:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2023-11-26T07:17:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2023-11-26T07:17:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: mon op complaint time = 120 2023-11-26T07:17:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-26T07:17:00.743 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2023-11-26T07:17:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2023-11-26T07:17:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2023-11-26T07:17:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2023-11-26T07:17:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-26T07:17:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-26T07:17:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: client mount timeout = 600 2023-11-26T07:17:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2023-11-26T07:17:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-11-26T07:17:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = "" 2023-11-26T07:17:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2023-11-26T07:17:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2023-11-26T07:17:00.745 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2023-11-26T07:17:00.745 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2023-11-26T07:17:00.745 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2023-11-26T07:17:00.745 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2023-11-26T07:17:00.746 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2023-11-26T07:17:00.746 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2023-11-26T07:17:00.746 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2023-11-26T07:17:00.746 INFO:teuthology.orchestra.run.smithi120.stdout:[mds] 2023-11-26T07:17:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds = 20 2023-11-26T07:17:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds balancer = 20 2023-11-26T07:17:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-11-26T07:17:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug frag = True 2023-11-26T07:17:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug scatterstat = True 2023-11-26T07:17:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: mds op complaint time = 180 2023-11-26T07:17:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: mds verify scatter = True 2023-11-26T07:17:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2023-11-26T07:17:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2023-11-26T07:17:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2023-11-26T07:17:00.749 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-26T07:17:00.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-26T07:17:00.847 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-26T07:17:00.847 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:00.848 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-26T07:17:00.856 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:00.857 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-26T07:17:00.908 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:17:00.908 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:00.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-26T07:17:00.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:17:00.987 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:00.988 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:01.040 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:17:01.040 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:01.040 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-26T07:17:01.040 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-26T07:17:01.076 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:01.077 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:01.128 INFO:tasks.ceph:Setting up mon nodes... 2023-11-26T07:17:01.128 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-26T07:17:01.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-26T07:17:01.184 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-26T07:17:01.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-26T07:17:01.249 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-26T07:17:01.268 INFO:tasks.ceph:Setting up mds nodes... 2023-11-26T07:17:01.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-26T07:17:01.323 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-26T07:17:01.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-26T07:17:01.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-26T07:17:01.450 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-26T07:17:01.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-26T07:17:01.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-26T07:17:01.534 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-26T07:17:01.539 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-26T07:17:01.559 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-26T07:17:01.658 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-26T07:17:01.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-26T07:17:01.682 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-26T07:17:01.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-26T07:17:01.725 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-26T07:17:01.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-26T07:17:01.825 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-26T07:17:01.842 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-26T07:17:01.885 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-26T07:17:01.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-26T07:17:01.985 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-26T07:17:02.002 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-26T07:17:02.002 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-26T07:17:02.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-26T07:17:02.022 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:02.023 INFO:tasks.ceph:role: osd.0 2023-11-26T07:17:02.023 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:17:02.023 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-26T07:17:02.087 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:02.087 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:02.087 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:02.087 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:02.087 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:02.088 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:02.088 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:02.088 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:02.088 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:02.088 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:02.112 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-26T07:17:02.115 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-26T07:17:02.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-26T07:17:02.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-26T07:17:02.244 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:02.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:02.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-26T07:17:02.307 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:02.307 INFO:tasks.ceph:role: osd.1 2023-11-26T07:17:02.307 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:17:02.307 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:02.367 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:02.391 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-26T07:17:02.394 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-26T07:17:02.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-26T07:17:02.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-26T07:17:02.523 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:02.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:02.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-26T07:17:02.587 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:02.587 INFO:tasks.ceph:role: osd.2 2023-11-26T07:17:02.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:17:02.588 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-26T07:17:02.647 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:02.647 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:02.671 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-26T07:17:02.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-26T07:17:02.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-26T07:17:02.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-26T07:17:02.803 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:02.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:02.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-26T07:17:02.871 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:02.871 INFO:tasks.ceph:role: osd.3 2023-11-26T07:17:02.871 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:17:02.872 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-26T07:17:02.935 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:02.935 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:02.935 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:02.936 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:02.936 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:02.936 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:02.936 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:02.936 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:02.936 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:02.936 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:02.959 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-26T07:17:02.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-26T07:17:02.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-26T07:17:03.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-26T07:17:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:03.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:03.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:03.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:03.224+0000 7fe61fe2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-26T07:17:03.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:03.228+0000 7fe61fe2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-26T07:17:03.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:03.228+0000 7fe61fe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:17:03.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:03.228+0000 7fe61fe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:17:03.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:03.228+0000 7fe61fe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-26T07:17:03.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:03.228+0000 7fe61fe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-26T07:17:06.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-26T07:17:06.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:06.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:06.335+0000 7f9166c36640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-26T07:17:06.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:06.335+0000 7f9166c36640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-26T07:17:06.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:06.335+0000 7f9166c36640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:17:06.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:06.335+0000 7f9166c36640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:17:06.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:06.335+0000 7f9166c36640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-26T07:17:06.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:06.335+0000 7f9166c36640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-26T07:17:09.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-26T07:17:09.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:09.451+0000 7f050f469640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-26T07:17:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:09.451+0000 7f050f469640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-26T07:17:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:09.451+0000 7f050f469640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:17:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:09.451+0000 7f050f469640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:17:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:09.451+0000 7f050f469640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-26T07:17:09.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:09.455+0000 7f050f469640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-26T07:17:12.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-26T07:17:12.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:12.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:12.554+0000 7fe891505640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-26T07:17:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:12.554+0000 7fe891505640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-26T07:17:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:12.554+0000 7fe891505640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:17:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:12.554+0000 7fe891505640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:17:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:12.554+0000 7fe891505640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-26T07:17:12.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:12.554+0000 7fe891505640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-26T07:17:15.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-26T07:17:15.565 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-26T07:17:15.588 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:15.588 INFO:tasks.ceph:role: osd.4 2023-11-26T07:17:15.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:17:15.588 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-26T07:17:15.662 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:15.662 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:15.662 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:15.662 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:15.662 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:15.663 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:15.663 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:15.663 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:15.663 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:15.663 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:16.122 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-11-26T07:17:16.124 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-11-26T07:17:16.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-26T07:17:16.228 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-26T07:17:16.245 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:16.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:16.246 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-26T07:17:16.310 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:16.310 INFO:tasks.ceph:role: osd.5 2023-11-26T07:17:16.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:17:16.310 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-26T07:17:16.382 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:16.382 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:16.382 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:16.382 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:16.383 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:16.383 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:16.383 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:16.864 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-11-26T07:17:16.866 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-11-26T07:17:16.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-26T07:17:17.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-26T07:17:17.019 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:17.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:17.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-26T07:17:17.082 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:17.082 INFO:tasks.ceph:role: osd.6 2023-11-26T07:17:17.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:17:17.082 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:17.155 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:17.156 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:17.641 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-11-26T07:17:17.644 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-11-26T07:17:17.645 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-26T07:17:17.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-26T07:17:17.798 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:17.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:17.799 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-26T07:17:17.862 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-26T07:17:17.862 INFO:tasks.ceph:role: osd.7 2023-11-26T07:17:17.862 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:17:17.862 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-26T07:17:17.934 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-26T07:17:17.934 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-26T07:17:17.934 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-26T07:17:17.934 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-26T07:17:17.934 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-26T07:17:17.934 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-11-26T07:17:17.934 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-26T07:17:17.935 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-26T07:17:17.935 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-26T07:17:17.935 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-26T07:17:18.368 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-11-26T07:17:18.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-11-26T07:17:18.371 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-26T07:17:18.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-26T07:17:18.498 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2023-11-26T07:17:18.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:17:18.499 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:18.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:18.633+0000 7ff0ee22b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-26T07:17:18.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:18.633+0000 7ff0ee22b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-26T07:17:18.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:18.633+0000 7ff0ee22b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:17:18.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:18.633+0000 7ff0ee22b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:17:18.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:18.633+0000 7ff0ee22b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-26T07:17:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:18.637+0000 7ff0ee22b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-26T07:17:21.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-26T07:17:21.642 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:21.743 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:21.740+0000 7f7c432d4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-26T07:17:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:21.740+0000 7f7c432d4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-26T07:17:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:21.740+0000 7f7c432d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:17:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:21.740+0000 7f7c432d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:17:21.744 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:21.740+0000 7f7c432d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-26T07:17:21.746 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:21.744+0000 7f7c432d4640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-26T07:17:24.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-26T07:17:24.758 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:24.855 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:24.852+0000 7f0d3912b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-26T07:17:24.855 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:24.852+0000 7f0d3912b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-26T07:17:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:24.852+0000 7f0d3912b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:17:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:24.852+0000 7f0d3912b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:17:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:24.852+0000 7f0d3912b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-26T07:17:24.857 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:24.852+0000 7f0d3912b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-26T07:17:27.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-26T07:17:27.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:27.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:27.976+0000 7f29f450b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-26T07:17:27.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:27.976+0000 7f29f450b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-26T07:17:27.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:27.980+0000 7f29f450b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:17:27.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:27.980+0000 7f29f450b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:17:27.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:27.980+0000 7f29f450b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-26T07:17:27.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:27.980+0000 7f29f450b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-26T07:17:28.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:28.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:30.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-26T07:17:30.996 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-26T07:17:30.996 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:30.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-26T07:17:31.020 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-26T07:17:31.083 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-26T07:17:31.147 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-26T07:17:31.211 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.211 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-26T07:17:31.275 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-26T07:17:31.339 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-26T07:17:31.402 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.403 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-26T07:17:31.424 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.424 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-26T07:17:31.486 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-26T07:17:31.550 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-26T07:17:31.618 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.618 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-26T07:17:31.682 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-26T07:17:31.745 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-26T07:17:31.805 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.805 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-26T07:17:31.814 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:31.815 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-26T07:17:31.866 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.866 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-26T07:17:31.875 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:31.876 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-26T07:17:31.930 INFO:tasks.ceph:Adding keys to all mons... 2023-11-26T07:17:31.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-26T07:17:31.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-26T07:17:31.981 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlc3stCxAAjCksCvC5/30P/2m2kedt6w== 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlK818ExAA3Pl7hruKT9tvdseH1RoDNw== 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJl2a4KGxAAGVTHr4IYGCxqIbJI4GAlHw== 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDv8GJlMTzJDRAAtRLnzO4hzBrRsOTxU0sn1g== 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDy8GJlYwIPFBAA08sYURmRGI+e5KAfsYCowQ== 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2023-11-26T07:17:31.982 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQD18GJl2yAVGxAAbmsr89meMeh8tOtuLwO2nQ== 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQD48GJlgsovIRAAR7B4+PHY5+5A/pLTUYSv/Q== 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJl5WcCDxAAAQ7rZ5sJaZ6CGeJ2izEpNA== 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJl+74KIBAAAU2yWLE9nGWyh2Eew8a2cQ== 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d] 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlkKVrJxAA/tao4nxlwlxXqNbpcOQO0w== 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQD+8GJllmjnJRAAfX4zIcgsX+H5/jgeJd4fJQ== 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2023-11-26T07:17:31.983 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAB8WJlebhlLBAAXicxjU2Nww1KEts/9c6YWQ== 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAE8WJlrYwEMxAAt996EyIggEIdDG5Jo8pxLg== 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAH8WJlUqeLOhAAMXAlFPwvIZkjtwDqTqj9Dg== 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA== 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:[client.2] 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlbfhnMRAAUU4/Sqog5uGnzt4xD/6M6g== 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJl19ntNBAAm+Na43D/jVnw3XfgG4syqg== 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout:[client.3] 2023-11-26T07:17:31.984 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlUVjqOhAAg1iYDvnKqcoojshB4YtI7Q== 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJlc3stCxAAjCksCvC5/30P/2m2kedt6w== 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJlK818ExAA3Pl7hruKT9tvdseH1RoDNw== 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJl2a4KGxAAGVTHr4IYGCxqIbJI4GAlHw== 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDv8GJlMTzJDRAAtRLnzO4hzBrRsOTxU0sn1g== 2023-11-26T07:17:31.996 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDy8GJlYwIPFBAA08sYURmRGI+e5KAfsYCowQ== 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD18GJl2yAVGxAAbmsr89meMeh8tOtuLwO2nQ== 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD48GJlgsovIRAAR7B4+PHY5+5A/pLTUYSv/Q== 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJl5WcCDxAAAQ7rZ5sJaZ6CGeJ2izEpNA== 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJl+74KIBAAAU2yWLE9nGWyh2Eew8a2cQ== 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJlkKVrJxAA/tao4nxlwlxXqNbpcOQO0w== 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2023-11-26T07:17:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD+8GJllmjnJRAAfX4zIcgsX+H5/jgeJd4fJQ== 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAB8WJlebhlLBAAXicxjU2Nww1KEts/9c6YWQ== 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAE8WJlrYwEMxAAt996EyIggEIdDG5Jo8pxLg== 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAH8WJlUqeLOhAAMXAlFPwvIZkjtwDqTqj9Dg== 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA== 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:[client.2] 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJlbfhnMRAAUU4/Sqog5uGnzt4xD/6M6g== 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJl19ntNBAAm+Na43D/jVnw3XfgG4syqg== 2023-11-26T07:17:31.998 INFO:teuthology.orchestra.run.smithi120.stdout:[client.3] 2023-11-26T07:17:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDt8GJlUVjqOhAAg1iYDvnKqcoojshB4YtI7Q== 2023-11-26T07:17:31.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:32.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:32.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.225 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.283 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:32.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-26T07:17:32.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.572 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-26T07:17:32.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.695 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-26T07:17:32.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:32.869 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:32.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:32.930 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:32.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:32.991 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:33.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:33.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-26T07:17:33.109 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-26T07:17:33.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-26T07:17:33.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:17:33.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-26T07:17:33.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-26T07:17:33.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:17:33.391 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-26T07:17:33.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-26T07:17:33.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-26T07:17:33.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-26T07:17:33.605 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:33.608 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-26T07:17:33.653 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-26T07:17:33.654 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-26T07:17:33.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-26T07:17:33.657 INFO:tasks.ceph.mon.a:Started 2023-11-26T07:17:33.657 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-26T07:17:33.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-26T07:17:33.700 INFO:tasks.ceph.mon.b:Started 2023-11-26T07:17:33.701 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-26T07:17:33.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-26T07:17:33.704 INFO:tasks.ceph.mon.c:Started 2023-11-26T07:17:33.704 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-26T07:17:33.704 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-26T07:17:33.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-26T07:17:33.708 INFO:tasks.ceph.mgr.y:Started 2023-11-26T07:17:33.708 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-26T07:17:33.708 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-26T07:17:33.711 INFO:tasks.ceph.mgr.x:Started 2023-11-26T07:17:33.711 INFO:tasks.ceph:Setting crush tunables to default 2023-11-26T07:17:33.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2023-11-26T07:17:33.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7faddda79640 1 Processor -- start 2023-11-26T07:17:33.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7faddda79640 1 -- start start 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7faddda79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7faddda79640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7faddda79640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80cf0e0 con 0x7fadd80b2160 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7faddda79640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd815dac0 con 0x7fadd80d1bc0 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7faddda79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80ceb20 con 0x7fadd815d6e0 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd7fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd7fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32922/0 (socket says 172.21.15.70:32922) 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 learned_addr learned my addr 172.21.15.70:0/3963727377 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:33.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:33.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:17:33.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:33.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:33.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:33.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:33.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:33.849+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:17:34.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:17:34.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:34.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-26T07:17:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.053+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-26T07:17:34.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:17:34.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:34.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:34.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:34.457+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-26T07:17:35.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:35.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:35.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:35.260+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-26T07:17:36.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 msgr2=0x7fadd80d0df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadd815d6e0 0x7fadd80d0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 msgr2=0x7fadd80b0750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.70:3300/0 conn(0x7fadd80d1bc0 0x7fadd80b0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 -- 172.21.15.70:0/3963727377 >> v1:172.21.15.120:6789/0 conn(0x7fadd80b2160 legacy=0x7fadd80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 -- 172.21.15.70:0/3963727377 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80cee00 con 0x7fadc4006180 2023-11-26T07:17:36.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd57fa640 1 -- 172.21.15.70:0/3963727377 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd815dac0 con 0x7fadc40036b0 2023-11-26T07:17:36.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:36.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:36.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:36.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:36.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:36.848+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-26T07:17:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.052+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.052+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.052+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:37.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.052+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:37.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.052+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-26T07:17:37.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.456+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:37.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.456+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:37.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.456+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:37.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.456+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:37.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:37.456+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-26T07:17:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:38.260+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:38.260+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-26T07:17:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:38.260+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-26T07:17:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:38.260+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-26T07:17:38.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:38.260+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-26T07:17:39.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.004+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449923786 0 0) 0x7fadd80cee00 con 0x7fadc4006180 2023-11-26T07:17:39.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.004+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc0003530 con 0x7fadc4006180 2023-11-26T07:17:39.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.004+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1393546846 0 0) 0x7fadc0003530 con 0x7fadc4006180 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 msgr2=0x7fadc4005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 --2- 172.21.15.70:0/3963727377 >> v2:172.21.15.120:3300/0 conn(0x7fadc40036b0 0x7fadc4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc400af20 con 0x7fadc4006180 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fadcc001700 con 0x7fadc4006180 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 >> v1:172.21.15.70:6789/0 conn(0x7fadc4006180 legacy=0x7fadc4008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd7fff640 1 -- 172.21.15.70:0/3963727377 reap_dead start 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc00039d0 0x7fadc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc0005390 0x7fadc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815dac0 con 0x7fadc00039d0 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc000c250 con 0x7fadc00047d0 2023-11-26T07:17:39.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc000c410 con 0x7fadc0005390 2023-11-26T07:17:39.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc00039d0 0x7fadc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd7fff640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc0005390 0x7fadc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd6ffd640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc0005390 msgr2=0x7fadc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc0005390 0x7fadc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 msgr2=0x7fadc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadc0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd77fe640 1 -- 172.21.15.70:0/3963727377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0003530 con 0x7fadc00039d0 2023-11-26T07:17:39.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.008+0000 7fadd6ffd640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadc0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:39.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7fadd77fe640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc00039d0 0x7fadc0003dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadc8003800 tx=0x7fadc801daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d19183bc0a91b70 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80a6980 con 0x7fadc00039d0 2023-11-26T07:17:39.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800c040 con 0x7fadc00039d0 2023-11-26T07:17:39.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7fadd67fc640 1 -- 172.21.15.70:0/3963727377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80a6d40 con 0x7fadc00039d0 2023-11-26T07:17:39.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 -- 172.21.15.70:0/3963727377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc00039d0 msgr2=0x7fadc0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc00039d0 0x7fadc0003dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadc8003800 tx=0x7fadc801daa0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 -- 172.21.15.70:0/3963727377 shutdown_connections 2023-11-26T07:17:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc0005390 0x7fadc000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadc0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 --2- 172.21.15.70:0/3963727377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc00039d0 0x7fadc0003dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 -- 172.21.15.70:0/3963727377 >> 172.21.15.70:0/3963727377 conn(0x7fadd809c550 msgr2=0x7fadd80d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 -- 172.21.15.70:0/3963727377 shutdown_connections 2023-11-26T07:17:39.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.012+0000 7faddda79640 1 -- 172.21.15.70:0/3963727377 wait complete. 2023-11-26T07:17:39.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 Processor -- start 2023-11-26T07:17:39.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 -- start start 2023-11-26T07:17:39.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc00039d0 0x7fadd815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadd806b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc0005390 0x7fadd806be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815bff0 con 0x7fadc0005390 2023-11-26T07:17:39.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815fdb0 con 0x7fadc00047d0 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815f7f0 con 0x7fadc00039d0 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc0005390 0x7fadd806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc00039d0 0x7fadd815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc00039d0 0x7fadd815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:37430/0 (socket says 172.21.15.70:37430) 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 -- 172.21.15.70:0/1506832984 learned_addr learned my addr 172.21.15.70:0/1506832984 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd6ffd640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadd806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 -- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 msgr2=0x7fadd806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadd806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 -- 172.21.15.70:0/1506832984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc0005390 msgr2=0x7fadd806be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc0005390 0x7fadd806be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 -- 172.21.15.70:0/1506832984 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd815fad0 con 0x7fadc00039d0 2023-11-26T07:17:39.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadd77fe640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc00039d0 0x7fadd815e610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadc80b1040 tx=0x7fadc0005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadbffff640 1 -- 172.21.15.70:0/1506832984 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80a6e60 con 0x7fadc00039d0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadbffff640 1 -- 172.21.15.70:0/1506832984 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc80ae650 con 0x7fadc00039d0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7fadbffff640 1 -- 172.21.15.70:0/1506832984 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80ae9c0 con 0x7fadc00039d0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80ca390 con 0x7fadc00039d0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.016+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd815eb50 con 0x7fadc00039d0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.020+0000 7fadbffff640 1 -- 172.21.15.70:0/1506832984 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fadc80b5040 con 0x7fadc00039d0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.020+0000 7fadbffff640 1 -- 172.21.15.70:0/1506832984 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fadc80b7400 con 0x7fadc00039d0 2023-11-26T07:17:39.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.020+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd815ff40 con 0x7fadc00039d0 2023-11-26T07:17:39.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.024+0000 7fadbffff640 1 -- 172.21.15.70:0/1506832984 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fadd815ff40 con 0x7fadc00039d0 2023-11-26T07:17:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.084+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fadd8067680 con 0x7fadc00039d0 2023-11-26T07:17:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7fadbffff640 1 -- 172.21.15.70:0/1506832984 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fadc80be030 con 0x7fadc00039d0 2023-11-26T07:17:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc00039d0 msgr2=0x7fadd815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc00039d0 0x7fadd815e610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadc80b1040 tx=0x7fadc0005800 comp rx=0 tx=0).stop 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 shutdown_connections 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadc0005390 0x7fadd806be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fadc00047d0 0x7fadd806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 --2- 172.21.15.70:0/1506832984 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fadc00039d0 0x7fadd815e610 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 >> 172.21.15.70:0/1506832984 conn(0x7fadd809c550 msgr2=0x7fadd80d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 shutdown_connections 2023-11-26T07:17:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:39.092+0000 7faddda79640 1 -- 172.21.15.70:0/1506832984 wait complete. 2023-11-26T07:17:39.115 INFO:tasks.ceph:check_enable_crimson: False 2023-11-26T07:17:39.115 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-26T07:17:39.116 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:39.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-26T07:17:39.136 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:39.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-26T07:17:39.198 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:39.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-26T07:17:39.212 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:39.208+0000 7ff30aad3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-26T07:17:39.232 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:17:39.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-26T07:17:39.294 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:39.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-26T07:17:39.317 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:39.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-26T07:17:39.382 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:39.382 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-26T07:17:39.447 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:17:39.448 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-26T07:17:39.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 7f617f30-acde-4a42-9bca-1c4da35adc04 0 2023-11-26T07:17:39.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3345b1d640 1 Processor -- start 2023-11-26T07:17:39.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3345b1d640 1 -- start start 2023-11-26T07:17:39.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3345b1d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f33400cf710 0x7f33400cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3345b1d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400cc730 con 0x7f3340143ac0 2023-11-26T07:17:39.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3345b1d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3340070ee0 con 0x7f33400cf280 2023-11-26T07:17:39.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3345b1d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3340143ea0 con 0x7f33400cf710 2023-11-26T07:17:39.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3336ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f33400cf280 0x7f33400cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57056/0 (socket says 172.21.15.120:57056) 2023-11-26T07:17:39.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f3336ffd640 1 -- 172.21.15.120:0/2463042902 learned_addr learned my addr 172.21.15.120:0/2463042902 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-11-26T07:17:39.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333ffff640 1 --2- 172.21.15.120:0/2463042902 >> v2:172.21.15.70:3300/0 conn(0x7f33400cf710 0x7f33400cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333effd640 1 -- 172.21.15.120:0/2463042902 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105877601 0 0) 0x7f3340070ee0 con 0x7f33400cf280 2023-11-26T07:17:39.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333effd640 1 -- 172.21.15.120:0/2463042902 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f332c003530 con 0x7f33400cf280 2023-11-26T07:17:39.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333effd640 1 -- 172.21.15.120:0/2463042902 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540126158 0 0) 0x7f33400cc730 con 0x7f3340143ac0 2023-11-26T07:17:39.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333effd640 1 -- 172.21.15.120:0/2463042902 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3340070ee0 con 0x7f3340143ac0 2023-11-26T07:17:39.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333ffff640 1 -- 172.21.15.120:0/2463042902 >> v1:172.21.15.120:6789/0 conn(0x7f33400cf280 legacy=0x7f33400cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333ffff640 1 -- 172.21.15.120:0/2463042902 >> v1:172.21.15.70:6789/0 conn(0x7f3340143ac0 legacy=0x7f3340070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.691+0000 7f333ffff640 1 -- 172.21.15.120:0/2463042902 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400711c0 con 0x7f33400cf710 2023-11-26T07:17:39.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f333ffff640 1 --2- 172.21.15.120:0/2463042902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 0x7f33400cd8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f33380097c0 tx=0x7f333801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ca317691c2a519 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f333effd640 1 -- 172.21.15.120:0/2463042902 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380ab680 con 0x7f33400cf710 2023-11-26T07:17:39.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f333effd640 1 -- 172.21.15.120:0/2463042902 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380ab7e0 con 0x7f33400cf710 2023-11-26T07:17:39.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f333effd640 1 -- 172.21.15.120:0/2463042902 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380abb70 con 0x7f33400cf710 2023-11-26T07:17:39.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f3345b1d640 1 -- 172.21.15.120:0/2463042902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 msgr2=0x7f33400cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f3345b1d640 1 --2- 172.21.15.120:0/2463042902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 0x7f33400cd8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f33380097c0 tx=0x7f333801c480 comp rx=0 tx=0).stop 2023-11-26T07:17:39.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f3345b1d640 1 -- 172.21.15.120:0/2463042902 shutdown_connections 2023-11-26T07:17:39.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f3345b1d640 1 --2- 172.21.15.120:0/2463042902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 0x7f33400cd8c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f3345b1d640 1 -- 172.21.15.120:0/2463042902 >> 172.21.15.120:0/2463042902 conn(0x7f334006a890 msgr2=0x7f334006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f3345b1d640 1 -- 172.21.15.120:0/2463042902 shutdown_connections 2023-11-26T07:17:39.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.695+0000 7f3345b1d640 1 -- 172.21.15.120:0/2463042902 wait complete. 2023-11-26T07:17:39.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 Processor -- start 2023-11-26T07:17:39.703 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 -- start start 2023-11-26T07:17:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33400cf280 0x7f33400cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 0x7f334015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3340143ac0 0x7f334013a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340139fd0 con 0x7f33400cf710 2023-11-26T07:17:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340139350 con 0x7f33400cf280 2023-11-26T07:17:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3340139630 con 0x7f3340143ac0 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33400cf280 0x7f33400cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333ffff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3340143ac0 0x7f334013a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33400cf280 0x7f33400cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35522/0 (socket says 172.21.15.120:35522) 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 -- 172.21.15.120:0/2173828382 learned_addr learned my addr 172.21.15.120:0/2173828382 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3336ffd640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 0x7f334015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 -- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3340143ac0 msgr2=0x7f334013a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3340143ac0 0x7f334013a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 -- 172.21.15.120:0/2173828382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 msgr2=0x7f334015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 0x7f334015cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 -- 172.21.15.120:0/2173828382 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009420 con 0x7f33400cf280 2023-11-26T07:17:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333ffff640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3340143ac0 0x7f334013a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333f7fe640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33400cf280 0x7f33400cb0e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f333000c490 tx=0x7f333000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333cff9640 1 -- 172.21.15.120:0/2173828382 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33300052d0 con 0x7f33400cf280 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333cff9640 1 -- 172.21.15.120:0/2173828382 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3330005430 con 0x7f33400cf280 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3340139910 con 0x7f33400cf280 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333cff9640 1 -- 172.21.15.120:0/2173828382 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330012870 con 0x7f33400cf280 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33400cb620 con 0x7f33400cf280 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333cff9640 1 -- 172.21.15.120:0/2173828382 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3330012cd0 con 0x7f33400cf280 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f333cff9640 1 -- 172.21.15.120:0/2173828382 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f333001b7d0 con 0x7f33400cf280 2023-11-26T07:17:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.699+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334013a110 con 0x7f33400cf280 2023-11-26T07:17:39.709 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.703+0000 7f333cff9640 1 -- 172.21.15.120:0/2173828382 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f334013a110 con 0x7f33400cf280 2023-11-26T07:17:39.759 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:39.756+0000 7ff30aad3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-26T07:17:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.767+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f617f30-acde-4a42-9bca-1c4da35adc04", "id": 0} v 0) v1 -- 0x7f3340067680 con 0x7f33400cf280 2023-11-26T07:17:39.781 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.775+0000 7f333cff9640 1 -- 172.21.15.120:0/2173828382 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f617f30-acde-4a42-9bca-1c4da35adc04", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f333001ba60 con 0x7f33400cf280 2023-11-26T07:17:39.781 INFO:teuthology.orchestra.run.smithi120.stdout:0 2023-11-26T07:17:39.782 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.775+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33400cf280 msgr2=0x7f33400cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.782 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.775+0000 7f3345b1d640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33400cf280 0x7f33400cb0e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f333000c490 tx=0x7f333000c950 comp rx=0 tx=0).stop 2023-11-26T07:17:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.775+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 shutdown_connections 2023-11-26T07:17:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.775+0000 7f3345b1d640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33400cf710 0x7f334015cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.779+0000 7f3345b1d640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3340143ac0 0x7f334013a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.779+0000 7f3345b1d640 1 --2- 172.21.15.120:0/2173828382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33400cf280 0x7f33400cb0e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.779+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 >> 172.21.15.120:0/2173828382 conn(0x7f334006a890 msgr2=0x7f3340142600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.779+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 shutdown_connections 2023-11-26T07:17:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.779+0000 7f3345b1d640 1 -- 172.21.15.120:0/2173828382 wait complete. 2023-11-26T07:17:39.799 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new d6a69912-aa01-4bcf-931b-ac2886810112 1 2023-11-26T07:17:39.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a9079640 1 Processor -- start 2023-11-26T07:17:39.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a9079640 1 -- start start 2023-11-26T07:17:39.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a9079640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18a415d6e0 0x7f18a40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a9079640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f18a40b2160 0x7f18a40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a9079640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a40cf0e0 con 0x7f18a40d19f0 2023-11-26T07:17:39.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a9079640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a415dac0 con 0x7f18a40b2160 2023-11-26T07:17:39.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a9079640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a40d1e80 con 0x7f18a415d6e0 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a2d9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18a415d6e0 0x7f18a40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a2d9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18a415d6e0 0x7f18a40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35542/0 (socket says 172.21.15.120:35542) 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a2d9d640 1 -- 172.21.15.120:0/3690958050 learned_addr learned my addr 172.21.15.120:0/3690958050 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a259c640 1 --2- 172.21.15.120:0/3690958050 >> v2:172.21.15.70:3300/0 conn(0x7f18a40b2160 0x7f18a40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a2d9d640 1 -- 172.21.15.120:0/3690958050 >> v2:172.21.15.70:3300/0 conn(0x7f18a40b2160 msgr2=0x7f18a40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a2d9d640 1 --2- 172.21.15.120:0/3690958050 >> v2:172.21.15.70:3300/0 conn(0x7f18a40b2160 0x7f18a40d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a2d9d640 1 -- 172.21.15.120:0/3690958050 >> v1:172.21.15.120:6789/0 conn(0x7f18a40d19f0 legacy=0x7f18a40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a2d9d640 1 -- 172.21.15.120:0/3690958050 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40ceb20 con 0x7f18a415d6e0 2023-11-26T07:17:39.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.931+0000 7f18a259c640 1 --2- 172.21.15.120:0/3690958050 >> v2:172.21.15.70:3300/0 conn(0x7f18a40b2160 0x7f18a40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:39.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a2d9d640 1 --2- 172.21.15.120:0/3690958050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a415d6e0 0x7f18a40d0df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f18a40b5db0 tx=0x7f189401c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b10c99a7a047e3b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a1d9b640 1 -- 172.21.15.120:0/3690958050 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940ab5f0 con 0x7f18a415d6e0 2023-11-26T07:17:39.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a1d9b640 1 -- 172.21.15.120:0/3690958050 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18940ab750 con 0x7f18a415d6e0 2023-11-26T07:17:39.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a1d9b640 1 -- 172.21.15.120:0/3690958050 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940abae0 con 0x7f18a415d6e0 2023-11-26T07:17:39.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 -- 172.21.15.120:0/3690958050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a415d6e0 msgr2=0x7f18a40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 --2- 172.21.15.120:0/3690958050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a415d6e0 0x7f18a40d0df0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f18a40b5db0 tx=0x7f189401c500 comp rx=0 tx=0).stop 2023-11-26T07:17:39.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 -- 172.21.15.120:0/3690958050 shutdown_connections 2023-11-26T07:17:39.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 --2- 172.21.15.120:0/3690958050 >> v2:172.21.15.70:3300/0 conn(0x7f18a40b2160 0x7f18a40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 --2- 172.21.15.120:0/3690958050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a415d6e0 0x7f18a40d0df0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 -- 172.21.15.120:0/3690958050 >> 172.21.15.120:0/3690958050 conn(0x7f18a409c550 msgr2=0x7f18a40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:39.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 -- 172.21.15.120:0/3690958050 shutdown_connections 2023-11-26T07:17:39.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.935+0000 7f18a9079640 1 -- 172.21.15.120:0/3690958050 wait complete. 2023-11-26T07:17:39.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 Processor -- start 2023-11-26T07:17:39.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 -- start start 2023-11-26T07:17:39.944 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a40b2160 0x7f18a40c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.944 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a40d19f0 0x7f18a414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18a415d6e0 0x7f18a415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a4160400 con 0x7f18a40b2160 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a414bbb0 con 0x7f18a40d19f0 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a41606a0 con 0x7f18a415d6e0 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a40d19f0 0x7f18a414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a359e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18a415d6e0 0x7f18a415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a40d19f0 0x7f18a414c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35550/0 (socket says 172.21.15.120:35550) 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 -- 172.21.15.120:0/144720899 learned_addr learned my addr 172.21.15.120:0/144720899 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:39.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a2d9d640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a40b2160 0x7f18a40c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 -- 172.21.15.120:0/144720899 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18a415d6e0 msgr2=0x7f18a415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18a415d6e0 0x7f18a415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 -- 172.21.15.120:0/144720899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a40b2160 msgr2=0x7f18a40c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a40b2160 0x7f18a40c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 -- 172.21.15.120:0/144720899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940094d0 con 0x7f18a40d19f0 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a259c640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a40d19f0 0x7f18a414c390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f189800e810 tx=0x7f189800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f188b7fe640 1 -- 172.21.15.120:0/144720899 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800c8d0 con 0x7f18a40d19f0 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f188b7fe640 1 -- 172.21.15.120:0/144720899 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800ca30 con 0x7f18a40d19f0 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f188b7fe640 1 -- 172.21.15.120:0/144720899 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800cdc0 con 0x7f18a40d19f0 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a4160980 con 0x7f18a40d19f0 2023-11-26T07:17:39.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a40c9af0 con 0x7f18a40d19f0 2023-11-26T07:17:39.948 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f188b7fe640 1 -- 172.21.15.120:0/144720899 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f189801c750 con 0x7f18a40d19f0 2023-11-26T07:17:39.948 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.939+0000 7f188b7fe640 1 -- 172.21.15.120:0/144720899 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f18980139a0 con 0x7f18a40d19f0 2023-11-26T07:17:39.948 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.943+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a4067680 con 0x7f18a40d19f0 2023-11-26T07:17:39.951 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:39.947+0000 7f188b7fe640 1 -- 172.21.15.120:0/144720899 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1898021060 con 0x7f18a40d19f0 2023-11-26T07:17:39.962 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:39.960+0000 7ff30aad3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-26T07:17:40.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.015+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6a69912-aa01-4bcf-931b-ac2886810112", "id": 1} v 0) v1 -- 0x7f18a4156c50 con 0x7f18a40d19f0 2023-11-26T07:17:40.026 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.019+0000 7f188b7fe640 1 -- 172.21.15.120:0/144720899 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6a69912-aa01-4bcf-931b-ac2886810112", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1898017070 con 0x7f18a40d19f0 2023-11-26T07:17:40.026 INFO:teuthology.orchestra.run.smithi120.stdout:1 2023-11-26T07:17:40.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a40d19f0 msgr2=0x7f18a414c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a40d19f0 0x7f18a414c390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f189800e810 tx=0x7f189800ecd0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 shutdown_connections 2023-11-26T07:17:40.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18a415d6e0 0x7f18a415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18a40d19f0 0x7f18a414c390 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 --2- 172.21.15.120:0/144720899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a40b2160 0x7f18a40c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 >> 172.21.15.120:0/144720899 conn(0x7f18a409c550 msgr2=0x7f18a41560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 shutdown_connections 2023-11-26T07:17:40.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.023+0000 7f18a9079640 1 -- 172.21.15.120:0/144720899 wait complete. 2023-11-26T07:17:40.045 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:40.039+0000 7f68ef460180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-26T07:17:40.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new c6c38537-0e14-4e7d-b7f3-0889d8123cf2 2 2023-11-26T07:17:40.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.175+0000 7fa31571d640 1 Processor -- start 2023-11-26T07:17:40.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.175+0000 7fa31571d640 1 -- start start 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa31571d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa3100b2240 0x7fa3100d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa31571d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100d4140 con 0x7fa3100d14e0 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa31571d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100d3930 con 0x7fa310160aa0 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa31571d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3100ce440 con 0x7fa3100b2240 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30effd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa310160aa0 0x7fa3100b2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57076/0 (socket says 172.21.15.120:57076) 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30effd640 1 -- 172.21.15.120:0/1295825609 learned_addr learned my addr 172.21.15.120:0/1295825609 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30e7fc640 1 --2- 172.21.15.120:0/1295825609 >> v2:172.21.15.70:3300/0 conn(0x7fa3100b2240 0x7fa3100d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30dffb640 1 -- 172.21.15.120:0/1295825609 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384769876 0 0) 0x7fa3100d3930 con 0x7fa310160aa0 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30dffb640 1 -- 172.21.15.120:0/1295825609 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f8003530 con 0x7fa310160aa0 2023-11-26T07:17:40.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30e7fc640 1 -- 172.21.15.120:0/1295825609 >> v1:172.21.15.120:6789/0 conn(0x7fa310160aa0 legacy=0x7fa3100b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30e7fc640 1 -- 172.21.15.120:0/1295825609 >> v1:172.21.15.70:6789/0 conn(0x7fa3100d14e0 legacy=0x7fa3100ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.179+0000 7fa30e7fc640 1 -- 172.21.15.120:0/1295825609 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3100cddc0 con 0x7fa3100b2240 2023-11-26T07:17:40.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa30e7fc640 1 --2- 172.21.15.120:0/1295825609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3100b2240 0x7fa3100d0590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa3040097c0 tx=0x7fa30401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b914a546108d6345 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa30dffb640 1 -- 172.21.15.120:0/1295825609 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040ac620 con 0x7fa3100b2240 2023-11-26T07:17:40.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa30dffb640 1 -- 172.21.15.120:0/1295825609 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3040ac780 con 0x7fa3100b2240 2023-11-26T07:17:40.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa30dffb640 1 -- 172.21.15.120:0/1295825609 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040acb10 con 0x7fa3100b2240 2023-11-26T07:17:40.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 -- 172.21.15.120:0/1295825609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3100b2240 msgr2=0x7fa3100d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 --2- 172.21.15.120:0/1295825609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3100b2240 0x7fa3100d0590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa3040097c0 tx=0x7fa30401c3c0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 -- 172.21.15.120:0/1295825609 shutdown_connections 2023-11-26T07:17:40.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 --2- 172.21.15.120:0/1295825609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3100b2240 0x7fa3100d0590 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 -- 172.21.15.120:0/1295825609 >> 172.21.15.120:0/1295825609 conn(0x7fa31009c550 msgr2=0x7fa3100d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 -- 172.21.15.120:0/1295825609 shutdown_connections 2023-11-26T07:17:40.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 -- 172.21.15.120:0/1295825609 wait complete. 2023-11-26T07:17:40.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 Processor -- start 2023-11-26T07:17:40.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.183+0000 7fa31571d640 1 -- start start 2023-11-26T07:17:40.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100b2240 0x7fa31015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3100d14e0 0x7fa3100ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa310160aa0 0x7fa3101597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31015b530 con 0x7fa310160aa0 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31015b740 con 0x7fa3100b2240 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31015c5a0 con 0x7fa3100d14e0 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3100d14e0 0x7fa3100ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100b2240 0x7fa31015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3100d14e0 0x7fa3100ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.120:50582/0 (socket says 172.21.15.120:50582) 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 -- 172.21.15.120:0/1738038597 learned_addr learned my addr 172.21.15.120:0/1738038597 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30f7fe640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa310160aa0 0x7fa3101597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 -- 172.21.15.120:0/1738038597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100b2240 msgr2=0x7fa31015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100b2240 0x7fa31015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 -- 172.21.15.120:0/1738038597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa310160aa0 msgr2=0x7fa3101597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa310160aa0 0x7fa3101597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 -- 172.21.15.120:0/1738038597 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009420 con 0x7fa3100d14e0 2023-11-26T07:17:40.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa30e7fc640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3100d14e0 0x7fa3100ccb00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa304018fd0 tx=0x7fa30401ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa2f77fe640 1 -- 172.21.15.120:0/1738038597 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040b8450 con 0x7fa3100d14e0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa2f77fe640 1 -- 172.21.15.120:0/1738038597 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3040b85d0 con 0x7fa3100d14e0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31015b990 con 0x7fa3100d14e0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa2f77fe640 1 -- 172.21.15.120:0/1738038597 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3040b8980 con 0x7fa3100d14e0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31015bf50 con 0x7fa3100d14e0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa2f77fe640 1 -- 172.21.15.120:0/1738038597 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa3040aa070 con 0x7fa3100d14e0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa2f77fe640 1 -- 172.21.15.120:0/1738038597 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa3040b8de0 con 0x7fa3100d14e0 2023-11-26T07:17:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.187+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310067680 con 0x7fa3100d14e0 2023-11-26T07:17:40.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.191+0000 7fa2f77fe640 1 -- 172.21.15.120:0/1738038597 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa3040dfce0 con 0x7fa3100d14e0 2023-11-26T07:17:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.255+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c6c38537-0e14-4e7d-b7f3-0889d8123cf2", "id": 2} v 0) v1 -- 0x7fa3100b90e0 con 0x7fa3100d14e0 2023-11-26T07:17:40.269 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.263+0000 7fa2f77fe640 1 -- 172.21.15.120:0/1738038597 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6c38537-0e14-4e7d-b7f3-0889d8123cf2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa3040ce030 con 0x7fa3100d14e0 2023-11-26T07:17:40.270 INFO:teuthology.orchestra.run.smithi120.stdout:2 2023-11-26T07:17:40.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3100d14e0 msgr2=0x7fa3100ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3100d14e0 0x7fa3100ccb00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa304018fd0 tx=0x7fa30401ac00 comp rx=0 tx=0).stop 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 shutdown_connections 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa310160aa0 0x7fa3101597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3100d14e0 0x7fa3100ccb00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 --2- 172.21.15.120:0/1738038597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100b2240 0x7fa31015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 >> 172.21.15.120:0/1738038597 conn(0x7fa31009c550 msgr2=0x7fa3100b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 shutdown_connections 2023-11-26T07:17:40.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.267+0000 7fa31571d640 1 -- 172.21.15.120:0/1738038597 wait complete. 2023-11-26T07:17:40.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new a8f222d5-be8c-4f49-8a76-931257753b67 3 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f5931ce3640 1 Processor -- start 2023-11-26T07:17:40.424 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f5931ce3640 1 -- start start 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f5931ce3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f592c0d1bc0 0x7f592c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f5931ce3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f592c0b2160 0x7f592c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f5931ce3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0cf0e0 con 0x7f592c15d6e0 2023-11-26T07:17:40.425 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f5931ce3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c15dac0 con 0x7f592c0d1bc0 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f5931ce3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0ceb20 con 0x7f592c0b2160 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f592c15d6e0 0x7f592c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57082/0 (socket says 172.21.15.120:57082) 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592b7fe640 1 -- 172.21.15.120:0/825116003 learned_addr learned my addr 172.21.15.120:0/825116003 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592bfff640 1 --2- 172.21.15.120:0/825116003 >> v2:172.21.15.120:3300/0 conn(0x7f592c0b2160 0x7f592c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592affd640 1 --2- 172.21.15.120:0/825116003 >> v2:172.21.15.70:3300/0 conn(0x7f592c0d1bc0 0x7f592c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592bfff640 1 -- 172.21.15.120:0/825116003 >> v2:172.21.15.70:3300/0 conn(0x7f592c0d1bc0 msgr2=0x7f592c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:40.427 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592bfff640 1 --2- 172.21.15.120:0/825116003 >> v2:172.21.15.70:3300/0 conn(0x7f592c0d1bc0 0x7f592c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.427 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592bfff640 1 -- 172.21.15.120:0/825116003 >> v1:172.21.15.120:6789/0 conn(0x7f592c15d6e0 legacy=0x7f592c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.427 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.419+0000 7f592bfff640 1 -- 172.21.15.120:0/825116003 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0cee00 con 0x7f592c0b2160 2023-11-26T07:17:40.430 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f592bfff640 1 --2- 172.21.15.120:0/825116003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c0b2160 0x7f592c0b0750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f592c08d820 tx=0x7f592401c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9fd3b9758b592db server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f592a7fc640 1 -- 172.21.15.120:0/825116003 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240a58c0 con 0x7f592c0b2160 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f592a7fc640 1 -- 172.21.15.120:0/825116003 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59240a5a20 con 0x7f592c0b2160 2023-11-26T07:17:40.431 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f592a7fc640 1 -- 172.21.15.120:0/825116003 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240a5db0 con 0x7f592c0b2160 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 -- 172.21.15.120:0/825116003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c0b2160 msgr2=0x7f592c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 --2- 172.21.15.120:0/825116003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c0b2160 0x7f592c0b0750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f592c08d820 tx=0x7f592401c910 comp rx=0 tx=0).stop 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 -- 172.21.15.120:0/825116003 shutdown_connections 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 --2- 172.21.15.120:0/825116003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c0b2160 0x7f592c0b0750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 --2- 172.21.15.120:0/825116003 >> v2:172.21.15.70:3300/0 conn(0x7f592c0d1bc0 0x7f592c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 -- 172.21.15.120:0/825116003 >> 172.21.15.120:0/825116003 conn(0x7f592c09c550 msgr2=0x7f592c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 -- 172.21.15.120:0/825116003 shutdown_connections 2023-11-26T07:17:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 -- 172.21.15.120:0/825116003 wait complete. 2023-11-26T07:17:40.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 Processor -- start 2023-11-26T07:17:40.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.427+0000 7f5931ce3640 1 -- start start 2023-11-26T07:17:40.435 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f592c0b2160 0x7f592c153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.435 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f592c0d1bc0 0x7f592c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.435 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c15d6e0 0x7f592c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.435 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c6dc0 con 0x7f592c0b2160 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c15e1b0 con 0x7f592c15d6e0 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c154af0 con 0x7f592c0d1bc0 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f592c0d1bc0 0x7f592c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c15d6e0 0x7f592c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f592c0d1bc0 0x7f592c0c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.120:50586/0 (socket says 172.21.15.120:50586) 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c15d6e0 0x7f592c15dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35572/0 (socket says 172.21.15.120:35572) 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 -- 172.21.15.120:0/1014092924 learned_addr learned my addr 172.21.15.120:0/1014092924 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592b7fe640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f592c0b2160 0x7f592c153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 -- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c15d6e0 msgr2=0x7f592c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c15d6e0 0x7f592c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 -- 172.21.15.120:0/1014092924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f592c0b2160 msgr2=0x7f592c153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f592c0b2160 0x7f592c153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.437 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 -- 172.21.15.120:0/1014092924 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924009a70 con 0x7f592c0d1bc0 2023-11-26T07:17:40.437 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592bfff640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c15d6e0 0x7f592c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f592affd640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f592c0d1bc0 0x7f592c0c9350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f592000e930 tx=0x7f592000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5913fff640 1 -- 172.21.15.120:0/1014092924 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920009690 con 0x7f592c0d1bc0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5913fff640 1 -- 172.21.15.120:0/1014092924 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000ca00 con 0x7f592c0d1bc0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5913fff640 1 -- 172.21.15.120:0/1014092924 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000cd70 con 0x7f592c0d1bc0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0c9a50 con 0x7f592c0d1bc0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5913fff640 1 -- 172.21.15.120:0/1014092924 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5920013770 con 0x7f592c0d1bc0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c155090 con 0x7f592c0d1bc0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5913fff640 1 -- 172.21.15.120:0/1014092924 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f592001ce30 con 0x7f592c0d1bc0 2023-11-26T07:17:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.431+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c15f610 con 0x7f592c0d1bc0 2023-11-26T07:17:40.439 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.435+0000 7f5913fff640 1 -- 172.21.15.120:0/1014092924 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f592c15f610 con 0x7f592c0d1bc0 2023-11-26T07:17:40.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.499+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a8f222d5-be8c-4f49-8a76-931257753b67", "id": 3} v 0) v1 -- 0x7f592c067680 con 0x7f592c0d1bc0 2023-11-26T07:17:40.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.507+0000 7f5913fff640 1 -- 172.21.15.120:0/1014092924 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8f222d5-be8c-4f49-8a76-931257753b67", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5920021060 con 0x7f592c0d1bc0 2023-11-26T07:17:40.514 INFO:teuthology.orchestra.run.smithi120.stdout:3 2023-11-26T07:17:40.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f592c0d1bc0 msgr2=0x7f592c0c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f592c0d1bc0 0x7f592c0c9350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f592000e930 tx=0x7f592000edf0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 shutdown_connections 2023-11-26T07:17:40.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f592c15d6e0 0x7f592c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f592c0d1bc0 0x7f592c0c9350 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 --2- 172.21.15.120:0/1014092924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f592c0b2160 0x7f592c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 >> 172.21.15.120:0/1014092924 conn(0x7f592c09c550 msgr2=0x7f592c0cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 shutdown_connections 2023-11-26T07:17:40.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.511+0000 7f5931ce3640 1 -- 172.21.15.120:0/1014092924 wait complete. 2023-11-26T07:17:40.533 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 03f81073-1152-4a51-be86-287aa4b40aaa 4 2023-11-26T07:17:40.585 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:40.580+0000 7ff30aad3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:40.612 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:40.607+0000 7f68ef460180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-26T07:17:40.647 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:40.644+0000 7ff30aad3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-26T07:17:40.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.663+0000 7fa94bd35640 1 Processor -- start 2023-11-26T07:17:40.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.663+0000 7fa94bd35640 1 -- start start 2023-11-26T07:17:40.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94bd35640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa94415d6e0 0x7fa9440d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94bd35640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9440d1bc0 0x7fa9440b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94bd35640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440cf0e0 con 0x7fa9440b2160 2023-11-26T07:17:40.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94bd35640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94415dac0 con 0x7fa94415d6e0 2023-11-26T07:17:40.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94bd35640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440ceb20 con 0x7fa9440d1bc0 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9440d1bc0 0x7fa9440b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9440d1bc0 0x7fa9440b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.120:50602/0 (socket says 172.21.15.120:50602) 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 -- 172.21.15.120:0/4079533508 learned_addr learned my addr 172.21.15.120:0/4079533508 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa949ad1640 1 --2- 172.21.15.120:0/4079533508 >> v2:172.21.15.70:3300/0 conn(0x7fa94415d6e0 0x7fa9440d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 -- 172.21.15.120:0/4079533508 >> v2:172.21.15.70:3300/0 conn(0x7fa94415d6e0 msgr2=0x7fa9440d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 --2- 172.21.15.120:0/4079533508 >> v2:172.21.15.70:3300/0 conn(0x7fa94415d6e0 0x7fa9440d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 -- 172.21.15.120:0/4079533508 >> v1:172.21.15.70:6789/0 conn(0x7fa9440b2160 legacy=0x7fa9440d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 -- 172.21.15.120:0/4079533508 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440cee00 con 0x7fa9440d1bc0 2023-11-26T07:17:40.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa948acf640 1 -- 172.21.15.120:0/4079533508 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160196866 0 0) 0x7fa9440cf0e0 con 0x7fa9440b2160 2023-11-26T07:17:40.674 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.667+0000 7fa94a2d2640 1 --2- 172.21.15.120:0/4079533508 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9440d1bc0 0x7fa9440b0750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009e50 tx=0x7fa93c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc346ba73a41a9c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.674 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa948acf640 1 -- 172.21.15.120:0/4079533508 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0a57d0 con 0x7fa9440d1bc0 2023-11-26T07:17:40.674 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa948acf640 1 -- 172.21.15.120:0/4079533508 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c0a5930 con 0x7fa9440d1bc0 2023-11-26T07:17:40.674 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa948acf640 1 -- 172.21.15.120:0/4079533508 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0a5cc0 con 0x7fa9440d1bc0 2023-11-26T07:17:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- 172.21.15.120:0/4079533508 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9440d1bc0 msgr2=0x7fa9440b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 --2- 172.21.15.120:0/4079533508 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9440d1bc0 0x7fa9440b0750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009e50 tx=0x7fa93c01ca10 comp rx=0 tx=0).stop 2023-11-26T07:17:40.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- 172.21.15.120:0/4079533508 shutdown_connections 2023-11-26T07:17:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 --2- 172.21.15.120:0/4079533508 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9440d1bc0 0x7fa9440b0750 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 --2- 172.21.15.120:0/4079533508 >> v2:172.21.15.70:3300/0 conn(0x7fa94415d6e0 0x7fa9440d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- 172.21.15.120:0/4079533508 >> 172.21.15.120:0/4079533508 conn(0x7fa94409c550 msgr2=0x7fa9440d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- 172.21.15.120:0/4079533508 shutdown_connections 2023-11-26T07:17:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- 172.21.15.120:0/4079533508 wait complete. 2023-11-26T07:17:40.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 Processor -- start 2023-11-26T07:17:40.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- start start 2023-11-26T07:17:40.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9440b2160 0x7fa9441509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9440d1bc0 0x7fa944158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa94415d6e0 0x7fa944152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94415bf80 con 0x7fa9440b2160 2023-11-26T07:17:40.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa944158d90 con 0x7fa9440d1bc0 2023-11-26T07:17:40.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94bd35640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94415b690 con 0x7fa94415d6e0 2023-11-26T07:17:40.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa9492d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9440d1bc0 0x7fa944158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94a2d2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa94415d6e0 0x7fa944152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94a2d2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa94415d6e0 0x7fa944152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.120:50612/0 (socket says 172.21.15.120:50612) 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa94a2d2640 1 -- 172.21.15.120:0/3496294528 learned_addr learned my addr 172.21.15.120:0/3496294528 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.671+0000 7fa949ad1640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9440b2160 0x7fa9441509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa9492d0640 1 -- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa94415d6e0 msgr2=0x7fa944152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa9492d0640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa94415d6e0 0x7fa944152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa9492d0640 1 -- 172.21.15.120:0/3496294528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9440b2160 msgr2=0x7fa9441509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa9492d0640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9440b2160 0x7fa9441509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa9492d0640 1 -- 172.21.15.120:0/3496294528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c009b30 con 0x7fa9440d1bc0 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa94a2d2640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa94415d6e0 0x7fa944152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa9492d0640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9440d1bc0 0x7fa944158470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa9340011f0 tx=0x7fa93400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa93a7fc640 1 -- 172.21.15.120:0/3496294528 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340054e0 con 0x7fa9440d1bc0 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa93a7fc640 1 -- 172.21.15.120:0/3496294528 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934003600 con 0x7fa9440d1bc0 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9440cd010 con 0x7fa9440d1bc0 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa93a7fc640 1 -- 172.21.15.120:0/3496294528 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934003a30 con 0x7fa9440d1bc0 2023-11-26T07:17:40.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94415bc10 con 0x7fa9440d1bc0 2023-11-26T07:17:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa93a7fc640 1 -- 172.21.15.120:0/3496294528 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa93401c440 con 0x7fa9440d1bc0 2023-11-26T07:17:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa93a7fc640 1 -- 172.21.15.120:0/3496294528 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa93401cc00 con 0x7fa9440d1bc0 2023-11-26T07:17:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.675+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94415c0f0 con 0x7fa9440d1bc0 2023-11-26T07:17:40.682 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.679+0000 7fa93a7fc640 1 -- 172.21.15.120:0/3496294528 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa934021060 con 0x7fa9440d1bc0 2023-11-26T07:17:40.708 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:40.704+0000 7ff30aad3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-26T07:17:40.748 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.743+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "03f81073-1152-4a51-be86-287aa4b40aaa", "id": 4} v 0) v1 -- 0x7fa944067680 con 0x7fa9440d1bc0 2023-11-26T07:17:40.756 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa93a7fc640 1 -- 172.21.15.120:0/3496294528 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "03f81073-1152-4a51-be86-287aa4b40aaa", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa934017070 con 0x7fa9440d1bc0 2023-11-26T07:17:40.757 INFO:teuthology.orchestra.run.smithi120.stdout:4 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9440d1bc0 msgr2=0x7fa944158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9440d1bc0 0x7fa944158470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa9340011f0 tx=0x7fa93400c8c0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 shutdown_connections 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa94415d6e0 0x7fa944152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9440d1bc0 0x7fa944158470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 --2- 172.21.15.120:0/3496294528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9440b2160 0x7fa9441509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 >> 172.21.15.120:0/3496294528 conn(0x7fa94409c550 msgr2=0x7fa94406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 shutdown_connections 2023-11-26T07:17:40.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.751+0000 7fa94bd35640 1 -- 172.21.15.120:0/3496294528 wait complete. 2023-11-26T07:17:40.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 9c070a19-1766-4918-b937-75107bfe163f 5 2023-11-26T07:17:40.797 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:40.792+0000 7ff30aad3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-26T07:17:40.821 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:40.815+0000 7f68ef460180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-26T07:17:40.856 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:40.852+0000 7ff30aad3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-26T07:17:40.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cf394640 1 Processor -- start 2023-11-26T07:17:40.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cf394640 1 -- start start 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cf394640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb0c815d6e0 0x7fb0c80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cf394640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb0c80d1bc0 0x7fb0c80b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cf394640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c80cf0e0 con 0x7fb0c80b2160 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cf394640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c815dac0 con 0x7fb0c815d6e0 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cf394640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c80ceb20 con 0x7fb0c80d1bc0 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cc92f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb0c80b2160 0x7fb0c80d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57098/0 (socket says 172.21.15.120:57098) 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cc92f640 1 -- 172.21.15.120:0/2330722419 learned_addr learned my addr 172.21.15.120:0/2330722419 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cd931640 1 --2- 172.21.15.120:0/2330722419 >> v2:172.21.15.120:3300/0 conn(0x7fb0c80d1bc0 0x7fb0c80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cd130640 1 --2- 172.21.15.120:0/2330722419 >> v2:172.21.15.70:3300/0 conn(0x7fb0c815d6e0 0x7fb0c80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cd931640 1 -- 172.21.15.120:0/2330722419 >> v2:172.21.15.70:3300/0 conn(0x7fb0c815d6e0 msgr2=0x7fb0c80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:40.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cd931640 1 --2- 172.21.15.120:0/2330722419 >> v2:172.21.15.70:3300/0 conn(0x7fb0c815d6e0 0x7fb0c80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cd931640 1 -- 172.21.15.120:0/2330722419 >> v1:172.21.15.120:6789/0 conn(0x7fb0c80b2160 legacy=0x7fb0c80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.907+0000 7fb0cd931640 1 -- 172.21.15.120:0/2330722419 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80cee00 con 0x7fb0c80d1bc0 2023-11-26T07:17:40.916 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cd931640 1 --2- 172.21.15.120:0/2330722419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c80b0750 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80b92d0 tx=0x7fb0c001c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=120d05c2e1b6c789 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0bffff640 1 -- 172.21.15.120:0/2330722419 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00a58c0 con 0x7fb0c80d1bc0 2023-11-26T07:17:40.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0bffff640 1 -- 172.21.15.120:0/2330722419 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00a5a20 con 0x7fb0c80d1bc0 2023-11-26T07:17:40.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0bffff640 1 -- 172.21.15.120:0/2330722419 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00a5db0 con 0x7fb0c80d1bc0 2023-11-26T07:17:40.918 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 -- 172.21.15.120:0/2330722419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 msgr2=0x7fb0c80b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.918 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 --2- 172.21.15.120:0/2330722419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c80b0750 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80b92d0 tx=0x7fb0c001c910 comp rx=0 tx=0).stop 2023-11-26T07:17:40.918 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 -- 172.21.15.120:0/2330722419 shutdown_connections 2023-11-26T07:17:40.918 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 --2- 172.21.15.120:0/2330722419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c80b0750 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.918 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 --2- 172.21.15.120:0/2330722419 >> v2:172.21.15.70:3300/0 conn(0x7fb0c815d6e0 0x7fb0c80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.918 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 -- 172.21.15.120:0/2330722419 >> 172.21.15.120:0/2330722419 conn(0x7fb0c809c550 msgr2=0x7fb0c80d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:40.918 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 -- 172.21.15.120:0/2330722419 shutdown_connections 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.911+0000 7fb0cf394640 1 -- 172.21.15.120:0/2330722419 wait complete. 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 Processor -- start 2023-11-26T07:17:40.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 -- start start 2023-11-26T07:17:40.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0c80b2160 0x7fb0c815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0c815d6e0 0x7fb0c8159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:40.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815c2c0 con 0x7fb0c815d6e0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815ac60 con 0x7fb0c80d1bc0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c815af40 con 0x7fb0c80b2160 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0c80b2160 0x7fb0c815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cc92f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cc92f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c8159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35610/0 (socket says 172.21.15.120:35610) 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0c80b2160 0x7fb0c815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.120:50614/0 (socket says 172.21.15.120:50614) 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cc92f640 1 -- 172.21.15.120:0/46390814 learned_addr learned my addr 172.21.15.120:0/46390814 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd931640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0c815d6e0 0x7fb0c8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 -- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 msgr2=0x7fb0c8159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c8159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 -- 172.21.15.120:0/46390814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0c815d6e0 msgr2=0x7fb0c8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0c815d6e0 0x7fb0c8159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 -- 172.21.15.120:0/46390814 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0009a70 con 0x7fb0c80b2160 2023-11-26T07:17:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cc92f640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cd130640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0c80b2160 0x7fb0c815bd80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400d5d0 tx=0x7fb0c400da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0bdffb640 1 -- 172.21.15.120:0/46390814 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40125f0 con 0x7fb0c80b2160 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0bdffb640 1 -- 172.21.15.120:0/46390814 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c4012750 con 0x7fb0c80b2160 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0bdffb640 1 -- 172.21.15.120:0/46390814 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4012ae0 con 0x7fb0c80b2160 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.915+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c815b220 con 0x7fb0c80b2160 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.919+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c815b7e0 con 0x7fb0c80b2160 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.919+0000 7fb0bdffb640 1 -- 172.21.15.120:0/46390814 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0c401e460 con 0x7fb0c80b2160 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.919+0000 7fb0bdffb640 1 -- 172.21.15.120:0/46390814 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb0c4014af0 con 0x7fb0c80b2160 2023-11-26T07:17:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.919+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c815b9a0 con 0x7fb0c80b2160 2023-11-26T07:17:40.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:40.919+0000 7fb0bdffb640 1 -- 172.21.15.120:0/46390814 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb0c4014cb0 con 0x7fb0c80b2160 2023-11-26T07:17:40.944 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:40.940+0000 7ff30aad3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-26T07:17:41.004 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:41.000+0000 7ff30aad3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-26T07:17:41.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.011+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9c070a19-1766-4918-b937-75107bfe163f", "id": 5} v 0) v1 -- 0x7fb0c80b1f90 con 0x7fb0c80b2160 2023-11-26T07:17:41.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0bdffb640 1 -- 172.21.15.120:0/46390814 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c070a19-1766-4918-b937-75107bfe163f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb0c4014570 con 0x7fb0c80b2160 2023-11-26T07:17:41.018 INFO:teuthology.orchestra.run.smithi120.stdout:5 2023-11-26T07:17:41.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0c80b2160 msgr2=0x7fb0c815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0c80b2160 0x7fb0c815bd80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400d5d0 tx=0x7fb0c400da90 comp rx=0 tx=0).stop 2023-11-26T07:17:41.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 shutdown_connections 2023-11-26T07:17:41.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0c815d6e0 0x7fb0c8159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0c80d1bc0 0x7fb0c8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 --2- 172.21.15.120:0/46390814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0c80b2160 0x7fb0c815bd80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 >> 172.21.15.120:0/46390814 conn(0x7fb0c809c550 msgr2=0x7fb0c806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 shutdown_connections 2023-11-26T07:17:41.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.015+0000 7fb0cf394640 1 -- 172.21.15.120:0/46390814 wait complete. 2023-11-26T07:17:41.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 520cc563-cde2-4144-98c0-7425192c41dd 6 2023-11-26T07:17:41.161 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:41.156+0000 7ff30aad3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-26T07:17:41.218 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.211+0000 7f4b73fdf640 1 Processor -- start 2023-11-26T07:17:41.218 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b73fdf640 1 -- start start 2023-11-26T07:17:41.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b73fdf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4b6c15d5b0 0x7f4b6c0d1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b73fdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c0d1d60 0x7f4b6c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b73fdf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4b6c0b36b0 0x7f4b6c0cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b73fdf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0d21c0 con 0x7f4b6c0b36b0 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b73fdf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0ce590 con 0x7f4b6c15d5b0 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b73fdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0cdf80 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4b6c15d5b0 0x7f4b6c0d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b7157a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c0d1d60 0x7f4b6c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4b6c15d5b0 0x7f4b6c0d1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35618/0 (socket says 172.21.15.120:35618) 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 -- 172.21.15.120:0/4071827971 learned_addr learned my addr 172.21.15.120:0/4071827971 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b7257c640 1 --2- 172.21.15.120:0/4071827971 >> v2:172.21.15.70:3300/0 conn(0x7f4b6c0b36b0 0x7f4b6c0cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 -- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c0d1d60 msgr2=0x7f4b6c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 --2- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c0d1d60 0x7f4b6c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 -- 172.21.15.120:0/4071827971 >> v2:172.21.15.70:3300/0 conn(0x7f4b6c0b36b0 msgr2=0x7f4b6c0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 --2- 172.21.15.120:0/4071827971 >> v2:172.21.15.70:3300/0 conn(0x7f4b6c0b36b0 0x7f4b6c0cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.222 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b71d7b640 1 -- 172.21.15.120:0/4071827971 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0b3ea0 con 0x7f4b6c15d5b0 2023-11-26T07:17:41.222 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b7157a640 1 --2- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c0d1d60 0x7f4b6c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.222 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.215+0000 7f4b7257c640 1 --2- 172.21.15.120:0/4071827971 >> v2:172.21.15.70:3300/0 conn(0x7f4b6c0b36b0 0x7f4b6c0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:41.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b71d7b640 1 --2- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c15d5b0 0x7f4b6c0d1820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0a11c0 tx=0x7f4b6801cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a7b2b01ce9ce1ce server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b70d79640 1 -- 172.21.15.120:0/4071827971 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680ab600 con 0x7f4b6c15d5b0 2023-11-26T07:17:41.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b70d79640 1 -- 172.21.15.120:0/4071827971 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b680a7050 con 0x7f4b6c15d5b0 2023-11-26T07:17:41.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b70d79640 1 -- 172.21.15.120:0/4071827971 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680ab980 con 0x7f4b6c15d5b0 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 -- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c15d5b0 msgr2=0x7f4b6c0d1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c15d5b0 0x7f4b6c0d1820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0a11c0 tx=0x7f4b6801cc70 comp rx=0 tx=0).stop 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 -- 172.21.15.120:0/4071827971 shutdown_connections 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/4071827971 >> v2:172.21.15.70:3300/0 conn(0x7f4b6c0b36b0 0x7f4b6c0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c0d1d60 0x7f4b6c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/4071827971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c15d5b0 0x7f4b6c0d1820 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 -- 172.21.15.120:0/4071827971 >> 172.21.15.120:0/4071827971 conn(0x7f4b6c08cc60 msgr2=0x7f4b6c09c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 -- 172.21.15.120:0/4071827971 shutdown_connections 2023-11-26T07:17:41.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.219+0000 7f4b73fdf640 1 -- 172.21.15.120:0/4071827971 wait complete. 2023-11-26T07:17:41.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 Processor -- start 2023-11-26T07:17:41.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 -- start start 2023-11-26T07:17:41.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b6c0b36b0 0x7f4b6c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c0d1d60 0x7f4b6c14c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c15d5b0 0x7f4b6c15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c14cca0 con 0x7f4b6c0b36b0 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c15f490 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c15f770 con 0x7f4b6c15d5b0 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c0d1d60 0x7f4b6c14c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7257c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c15d5b0 0x7f4b6c15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c0d1d60 0x7f4b6c14c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35626/0 (socket says 172.21.15.120:35626) 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 -- 172.21.15.120:0/1467563365 learned_addr learned my addr 172.21.15.120:0/1467563365 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b71d7b640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b6c0b36b0 0x7f4b6c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 -- 172.21.15.120:0/1467563365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c15d5b0 msgr2=0x7f4b6c15ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c15d5b0 0x7f4b6c15ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 -- 172.21.15.120:0/1467563365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b6c0b36b0 msgr2=0x7f4b6c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b6c0b36b0 0x7f4b6c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 -- 172.21.15.120:0/1467563365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c009420 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b7157a640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c0d1d60 0x7f4b6c14c760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00e980 tx=0x7f4b5c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.230 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:41.224+0000 7ff30aad3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b627fc640 1 -- 172.21.15.120:0/1467563365 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00ca00 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b627fc640 1 -- 172.21.15.120:0/1467563365 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c00cb60 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b627fc640 1 -- 172.21.15.120:0/1467563365 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c013470 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b680094d0 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c15fd30 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b627fc640 1 -- 172.21.15.120:0/1467563365 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4b5c005ca0 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b627fc640 1 -- 172.21.15.120:0/1467563365 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4b5c006840 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.223+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c067680 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.232 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.227+0000 7f4b627fc640 1 -- 172.21.15.120:0/1467563365 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4b5c021060 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.295+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "520cc563-cde2-4144-98c0-7425192c41dd", "id": 6} v 0) v1 -- 0x7f4b6c074980 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.303 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b627fc640 1 -- 172.21.15.120:0/1467563365 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "520cc563-cde2-4144-98c0-7425192c41dd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b5c029020 con 0x7f4b6c0d1d60 2023-11-26T07:17:41.303 INFO:teuthology.orchestra.run.smithi120.stdout:6 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c0d1d60 msgr2=0x7f4b6c14c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c0d1d60 0x7f4b6c14c760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00e980 tx=0x7f4b5c00ee40 comp rx=0 tx=0).stop 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 shutdown_connections 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b6c15d5b0 0x7f4b6c15ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b6c0d1d60 0x7f4b6c14c760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 --2- 172.21.15.120:0/1467563365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b6c0b36b0 0x7f4b6c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 >> 172.21.15.120:0/1467563365 conn(0x7f4b6c08cc60 msgr2=0x7f4b6c0d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 shutdown_connections 2023-11-26T07:17:41.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.299+0000 7f4b73fdf640 1 -- 172.21.15.120:0/1467563365 wait complete. 2023-11-26T07:17:41.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new e850d242-cf65-409f-809e-16d5626a8026 7 2023-11-26T07:17:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f00709c4640 1 Processor -- start 2023-11-26T07:17:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f00709c4640 1 -- start start 2023-11-26T07:17:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f00709c4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f006c0d1f30 0x7f006c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f00709c4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c0ce590 con 0x7f006c15d5b0 2023-11-26T07:17:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f00709c4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c0cdf80 con 0x7f006c0b36b0 2023-11-26T07:17:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f00709c4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c0b3ea0 con 0x7f006c0d1f30 2023-11-26T07:17:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f0069d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f006c0d1f30 0x7f006c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f0069d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f006c0d1f30 0x7f006c0b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35630/0 (socket says 172.21.15.120:35630) 2023-11-26T07:17:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f0069d9b640 1 -- 172.21.15.120:0/4048447715 learned_addr learned my addr 172.21.15.120:0/4048447715 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f0069d9b640 1 -- 172.21.15.120:0/4048447715 >> v1:172.21.15.120:6789/0 conn(0x7f006c0b36b0 legacy=0x7f006c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f0069d9b640 1 -- 172.21.15.120:0/4048447715 >> v1:172.21.15.70:6789/0 conn(0x7f006c15d5b0 legacy=0x7f006c0d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.455+0000 7f0069d9b640 1 -- 172.21.15.120:0/4048447715 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0ce220 con 0x7f006c0d1f30 2023-11-26T07:17:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f0069d9b640 1 --2- 172.21.15.120:0/4048447715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c0d1f30 0x7f006c0b3170 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0060009870 tx=0x7f006001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeef242470a1e0ae server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f006959a640 1 -- 172.21.15.120:0/4048447715 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600a7070 con 0x7f006c0d1f30 2023-11-26T07:17:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f006959a640 1 -- 172.21.15.120:0/4048447715 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00600ab430 con 0x7f006c0d1f30 2023-11-26T07:17:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f006959a640 1 -- 172.21.15.120:0/4048447715 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600ab7c0 con 0x7f006c0d1f30 2023-11-26T07:17:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f00709c4640 1 -- 172.21.15.120:0/4048447715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c0d1f30 msgr2=0x7f006c0b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f00709c4640 1 --2- 172.21.15.120:0/4048447715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c0d1f30 0x7f006c0b3170 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0060009870 tx=0x7f006001c500 comp rx=0 tx=0).stop 2023-11-26T07:17:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f00709c4640 1 -- 172.21.15.120:0/4048447715 shutdown_connections 2023-11-26T07:17:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f00709c4640 1 --2- 172.21.15.120:0/4048447715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c0d1f30 0x7f006c0b3170 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f00709c4640 1 -- 172.21.15.120:0/4048447715 >> 172.21.15.120:0/4048447715 conn(0x7f006c08cc60 msgr2=0x7f006c09c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f00709c4640 1 -- 172.21.15.120:0/4048447715 shutdown_connections 2023-11-26T07:17:41.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.459+0000 7f00709c4640 1 -- 172.21.15.120:0/4048447715 wait complete. 2023-11-26T07:17:41.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 Processor -- start 2023-11-26T07:17:41.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 -- start start 2023-11-26T07:17:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f006c0b36b0 0x7f006c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f006c0d1f30 0x7f006c0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c15d5b0 0x7f006c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c150880 con 0x7f006c0b36b0 2023-11-26T07:17:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0cc760 con 0x7f006c15d5b0 2023-11-26T07:17:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f00709c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c1542c0 con 0x7f006c0d1f30 2023-11-26T07:17:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f006c0d1f30 0x7f006c0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f006ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c15d5b0 0x7f006c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f006ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c15d5b0 0x7f006c0cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35636/0 (socket says 172.21.15.120:35636) 2023-11-26T07:17:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f006ad9d640 1 -- 172.21.15.120:0/1226450278 learned_addr learned my addr 172.21.15.120:0/1226450278 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-11-26T07:17:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f006c0d1f30 0x7f006c0cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.120:50646/0 (socket says 172.21.15.120:50646) 2023-11-26T07:17:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f006a59c640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f006c0b36b0 0x7f006c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 -- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c15d5b0 msgr2=0x7f006c0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c15d5b0 0x7f006c0cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 -- 172.21.15.120:0/1226450278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f006c0b36b0 msgr2=0x7f006c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f006c0b36b0 0x7f006c0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 -- 172.21.15.120:0/1226450278 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600094d0 con 0x7f006c0d1f30 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f006ad9d640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c15d5b0 0x7f006c0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f0069d9b640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f006c0d1f30 0x7f006c0cbce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00600ac000 tx=0x7f00600192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f005affd640 1 -- 172.21.15.120:0/1226450278 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600b4800 con 0x7f006c0d1f30 2023-11-26T07:17:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.463+0000 7f005affd640 1 -- 172.21.15.120:0/1226450278 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00600b49a0 con 0x7f006c0d1f30 2023-11-26T07:17:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.467+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c14ff50 con 0x7f006c0d1f30 2023-11-26T07:17:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.467+0000 7f005affd640 1 -- 172.21.15.120:0/1226450278 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600b4d50 con 0x7f006c0d1f30 2023-11-26T07:17:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.467+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c150510 con 0x7f006c0d1f30 2023-11-26T07:17:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.467+0000 7f005affd640 1 -- 172.21.15.120:0/1226450278 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00600be6f0 con 0x7f006c0d1f30 2023-11-26T07:17:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.467+0000 7f005affd640 1 -- 172.21.15.120:0/1226450278 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f00600c6c20 con 0x7f006c0d1f30 2023-11-26T07:17:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.467+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006c150a30 con 0x7f006c0d1f30 2023-11-26T07:17:41.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.467+0000 7f005affd640 1 -- 172.21.15.120:0/1226450278 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f006c150a30 con 0x7f006c0d1f30 2023-11-26T07:17:41.516 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:41.511+0000 7f68ef460180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:41.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.535+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e850d242-cf65-409f-809e-16d5626a8026", "id": 7} v 0) v1 -- 0x7f006c067680 con 0x7f006c0d1f30 2023-11-26T07:17:41.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f005affd640 1 -- 172.21.15.120:0/1226450278 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e850d242-cf65-409f-809e-16d5626a8026", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00600cc0b0 con 0x7f006c0d1f30 2023-11-26T07:17:41.545 INFO:teuthology.orchestra.run.smithi120.stdout:7 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f006c0d1f30 msgr2=0x7f006c0cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f006c0d1f30 0x7f006c0cbce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00600ac000 tx=0x7f00600192a0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 shutdown_connections 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f006c15d5b0 0x7f006c0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f006c0d1f30 0x7f006c0cbce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 --2- 172.21.15.120:0/1226450278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f006c0b36b0 0x7f006c0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 >> 172.21.15.120:0/1226450278 conn(0x7f006c08cc60 msgr2=0x7f006c06c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 shutdown_connections 2023-11-26T07:17:41.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:17:41.539+0000 7f00709c4640 1 -- 172.21.15.120:0/1226450278 wait complete. 2023-11-26T07:17:41.564 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-26T07:17:41.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-26T07:17:41.575 INFO:tasks.ceph.osd.0:Started 2023-11-26T07:17:41.575 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-26T07:17:41.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-26T07:17:41.581 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:41.575+0000 7f68ef460180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-26T07:17:41.587 INFO:tasks.ceph.osd.1:Started 2023-11-26T07:17:41.587 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-26T07:17:41.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-26T07:17:41.595 INFO:tasks.ceph.osd.2:Started 2023-11-26T07:17:41.596 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-26T07:17:41.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-26T07:17:41.605 INFO:tasks.ceph.osd.3:Started 2023-11-26T07:17:41.605 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-26T07:17:41.605 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-26T07:17:41.610 INFO:tasks.ceph.osd.4:Started 2023-11-26T07:17:41.610 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-26T07:17:41.611 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-26T07:17:41.615 INFO:tasks.ceph.osd.5:Started 2023-11-26T07:17:41.615 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-26T07:17:41.616 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-26T07:17:41.620 INFO:tasks.ceph.osd.6:Started 2023-11-26T07:17:41.620 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-26T07:17:41.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-26T07:17:41.626 INFO:tasks.ceph.osd.7:Started 2023-11-26T07:17:41.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:41.652 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:41.647+0000 7f68ef460180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-26T07:17:41.770 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:41.767+0000 7f68ef460180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-26T07:17:41.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 Processor -- start 2023-11-26T07:17:41.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 -- start start 2023-11-26T07:17:41.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdf0c15d6e0 0x7fdf0c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdf0c0d19f0 0x7fdf0c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c15dac0 con 0x7fdf0c0d19f0 2023-11-26T07:17:41.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0d1e80 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf12491640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0cf0e0 con 0x7fdf0c0b2160 2023-11-26T07:17:41.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdf0c0d19f0 0x7fdf0c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdf0c0d19f0 0x7fdf0c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33034/0 (socket says 172.21.15.70:33034) 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 -- 172.21.15.70:0/4047350999 learned_addr learned my addr 172.21.15.70:0/4047350999 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf0bfff640 1 --2- 172.21.15.70:0/4047350999 >> v2:172.21.15.120:3300/0 conn(0x7fdf0c15d6e0 0x7fdf0c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf0b7fe640 1 --2- 172.21.15.70:0/4047350999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 -- 172.21.15.70:0/4047350999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 msgr2=0x7fdf0c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 --2- 172.21.15.70:0/4047350999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c0d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 -- 172.21.15.70:0/4047350999 >> v2:172.21.15.120:3300/0 conn(0x7fdf0c15d6e0 msgr2=0x7fdf0c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 --2- 172.21.15.70:0/4047350999 >> v2:172.21.15.120:3300/0 conn(0x7fdf0c15d6e0 0x7fdf0c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf10a2e640 1 -- 172.21.15.70:0/4047350999 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0ceb20 con 0x7fdf0c0d19f0 2023-11-26T07:17:41.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.796+0000 7fdf0b7fe640 1 --2- 172.21.15.70:0/4047350999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:41.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf10a2e640 1 --2- 172.21.15.70:0/4047350999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c0d19f0 0x7fdf0c0cfbf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0b5db0 tx=0x7fdf0401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16e4dd01bb6a0e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf0affd640 1 -- 172.21.15.70:0/4047350999 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040a6490 con 0x7fdf0c0d19f0 2023-11-26T07:17:41.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf0affd640 1 -- 172.21.15.70:0/4047350999 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf040a65f0 con 0x7fdf0c0d19f0 2023-11-26T07:17:41.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf0affd640 1 -- 172.21.15.70:0/4047350999 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040a6980 con 0x7fdf0c0d19f0 2023-11-26T07:17:41.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 -- 172.21.15.70:0/4047350999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c0d19f0 msgr2=0x7fdf0c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 --2- 172.21.15.70:0/4047350999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c0d19f0 0x7fdf0c0cfbf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0b5db0 tx=0x7fdf0401c710 comp rx=0 tx=0).stop 2023-11-26T07:17:41.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 -- 172.21.15.70:0/4047350999 shutdown_connections 2023-11-26T07:17:41.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 --2- 172.21.15.70:0/4047350999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c0d19f0 0x7fdf0c0cfbf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 --2- 172.21.15.70:0/4047350999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 --2- 172.21.15.70:0/4047350999 >> v2:172.21.15.120:3300/0 conn(0x7fdf0c15d6e0 0x7fdf0c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 -- 172.21.15.70:0/4047350999 >> 172.21.15.70:0/4047350999 conn(0x7fdf0c09c550 msgr2=0x7fdf0c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 -- 172.21.15.70:0/4047350999 shutdown_connections 2023-11-26T07:17:41.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.800+0000 7fdf12491640 1 -- 172.21.15.70:0/4047350999 wait complete. 2023-11-26T07:17:41.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 Processor -- start 2023-11-26T07:17:41.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 -- start start 2023-11-26T07:17:41.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf0c0d19f0 0x7fdf0c15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c15d6e0 0x7fdf0c0cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c155300 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1555e0 con 0x7fdf0c0d19f0 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1558c0 con 0x7fdf0c0b2160 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c15d6e0 0x7fdf0c0cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c15d6e0 0x7fdf0c0cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33050/0 (socket says 172.21.15.70:33050) 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 -- 172.21.15.70:0/952504180 learned_addr learned my addr 172.21.15.70:0/952504180 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf0bfff640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf0b7fe640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf0c0d19f0 0x7fdf0c15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:41.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 -- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 msgr2=0x7fdf0c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 -- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf0c0d19f0 msgr2=0x7fdf0c15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf0c0d19f0 0x7fdf0c15a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 -- 172.21.15.70:0/952504180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009b30 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf10a2e640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c15d6e0 0x7fdf0c0cad00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf0401cfb0 tx=0x7fdf040194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf08ff9640 1 -- 172.21.15.70:0/952504180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040a6490 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf08ff9640 1 -- 172.21.15.70:0/952504180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf040a7670 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf08ff9640 1 -- 172.21.15.70:0/952504180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040a7a00 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.804+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c155ba0 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.808+0000 7fdf08ff9640 1 -- 172.21.15.70:0/952504180 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf040bb440 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.808+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c160300 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.808+0000 7fdf08ff9640 1 -- 172.21.15.70:0/952504180 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fdf040b1420 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.808+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c155de0 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.824+0000 7fdf08ff9640 1 -- 172.21.15.70:0/952504180 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fdf0c155de0 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.831 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:41.827+0000 7f68ef460180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-26T07:17:41.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf0c067680 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf08ff9640 1 -- 172.21.15.70:0/952504180 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdf040cb020 con 0x7fdf0c15d6e0 2023-11-26T07:17:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:41.884 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:17:41.541729+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c15d6e0 msgr2=0x7fdf0c0cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c15d6e0 0x7fdf0c0cad00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf0401cfb0 tx=0x7fdf040194b0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 shutdown_connections 2023-11-26T07:17:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf0c15d6e0 0x7fdf0c0cad00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf0c0d19f0 0x7fdf0c15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 --2- 172.21.15.70:0/952504180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdf0c0b2160 0x7fdf0c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:41.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 >> 172.21.15.70:0/952504180 conn(0x7fdf0c09c550 msgr2=0x7fdf0c15f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:41.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 shutdown_connections 2023-11-26T07:17:41.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:41.880+0000 7fdf12491640 1 -- 172.21.15.70:0/952504180 wait complete. 2023-11-26T07:17:41.904 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-26T07:17:41.904 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-26T07:17:41.919 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:41.915+0000 7f68ef460180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-26T07:17:41.948 INFO:tasks.ceph.mgr.y.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-26T07:17:41.948 INFO:tasks.ceph.mgr.y.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-26T07:17:41.948 INFO:tasks.ceph.mgr.y.smithi070.stderr: from numpy import show_config as show_numpy_config 2023-11-26T07:17:41.979 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:41.975+0000 7f68ef460180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-26T07:17:42.007 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:42.004+0000 7ff30aad3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-26T07:17:42.137 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:42.131+0000 7f68ef460180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-26T07:17:42.143 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:42.140+0000 7ff30aad3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:42.205 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:42.199+0000 7f68ef460180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-26T07:17:42.267 INFO:tasks.ceph.osd.5.smithi120.stderr:2023-11-26T07:17:42.263+0000 7fc6b1b67640 -1 Falling back to public interface 2023-11-26T07:17:42.284 INFO:tasks.ceph.osd.3.smithi070.stderr:2023-11-26T07:17:42.280+0000 7efe0256e640 -1 Falling back to public interface 2023-11-26T07:17:42.284 INFO:tasks.ceph.osd.1.smithi070.stderr:2023-11-26T07:17:42.280+0000 7f9fc8b13640 -1 Falling back to public interface 2023-11-26T07:17:42.285 INFO:tasks.ceph.osd.2.smithi070.stderr:2023-11-26T07:17:42.280+0000 7f67e7c9e640 -1 Falling back to public interface 2023-11-26T07:17:42.285 INFO:tasks.ceph.osd.2.smithi070.stderr:2023-11-26T07:17:42.280+0000 7f67e6c5f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2023-11-26T07:17:42.292 INFO:tasks.ceph.osd.6.smithi120.stderr:2023-11-26T07:17:42.287+0000 7fd4b8a7e640 -1 Falling back to public interface 2023-11-26T07:17:42.292 INFO:tasks.ceph.osd.7.smithi120.stderr:2023-11-26T07:17:42.287+0000 7fcba5dc6640 -1 Falling back to public interface 2023-11-26T07:17:42.293 INFO:tasks.ceph.osd.6.smithi120.stderr:2023-11-26T07:17:42.287+0000 7fd4b7a3f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-11-26T07:17:42.307 INFO:tasks.ceph.osd.0.smithi070.stderr:2023-11-26T07:17:42.304+0000 7fa19062b640 -1 Falling back to public interface 2023-11-26T07:17:42.312 INFO:tasks.ceph.osd.4.smithi120.stderr:2023-11-26T07:17:42.307+0000 7f6e699a7640 -1 Falling back to public interface 2023-11-26T07:17:42.315 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:42.312+0000 7ff30aad3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:42.388 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:42.384+0000 7ff30aad3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-26T07:17:42.526 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:42.520+0000 7ff30aad3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:42.708 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:42.834 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.828+0000 7fa33e33e640 1 Processor -- start 2023-11-26T07:17:42.834 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.828+0000 7fa33e33e640 1 -- start start 2023-11-26T07:17:42.835 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa33e33e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa3380d1e20 0x7fa3380cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.835 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa33e33e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380cf510 0x7fa33815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.835 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa33e33e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380ce470 con 0x7fa3380d1a40 2023-11-26T07:17:42.836 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa33e33e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3380cf960 con 0x7fa3380d1e20 2023-11-26T07:17:42.836 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa33e33e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380ce750 con 0x7fa3380cf510 2023-11-26T07:17:42.836 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa3377fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa3380d1e20 0x7fa3380cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.836 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa33c8db640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380cf510 0x7fa33815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.836 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa337fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa3380d1a40 0x7fa3380b4540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:57742/0 (socket says 172.21.15.70:57742) 2023-11-26T07:17:42.837 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa3377fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa3380d1e20 0x7fa3380cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:42168/0 (socket says 172.21.15.70:42168) 2023-11-26T07:17:42.837 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa337fff640 1 -- 172.21.15.70:0/645768376 learned_addr learned my addr 172.21.15.70:0/645768376 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:17:42.837 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa3377fe640 1 -- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380cf510 msgr2=0x7fa33815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:42.837 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa3377fe640 1 --2- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380cf510 0x7fa33815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.837 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa3377fe640 1 -- 172.21.15.70:0/645768376 >> v1:172.21.15.120:6789/0 conn(0x7fa3380d1a40 legacy=0x7fa3380b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.837 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa3377fe640 1 -- 172.21.15.70:0/645768376 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3380cea30 con 0x7fa3380d1e20 2023-11-26T07:17:42.837 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.832+0000 7fa33c8db640 1 --2- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380cf510 0x7fa33815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:42.838 INFO:tasks.ceph.mgr.x.smithi120.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-26T07:17:42.838 INFO:tasks.ceph.mgr.x.smithi120.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-26T07:17:42.839 INFO:tasks.ceph.mgr.x.smithi120.stderr: from numpy import show_config as show_numpy_config 2023-11-26T07:17:42.839 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa3377fe640 1 --2- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1e20 0x7fa3380cde70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0097c0 tx=0x7fa32c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c64fd521ad271c17 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.839 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa336ffd640 1 -- 172.21.15.70:0/645768376 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0a8970 con 0x7fa3380d1e20 2023-11-26T07:17:42.840 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa336ffd640 1 -- 172.21.15.70:0/645768376 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c0a8ad0 con 0x7fa3380d1e20 2023-11-26T07:17:42.840 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa336ffd640 1 -- 172.21.15.70:0/645768376 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0a8e60 con 0x7fa3380d1e20 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 -- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1e20 msgr2=0x7fa3380cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 --2- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1e20 0x7fa3380cde70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa32c0097c0 tx=0x7fa32c01ec70 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 -- 172.21.15.70:0/645768376 shutdown_connections 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 --2- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380cf510 0x7fa33815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 --2- 172.21.15.70:0/645768376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1e20 0x7fa3380cde70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 -- 172.21.15.70:0/645768376 >> 172.21.15.70:0/645768376 conn(0x7fa33808ccb0 msgr2=0x7fa33809c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 -- 172.21.15.70:0/645768376 shutdown_connections 2023-11-26T07:17:42.841 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 -- 172.21.15.70:0/645768376 wait complete. 2023-11-26T07:17:42.842 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 Processor -- start 2023-11-26T07:17:42.842 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.836+0000 7fa33e33e640 1 -- start start 2023-11-26T07:17:42.844 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3380cf510 0x7fa3380cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.844 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1a40 0x7fa3380cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.844 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380d1e20 0x7fa3381f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:42.844 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cc9b0 con 0x7fa3380cf510 2023-11-26T07:17:42.844 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815dd30 con 0x7fa3380d1a40 2023-11-26T07:17:42.844 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815e010 con 0x7fa3380d1e20 2023-11-26T07:17:42.844 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3380cf510 0x7fa3380cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3380cf510 0x7fa3380cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33058/0 (socket says 172.21.15.70:33058) 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 -- 172.21.15.70:0/499008315 learned_addr learned my addr 172.21.15.70:0/499008315 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33c8db640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380d1e20 0x7fa3381f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa3377fe640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1a40 0x7fa3380cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 -- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380d1e20 msgr2=0x7fa3381f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380d1e20 0x7fa3381f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 -- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1a40 msgr2=0x7fa3380cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1a40 0x7fa3380cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.845 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 -- 172.21.15.70:0/499008315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009a70 con 0x7fa3380cf510 2023-11-26T07:17:42.846 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa337fff640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3380cf510 0x7fa3380cad40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c500 tx=0x7fa32800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa334ff9640 1 -- 172.21.15.70:0/499008315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328005cf0 con 0x7fa3380cf510 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa334ff9640 1 -- 172.21.15.70:0/499008315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328005e50 con 0x7fa3380cf510 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa334ff9640 1 -- 172.21.15.70:0/499008315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280072f0 con 0x7fa3380cf510 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c009420 con 0x7fa3380cf510 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33815e5d0 con 0x7fa3380cf510 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa334ff9640 1 -- 172.21.15.70:0/499008315 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa32801c440 con 0x7fa3380cf510 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa334ff9640 1 -- 172.21.15.70:0/499008315 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa328012b60 con 0x7fa3380cf510 2023-11-26T07:17:42.847 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.840+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33815e7c0 con 0x7fa3380cf510 2023-11-26T07:17:42.848 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.844+0000 7fa334ff9640 1 -- 172.21.15.70:0/499008315 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa328021060 con 0x7fa3380cf510 2023-11-26T07:17:42.898 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:42.891+0000 7f68ef460180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-26T07:17:42.917 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.912+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa338067680 con 0x7fa3380cf510 2023-11-26T07:17:42.917 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.912+0000 7fa334ff9640 1 -- 172.21.15.70:0/499008315 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa328017070 con 0x7fa3380cf510 2023-11-26T07:17:42.918 INFO:teuthology.misc.health.smithi070.stdout: 2023-11-26T07:17:42.918 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":10,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:17:41.541729+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:42.919 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3380cf510 msgr2=0x7fa3380cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:42.919 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3380cf510 0x7fa3380cad40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa32800c500 tx=0x7fa32800c9c0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.919 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 shutdown_connections 2023-11-26T07:17:42.919 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3380d1e20 0x7fa3381f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.919 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3380d1a40 0x7fa3380cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.919 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 --2- 172.21.15.70:0/499008315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3380cf510 0x7fa3380cad40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:42.920 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 >> 172.21.15.70:0/499008315 conn(0x7fa33808ccb0 msgr2=0x7fa3380c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:42.920 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 shutdown_connections 2023-11-26T07:17:42.920 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:42.916+0000 7fa33e33e640 1 -- 172.21.15.70:0/499008315 wait complete. 2023-11-26T07:17:42.936 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-26T07:17:43.035 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:43.031+0000 7f68ef460180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:43.217 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:43.211+0000 7f68ef460180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-26T07:17:43.218 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:43.212+0000 7ff30aad3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-26T07:17:43.290 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:43.287+0000 7f68ef460180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-26T07:17:43.305 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:43.300+0000 7ff30aad3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-26T07:17:43.428 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:43.423+0000 7f68ef460180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-26T07:17:43.494 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:43.488+0000 7ff30aad3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-26T07:17:43.580 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:43.576+0000 7ff30aad3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-26T07:17:43.906 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:43.900+0000 7ff30aad3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-26T07:17:43.974 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:43.968+0000 7ff30aad3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-26T07:17:44.121 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:44.115+0000 7f68ef460180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-26T07:17:44.208 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:44.203+0000 7f68ef460180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-26T07:17:44.398 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:44.395+0000 7f68ef460180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-26T07:17:44.484 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:44.479+0000 7f68ef460180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-26T07:17:44.812 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:44.807+0000 7f68ef460180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-26T07:17:44.879 INFO:tasks.ceph.mgr.x.smithi120.stderr:2023-11-26T07:17:44.875+0000 7f68ef460180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-26T07:17:44.995 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:44.992+0000 7ff2b2153640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-26T07:17:44.995 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:17:44.992+0000 7ff2b2153640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-26T07:17:46.193 INFO:tasks.ceph.osd.5.smithi120.stderr:2023-11-26T07:17:46.187+0000 7fc6b1b67640 -1 osd.5 0 log_to_monitors true 2023-11-26T07:17:46.210 INFO:tasks.ceph.osd.7.smithi120.stderr:2023-11-26T07:17:46.207+0000 7fcba5dc6640 -1 osd.7 0 log_to_monitors true 2023-11-26T07:17:46.229 INFO:tasks.ceph.osd.0.smithi070.stderr:2023-11-26T07:17:46.224+0000 7fa19062b640 -1 osd.0 0 log_to_monitors true 2023-11-26T07:17:46.255 INFO:tasks.ceph.osd.1.smithi070.stderr:2023-11-26T07:17:46.252+0000 7f9fc8b13640 -1 osd.1 0 log_to_monitors true 2023-11-26T07:17:46.268 INFO:tasks.ceph.osd.4.smithi120.stderr:2023-11-26T07:17:46.263+0000 7f6e699a7640 -1 osd.4 0 log_to_monitors true 2023-11-26T07:17:46.286 INFO:tasks.ceph.osd.2.smithi070.stderr:2023-11-26T07:17:46.280+0000 7f67e7c9e640 -1 osd.2 0 log_to_monitors true 2023-11-26T07:17:46.293 INFO:tasks.ceph.osd.3.smithi070.stderr:2023-11-26T07:17:46.288+0000 7efe0256e640 -1 osd.3 0 log_to_monitors true 2023-11-26T07:17:46.321 INFO:tasks.ceph.osd.6.smithi120.stderr:2023-11-26T07:17:46.315+0000 7fd4b8a7e640 -1 osd.6 0 log_to_monitors true 2023-11-26T07:17:49.556 INFO:tasks.ceph.osd.1.smithi070.stderr:2023-11-26T07:17:49.552+0000 7f9fc429a640 -1 osd.1 0 waiting for initial osdmap 2023-11-26T07:17:49.572 INFO:tasks.ceph.osd.2.smithi070.stderr:2023-11-26T07:17:49.568+0000 7f67e3425640 -1 osd.2 0 waiting for initial osdmap 2023-11-26T07:17:49.580 INFO:tasks.ceph.osd.1.smithi070.stderr:2023-11-26T07:17:49.576+0000 7f9fbc8e7640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:49.588 INFO:tasks.ceph.osd.3.smithi070.stderr:2023-11-26T07:17:49.584+0000 7efdfdcf5640 -1 osd.3 0 waiting for initial osdmap 2023-11-26T07:17:49.608 INFO:tasks.ceph.osd.2.smithi070.stderr:2023-11-26T07:17:49.604+0000 7f67dba72640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:49.614 INFO:tasks.ceph.osd.0.smithi070.stderr:2023-11-26T07:17:49.608+0000 7fa18b375640 -1 osd.0 0 waiting for initial osdmap 2023-11-26T07:17:49.628 INFO:tasks.ceph.osd.3.smithi070.stderr:2023-11-26T07:17:49.624+0000 7efdf6342640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:49.664 INFO:tasks.ceph.osd.0.smithi070.stderr:2023-11-26T07:17:49.660+0000 7fa1839c2640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:49.741 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:49.870 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.864+0000 7f9df8fe7640 1 Processor -- start 2023-11-26T07:17:49.870 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.864+0000 7f9df8fe7640 1 -- start start 2023-11-26T07:17:49.871 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df8fe7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9df406c290 0x7f9df415c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df8fe7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9df40b2a10 0x7f9df40cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df8fe7640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df40b2ea0 con 0x7f9df406c670 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df8fe7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df415be40 con 0x7f9df406c290 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df8fe7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40ccd60 con 0x7f9df40b2a10 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9df406c290 0x7f9df415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9df406c290 0x7f9df415c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47716/0 (socket says 172.21.15.70:47716) 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df259c640 1 -- 172.21.15.70:0/4251611110 learned_addr learned my addr 172.21.15.70:0/4251611110 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:49.872 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9de9d9b640 1 --2- 172.21.15.70:0/4251611110 >> v2:172.21.15.120:3300/0 conn(0x7f9df40b2a10 0x7f9df40cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.873 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df259c640 1 -- 172.21.15.70:0/4251611110 >> v2:172.21.15.120:3300/0 conn(0x7f9df40b2a10 msgr2=0x7f9df40cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.873 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df259c640 1 --2- 172.21.15.70:0/4251611110 >> v2:172.21.15.120:3300/0 conn(0x7f9df40b2a10 0x7f9df40cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.873 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df259c640 1 -- 172.21.15.70:0/4251611110 >> v1:172.21.15.120:6789/0 conn(0x7f9df406c670 legacy=0x7f9df415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:49.873 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.868+0000 7f9df259c640 1 -- 172.21.15.70:0/4251611110 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40ccf70 con 0x7f9df406c290 2023-11-26T07:17:49.875 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df259c640 1 --2- 172.21.15.70:0/4251611110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df406c290 0x7f9df415c260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9df40ce340 tx=0x7f9de401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5029efbea4bec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.875 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df1d9b640 1 -- 172.21.15.70:0/4251611110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de40aa5f0 con 0x7f9df406c290 2023-11-26T07:17:49.875 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df1d9b640 1 -- 172.21.15.70:0/4251611110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40aa750 con 0x7f9df406c290 2023-11-26T07:17:49.875 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df1d9b640 1 -- 172.21.15.70:0/4251611110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de40aaae0 con 0x7f9df406c290 2023-11-26T07:17:49.876 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 -- 172.21.15.70:0/4251611110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df406c290 msgr2=0x7f9df415c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.876 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/4251611110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df406c290 0x7f9df415c260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9df40ce340 tx=0x7f9de401c490 comp rx=0 tx=0).stop 2023-11-26T07:17:49.876 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 -- 172.21.15.70:0/4251611110 shutdown_connections 2023-11-26T07:17:49.876 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/4251611110 >> v2:172.21.15.120:3300/0 conn(0x7f9df40b2a10 0x7f9df40cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.877 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/4251611110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df406c290 0x7f9df415c260 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.877 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 -- 172.21.15.70:0/4251611110 >> 172.21.15.70:0/4251611110 conn(0x7f9df406dc00 msgr2=0x7f9df406a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:49.877 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 -- 172.21.15.70:0/4251611110 shutdown_connections 2023-11-26T07:17:49.877 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 -- 172.21.15.70:0/4251611110 wait complete. 2023-11-26T07:17:49.878 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 Processor -- start 2023-11-26T07:17:49.878 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.872+0000 7f9df8fe7640 1 -- start start 2023-11-26T07:17:49.880 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df406c290 0x7f9df415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.880 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9df406c670 0x7f9df413e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.880 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df40b2a10 0x7f9df4154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.880 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df41f6210 con 0x7f9df40b2a10 2023-11-26T07:17:49.880 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df413e7e0 con 0x7f9df406c290 2023-11-26T07:17:49.880 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df415c670 con 0x7f9df406c670 2023-11-26T07:17:49.880 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df40b2a10 0x7f9df4154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df406c290 0x7f9df415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df40b2a10 0x7f9df4154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47730/0 (socket says 172.21.15.70:47730) 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 -- 172.21.15.70:0/2760489356 learned_addr learned my addr 172.21.15.70:0/2760489356 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9de9d9b640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9df406c670 0x7f9df413e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 -- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9df406c670 msgr2=0x7f9df413e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9df406c670 0x7f9df413e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 -- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df406c290 msgr2=0x7f9df415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df406c290 0x7f9df415a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 -- 172.21.15.70:0/2760489356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40094d0 con 0x7f9df40b2a10 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df259c640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df406c290 0x7f9df415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:17:49.881 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df2d9d640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df40b2a10 0x7f9df4154f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c3c0 tx=0x7f9dec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.882 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9deb7fe640 1 -- 172.21.15.70:0/2760489356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011790 con 0x7f9df40b2a10 2023-11-26T07:17:49.882 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9deb7fe640 1 -- 172.21.15.70:0/2760489356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec0118f0 con 0x7f9df40b2a10 2023-11-26T07:17:49.882 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9deb7fe640 1 -- 172.21.15.70:0/2760489356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011ca0 con 0x7f9df40b2a10 2023-11-26T07:17:49.883 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df413ea20 con 0x7f9df40b2a10 2023-11-26T07:17:49.883 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df413efe0 con 0x7f9df40b2a10 2023-11-26T07:17:49.883 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df4067680 con 0x7f9df40b2a10 2023-11-26T07:17:49.883 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.876+0000 7f9deb7fe640 1 -- 172.21.15.70:0/2760489356 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f9dec01c460 con 0x7f9df40b2a10 2023-11-26T07:17:49.883 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.880+0000 7f9deb7fe640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9dd4066410 0x7f9dd40688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:49.883 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.880+0000 7f9deb7fe640 1 -- 172.21.15.70:0/2760489356 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f9dec082f30 con 0x7f9df40b2a10 2023-11-26T07:17:49.884 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.880+0000 7f9df259c640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9dd4066410 0x7f9dd40688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:49.884 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.880+0000 7f9df259c640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9dd4066410 0x7f9dd40688d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9de40ae000 tx=0x7f9de40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:49.888 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:49.884+0000 7f9deb7fe640 1 -- 172.21.15.70:0/2760489356 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dec0510f0 con 0x7f9df40b2a10 2023-11-26T07:17:50.043 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9df415c7b0 con 0x7f9df40b2a10 2023-11-26T07:17:50.044 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9deb7fe640 1 -- 172.21.15.70:0/2760489356 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9dec003810 con 0x7f9df40b2a10 2023-11-26T07:17:50.044 INFO:teuthology.misc.health.smithi070.stdout: 2023-11-26T07:17:50.044 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":12,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:17:47.772547+0000","last_up_change":"0.000000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:50.046 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9dd4066410 msgr2=0x7f9dd40688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.046 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9dd4066410 0x7f9dd40688d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9de40ae000 tx=0x7f9de40a7000 comp rx=0 tx=0).stop 2023-11-26T07:17:50.047 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df40b2a10 msgr2=0x7f9df4154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:50.047 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df40b2a10 0x7f9df4154f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00c3c0 tx=0x7f9dec00c880 comp rx=0 tx=0).stop 2023-11-26T07:17:50.047 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 shutdown_connections 2023-11-26T07:17:50.047 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9dd4066410 0x7f9dd40688d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.047 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9df40b2a10 0x7f9df4154f40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.047 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9df406c670 0x7f9df413e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.047 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 --2- 172.21.15.70:0/2760489356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9df406c290 0x7f9df415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:50.048 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 >> 172.21.15.70:0/2760489356 conn(0x7f9df406dc00 msgr2=0x7f9df40af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:50.048 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 shutdown_connections 2023-11-26T07:17:50.048 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:50.040+0000 7f9df8fe7640 1 -- 172.21.15.70:0/2760489356 wait complete. 2023-11-26T07:17:50.064 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-26T07:17:50.203 INFO:tasks.ceph.osd.4.smithi120.stderr:2023-11-26T07:17:50.199+0000 7f6e66964640 -1 osd.4 0 waiting for initial osdmap 2023-11-26T07:17:50.211 INFO:tasks.ceph.osd.6.smithi120.stderr:2023-11-26T07:17:50.207+0000 7fd4b4205640 -1 osd.6 0 waiting for initial osdmap 2023-11-26T07:17:50.219 INFO:tasks.ceph.osd.7.smithi120.stderr:2023-11-26T07:17:50.215+0000 7fcba154f640 -1 osd.7 0 waiting for initial osdmap 2023-11-26T07:17:50.232 INFO:tasks.ceph.osd.5.smithi120.stderr:2023-11-26T07:17:50.227+0000 7fc6ad2f0640 -1 osd.5 0 waiting for initial osdmap 2023-11-26T07:17:50.236 INFO:tasks.ceph.osd.4.smithi120.stderr:2023-11-26T07:17:50.231+0000 7f6e5d77b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:50.243 INFO:tasks.ceph.osd.6.smithi120.stderr:2023-11-26T07:17:50.239+0000 7fd4ac852640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:50.256 INFO:tasks.ceph.osd.7.smithi120.stderr:2023-11-26T07:17:50.251+0000 7fcb99b9c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:50.283 INFO:tasks.ceph.osd.5.smithi120.stderr:2023-11-26T07:17:50.279+0000 7fc6a593d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-26T07:17:56.869 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:57.009 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.004+0000 7ff2c0679640 1 Processor -- start 2023-11-26T07:17:57.009 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.004+0000 7ff2c0679640 1 -- start start 2023-11-26T07:17:57.010 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.004+0000 7ff2c0679640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff2b813d0c0 0x7ff2b815b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.010 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.004+0000 7ff2c0679640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.010 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.004+0000 7ff2c0679640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b80cecd0 con 0x7ff2b813fcb0 2023-11-26T07:17:57.011 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.004+0000 7ff2c0679640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b813d4a0 con 0x7ff2b813d0c0 2023-11-26T07:17:57.011 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.004+0000 7ff2c0679640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b8140140 con 0x7ff2b80cd8c0 2023-11-26T07:17:57.011 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bdc14640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.011 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2be415640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff2b813d0c0 0x7ff2b815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.011 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bdc14640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:33464/0 (socket says 172.21.15.70:33464) 2023-11-26T07:17:57.011 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bec16640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff2b813fcb0 0x7ff2b815dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:47840/0 (socket says 172.21.15.70:47840) 2023-11-26T07:17:57.011 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bdc14640 1 -- 172.21.15.70:0/704510715 learned_addr learned my addr 172.21.15.70:0/704510715 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:57.012 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bd413640 1 -- 172.21.15.70:0/704510715 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250839096 0 0) 0x7ff2b80cecd0 con 0x7ff2b813fcb0 2023-11-26T07:17:57.012 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bd413640 1 -- 172.21.15.70:0/704510715 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a4003530 con 0x7ff2b813fcb0 2023-11-26T07:17:57.012 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bdc14640 1 -- 172.21.15.70:0/704510715 >> v2:172.21.15.120:3300/0 conn(0x7ff2b813d0c0 msgr2=0x7ff2b815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:57.013 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bdc14640 1 --2- 172.21.15.70:0/704510715 >> v2:172.21.15.120:3300/0 conn(0x7ff2b813d0c0 0x7ff2b815b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.013 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bdc14640 1 -- 172.21.15.70:0/704510715 >> v1:172.21.15.120:6789/0 conn(0x7ff2b813fcb0 legacy=0x7ff2b815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.013 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2bdc14640 1 -- 172.21.15.70:0/704510715 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b80ce0c0 con 0x7ff2b80cd8c0 2023-11-26T07:17:57.013 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.008+0000 7ff2be415640 1 --2- 172.21.15.70:0/704510715 >> v2:172.21.15.120:3300/0 conn(0x7ff2b813d0c0 0x7ff2b815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:57.014 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2bdc14640 1 --2- 172.21.15.70:0/704510715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009870 tx=0x7ff2a801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91abcbcb84f46c4a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.015 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2bd413640 1 -- 172.21.15.70:0/704510715 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80aa670 con 0x7ff2b80cd8c0 2023-11-26T07:17:57.015 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2bd413640 1 -- 172.21.15.70:0/704510715 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a80aa7d0 con 0x7ff2b80cd8c0 2023-11-26T07:17:57.015 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2bd413640 1 -- 172.21.15.70:0/704510715 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80aab40 con 0x7ff2b80cd8c0 2023-11-26T07:17:57.016 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- 172.21.15.70:0/704510715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 msgr2=0x7ff2b813f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.016 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 --2- 172.21.15.70:0/704510715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009870 tx=0x7ff2a801c510 comp rx=0 tx=0).stop 2023-11-26T07:17:57.016 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- 172.21.15.70:0/704510715 shutdown_connections 2023-11-26T07:17:57.016 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 --2- 172.21.15.70:0/704510715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.016 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 --2- 172.21.15.70:0/704510715 >> v2:172.21.15.120:3300/0 conn(0x7ff2b813d0c0 0x7ff2b815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.017 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- 172.21.15.70:0/704510715 >> 172.21.15.70:0/704510715 conn(0x7ff2b806dc00 msgr2=0x7ff2b806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.017 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- 172.21.15.70:0/704510715 shutdown_connections 2023-11-26T07:17:57.017 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- 172.21.15.70:0/704510715 wait complete. 2023-11-26T07:17:57.017 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 Processor -- start 2023-11-26T07:17:57.017 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- start start 2023-11-26T07:17:57.019 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.019 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2b813d0c0 0x7ff2b80ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.019 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b813fcb0 0x7ff2b8137400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.019 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b813f850 con 0x7ff2b813fcb0 2023-11-26T07:17:57.019 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b81431f0 con 0x7ff2b813d0c0 2023-11-26T07:17:57.019 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.012+0000 7ff2c0679640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80aec80 con 0x7ff2b80cd8c0 2023-11-26T07:17:57.019 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b813fcb0 0x7ff2b8137400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.020 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b813fcb0 0x7ff2b8137400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60666/0 (socket says 172.21.15.70:60666) 2023-11-26T07:17:57.020 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 -- 172.21.15.70:0/2762131240 learned_addr learned my addr 172.21.15.70:0/2762131240 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:57.020 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2be415640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.020 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bdc14640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2b813d0c0 0x7ff2b80ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.021 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 -- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 msgr2=0x7ff2b813f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.021 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.021 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 -- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2b813d0c0 msgr2=0x7ff2b80ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.021 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2b813d0c0 0x7ff2b80ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.021 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 -- 172.21.15.70:0/2762131240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4009420 con 0x7ff2b813fcb0 2023-11-26T07:17:57.021 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2be415640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:57.021 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2bec16640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b813fcb0 0x7ff2b8137400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c7f0 tx=0x7ff2b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.022 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2aeffd640 1 -- 172.21.15.70:0/2762131240 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000a640 con 0x7ff2b813fcb0 2023-11-26T07:17:57.022 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2aeffd640 1 -- 172.21.15.70:0/2762131240 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b000a7a0 con 0x7ff2b813fcb0 2023-11-26T07:17:57.022 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a80094d0 con 0x7ff2b813fcb0 2023-11-26T07:17:57.022 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2aeffd640 1 -- 172.21.15.70:0/2762131240 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000ab10 con 0x7ff2b813fcb0 2023-11-26T07:17:57.022 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b80b3de0 con 0x7ff2b813fcb0 2023-11-26T07:17:57.022 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b80cdd20 con 0x7ff2b813fcb0 2023-11-26T07:17:57.022 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.016+0000 7ff2aeffd640 1 -- 172.21.15.70:0/2762131240 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2b000ac70 con 0x7ff2b813fcb0 2023-11-26T07:17:57.023 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.020+0000 7ff2aeffd640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff29c066470 0x7ff29c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.023 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.020+0000 7ff2aeffd640 1 -- 172.21.15.70:0/2762131240 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff2b0083330 con 0x7ff2b813fcb0 2023-11-26T07:17:57.023 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.020+0000 7ff2be415640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff29c066470 0x7ff29c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.023 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.020+0000 7ff2be415640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff29c066470 0x7ff29c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009fd0 tx=0x7ff2b4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.027 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.024+0000 7ff2aeffd640 1 -- 172.21.15.70:0/2762131240 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2b80cdd20 con 0x7ff2b813fcb0 2023-11-26T07:17:57.178 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.172+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2b81433a0 con 0x7ff2b813fcb0 2023-11-26T07:17:57.179 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2aeffd640 1 -- 172.21.15.70:0/2762131240 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7ff2b81433a0 con 0x7ff2b813fcb0 2023-11-26T07:17:57.179 INFO:teuthology.misc.health.smithi070.stdout: 2023-11-26T07:17:57.179 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":17,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:17:54.944662+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:57.181 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff29c066470 msgr2=0x7ff29c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.181 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff29c066470 0x7ff29c068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009fd0 tx=0x7ff2b4009190 comp rx=0 tx=0).stop 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b813fcb0 msgr2=0x7ff2b8137400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b813fcb0 0x7ff2b8137400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c7f0 tx=0x7ff2b000ccb0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 shutdown_connections 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff29c066470 0x7ff29c068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b813fcb0 0x7ff2b8137400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2b813d0c0 0x7ff2b80ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 --2- 172.21.15.70:0/2762131240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2b80cd8c0 0x7ff2b813f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 >> 172.21.15.70:0/2762131240 conn(0x7ff2b806dc00 msgr2=0x7ff2b806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 shutdown_connections 2023-11-26T07:17:57.182 INFO:teuthology.misc.health.smithi070.stderr:2023-11-26T07:17:57.176+0000 7ff2c0679640 1 -- 172.21.15.70:0/2762131240 wait complete. 2023-11-26T07:17:57.198 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-26T07:17:57.198 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-26T07:17:57.199 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:17:57.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:17:57.202 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:17:57.202 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:17:57.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:17:57.206 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:17:57.206 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:17:57.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:17:57.210 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:17:57.210 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:17:57.211 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:17:57.215 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:17:57.215 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-26T07:17:57.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:17:57.305 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-11-26T07:17:57.305 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2023-11-26T07:17:57.319 INFO:tasks.ceph.mds.d.smithi120.stdout:starting mds.d at 2023-11-26T07:17:57.321 INFO:tasks.ceph.mds.b.smithi120.stdout:starting mds.b at 2023-11-26T07:17:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f7541357640 1 Processor -- start 2023-11-26T07:17:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f7541357640 1 -- start start 2023-11-26T07:17:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f7541357640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c0ac060 0x7f753c0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f7541357640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f753c15d570 0x7f753c0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f7541357640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c0725b0 con 0x7f753c0adf10 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f7541357640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753c072890 con 0x7f753c15d570 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f7541357640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0b3f30 con 0x7f753c0ac060 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f753b7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f753c0adf10 0x7f753c0afc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51352/0 (socket says 172.21.15.70:51352) 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f753b7fe640 1 -- 172.21.15.70:0/3614782817 learned_addr learned my addr 172.21.15.70:0/3614782817 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f753affd640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c0ac060 0x7f753c0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f75327fc640 1 --2- 172.21.15.70:0/3614782817 >> v2:172.21.15.120:3300/0 conn(0x7f753c15d570 0x7f753c0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122322109 0 0) 0x7f753c0725b0 con 0x7f753c0adf10 2023-11-26T07:17:57.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.356+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7528003530 con 0x7f753c0adf10 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944347375 0 0) 0x7f7528003530 con 0x7f753c0adf10 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c0ac060 msgr2=0x7f753c0af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c0ac060 0x7f753c0af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 >> v2:172.21.15.120:3300/0 conn(0x7f753c15d570 msgr2=0x7f753c0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 --2- 172.21.15.70:0/3614782817 >> v2:172.21.15.120:3300/0 conn(0x7f753c15d570 0x7f753c0af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0b4210 con 0x7f753c0adf10 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f7534001680 con 0x7f753c0adf10 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 >> v1:172.21.15.70:6789/0 conn(0x7f753c0adf10 legacy=0x7f753c0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f7528003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75280047d0 0x7f7528004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7528005190 0x7f752800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c072890 con 0x7f7528003980 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0b3f30 con 0x7f7528005190 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752800bed0 con 0x7f75280047d0 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c0ac060 0x7f753c0af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f75327fc640 1 --2- 172.21.15.70:0/3614782817 >> v2:172.21.15.120:3300/0 conn(0x7f753c15d570 0x7f753c0af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f7528003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753b7fe640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7528005190 0x7f752800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f75327fc640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75280047d0 0x7f7528004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 -- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75280047d0 msgr2=0x7f7528004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75280047d0 0x7f7528004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 -- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7528005190 msgr2=0x7f752800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7528005190 0x7f752800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 -- 172.21.15.70:0/3614782817 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528003530 con 0x7f7528003980 2023-11-26T07:17:57.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.360+0000 7f753affd640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f7528003da0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f752c009b20 tx=0x7f752c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e77c27a97261a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c004030 con 0x7f7528003980 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c004190 con 0x7f7528003980 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f753a7fc640 1 -- 172.21.15.70:0/3614782817 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c004520 con 0x7f7528003980 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- 172.21.15.70:0/3614782817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 msgr2=0x7f7528003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 --2- 172.21.15.70:0/3614782817 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f7528003da0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f752c009b20 tx=0x7f752c01ca60 comp rx=0 tx=0).stop 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f753b7fe640 1 -- 172.21.15.70:0/3614782817 reap_dead start 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- 172.21.15.70:0/3614782817 shutdown_connections 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- 172.21.15.70:0/3614782817 >> 172.21.15.70:0/3614782817 conn(0x7f753c071a90 msgr2=0x7f753c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- 172.21.15.70:0/3614782817 shutdown_connections 2023-11-26T07:17:57.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- 172.21.15.70:0/3614782817 wait complete. 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 Processor -- start 2023-11-26T07:17:57.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- start start 2023-11-26T07:17:57.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f753c14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c06dd80 0x7f753c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f753c14eb20 0x7f753c158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c06e5d0 con 0x7f7528003980 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c1580a0 con 0x7f753c14eb20 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f7541357640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c06e2f0 con 0x7f753c06dd80 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f753affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f753c14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f753affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f753c14f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60688/0 (socket says 172.21.15.70:60688) 2023-11-26T07:17:57.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.364+0000 7f753affd640 1 -- 172.21.15.70:0/1654152980 learned_addr learned my addr 172.21.15.70:0/1654152980 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f75327fc640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c06dd80 0x7f753c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753b7fe640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f753c14eb20 0x7f753c158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753affd640 1 -- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c06dd80 msgr2=0x7f753c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753affd640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c06dd80 0x7f753c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753affd640 1 -- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f753c14eb20 msgr2=0x7f753c158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753affd640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f753c14eb20 0x7f753c158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753affd640 1 -- 172.21.15.70:0/1654152980 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c157a50 con 0x7f7528003980 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753b7fe640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f753c14eb20 0x7f753c158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f753affd640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f753c14f400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f752c009b20 tx=0x7f7528005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7533fff640 1 -- 172.21.15.70:0/1654152980 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00f000 con 0x7f7528003980 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7533fff640 1 -- 172.21.15.70:0/1654152980 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c0a5cd0 con 0x7f7528003980 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7533fff640 1 -- 172.21.15.70:0/1654152980 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c004500 con 0x7f7528003980 2023-11-26T07:17:57.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c157d30 con 0x7f7528003980 2023-11-26T07:17:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c14f9e0 con 0x7f7528003980 2023-11-26T07:17:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c067500 con 0x7f7528003980 2023-11-26T07:17:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7533fff640 1 -- 172.21.15.70:0/1654152980 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f752c003620 con 0x7f7528003980 2023-11-26T07:17:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7533fff640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f751c066470 0x7f751c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.368+0000 7f7533fff640 1 -- 172.21.15.70:0/1654152980 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f752c11d120 con 0x7f7528003980 2023-11-26T07:17:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.372+0000 7f75327fc640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f751c066470 0x7f751c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.372+0000 7f75327fc640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f751c066470 0x7f751c068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75240134a0 tx=0x7f752400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.372+0000 7f7533fff640 1 -- 172.21.15.70:0/1654152980 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f752c0ea8e0 con 0x7f7528003980 2023-11-26T07:17:57.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.524+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f753c067500 con 0x7f7528003980 2023-11-26T07:17:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7533fff640 1 -- 172.21.15.70:0/1654152980 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f752c0edf00 con 0x7f7528003980 2023-11-26T07:17:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:57.532 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:17:54.944662+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:17:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f751c066470 msgr2=0x7f751c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f751c066470 0x7f751c068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75240134a0 tx=0x7f752400b040 comp rx=0 tx=0).stop 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 msgr2=0x7f753c14f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f753c14f400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f752c009b20 tx=0x7f7528005800 comp rx=0 tx=0).stop 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 shutdown_connections 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f753c14eb20 0x7f753c158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f753c06dd80 0x7f753c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f751c066470 0x7f751c068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 --2- 172.21.15.70:0/1654152980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7528003980 0x7f753c14f400 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 >> 172.21.15.70:0/1654152980 conn(0x7f753c071a90 msgr2=0x7f753c0b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 shutdown_connections 2023-11-26T07:17:57.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.528+0000 7f7541357640 1 -- 172.21.15.70:0/1654152980 wait complete. 2023-11-26T07:17:57.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:17:57.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:17:57.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b672a640 1 Processor -- start 2023-11-26T07:17:57.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b672a640 1 -- start start 2023-11-26T07:17:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b672a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f89b00cf280 0x7f89b00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b672a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b00cc730 con 0x7f89b00cd1b0 2023-11-26T07:17:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b672a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0070ee0 con 0x7f89b0143ac0 2023-11-26T07:17:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b672a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b0143ea0 con 0x7f89b00cf280 2023-11-26T07:17:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b4cc7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f89b00cd1b0 0x7f89b00cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51362/0 (socket says 172.21.15.70:51362) 2023-11-26T07:17:57.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89b4cc7640 1 -- 172.21.15.70:0/1080767527 learned_addr learned my addr 172.21.15.70:0/1080767527 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:17:57.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89af7fe640 1 --2- 172.21.15.70:0/1080767527 >> v2:172.21.15.120:3300/0 conn(0x7f89b00cf280 0x7f89b00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89aeffd640 1 -- 172.21.15.70:0/1080767527 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841772117 0 0) 0x7f89b00cc730 con 0x7f89b00cd1b0 2023-11-26T07:17:57.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.688+0000 7f89aeffd640 1 -- 172.21.15.70:0/1080767527 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8998003530 con 0x7f89b00cd1b0 2023-11-26T07:17:57.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89af7fe640 1 -- 172.21.15.70:0/1080767527 >> v1:172.21.15.120:6789/0 conn(0x7f89b0143ac0 legacy=0x7f89b0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89af7fe640 1 -- 172.21.15.70:0/1080767527 >> v1:172.21.15.70:6789/0 conn(0x7f89b00cd1b0 legacy=0x7f89b00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89af7fe640 1 -- 172.21.15.70:0/1080767527 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00711c0 con 0x7f89b00cf280 2023-11-26T07:17:57.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89af7fe640 1 --2- 172.21.15.70:0/1080767527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b00cf280 0x7f89b00cf710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89a40097c0 tx=0x7f89a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f88669851edda227 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89aeffd640 1 -- 172.21.15.70:0/1080767527 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40a8050 con 0x7f89b00cf280 2023-11-26T07:17:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89aeffd640 1 -- 172.21.15.70:0/1080767527 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a40ac5f0 con 0x7f89b00cf280 2023-11-26T07:17:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89aeffd640 1 -- 172.21.15.70:0/1080767527 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40ac980 con 0x7f89b00cf280 2023-11-26T07:17:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89b672a640 1 -- 172.21.15.70:0/1080767527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b00cf280 msgr2=0x7f89b00cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89b672a640 1 --2- 172.21.15.70:0/1080767527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b00cf280 0x7f89b00cf710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89a40097c0 tx=0x7f89a401c480 comp rx=0 tx=0).stop 2023-11-26T07:17:57.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89b672a640 1 -- 172.21.15.70:0/1080767527 shutdown_connections 2023-11-26T07:17:57.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89b672a640 1 --2- 172.21.15.70:0/1080767527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b00cf280 0x7f89b00cf710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89b672a640 1 -- 172.21.15.70:0/1080767527 >> 172.21.15.70:0/1080767527 conn(0x7f89b006a890 msgr2=0x7f89b006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89b672a640 1 -- 172.21.15.70:0/1080767527 shutdown_connections 2023-11-26T07:17:57.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.692+0000 7f89b672a640 1 -- 172.21.15.70:0/1080767527 wait complete. 2023-11-26T07:17:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 Processor -- start 2023-11-26T07:17:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 -- start start 2023-11-26T07:17:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b00cd1b0 0x7f89b0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f89b00cf280 0x7f89b0157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0143ac0 0x7f89b006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0157940 con 0x7f89b00cd1b0 2023-11-26T07:17:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00afce0 con 0x7f89b0143ac0 2023-11-26T07:17:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00affc0 con 0x7f89b00cf280 2023-11-26T07:17:57.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b00cd1b0 0x7f89b0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b00cd1b0 0x7f89b0158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60700/0 (socket says 172.21.15.70:60700) 2023-11-26T07:17:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 -- 172.21.15.70:0/1505727382 learned_addr learned my addr 172.21.15.70:0/1505727382 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 -- 172.21.15.70:0/1505727382 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f89b00cf280 msgr2=0x7f89b0157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f89b00cf280 0x7f89b0157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 -- 172.21.15.70:0/1505727382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0143ac0 msgr2=0x7f89b006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0143ac0 0x7f89b006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 -- 172.21.15.70:0/1505727382 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4009420 con 0x7f89b00cd1b0 2023-11-26T07:17:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89affff640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b00cd1b0 0x7f89b0158590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f89a000c3c0 tx=0x7f89a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89acff9640 1 -- 172.21.15.70:0/1505727382 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00052d0 con 0x7f89b00cd1b0 2023-11-26T07:17:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89acff9640 1 -- 172.21.15.70:0/1505727382 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a0005430 con 0x7f89b00cd1b0 2023-11-26T07:17:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89acff9640 1 -- 172.21.15.70:0/1505727382 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0003840 con 0x7f89b00cd1b0 2023-11-26T07:17:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b00b02a0 con 0x7f89b00cd1b0 2023-11-26T07:17:57.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.695+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b00b0860 con 0x7f89b00cd1b0 2023-11-26T07:17:57.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.699+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b0067680 con 0x7f89b00cd1b0 2023-11-26T07:17:57.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.699+0000 7f89acff9640 1 -- 172.21.15.70:0/1505727382 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89a00039a0 con 0x7f89b00cd1b0 2023-11-26T07:17:57.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.699+0000 7f89acff9640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f899c066470 0x7f899c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:57.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.699+0000 7f89acff9640 1 -- 172.21.15.70:0/1505727382 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89a0083140 con 0x7f89b00cd1b0 2023-11-26T07:17:57.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.699+0000 7f89af7fe640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f899c066470 0x7f899c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:57.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.703+0000 7f89af7fe640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f899c066470 0x7f899c068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89a40ae000 tx=0x7f89a4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:57.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.703+0000 7f89acff9640 1 -- 172.21.15.70:0/1505727382 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89a0050880 con 0x7f89b00cd1b0 2023-11-26T07:17:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.855+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89b006ae80 con 0x7f89b00cd1b0 2023-11-26T07:17:57.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.855+0000 7f89acff9640 1 -- 172.21.15.70:0/1505727382 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89a0017020 con 0x7f89b00cd1b0 2023-11-26T07:17:57.862 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:17:57.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f899c066470 msgr2=0x7f899c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f899c066470 0x7f899c068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89a40ae000 tx=0x7f89a4004740 comp rx=0 tx=0).stop 2023-11-26T07:17:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b00cd1b0 msgr2=0x7f89b0158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b00cd1b0 0x7f89b0158590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f89a000c3c0 tx=0x7f89a000c880 comp rx=0 tx=0).stop 2023-11-26T07:17:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 shutdown_connections 2023-11-26T07:17:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89b0143ac0 0x7f89b006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f89b00cf280 0x7f89b0157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f899c066470 0x7f899c068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 --2- 172.21.15.70:0/1505727382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89b00cd1b0 0x7f89b0158590 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 >> 172.21.15.70:0/1505727382 conn(0x7f89b006a890 msgr2=0x7f89b013d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 shutdown_connections 2023-11-26T07:17:57.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:57.859+0000 7f89b672a640 1 -- 172.21.15.70:0/1505727382 wait complete. 2023-11-26T07:17:57.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:17:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.015+0000 7f80d286b640 1 Processor -- start 2023-11-26T07:17:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.015+0000 7f80d286b640 1 -- start start 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80d286b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc15d5b0 0x7f80cc0d1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80d286b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80cc0d1d60 0x7f80cc0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80d286b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f80cc0b36b0 0x7f80cc0cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80d286b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0d21c0 con 0x7f80cc0d1d60 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80d286b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0ce590 con 0x7f80cc0b36b0 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80d286b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0cdf80 con 0x7f80cc15d5b0 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80cc0d1d60 0x7f80cc0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80cc0d1d60 0x7f80cc0b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60708/0 (socket says 172.21.15.70:60708) 2023-11-26T07:17:58.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 -- 172.21.15.70:0/2434115042 learned_addr learned my addr 172.21.15.70:0/2434115042 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 -- 172.21.15.70:0/2434115042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc15d5b0 msgr2=0x7f80cc0d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:58.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 --2- 172.21.15.70:0/2434115042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc15d5b0 0x7f80cc0d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 -- 172.21.15.70:0/2434115042 >> v2:172.21.15.120:3300/0 conn(0x7f80cc0b36b0 msgr2=0x7f80cc0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:17:58.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 --2- 172.21.15.70:0/2434115042 >> v2:172.21.15.120:3300/0 conn(0x7f80cc0b36b0 0x7f80cc0cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.019+0000 7f80cb7fe640 1 -- 172.21.15.70:0/2434115042 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0b3ea0 con 0x7f80cc0d1d60 2023-11-26T07:17:58.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80cb7fe640 1 --2- 172.21.15.70:0/2434115042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc0d1d60 0x7f80cc0b3170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f80cc08bd80 tx=0x7f80c001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a6c629fb9e83fd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:58.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80caffd640 1 -- 172.21.15.70:0/2434115042 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00ab600 con 0x7f80cc0d1d60 2023-11-26T07:17:58.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80caffd640 1 -- 172.21.15.70:0/2434115042 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c00a7050 con 0x7f80cc0d1d60 2023-11-26T07:17:58.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80caffd640 1 -- 172.21.15.70:0/2434115042 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00ab980 con 0x7f80cc0d1d60 2023-11-26T07:17:58.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 -- 172.21.15.70:0/2434115042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc0d1d60 msgr2=0x7f80cc0b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 --2- 172.21.15.70:0/2434115042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc0d1d60 0x7f80cc0b3170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f80cc08bd80 tx=0x7f80c001cc70 comp rx=0 tx=0).stop 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 -- 172.21.15.70:0/2434115042 shutdown_connections 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 --2- 172.21.15.70:0/2434115042 >> v2:172.21.15.120:3300/0 conn(0x7f80cc0b36b0 0x7f80cc0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 --2- 172.21.15.70:0/2434115042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc0d1d60 0x7f80cc0b3170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 --2- 172.21.15.70:0/2434115042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc15d5b0 0x7f80cc0d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 -- 172.21.15.70:0/2434115042 >> 172.21.15.70:0/2434115042 conn(0x7f80cc08cc60 msgr2=0x7f80cc09c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 -- 172.21.15.70:0/2434115042 shutdown_connections 2023-11-26T07:17:58.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 -- 172.21.15.70:0/2434115042 wait complete. 2023-11-26T07:17:58.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 Processor -- start 2023-11-26T07:17:58.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.023+0000 7f80d286b640 1 -- start start 2023-11-26T07:17:58.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80cc0b36b0 0x7f80cc0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc0d1d60 0x7f80cc1f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc15d5b0 0x7f80cc1f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc155790 con 0x7f80cc15d5b0 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc1548a0 con 0x7f80cc0b36b0 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc154b80 con 0x7f80cc0d1d60 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc15d5b0 0x7f80cc1f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc15d5b0 0x7f80cc1f9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60720/0 (socket says 172.21.15.70:60720) 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 -- 172.21.15.70:0/3737428138 learned_addr learned my addr 172.21.15.70:0/3737428138 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80cb7fe640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc0d1d60 0x7f80cc1f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:58.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80cbfff640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80cc0b36b0 0x7f80cc0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 -- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc0d1d60 msgr2=0x7f80cc1f9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc0d1d60 0x7f80cc1f9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 -- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80cc0b36b0 msgr2=0x7f80cc0b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80cc0b36b0 0x7f80cc0b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 -- 172.21.15.70:0/3737428138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00094d0 con 0x7f80cc15d5b0 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d0e08640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc15d5b0 0x7f80cc1f9fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80c400b970 tx=0x7f80c400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80c8ff9640 1 -- 172.21.15.70:0/3737428138 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400cb40 con 0x7f80cc15d5b0 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80c8ff9640 1 -- 172.21.15.70:0/3737428138 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400ccc0 con 0x7f80cc15d5b0 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc0b3c70 con 0x7f80cc15d5b0 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80c8ff9640 1 -- 172.21.15.70:0/3737428138 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4014680 con 0x7f80cc15d5b0 2023-11-26T07:17:58.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc155140 con 0x7f80cc15d5b0 2023-11-26T07:17:58.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc15dc30 con 0x7f80cc15d5b0 2023-11-26T07:17:58.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.027+0000 7f80c8ff9640 1 -- 172.21.15.70:0/3737428138 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80c401d3b0 con 0x7f80cc15d5b0 2023-11-26T07:17:58.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.031+0000 7f80c8ff9640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f80b8066470 0x7f80b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:17:58.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.031+0000 7f80c8ff9640 1 -- 172.21.15.70:0/3737428138 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80c4083970 con 0x7f80cc15d5b0 2023-11-26T07:17:58.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.031+0000 7f80cbfff640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f80b8066470 0x7f80b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:17:58.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.031+0000 7f80cbfff640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f80b8066470 0x7f80b8068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0098f0 tx=0x7f80bc006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:17:58.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.035+0000 7f80c8ff9640 1 -- 172.21.15.70:0/3737428138 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80cc15dc30 con 0x7f80cc15d5b0 2023-11-26T07:17:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.211+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80cc15dc30 con 0x7f80cc15d5b0 2023-11-26T07:17:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.211+0000 7f80c8ff9640 1 -- 172.21.15.70:0/3737428138 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f80cc15dc30 con 0x7f80cc15d5b0 2023-11-26T07:17:58.219 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:17:58.219 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-26T07:17:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2023-11-26T07:17:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f80b8066470 msgr2=0x7f80b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f80b8066470 0x7f80b8068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0098f0 tx=0x7f80bc006f90 comp rx=0 tx=0).stop 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc15d5b0 msgr2=0x7f80cc1f9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc15d5b0 0x7f80cc1f9fc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80c400b970 tx=0x7f80c400be30 comp rx=0 tx=0).stop 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 shutdown_connections 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f80b8066470 0x7f80b8068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80cc15d5b0 0x7f80cc1f9fc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80cc0d1d60 0x7f80cc1f9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 --2- 172.21.15.70:0/3737428138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80cc0b36b0 0x7f80cc0b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 >> 172.21.15.70:0/3737428138 conn(0x7f80cc08cc60 msgr2=0x7f80cc1562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 shutdown_connections 2023-11-26T07:17:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:17:58.215+0000 7f80d286b640 1 -- 172.21.15.70:0/3737428138 wait complete. 2023-11-26T07:17:58.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:17:58.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:00.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:00.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68d2101640 1 Processor -- start 2023-11-26T07:18:00.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68d2101640 1 -- start start 2023-11-26T07:18:00.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68d2101640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68cc13e290 0x7f68cc0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68d2101640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc15fb20 con 0x7f68cc0cf7c0 2023-11-26T07:18:00.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68d2101640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc06c520 con 0x7f68cc15f6b0 2023-11-26T07:18:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68d2101640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc0cfc40 con 0x7f68cc13e290 2023-11-26T07:18:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68cb7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68cc13e290 0x7f68cc0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68caffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f68cc0cf7c0 0x7f68cc15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51376/0 (socket says 172.21.15.70:51376) 2023-11-26T07:18:00.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.375+0000 7f68caffd640 1 -- 172.21.15.70:0/3981854901 learned_addr learned my addr 172.21.15.70:0/3981854901 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:00.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68cb7fe640 1 -- 172.21.15.70:0/3981854901 >> v1:172.21.15.120:6789/0 conn(0x7f68cc15f6b0 legacy=0x7f68cc0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68cb7fe640 1 -- 172.21.15.70:0/3981854901 >> v1:172.21.15.70:6789/0 conn(0x7f68cc0cf7c0 legacy=0x7f68cc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68ca7fc640 1 -- 172.21.15.70:0/3981854901 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586009020 0 0) 0x7f68c0001120 con 0x7f68cc0cf7c0 2023-11-26T07:18:00.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68cb7fe640 1 -- 172.21.15.70:0/3981854901 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc06c800 con 0x7f68cc13e290 2023-11-26T07:18:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68cb7fe640 1 --2- 172.21.15.70:0/3981854901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc0cf280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009740 tx=0x7f68bc01c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a536bae2c3983ba server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68ca7fc640 1 -- 172.21.15.70:0/3981854901 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0ab600 con 0x7f68cc13e290 2023-11-26T07:18:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68ca7fc640 1 -- 172.21.15.70:0/3981854901 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc0a7050 con 0x7f68cc13e290 2023-11-26T07:18:00.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68ca7fc640 1 -- 172.21.15.70:0/3981854901 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0ab980 con 0x7f68cc13e290 2023-11-26T07:18:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68d2101640 1 -- 172.21.15.70:0/3981854901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 msgr2=0x7f68cc0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68d2101640 1 --2- 172.21.15.70:0/3981854901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc0cf280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009740 tx=0x7f68bc01c2b0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68d2101640 1 -- 172.21.15.70:0/3981854901 shutdown_connections 2023-11-26T07:18:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68d2101640 1 --2- 172.21.15.70:0/3981854901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc0cf280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.379+0000 7f68d2101640 1 -- 172.21.15.70:0/3981854901 >> 172.21.15.70:0/3981854901 conn(0x7f68cc06a890 msgr2=0x7f68cc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:00.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 -- 172.21.15.70:0/3981854901 shutdown_connections 2023-11-26T07:18:00.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 -- 172.21.15.70:0/3981854901 wait complete. 2023-11-26T07:18:00.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 Processor -- start 2023-11-26T07:18:00.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 -- start start 2023-11-26T07:18:00.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68cc0cf7c0 0x7f68cc1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc15f6b0 0x7f68cc1f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc128f00 con 0x7f68cc13e290 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc12f570 con 0x7f68cc15f6b0 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68d2101640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1282f0 con 0x7f68cc0cf7c0 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68cb7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68cc0cf7c0 0x7f68cc1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60734/0 (socket says 172.21.15.70:60734) 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 -- 172.21.15.70:0/150103315 learned_addr learned my addr 172.21.15.70:0/150103315 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68cbfff640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc15f6b0 0x7f68cc1f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 -- 172.21.15.70:0/150103315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68cc0cf7c0 msgr2=0x7f68cc1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68cc0cf7c0 0x7f68cc1594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 -- 172.21.15.70:0/150103315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc15f6b0 msgr2=0x7f68cc1f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc15f6b0 0x7f68cc1f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 -- 172.21.15.70:0/150103315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc009420 con 0x7f68cc13e290 2023-11-26T07:18:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.383+0000 7f68caffd640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc159a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c780 tx=0x7f68c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68b3fff640 1 -- 172.21.15.70:0/150103315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0005ac0 con 0x7f68cc13e290 2023-11-26T07:18:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68b3fff640 1 -- 172.21.15.70:0/150103315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0005c20 con 0x7f68cc13e290 2023-11-26T07:18:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68b3fff640 1 -- 172.21.15.70:0/150103315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0004a30 con 0x7f68cc13e290 2023-11-26T07:18:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc1285d0 con 0x7f68cc13e290 2023-11-26T07:18:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc128b90 con 0x7f68cc13e290 2023-11-26T07:18:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc1f5170 con 0x7f68cc13e290 2023-11-26T07:18:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68b3fff640 1 -- 172.21.15.70:0/150103315 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68c0004b90 con 0x7f68cc13e290 2023-11-26T07:18:00.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68b3fff640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68b3fff640 1 -- 172.21.15.70:0/150103315 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68c0082b00 con 0x7f68cc13e290 2023-11-26T07:18:00.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.387+0000 7f68cb7fe640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.391+0000 7f68cb7fe640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68b80664a0 0x7f68b8068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ad000 tx=0x7f68bc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:00.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.391+0000 7f68b3fff640 1 -- 172.21.15.70:0/150103315 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68c0084e60 con 0x7f68cc13e290 2023-11-26T07:18:00.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.571+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68cc15fb20 con 0x7f68cc13e290 2023-11-26T07:18:00.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.571+0000 7f68b3fff640 1 -- 172.21.15.70:0/150103315 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f68cc15fb20 con 0x7f68cc13e290 2023-11-26T07:18:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:00.579 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-26T07:18:00.579 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 3 2023-11-26T07:18:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68b80664a0 msgr2=0x7f68b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68b80664a0 0x7f68b8068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0ad000 tx=0x7f68bc0a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 msgr2=0x7f68cc159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc159a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c780 tx=0x7f68c000cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 shutdown_connections 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc13e290 0x7f68cc159a20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc15f6b0 0x7f68cc1f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 --2- 172.21.15.70:0/150103315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68cc0cf7c0 0x7f68cc1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 >> 172.21.15.70:0/150103315 conn(0x7f68cc06a890 msgr2=0x7f68cc0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 shutdown_connections 2023-11-26T07:18:00.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.575+0000 7f68d2101640 1 -- 172.21.15.70:0/150103315 wait complete. 2023-11-26T07:18:00.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:00.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.731+0000 7f9b5b691640 1 Processor -- start 2023-11-26T07:18:00.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.731+0000 7f9b5b691640 1 -- start start 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5b691640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9b5415ea30 0x7f9b54070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5b691640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540b3830 0x7f9b540cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5b691640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9b540cf7d0 0x7f9b5406e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5b691640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540cfc50 con 0x7f9b5415ea30 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5b691640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540cbf60 con 0x7f9b540cf7d0 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5b691640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5415ee10 con 0x7f9b540b3830 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9b5415ea30 0x7f9b54070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9b5415ea30 0x7f9b54070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60738/0 (socket says 172.21.15.70:60738) 2023-11-26T07:18:00.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 -- 172.21.15.70:0/4057685503 learned_addr learned my addr 172.21.15.70:0/4057685503 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b58c2c640 1 --2- 172.21.15.70:0/4057685503 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540b3830 0x7f9b540cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b59c2e640 1 --2- 172.21.15.70:0/4057685503 >> v2:172.21.15.120:3300/0 conn(0x7f9b540cf7d0 0x7f9b5406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 -- 172.21.15.70:0/4057685503 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540b3830 msgr2=0x7f9b540cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 --2- 172.21.15.70:0/4057685503 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540b3830 0x7f9b540cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 -- 172.21.15.70:0/4057685503 >> v2:172.21.15.120:3300/0 conn(0x7f9b540cf7d0 msgr2=0x7f9b5406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 --2- 172.21.15.70:0/4057685503 >> v2:172.21.15.120:3300/0 conn(0x7f9b540cf7d0 0x7f9b5406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 -- 172.21.15.70:0/4057685503 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5406fb60 con 0x7f9b5415ea30 2023-11-26T07:18:00.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b59c2e640 1 --2- 172.21.15.70:0/4057685503 >> v2:172.21.15.120:3300/0 conn(0x7f9b540cf7d0 0x7f9b5406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:00.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.735+0000 7f9b5942d640 1 --2- 172.21.15.70:0/4057685503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54070290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b540d0df0 tx=0x7f9b5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304f6d811bff5f24 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b4bfff640 1 -- 172.21.15.70:0/4057685503 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500aa5f0 con 0x7f9b5415ea30 2023-11-26T07:18:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b4bfff640 1 -- 172.21.15.70:0/4057685503 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b500aa750 con 0x7f9b5415ea30 2023-11-26T07:18:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b4bfff640 1 -- 172.21.15.70:0/4057685503 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500aaae0 con 0x7f9b5415ea30 2023-11-26T07:18:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- 172.21.15.70:0/4057685503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 msgr2=0x7f9b54070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 --2- 172.21.15.70:0/4057685503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54070290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b540d0df0 tx=0x7f9b5001c4d0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- 172.21.15.70:0/4057685503 shutdown_connections 2023-11-26T07:18:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 --2- 172.21.15.70:0/4057685503 >> v2:172.21.15.120:3300/0 conn(0x7f9b540cf7d0 0x7f9b5406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 --2- 172.21.15.70:0/4057685503 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540b3830 0x7f9b540cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 --2- 172.21.15.70:0/4057685503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54070290 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- 172.21.15.70:0/4057685503 >> 172.21.15.70:0/4057685503 conn(0x7f9b540b2d10 msgr2=0x7f9b540b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:00.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- 172.21.15.70:0/4057685503 shutdown_connections 2023-11-26T07:18:00.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- 172.21.15.70:0/4057685503 wait complete. 2023-11-26T07:18:00.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 Processor -- start 2023-11-26T07:18:00.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- start start 2023-11-26T07:18:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b540b3830 0x7f9b54158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540cf7d0 0x7f9b5413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54158f60 con 0x7f9b5415ea30 2023-11-26T07:18:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5413ecf0 con 0x7f9b540b3830 2023-11-26T07:18:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.739+0000 7f9b5b691640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b541589a0 con 0x7f9b540cf7d0 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60754/0 (socket says 172.21.15.70:60754) 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 -- 172.21.15.70:0/3325962386 learned_addr learned my addr 172.21.15.70:0/3325962386 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b58c2c640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540cf7d0 0x7f9b5413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b5942d640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b540b3830 0x7f9b54158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 -- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540cf7d0 msgr2=0x7f9b5413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540cf7d0 0x7f9b5413e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 -- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b540b3830 msgr2=0x7f9b54158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b540b3830 0x7f9b54158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 -- 172.21.15.70:0/3325962386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b500094d0 con 0x7f9b5415ea30 2023-11-26T07:18:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b59c2e640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54156850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007e60 tx=0x7f9b4c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b49ffb640 1 -- 172.21.15.70:0/3325962386 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c015600 con 0x7f9b5415ea30 2023-11-26T07:18:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b49ffb640 1 -- 172.21.15.70:0/3325962386 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00f040 con 0x7f9b5415ea30 2023-11-26T07:18:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b54158c80 con 0x7f9b5415ea30 2023-11-26T07:18:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b49ffb640 1 -- 172.21.15.70:0/3325962386 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0159a0 con 0x7f9b5415ea30 2023-11-26T07:18:00.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5413e290 con 0x7f9b5415ea30 2023-11-26T07:18:00.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5413de10 con 0x7f9b5415ea30 2023-11-26T07:18:00.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b49ffb640 1 -- 172.21.15.70:0/3325962386 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b4c01e3b0 con 0x7f9b5415ea30 2023-11-26T07:18:00.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b49ffb640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9b38066470 0x7f9b38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:00.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b49ffb640 1 -- 172.21.15.70:0/3325962386 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b4c083d60 con 0x7f9b5415ea30 2023-11-26T07:18:00.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.743+0000 7f9b5942d640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9b38066470 0x7f9b38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:00.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.747+0000 7f9b5942d640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9b38066470 0x7f9b38068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b500ae000 tx=0x7f9b500a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.747+0000 7f9b49ffb640 1 -- 172.21.15.70:0/3325962386 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b5413de10 con 0x7f9b5415ea30 2023-11-26T07:18:00.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.899+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b5413de10 con 0x7f9b5415ea30 2023-11-26T07:18:00.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.899+0000 7f9b49ffb640 1 -- 172.21.15.70:0/3325962386 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f9b5413de10 con 0x7f9b5415ea30 2023-11-26T07:18:00.907 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:00.908 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:17:54.944662+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:00.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9b38066470 msgr2=0x7f9b38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9b38066470 0x7f9b38068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b500ae000 tx=0x7f9b500a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 msgr2=0x7f9b54156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54156850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007e60 tx=0x7f9b4c00d4a0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 shutdown_connections 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9b38066470 0x7f9b38068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b5415ea30 0x7f9b54156850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9b540cf7d0 0x7f9b5413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 --2- 172.21.15.70:0/3325962386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b540b3830 0x7f9b54158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 >> 172.21.15.70:0/3325962386 conn(0x7f9b540b2d10 msgr2=0x7f9b5415ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 shutdown_connections 2023-11-26T07:18:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:00.903+0000 7f9b5b691640 1 -- 172.21.15.70:0/3325962386 wait complete. 2023-11-26T07:18:00.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:00.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb106155640 1 Processor -- start 2023-11-26T07:18:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb106155640 1 -- start start 2023-11-26T07:18:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb106155640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb100070ba0 0x7fb10006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb106155640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1000cdd10 0x7fb10006d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb106155640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1000cd610 con 0x7fb100161cf0 2023-11-26T07:18:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb106155640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000cd8f0 con 0x7fb100070ba0 2023-11-26T07:18:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb106155640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb100161210 con 0x7fb1000cdd10 2023-11-26T07:18:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0ff7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb100070ba0 0x7fb10006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0ff7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb100070ba0 0x7fb10006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60770/0 (socket says 172.21.15.70:60770) 2023-11-26T07:18:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0ff7fe640 1 -- 172.21.15.70:0/2883210457 learned_addr learned my addr 172.21.15.70:0/2883210457 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0fffff640 1 --2- 172.21.15.70:0/2883210457 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1000cdd10 0x7fb10006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0ff7fe640 1 -- 172.21.15.70:0/2883210457 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1000cdd10 msgr2=0x7fb10006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0ff7fe640 1 --2- 172.21.15.70:0/2883210457 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1000cdd10 0x7fb10006d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0ff7fe640 1 -- 172.21.15.70:0/2883210457 >> v1:172.21.15.120:6789/0 conn(0x7fb100161cf0 legacy=0x7fb100070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.063+0000 7fb0ff7fe640 1 -- 172.21.15.70:0/2883210457 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1001614f0 con 0x7fb100070ba0 2023-11-26T07:18:01.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb0ff7fe640 1 --2- 172.21.15.70:0/2883210457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100070ba0 0x7fb10006bae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009870 tx=0x7fb0f001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406b46bd0436724f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb0fe7fc640 1 -- 172.21.15.70:0/2883210457 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00a9620 con 0x7fb100070ba0 2023-11-26T07:18:01.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb0fe7fc640 1 -- 172.21.15.70:0/2883210457 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f00a9780 con 0x7fb100070ba0 2023-11-26T07:18:01.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb0fe7fc640 1 -- 172.21.15.70:0/2883210457 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00a9b10 con 0x7fb100070ba0 2023-11-26T07:18:01.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 -- 172.21.15.70:0/2883210457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100070ba0 msgr2=0x7fb10006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 --2- 172.21.15.70:0/2883210457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100070ba0 0x7fb10006bae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009870 tx=0x7fb0f001c540 comp rx=0 tx=0).stop 2023-11-26T07:18:01.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 -- 172.21.15.70:0/2883210457 shutdown_connections 2023-11-26T07:18:01.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 --2- 172.21.15.70:0/2883210457 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1000cdd10 0x7fb10006d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 --2- 172.21.15.70:0/2883210457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100070ba0 0x7fb10006bae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 -- 172.21.15.70:0/2883210457 >> 172.21.15.70:0/2883210457 conn(0x7fb1000cf710 msgr2=0x7fb1000cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:01.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 -- 172.21.15.70:0/2883210457 shutdown_connections 2023-11-26T07:18:01.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.067+0000 7fb106155640 1 -- 172.21.15.70:0/2883210457 wait complete. 2023-11-26T07:18:01.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 Processor -- start 2023-11-26T07:18:01.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 -- start start 2023-11-26T07:18:01.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb100070ba0 0x7fb10014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1000cdd10 0x7fb1000ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100161cf0 0x7fb100152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001609b0 con 0x7fb100161cf0 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10014ebc0 con 0x7fb1000cdd10 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10014eea0 con 0x7fb100070ba0 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100161cf0 0x7fb100152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0feffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1000cdd10 0x7fb1000ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0ff7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb100070ba0 0x7fb10014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100161cf0 0x7fb100152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60774/0 (socket says 172.21.15.70:60774) 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 -- 172.21.15.70:0/3830986417 learned_addr learned my addr 172.21.15.70:0/3830986417 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0feffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1000cdd10 0x7fb1000ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:37738/0 (socket says 172.21.15.70:37738) 2023-11-26T07:18:01.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 -- 172.21.15.70:0/3830986417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb100070ba0 msgr2=0x7fb10014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb100070ba0 0x7fb10014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 -- 172.21.15.70:0/3830986417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1000cdd10 msgr2=0x7fb1000ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1000cdd10 0x7fb1000ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 -- 172.21.15.70:0/3830986417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f00094d0 con 0x7fb100161cf0 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0fffff640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100161cf0 0x7fb100152f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800efc0 tx=0x7fb0f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3830986417 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8014480 con 0x7fb100161cf0 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3830986417 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800f040 con 0x7fb100161cf0 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100160360 con 0x7fb100161cf0 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3830986417 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8014820 con 0x7fb100161cf0 2023-11-26T07:18:01.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.071+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10014d8b0 con 0x7fb100161cf0 2023-11-26T07:18:01.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.075+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1000ae360 con 0x7fb100161cf0 2023-11-26T07:18:01.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.075+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3830986417 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb0f8014980 con 0x7fb100161cf0 2023-11-26T07:18:01.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.075+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0ec066470 0x7fb0ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.075+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3830986417 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0f8084820 con 0x7fb100161cf0 2023-11-26T07:18:01.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.075+0000 7fb0ff7fe640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0ec066470 0x7fb0ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.075+0000 7fb0ff7fe640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0ec066470 0x7fb0ec068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00ae000 tx=0x7fb0f00b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.079+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3830986417 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0f8052130 con 0x7fb100161cf0 2023-11-26T07:18:01.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1000ce260 con 0x7fb100161cf0 2023-11-26T07:18:01.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3830986417 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0f8018020 con 0x7fb100161cf0 2023-11-26T07:18:01.236 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:01.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0ec066470 msgr2=0x7fb0ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0ec066470 0x7fb0ec068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00ae000 tx=0x7fb0f00b3040 comp rx=0 tx=0).stop 2023-11-26T07:18:01.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100161cf0 msgr2=0x7fb100152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100161cf0 0x7fb100152f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800efc0 tx=0x7fb0f800c490 comp rx=0 tx=0).stop 2023-11-26T07:18:01.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 shutdown_connections 2023-11-26T07:18:01.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0ec066470 0x7fb0ec068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb100161cf0 0x7fb100152f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1000cdd10 0x7fb1000ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 --2- 172.21.15.70:0/3830986417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb100070ba0 0x7fb10014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 >> 172.21.15.70:0/3830986417 conn(0x7fb1000cf710 msgr2=0x7fb1000b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:01.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 shutdown_connections 2023-11-26T07:18:01.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.231+0000 7fb106155640 1 -- 172.21.15.70:0/3830986417 wait complete. 2023-11-26T07:18:01.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:18:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e4b12a640 1 Processor -- start 2023-11-26T07:18:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e4b12a640 1 -- start start 2023-11-26T07:18:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e4b12a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e4b12a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8e44099a70 0x7f8e44161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e4b12a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e440cf260 con 0x7f8e4406f000 2023-11-26T07:18:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e4b12a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4409a010 con 0x7f8e44099a70 2023-11-26T07:18:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e4b12a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4409a2f0 con 0x7f8e4406f3e0 2023-11-26T07:18:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e48ec6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8e4406f000 0x7f8e4406d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51392/0 (socket says 172.21.15.70:51392) 2023-11-26T07:18:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e48ec6640 1 -- 172.21.15.70:0/2112654944 learned_addr learned my addr 172.21.15.70:0/2112654944 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e496c7640 1 --2- 172.21.15.70:0/2112654944 >> v2:172.21.15.120:3300/0 conn(0x7f8e44099a70 0x7f8e44161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e43fff640 1 --2- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e437fe640 1 -- 172.21.15.70:0/2112654944 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610069533 0 0) 0x7f8e440cf260 con 0x7f8e4406f000 2023-11-26T07:18:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e437fe640 1 -- 172.21.15.70:0/2112654944 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e34003530 con 0x7f8e4406f000 2023-11-26T07:18:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e496c7640 1 -- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 msgr2=0x7f8e44161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e496c7640 1 --2- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e496c7640 1 -- 172.21.15.70:0/2112654944 >> v1:172.21.15.70:6789/0 conn(0x7f8e4406f000 legacy=0x7f8e4406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.391+0000 7f8e496c7640 1 -- 172.21.15.70:0/2112654944 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4409a5d0 con 0x7f8e44099a70 2023-11-26T07:18:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e496c7640 1 --2- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44161bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009d90 tx=0x7f8e3c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa476c80e55c13a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e437fe640 1 -- 172.21.15.70:0/2112654944 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0a5780 con 0x7f8e44099a70 2023-11-26T07:18:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e437fe640 1 -- 172.21.15.70:0/2112654944 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0a58e0 con 0x7f8e44099a70 2023-11-26T07:18:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e437fe640 1 -- 172.21.15.70:0/2112654944 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0a5c50 con 0x7f8e44099a70 2023-11-26T07:18:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 msgr2=0x7f8e44161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44161bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009d90 tx=0x7f8e3c01c8c0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2112654944 shutdown_connections 2023-11-26T07:18:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44161bd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2112654944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2112654944 >> 172.21.15.70:0/2112654944 conn(0x7f8e440b2d10 msgr2=0x7f8e440b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2112654944 shutdown_connections 2023-11-26T07:18:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.395+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2112654944 wait complete. 2023-11-26T07:18:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 Processor -- start 2023-11-26T07:18:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 -- start start 2023-11-26T07:18:01.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e4406f000 0x7f8e440b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440b5380 con 0x7f8e4406f000 2023-11-26T07:18:01.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e44159e70 con 0x7f8e44099a70 2023-11-26T07:18:01.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4415a110 con 0x7f8e4406f3e0 2023-11-26T07:18:01.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e4406f000 0x7f8e440b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e4406f000 0x7f8e440b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60788/0 (socket says 172.21.15.70:60788) 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 -- 172.21.15.70:0/2483287254 learned_addr learned my addr 172.21.15.70:0/2483287254 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e43fff640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e496c7640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 -- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 msgr2=0x7f8e44159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 -- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 msgr2=0x7f8e44150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 -- 172.21.15.70:0/2483287254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009a70 con 0x7f8e4406f000 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e496c7640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:01.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e48ec6640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e4406f000 0x7f8e440b4e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c450 tx=0x7f8e3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e417fa640 1 -- 172.21.15.70:0/2483287254 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38005cf0 con 0x7f8e4406f000 2023-11-26T07:18:01.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e417fa640 1 -- 172.21.15.70:0/2483287254 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38005e50 con 0x7f8e4406f000 2023-11-26T07:18:01.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e417fa640 1 -- 172.21.15.70:0/2483287254 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38007290 con 0x7f8e4406f000 2023-11-26T07:18:01.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4415a3f0 con 0x7f8e4406f000 2023-11-26T07:18:01.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.399+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4415a9b0 con 0x7f8e4406f000 2023-11-26T07:18:01.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.403+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e44067680 con 0x7f8e4406f000 2023-11-26T07:18:01.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.403+0000 7f8e417fa640 1 -- 172.21.15.70:0/2483287254 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8e380073f0 con 0x7f8e4406f000 2023-11-26T07:18:01.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.403+0000 7f8e417fa640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8e28066470 0x7f8e28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.403+0000 7f8e417fa640 1 -- 172.21.15.70:0/2483287254 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e38083070 con 0x7f8e4406f000 2023-11-26T07:18:01.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.403+0000 7f8e43fff640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8e28066470 0x7f8e28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.403+0000 7f8e43fff640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8e28066470 0x7f8e28068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e440cebe0 tx=0x7f8e30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.407+0000 7f8e417fa640 1 -- 172.21.15.70:0/2483287254 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e380508d0 con 0x7f8e4406f000 2023-11-26T07:18:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.555+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8e440b70a0 con 0x7f8e4406f000 2023-11-26T07:18:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e417fa640 1 -- 172.21.15.70:0/2483287254 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8e38017090 con 0x7f8e4406f000 2023-11-26T07:18:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:01.563 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:18:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:18:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2023-11-26T07:18:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2023-11-26T07:18:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:18:01.564 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:18:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8e28066470 msgr2=0x7f8e28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8e28066470 0x7f8e28068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e440cebe0 tx=0x7f8e30008040 comp rx=0 tx=0).stop 2023-11-26T07:18:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e4406f000 msgr2=0x7f8e440b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e4406f000 0x7f8e440b4e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c450 tx=0x7f8e3800c910 comp rx=0 tx=0).stop 2023-11-26T07:18:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 shutdown_connections 2023-11-26T07:18:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8e44099a70 0x7f8e44150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8e4406f3e0 0x7f8e44159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8e28066470 0x7f8e28068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 --2- 172.21.15.70:0/2483287254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e4406f000 0x7f8e440b4e40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 >> 172.21.15.70:0/2483287254 conn(0x7f8e440b2d10 msgr2=0x7f8e440cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 shutdown_connections 2023-11-26T07:18:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.559+0000 7f8e4b12a640 1 -- 172.21.15.70:0/2483287254 wait complete. 2023-11-26T07:18:01.584 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:18:01.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:18:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbe4c79640 1 Processor -- start 2023-11-26T07:18:01.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbe4c79640 1 -- start start 2023-11-26T07:18:01.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbe4c79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe015d6e0 0x7fcbe00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbe4c79640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcbe00b2160 0x7fcbe00d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbe4c79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe00cf0e0 con 0x7fcbe00d19f0 2023-11-26T07:18:01.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbe4c79640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe015dac0 con 0x7fcbe00b2160 2023-11-26T07:18:01.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbe4c79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00d1e80 con 0x7fcbe015d6e0 2023-11-26T07:18:01.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbded9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcbe00d19f0 0x7fcbe00cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51408/0 (socket says 172.21.15.70:51408) 2023-11-26T07:18:01.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbded9d640 1 -- 172.21.15.70:0/1705278488 learned_addr learned my addr 172.21.15.70:0/1705278488 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:01.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbddd9b640 1 --2- 172.21.15.70:0/1705278488 >> v2:172.21.15.120:3300/0 conn(0x7fcbe00b2160 0x7fcbe00d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbde59c640 1 --2- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe015d6e0 0x7fcbe00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbdd59a640 1 -- 172.21.15.70:0/1705278488 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896842916 0 0) 0x7fcbe00cf0e0 con 0x7fcbe00d19f0 2023-11-26T07:18:01.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbdd59a640 1 -- 172.21.15.70:0/1705278488 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc8003530 con 0x7fcbe00d19f0 2023-11-26T07:18:01.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbddd9b640 1 -- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe015d6e0 msgr2=0x7fcbe00d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:01.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbdd59a640 1 -- 172.21.15.70:0/1705278488 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861576525 0 0) 0x7fcbc8003530 con 0x7fcbe00d19f0 2023-11-26T07:18:01.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbddd9b640 1 --2- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe015d6e0 0x7fcbe00d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbddd9b640 1 -- 172.21.15.70:0/1705278488 >> v1:172.21.15.70:6789/0 conn(0x7fcbe00d19f0 legacy=0x7fcbe00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbddd9b640 1 -- 172.21.15.70:0/1705278488 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00ceb20 con 0x7fcbe00b2160 2023-11-26T07:18:01.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.719+0000 7fcbde59c640 1 --2- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe015d6e0 0x7fcbe00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:01.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.723+0000 7fcbddd9b640 1 --2- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe00d14b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40097c0 tx=0x7fcbd401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9232286ded325b4d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.723+0000 7fcbdd59a640 1 -- 172.21.15.70:0/1705278488 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8001a00 con 0x7fcbe00b2160 2023-11-26T07:18:01.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.723+0000 7fcbdd59a640 1 -- 172.21.15.70:0/1705278488 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd40a7050 con 0x7fcbe00b2160 2023-11-26T07:18:01.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.723+0000 7fcbdd59a640 1 -- 172.21.15.70:0/1705278488 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40ab620 con 0x7fcbe00b2160 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.723+0000 7fcbe4c79640 1 -- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 msgr2=0x7fcbe00d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.723+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe00d14b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40097c0 tx=0x7fcbd401c3a0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- 172.21.15.70:0/1705278488 shutdown_connections 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe00d14b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/1705278488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe015d6e0 0x7fcbe00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- 172.21.15.70:0/1705278488 >> 172.21.15.70:0/1705278488 conn(0x7fcbe009c550 msgr2=0x7fcbe00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- 172.21.15.70:0/1705278488 shutdown_connections 2023-11-26T07:18:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- 172.21.15.70:0/1705278488 wait complete. 2023-11-26T07:18:01.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 Processor -- start 2023-11-26T07:18:01.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- start start 2023-11-26T07:18:01.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe00d19f0 0x7fcbe0156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbe015d6e0 0x7fcbe006b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe0153740 con 0x7fcbe015d6e0 2023-11-26T07:18:01.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00cc080 con 0x7fcbe00b2160 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbe4c79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00b5e10 con 0x7fcbe00d19f0 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbe015d6e0 0x7fcbe006b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbe015d6e0 0x7fcbe006b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60794/0 (socket says 172.21.15.70:60794) 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 -- 172.21.15.70:0/2879325257 learned_addr learned my addr 172.21.15.70:0/2879325257 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 -- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe00d19f0 msgr2=0x7fcbe0156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe00d19f0 0x7fcbe0156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbde59c640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 -- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 msgr2=0x7fcbe0152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe0152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 -- 172.21.15.70:0/2879325257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd0009420 con 0x7fcbe015d6e0 2023-11-26T07:18:01.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbde59c640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe0152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:01.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbded9d640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbe015d6e0 0x7fcbe006b0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8001840 tx=0x7fcbd800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.727+0000 7fcbceffd640 1 -- 172.21.15.70:0/2879325257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8012400 con 0x7fcbe015d6e0 2023-11-26T07:18:01.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbceffd640 1 -- 172.21.15.70:0/2879325257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd8012580 con 0x7fcbe015d6e0 2023-11-26T07:18:01.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd4009420 con 0x7fcbe015d6e0 2023-11-26T07:18:01.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbceffd640 1 -- 172.21.15.70:0/2879325257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8012930 con 0x7fcbe015d6e0 2023-11-26T07:18:01.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe00cc290 con 0x7fcbe015d6e0 2023-11-26T07:18:01.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe0153880 con 0x7fcbe015d6e0 2023-11-26T07:18:01.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbceffd640 1 -- 172.21.15.70:0/2879325257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbd8012a90 con 0x7fcbe015d6e0 2023-11-26T07:18:01.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbceffd640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc0066470 0x7fcbc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:01.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbceffd640 1 -- 172.21.15.70:0/2879325257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcbd8084310 con 0x7fcbe015d6e0 2023-11-26T07:18:01.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbde59c640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc0066470 0x7fcbc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:01.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.731+0000 7fcbde59c640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc0066470 0x7fcbc0068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009bd0 tx=0x7fcbd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:01.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.735+0000 7fcbceffd640 1 -- 172.21.15.70:0/2879325257 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbe0153880 con 0x7fcbe015d6e0 2023-11-26T07:18:01.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:01.887+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcbe0153880 con 0x7fcbe015d6e0 2023-11-26T07:18:02.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.075+0000 7fcbceffd640 1 -- 172.21.15.70:0/2879325257 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcbe0153880 con 0x7fcbe015d6e0 2023-11-26T07:18:02.081 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2023-11-26T07:18:02.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc0066470 msgr2=0x7fcbc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:02.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc0066470 0x7fcbc0068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009bd0 tx=0x7fcbd0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:02.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbe015d6e0 msgr2=0x7fcbe006b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:02.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbe015d6e0 0x7fcbe006b0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8001840 tx=0x7fcbd800a430 comp rx=0 tx=0).stop 2023-11-26T07:18:02.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 shutdown_connections 2023-11-26T07:18:02.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc0066470 0x7fcbc0068930 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009bd0 tx=0x7fcbd0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbe015d6e0 0x7fcbe006b0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe00d19f0 0x7fcbe0156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 --2- 172.21.15.70:0/2879325257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe00b2160 0x7fcbe0152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 >> 172.21.15.70:0/2879325257 conn(0x7fcbe009c550 msgr2=0x7fcbe00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 shutdown_connections 2023-11-26T07:18:02.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.079+0000 7fcbe4c79640 1 -- 172.21.15.70:0/2879325257 wait complete. 2023-11-26T07:18:02.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:18:02.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e51eea640 1 Processor -- start 2023-11-26T07:18:02.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e51eea640 1 -- start start 2023-11-26T07:18:02.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e51eea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:02.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e51eea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e4c071550 0x7f3e4c0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:02.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e51eea640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0b25f0 con 0x7f3e4c143c00 2023-11-26T07:18:02.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e51eea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c071f20 con 0x7f3e4c071550 2023-11-26T07:18:02.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e51eea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b28d0 con 0x7f3e4c070390 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e4bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e4c071550 0x7f3e4c0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e4bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e4c071550 0x7f3e4c0719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60796/0 (socket says 172.21.15.70:60796) 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e4bfff640 1 -- 172.21.15.70:0/2807594308 learned_addr learned my addr 172.21.15.70:0/2807594308 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e43fff640 1 --2- 172.21.15.70:0/2807594308 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e4bfff640 1 -- 172.21.15.70:0/2807594308 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 msgr2=0x7f3e4c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e4bfff640 1 --2- 172.21.15.70:0/2807594308 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e4bfff640 1 -- 172.21.15.70:0/2807594308 >> v1:172.21.15.120:6789/0 conn(0x7f3e4c143c00 legacy=0x7f3e4c0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:02.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.247+0000 7f3e4bfff640 1 -- 172.21.15.70:0/2807594308 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0b2bb0 con 0x7f3e4c071550 2023-11-26T07:18:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e4bfff640 1 --2- 172.21.15.70:0/2807594308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c071550 0x7f3e4c0719e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009e50 tx=0x7f3e4401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa79984e201a0541 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e4affd640 1 -- 172.21.15.70:0/2807594308 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440a5750 con 0x7f3e4c071550 2023-11-26T07:18:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e4affd640 1 -- 172.21.15.70:0/2807594308 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e440a58b0 con 0x7f3e4c071550 2023-11-26T07:18:02.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e4affd640 1 -- 172.21.15.70:0/2807594308 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440a5c40 con 0x7f3e4c071550 2023-11-26T07:18:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 -- 172.21.15.70:0/2807594308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c071550 msgr2=0x7f3e4c0719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 --2- 172.21.15.70:0/2807594308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c071550 0x7f3e4c0719e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009e50 tx=0x7f3e4401c980 comp rx=0 tx=0).stop 2023-11-26T07:18:02.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 -- 172.21.15.70:0/2807594308 shutdown_connections 2023-11-26T07:18:02.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 --2- 172.21.15.70:0/2807594308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c071550 0x7f3e4c0719e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 --2- 172.21.15.70:0/2807594308 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 -- 172.21.15.70:0/2807594308 >> 172.21.15.70:0/2807594308 conn(0x7f3e4c0b0bf0 msgr2=0x7f3e4c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:02.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 -- 172.21.15.70:0/2807594308 shutdown_connections 2023-11-26T07:18:02.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.251+0000 7f3e51eea640 1 -- 172.21.15.70:0/2807594308 wait complete. 2023-11-26T07:18:02.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 Processor -- start 2023-11-26T07:18:02.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 -- start start 2023-11-26T07:18:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e4c071550 0x7f3e4c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c143c00 0x7f3e4c158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c157550 con 0x7f3e4c143c00 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c1577f0 con 0x7f3e4c071550 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c157ad0 con 0x7f3e4c070390 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c143c00 0x7f3e4c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c143c00 0x7f3e4c158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60808/0 (socket says 172.21.15.70:60808) 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 -- 172.21.15.70:0/762789468 learned_addr learned my addr 172.21.15.70:0/762789468 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e43fff640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e4c071550 0x7f3e4c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4b7fe640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 -- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 msgr2=0x7f3e4c142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 -- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e4c071550 msgr2=0x7f3e4c157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e4c071550 0x7f3e4c157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 -- 172.21.15.70:0/762789468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44009b30 con 0x7f3e4c143c00 2023-11-26T07:18:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e4bfff640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c143c00 0x7f3e4c158890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e440af040 tx=0x7f3e44019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e48ff9640 1 -- 172.21.15.70:0/762789468 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440a5e30 con 0x7f3e4c143c00 2023-11-26T07:18:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e48ff9640 1 -- 172.21.15.70:0/762789468 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44009250 con 0x7f3e4c143c00 2023-11-26T07:18:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c157db0 con 0x7f3e4c143c00 2023-11-26T07:18:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e48ff9640 1 -- 172.21.15.70:0/762789468 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440b86b0 con 0x7f3e4c143c00 2023-11-26T07:18:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.255+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c158370 con 0x7f3e4c143c00 2023-11-26T07:18:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.259+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c067720 con 0x7f3e4c143c00 2023-11-26T07:18:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.259+0000 7f3e48ff9640 1 -- 172.21.15.70:0/762789468 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e440b8810 con 0x7f3e4c143c00 2023-11-26T07:18:02.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.259+0000 7f3e48ff9640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e2c066470 0x7f3e2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:02.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.259+0000 7f3e48ff9640 1 -- 172.21.15.70:0/762789468 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3e4411f160 con 0x7f3e4c143c00 2023-11-26T07:18:02.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.259+0000 7f3e4b7fe640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e2c066470 0x7f3e2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:02.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.259+0000 7f3e4b7fe640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e2c066470 0x7f3e2c068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0cf2b0 tx=0x7f3e3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:02.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.263+0000 7f3e48ff9640 1 -- 172.21.15.70:0/762789468 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e440ec860 con 0x7f3e4c143c00 2023-11-26T07:18:02.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:02.415+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e4c13feb0 con 0x7f3e4c143c00 2023-11-26T07:18:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.087+0000 7f3e48ff9640 1 -- 172.21.15.70:0/762789468 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e440efe80 con 0x7f3e4c143c00 2023-11-26T07:18:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2023-11-26T07:18:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e2c066470 msgr2=0x7f3e2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e2c066470 0x7f3e2c068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0cf2b0 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c143c00 msgr2=0x7f3e4c158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c143c00 0x7f3e4c158890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e440af040 tx=0x7f3e44019720 comp rx=0 tx=0).stop 2023-11-26T07:18:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 shutdown_connections 2023-11-26T07:18:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e2c066470 0x7f3e2c068930 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0cf2b0 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e4c143c00 0x7f3e4c158890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e4c071550 0x7f3e4c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 --2- 172.21.15.70:0/762789468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e4c070390 0x7f3e4c142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 >> 172.21.15.70:0/762789468 conn(0x7f3e4c0b0bf0 msgr2=0x7f3e4c0cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 shutdown_connections 2023-11-26T07:18:03.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.091+0000 7f3e51eea640 1 -- 172.21.15.70:0/762789468 wait complete. 2023-11-26T07:18:03.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:18:03.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.275+0000 7f3860301640 1 Processor -- start 2023-11-26T07:18:03.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.275+0000 7f3860301640 1 -- start start 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f3860301640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f3860301640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f385815f4e0 0x7f38580cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f3860301640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385806c520 con 0x7f385813e290 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f3860301640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385806c800 con 0x7f385815f4e0 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f3860301640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385806cae0 con 0x7f38580cf990 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385e09d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f385813e290 0x7f38580cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:51420/0 (socket says 172.21.15.70:51420) 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385e09d640 1 -- 172.21.15.70:0/1472757770 learned_addr learned my addr 172.21.15.70:0/1472757770 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385d89c640 1 --2- 172.21.15.70:0/1472757770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385e89e640 1 --2- 172.21.15.70:0/1472757770 >> v2:172.21.15.120:3300/0 conn(0x7f385815f4e0 0x7f38580cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385d09b640 1 -- 172.21.15.70:0/1472757770 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372637209 0 0) 0x7f385806c520 con 0x7f385813e290 2023-11-26T07:18:03.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385d09b640 1 -- 172.21.15.70:0/1472757770 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3844003530 con 0x7f385813e290 2023-11-26T07:18:03.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385d89c640 1 -- 172.21.15.70:0/1472757770 >> v2:172.21.15.120:3300/0 conn(0x7f385815f4e0 msgr2=0x7f38580cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:03.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385d89c640 1 --2- 172.21.15.70:0/1472757770 >> v2:172.21.15.120:3300/0 conn(0x7f385815f4e0 0x7f38580cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385d89c640 1 -- 172.21.15.70:0/1472757770 >> v1:172.21.15.70:6789/0 conn(0x7f385813e290 legacy=0x7f38580cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.279+0000 7f385d89c640 1 -- 172.21.15.70:0/1472757770 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385806cdc0 con 0x7f38580cf990 2023-11-26T07:18:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f385d89c640 1 --2- 172.21.15.70:0/1472757770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815efa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38480097c0 tx=0x7f384801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d99cfec13dc21824 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f385d09b640 1 -- 172.21.15.70:0/1472757770 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480ab670 con 0x7f38580cf990 2023-11-26T07:18:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f385d09b640 1 -- 172.21.15.70:0/1472757770 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38480ab7d0 con 0x7f38580cf990 2023-11-26T07:18:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f385d09b640 1 -- 172.21.15.70:0/1472757770 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480abb60 con 0x7f38580cf990 2023-11-26T07:18:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 -- 172.21.15.70:0/1472757770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 msgr2=0x7f385815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 --2- 172.21.15.70:0/1472757770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815efa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38480097c0 tx=0x7f384801c450 comp rx=0 tx=0).stop 2023-11-26T07:18:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 -- 172.21.15.70:0/1472757770 shutdown_connections 2023-11-26T07:18:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 --2- 172.21.15.70:0/1472757770 >> v2:172.21.15.120:3300/0 conn(0x7f385815f4e0 0x7f38580cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 --2- 172.21.15.70:0/1472757770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815efa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 -- 172.21.15.70:0/1472757770 >> 172.21.15.70:0/1472757770 conn(0x7f385806a890 msgr2=0x7f385806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 -- 172.21.15.70:0/1472757770 shutdown_connections 2023-11-26T07:18:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 -- 172.21.15.70:0/1472757770 wait complete. 2023-11-26T07:18:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 Processor -- start 2023-11-26T07:18:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.283+0000 7f3860301640 1 -- start start 2023-11-26T07:18:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f385813e290 0x7f38580b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f385815f4e0 0x7f38581f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385815b8e0 con 0x7f385813e290 2023-11-26T07:18:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b0b00 con 0x7f385815f4e0 2023-11-26T07:18:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580b0d80 con 0x7f38580cf990 2023-11-26T07:18:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f385813e290 0x7f38580b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f385813e290 0x7f38580b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60824/0 (socket says 172.21.15.70:60824) 2023-11-26T07:18:03.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 -- 172.21.15.70:0/3827796635 learned_addr learned my addr 172.21.15.70:0/3827796635 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385e09d640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385e89e640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f385815f4e0 0x7f38581f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 -- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 msgr2=0x7f385815e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 -- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f385815f4e0 msgr2=0x7f38581f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f385815f4e0 0x7f38581f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 -- 172.21.15.70:0/3827796635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848009420 con 0x7f385813e290 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385e89e640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f385815f4e0 0x7f38581f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f385d89c640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f385813e290 0x7f38580b05c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38480ad040 tx=0x7f384801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f384effd640 1 -- 172.21.15.70:0/3827796635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480bf610 con 0x7f385813e290 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f384effd640 1 -- 172.21.15.70:0/3827796635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38480bf7b0 con 0x7f385813e290 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580b1060 con 0x7f385813e290 2023-11-26T07:18:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f384effd640 1 -- 172.21.15.70:0/3827796635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480bfb60 con 0x7f385813e290 2023-11-26T07:18:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385815baf0 con 0x7f385813e290 2023-11-26T07:18:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385815bce0 con 0x7f385813e290 2023-11-26T07:18:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.287+0000 7f384effd640 1 -- 172.21.15.70:0/3827796635 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f38480ca430 con 0x7f385813e290 2023-11-26T07:18:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.291+0000 7f384effd640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f383c066470 0x7f383c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.291+0000 7f384effd640 1 -- 172.21.15.70:0/3827796635 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f385815fb00 con 0x7f385813e290 2023-11-26T07:18:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.291+0000 7f385e09d640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f383c066470 0x7f383c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.291+0000 7f385e09d640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f383c066470 0x7f383c068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f38540011f0 tx=0x7f3854009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:03.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.295+0000 7f384effd640 1 -- 172.21.15.70:0/3827796635 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38480ec1a0 con 0x7f385813e290 2023-11-26T07:18:03.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:03.475+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3858067680 con 0x7f385813e290 2023-11-26T07:18:04.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f384effd640 1 -- 172.21.15.70:0/3827796635 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f38480ef7c0 con 0x7f385813e290 2023-11-26T07:18:04.094 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2023-11-26T07:18:04.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f383c066470 msgr2=0x7f383c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f383c066470 0x7f383c068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f38540011f0 tx=0x7f3854009040 comp rx=0 tx=0).stop 2023-11-26T07:18:04.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f385813e290 msgr2=0x7f38580b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f385813e290 0x7f38580b05c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f38480ad040 tx=0x7f384801ac90 comp rx=0 tx=0).stop 2023-11-26T07:18:04.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 shutdown_connections 2023-11-26T07:18:04.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f383c066470 0x7f383c068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f385813e290 0x7f38580b05c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f385815f4e0 0x7f38581f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 --2- 172.21.15.70:0/3827796635 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f38580cf990 0x7f385815e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 >> 172.21.15.70:0/3827796635 conn(0x7f385806a890 msgr2=0x7f3858071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:04.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 shutdown_connections 2023-11-26T07:18:04.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.091+0000 7f3860301640 1 -- 172.21.15.70:0/3827796635 wait complete. 2023-11-26T07:18:04.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:04.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16f61aa640 1 Processor -- start 2023-11-26T07:18:04.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16f61aa640 1 -- start start 2023-11-26T07:18:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16f61aa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f16f0070ba0 0x7f16f015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16f61aa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f16f00cd610 0x7f16f01610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16f61aa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f00cde60 con 0x7f16f006bae0 2023-11-26T07:18:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16f61aa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f015dc10 con 0x7f16f0070ba0 2023-11-26T07:18:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16f61aa640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f015def0 con 0x7f16f00cd610 2023-11-26T07:18:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16ef7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f16f0070ba0 0x7f16f015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16ef7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f16f0070ba0 0x7f16f015e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59802/0 (socket says 172.21.15.70:59802) 2023-11-26T07:18:04.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.255+0000 7f16ef7fe640 1 -- 172.21.15.70:0/3530839066 learned_addr learned my addr 172.21.15.70:0/3530839066 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:04.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16effff640 1 --2- 172.21.15.70:0/3530839066 >> v2:172.21.15.120:3300/0 conn(0x7f16f00cd610 0x7f16f01610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16ef7fe640 1 -- 172.21.15.70:0/3530839066 >> v2:172.21.15.120:3300/0 conn(0x7f16f00cd610 msgr2=0x7f16f01610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:04.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16ef7fe640 1 --2- 172.21.15.70:0/3530839066 >> v2:172.21.15.120:3300/0 conn(0x7f16f00cd610 0x7f16f01610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16ef7fe640 1 -- 172.21.15.70:0/3530839066 >> v1:172.21.15.120:6789/0 conn(0x7f16f006bae0 legacy=0x7f16f0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:04.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16ef7fe640 1 -- 172.21.15.70:0/3530839066 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f015e1d0 con 0x7f16f0070ba0 2023-11-26T07:18:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16ef7fe640 1 --2- 172.21.15.70:0/3530839066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0070ba0 0x7f16f015e6f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16f0072570 tx=0x7f16e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183d9f780a6adb34 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16eeffd640 1 -- 172.21.15.70:0/3530839066 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00ac630 con 0x7f16f0070ba0 2023-11-26T07:18:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16eeffd640 1 -- 172.21.15.70:0/3530839066 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e00ac790 con 0x7f16f0070ba0 2023-11-26T07:18:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.259+0000 7f16eeffd640 1 -- 172.21.15.70:0/3530839066 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00acb20 con 0x7f16f0070ba0 2023-11-26T07:18:04.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- 172.21.15.70:0/3530839066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0070ba0 msgr2=0x7f16f015e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 --2- 172.21.15.70:0/3530839066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0070ba0 0x7f16f015e6f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16f0072570 tx=0x7f16e001c430 comp rx=0 tx=0).stop 2023-11-26T07:18:04.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- 172.21.15.70:0/3530839066 shutdown_connections 2023-11-26T07:18:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 --2- 172.21.15.70:0/3530839066 >> v2:172.21.15.120:3300/0 conn(0x7f16f00cd610 0x7f16f01610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 --2- 172.21.15.70:0/3530839066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0070ba0 0x7f16f015e6f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- 172.21.15.70:0/3530839066 >> 172.21.15.70:0/3530839066 conn(0x7f16f00cf710 msgr2=0x7f16f00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- 172.21.15.70:0/3530839066 shutdown_connections 2023-11-26T07:18:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- 172.21.15.70:0/3530839066 wait complete. 2023-11-26T07:18:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 Processor -- start 2023-11-26T07:18:04.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- start start 2023-11-26T07:18:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16f006bae0 0x7f16f0159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0070ba0 0x7f16f01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f00cd610 0x7f16f0151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0151f40 con 0x7f16f00cd610 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01563f0 con 0x7f16f0070ba0 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16f61aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01560c0 con 0x7f16f006bae0 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f00cd610 0x7f16f0151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f00cd610 0x7f16f0151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59804/0 (socket says 172.21.15.70:59804) 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 -- 172.21.15.70:0/2801689829 learned_addr learned my addr 172.21.15.70:0/2801689829 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16e7fff640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0070ba0 0x7f16f01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16ef7fe640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16f006bae0 0x7f16f0159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 -- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16f006bae0 msgr2=0x7f16f0159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16f006bae0 0x7f16f0159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 -- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0070ba0 msgr2=0x7f16f01514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0070ba0 0x7f16f01514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.263+0000 7f16effff640 1 -- 172.21.15.70:0/2801689829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00094d0 con 0x7f16f00cd610 2023-11-26T07:18:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16effff640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f00cd610 0x7f16f0151a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16e8007e60 tx=0x7f16e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ecff9640 1 -- 172.21.15.70:0/2801689829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8014420 con 0x7f16f00cd610 2023-11-26T07:18:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ecff9640 1 -- 172.21.15.70:0/2801689829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e80145a0 con 0x7f16f00cd610 2023-11-26T07:18:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ecff9640 1 -- 172.21.15.70:0/2801689829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8014950 con 0x7f16f00cd610 2023-11-26T07:18:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f015c4d0 con 0x7f16f00cd610 2023-11-26T07:18:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f015ca90 con 0x7f16f00cd610 2023-11-26T07:18:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f0156560 con 0x7f16f00cd610 2023-11-26T07:18:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ecff9640 1 -- 172.21.15.70:0/2801689829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16e8014ab0 con 0x7f16f00cd610 2023-11-26T07:18:04.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ecff9640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16d0066470 0x7f16d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ecff9640 1 -- 172.21.15.70:0/2801689829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e8084660 con 0x7f16f00cd610 2023-11-26T07:18:04.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ef7fe640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16d0066470 0x7f16d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.267+0000 7f16ef7fe640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16d0066470 0x7f16d0068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16e00ae000 tx=0x7f16e00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.271+0000 7f16ecff9640 1 -- 172.21.15.70:0/2801689829 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16e8051b80 con 0x7f16f00cd610 2023-11-26T07:18:04.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.423+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f0067680 con 0x7f16f00cd610 2023-11-26T07:18:04.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16ecff9640 1 -- 172.21.15.70:0/2801689829 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f16e80551a0 con 0x7f16f00cd610 2023-11-26T07:18:04.432 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:04.432 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:03.481734+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16d0066470 msgr2=0x7f16d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16d0066470 0x7f16d0068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f16e00ae000 tx=0x7f16e00a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f00cd610 msgr2=0x7f16f0151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f00cd610 0x7f16f0151a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16e8007e60 tx=0x7f16e800e4b0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 shutdown_connections 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16d0066470 0x7f16d0068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f00cd610 0x7f16f0151a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0070ba0 0x7f16f01514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 --2- 172.21.15.70:0/2801689829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16f006bae0 0x7f16f0159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 >> 172.21.15.70:0/2801689829 conn(0x7f16f00cf710 msgr2=0x7f16f00b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:04.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 shutdown_connections 2023-11-26T07:18:04.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.427+0000 7f16f61aa640 1 -- 172.21.15.70:0/2801689829 wait complete. 2023-11-26T07:18:04.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:04.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f5aa32640 1 Processor -- start 2023-11-26T07:18:04.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f5aa32640 1 -- start start 2023-11-26T07:18:04.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f5aa32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f5aa32640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4f540d1bc0 0x7f4f540b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f5aa32640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f540cf0e0 con 0x7f4f540b2160 2023-11-26T07:18:04.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f5aa32640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5415dac0 con 0x7f4f540d1bc0 2023-11-26T07:18:04.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f5aa32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540ceb20 con 0x7f4f5415d6e0 2023-11-26T07:18:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f53fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f58fcf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4f540d1bc0 0x7f4f540b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f53fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53700/0 (socket says 172.21.15.70:53700) 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f53fff640 1 -- 172.21.15.70:0/2286607059 learned_addr learned my addr 172.21.15.70:0/2286607059 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f537fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4f540b2160 0x7f4f540d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40844/0 (socket says 172.21.15.70:40844) 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f53fff640 1 -- 172.21.15.70:0/2286607059 >> v2:172.21.15.120:3300/0 conn(0x7f4f540d1bc0 msgr2=0x7f4f540b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f53fff640 1 --2- 172.21.15.70:0/2286607059 >> v2:172.21.15.120:3300/0 conn(0x7f4f540d1bc0 0x7f4f540b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f53fff640 1 -- 172.21.15.70:0/2286607059 >> v1:172.21.15.120:6789/0 conn(0x7f4f540b2160 legacy=0x7f4f540d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f53fff640 1 -- 172.21.15.70:0/2286607059 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540cee00 con 0x7f4f5415d6e0 2023-11-26T07:18:04.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.587+0000 7f4f58fcf640 1 --2- 172.21.15.70:0/2286607059 >> v2:172.21.15.120:3300/0 conn(0x7f4f540d1bc0 0x7f4f540b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f53fff640 1 --2- 172.21.15.70:0/2286607059 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540d0df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009870 tx=0x7f4f4401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316537dd12d9f98 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f52ffd640 1 -- 172.21.15.70:0/2286607059 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440a7070 con 0x7f4f5415d6e0 2023-11-26T07:18:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f52ffd640 1 -- 172.21.15.70:0/2286607059 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f440ab430 con 0x7f4f5415d6e0 2023-11-26T07:18:04.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f52ffd640 1 -- 172.21.15.70:0/2286607059 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440ab7c0 con 0x7f4f5415d6e0 2023-11-26T07:18:04.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 -- 172.21.15.70:0/2286607059 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 msgr2=0x7f4f540d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/2286607059 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540d0df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009870 tx=0x7f4f4401c540 comp rx=0 tx=0).stop 2023-11-26T07:18:04.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 -- 172.21.15.70:0/2286607059 shutdown_connections 2023-11-26T07:18:04.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/2286607059 >> v2:172.21.15.120:3300/0 conn(0x7f4f540d1bc0 0x7f4f540b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/2286607059 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540d0df0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 -- 172.21.15.70:0/2286607059 >> 172.21.15.70:0/2286607059 conn(0x7f4f5409c550 msgr2=0x7f4f540d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:04.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 -- 172.21.15.70:0/2286607059 shutdown_connections 2023-11-26T07:18:04.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.591+0000 7f4f5aa32640 1 -- 172.21.15.70:0/2286607059 wait complete. 2023-11-26T07:18:04.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 Processor -- start 2023-11-26T07:18:04.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 -- start start 2023-11-26T07:18:04.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f540b2160 0x7f4f541f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f540d1bc0 0x7f4f54143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540cd510 con 0x7f4f540b2160 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540c8870 con 0x7f4f540d1bc0 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540c7f40 con 0x7f4f5415d6e0 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f540b2160 0x7f4f541f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f540b2160 0x7f4f541f9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59818/0 (socket says 172.21.15.70:59818) 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 -- 172.21.15.70:0/606269826 learned_addr learned my addr 172.21.15.70:0/606269826 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f537fe640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f540d1bc0 0x7f4f54143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f58fcf640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 -- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 msgr2=0x7f4f540ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 -- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f540d1bc0 msgr2=0x7f4f54143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f540d1bc0 0x7f4f54143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 -- 172.21.15.70:0/606269826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c009a70 con 0x7f4f540b2160 2023-11-26T07:18:04.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f53fff640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f540b2160 0x7f4f541f9550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f440ad040 tx=0x7f4f440192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f50ff9640 1 -- 172.21.15.70:0/606269826 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440bc070 con 0x7f4f540b2160 2023-11-26T07:18:04.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f50ff9640 1 -- 172.21.15.70:0/606269826 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f440b4420 con 0x7f4f540b2160 2023-11-26T07:18:04.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f50ff9640 1 -- 172.21.15.70:0/606269826 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440b47f0 con 0x7f4f540b2160 2023-11-26T07:18:04.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f440094d0 con 0x7f4f540b2160 2023-11-26T07:18:04.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.595+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f540c8500 con 0x7f4f540b2160 2023-11-26T07:18:04.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.599+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f54067680 con 0x7f4f540b2160 2023-11-26T07:18:04.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.599+0000 7f4f50ff9640 1 -- 172.21.15.70:0/606269826 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f440b4950 con 0x7f4f540b2160 2023-11-26T07:18:04.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.599+0000 7f4f50ff9640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4f40066470 0x7f4f40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.599+0000 7f4f50ff9640 1 -- 172.21.15.70:0/606269826 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f4411d600 con 0x7f4f540b2160 2023-11-26T07:18:04.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.599+0000 7f4f537fe640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4f40066470 0x7f4f40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.599+0000 7f4f537fe640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4f40066470 0x7f4f40068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f540b8fb0 tx=0x7f4f48007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.603+0000 7f4f50ff9640 1 -- 172.21.15.70:0/606269826 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f440eaa70 con 0x7f4f540b2160 2023-11-26T07:18:04.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.755+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f540d26c0 con 0x7f4f540b2160 2023-11-26T07:18:04.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f50ff9640 1 -- 172.21.15.70:0/606269826 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f4f440ee090 con 0x7f4f540b2160 2023-11-26T07:18:04.764 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:04.764 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":20,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:03.481734+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:04.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4f40066470 msgr2=0x7f4f40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4f40066470 0x7f4f40068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f540b8fb0 tx=0x7f4f48007e50 comp rx=0 tx=0).stop 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f540b2160 msgr2=0x7f4f541f9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f540b2160 0x7f4f541f9550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f440ad040 tx=0x7f4f440192e0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 shutdown_connections 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f5415d6e0 0x7f4f540ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f540d1bc0 0x7f4f54143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4f40066470 0x7f4f40068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 --2- 172.21.15.70:0/606269826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f540b2160 0x7f4f541f9550 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 >> 172.21.15.70:0/606269826 conn(0x7f4f5409c550 msgr2=0x7f4f540734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 shutdown_connections 2023-11-26T07:18:04.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.759+0000 7f4f5aa32640 1 -- 172.21.15.70:0/606269826 wait complete. 2023-11-26T07:18:04.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:18:04.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.923+0000 7f65a2a68640 1 Processor -- start 2023-11-26T07:18:04.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.923+0000 7f65a2a68640 1 -- start start 2023-11-26T07:18:04.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.923+0000 7f65a2a68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c143ac0 0x7f659c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.923+0000 7f65a2a68640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f659c0708b0 0x7f659c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.923+0000 7f65a2a68640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c0cfbf0 con 0x7f659c0cf7c0 2023-11-26T07:18:04.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.923+0000 7f65a2a68640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c143ea0 con 0x7f659c0708b0 2023-11-26T07:18:04.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.923+0000 7f65a2a68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0cc730 con 0x7f659c143ac0 2023-11-26T07:18:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f659c0708b0 0x7f659c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f65a0804640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c143ac0 0x7f659c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f659c0708b0 0x7f659c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52142/0 (socket says 172.21.15.70:52142) 2023-11-26T07:18:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 -- 172.21.15.70:0/3783722311 learned_addr learned my addr 172.21.15.70:0/3783722311 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f65a1005640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f659c0cf7c0 0x7f659c0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40858/0 (socket says 172.21.15.70:40858) 2023-11-26T07:18:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 -- 172.21.15.70:0/3783722311 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c143ac0 msgr2=0x7f659c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 --2- 172.21.15.70:0/3783722311 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c143ac0 0x7f659c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 -- 172.21.15.70:0/3783722311 >> v1:172.21.15.120:6789/0 conn(0x7f659c0cf7c0 legacy=0x7f659c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 -- 172.21.15.70:0/3783722311 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c070ee0 con 0x7f659c0708b0 2023-11-26T07:18:04.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f6593fff640 1 --2- 172.21.15.70:0/3783722311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c0708b0 0x7f659c0cf280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f658c009870 tx=0x7f658c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816b34a6c4f0bbec server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f65937fe640 1 -- 172.21.15.70:0/3783722311 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0ab650 con 0x7f659c0708b0 2023-11-26T07:18:04.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f65937fe640 1 -- 172.21.15.70:0/3783722311 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0ab7b0 con 0x7f659c0708b0 2023-11-26T07:18:04.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.927+0000 7f65937fe640 1 -- 172.21.15.70:0/3783722311 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0abb40 con 0x7f659c0708b0 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 -- 172.21.15.70:0/3783722311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c0708b0 msgr2=0x7f659c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3783722311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c0708b0 0x7f659c0cf280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f658c009870 tx=0x7f658c01c540 comp rx=0 tx=0).stop 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 -- 172.21.15.70:0/3783722311 shutdown_connections 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3783722311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c0708b0 0x7f659c0cf280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3783722311 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c143ac0 0x7f659c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 -- 172.21.15.70:0/3783722311 >> 172.21.15.70:0/3783722311 conn(0x7f659c06a890 msgr2=0x7f659c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 -- 172.21.15.70:0/3783722311 shutdown_connections 2023-11-26T07:18:04.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 -- 172.21.15.70:0/3783722311 wait complete. 2023-11-26T07:18:04.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 Processor -- start 2023-11-26T07:18:04.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.931+0000 7f65a2a68640 1 -- start start 2023-11-26T07:18:04.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c0708b0 0x7f659c0acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f659c0cf7c0 0x7f659c0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c143ac0 0x7f659c1396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0ae1e0 con 0x7f659c0cf7c0 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0b1a20 con 0x7f659c143ac0 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c139c30 con 0x7f659c0708b0 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f659c0cf7c0 0x7f659c0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f659c0cf7c0 0x7f659c0b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59828/0 (socket says 172.21.15.70:59828) 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 -- 172.21.15.70:0/3362123779 learned_addr learned my addr 172.21.15.70:0/3362123779 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a0804640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c0708b0 0x7f659c0acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a1005640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c143ac0 0x7f659c1396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 -- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c0708b0 msgr2=0x7f659c0acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c0708b0 0x7f659c0acf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 -- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c143ac0 msgr2=0x7f659c1396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:04.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c143ac0 0x7f659c1396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:04.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 -- 172.21.15.70:0/3362123779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0094d0 con 0x7f659c0cf7c0 2023-11-26T07:18:04.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a0804640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c0708b0 0x7f659c0acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:04.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a1005640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c143ac0 0x7f659c1396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:04.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f6593fff640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f659c0cf7c0 0x7f659c0b14e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f658c0ad040 tx=0x7f658c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65917fa640 1 -- 172.21.15.70:0/3362123779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b4800 con 0x7f659c0cf7c0 2023-11-26T07:18:04.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65917fa640 1 -- 172.21.15.70:0/3362123779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0b4980 con 0x7f659c0cf7c0 2023-11-26T07:18:04.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c0ad5d0 con 0x7f659c0cf7c0 2023-11-26T07:18:04.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65917fa640 1 -- 172.21.15.70:0/3362123779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c0b4d30 con 0x7f659c0cf7c0 2023-11-26T07:18:04.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c0adb90 con 0x7f659c0cf7c0 2023-11-26T07:18:04.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.935+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c0ae350 con 0x7f659c0cf7c0 2023-11-26T07:18:04.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.939+0000 7f65917fa640 1 -- 172.21.15.70:0/3362123779 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f658c0b3380 con 0x7f659c0cf7c0 2023-11-26T07:18:04.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.939+0000 7f65917fa640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6588066470 0x7f6588068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:04.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.939+0000 7f65917fa640 1 -- 172.21.15.70:0/3362123779 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f658c11e380 con 0x7f659c0cf7c0 2023-11-26T07:18:04.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.939+0000 7f65a0804640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6588066470 0x7f6588068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:04.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.939+0000 7f65a0804640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6588066470 0x7f6588068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6598009bb0 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:04.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:04.943+0000 7f65917fa640 1 -- 172.21.15.70:0/3362123779 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f658c0eb9d0 con 0x7f659c0cf7c0 2023-11-26T07:18:05.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:05.127+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f659c067680 con 0x7f659c0cf7c0 2023-11-26T07:18:06.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.111+0000 7f65917fa640 1 -- 172.21.15.70:0/3362123779 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f658c0ab610 con 0x7f659c0cf7c0 2023-11-26T07:18:06.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6588066470 msgr2=0x7f6588068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6588066470 0x7f6588068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6598009bb0 tx=0x7f6598008040 comp rx=0 tx=0).stop 2023-11-26T07:18:06.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f659c0cf7c0 msgr2=0x7f659c0b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f659c0cf7c0 0x7f659c0b14e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f658c0ad040 tx=0x7f658c01ad80 comp rx=0 tx=0).stop 2023-11-26T07:18:06.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 shutdown_connections 2023-11-26T07:18:06.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6588066470 0x7f6588068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f659c0cf7c0 0x7f659c0b14e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f659c143ac0 0x7f659c1396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 --2- 172.21.15.70:0/3362123779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f659c0708b0 0x7f659c0acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 >> 172.21.15.70:0/3362123779 conn(0x7f659c06a890 msgr2=0x7f659c06ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:06.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 shutdown_connections 2023-11-26T07:18:06.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.115+0000 7f65a2a68640 1 -- 172.21.15.70:0/3362123779 wait complete. 2023-11-26T07:18:06.145 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:18:06.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:18:06.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.287+0000 7f74b7c13640 1 Processor -- start 2023-11-26T07:18:06.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.287+0000 7f74b7c13640 1 -- start start 2023-11-26T07:18:06.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74b0070fd0 0x7f74b0162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00cfc20 con 0x7f74b00cf7c0 2023-11-26T07:18:06.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b0162080 con 0x7f74b0070fd0 2023-11-26T07:18:06.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0161d70 con 0x7f74b014b1e0 2023-11-26T07:18:06.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74b0070fd0 0x7f74b0162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74b0070fd0 0x7f74b0162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59830/0 (socket says 172.21.15.70:59830) 2023-11-26T07:18:06.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 -- 172.21.15.70:0/1931360858 learned_addr learned my addr 172.21.15.70:0/1931360858 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:06.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b59af640 1 --2- 172.21.15.70:0/1931360858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 -- 172.21.15.70:0/1931360858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 msgr2=0x7f74b00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:06.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 --2- 172.21.15.70:0/1931360858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 -- 172.21.15.70:0/1931360858 >> v1:172.21.15.120:6789/0 conn(0x7f74b00cf7c0 legacy=0x7f74b00708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:06.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 -- 172.21.15.70:0/1931360858 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b014b5c0 con 0x7f74b0070fd0 2023-11-26T07:18:06.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b61b0640 1 --2- 172.21.15.70:0/1931360858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b0162510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e50 tx=0x7f74a801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42efc8c18d0c57b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b49ad640 1 -- 172.21.15.70:0/1931360858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80a58a0 con 0x7f74b0070fd0 2023-11-26T07:18:06.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b49ad640 1 -- 172.21.15.70:0/1931360858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a80a5a00 con 0x7f74b0070fd0 2023-11-26T07:18:06.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b49ad640 1 -- 172.21.15.70:0/1931360858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80a5d90 con 0x7f74b0070fd0 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- 172.21.15.70:0/1931360858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 msgr2=0x7f74b0162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1931360858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b0162510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e50 tx=0x7f74a801c9e0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- 172.21.15.70:0/1931360858 shutdown_connections 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1931360858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b0162510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1931360858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- 172.21.15.70:0/1931360858 >> 172.21.15.70:0/1931360858 conn(0x7f74b006a890 msgr2=0x7f74b006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- 172.21.15.70:0/1931360858 shutdown_connections 2023-11-26T07:18:06.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- 172.21.15.70:0/1931360858 wait complete. 2023-11-26T07:18:06.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 Processor -- start 2023-11-26T07:18:06.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- start start 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b00abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74b00cf7c0 0x7f74b0142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00ab920 con 0x7f74b0070fd0 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00aad10 con 0x7f74b00cf7c0 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b7c13640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00aaff0 con 0x7f74b014b1e0 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b59af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b00abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.291+0000 7f74b59af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b00abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59846/0 (socket says 172.21.15.70:59846) 2023-11-26T07:18:06.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b59af640 1 -- 172.21.15.70:0/1729779411 learned_addr learned my addr 172.21.15.70:0/1729779411 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b61b0640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b51ae640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74b00cf7c0 0x7f74b0142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b59af640 1 -- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 msgr2=0x7f74b00ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b59af640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b59af640 1 -- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74b00cf7c0 msgr2=0x7f74b0142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b59af640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74b00cf7c0 0x7f74b0142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b59af640 1 -- 172.21.15.70:0/1729779411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009b30 con 0x7f74b0070fd0 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b61b0640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b59af640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b00abdb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00d5f0 tx=0x7f74ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74a67fc640 1 -- 172.21.15.70:0/1729779411 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0125f0 con 0x7f74b0070fd0 2023-11-26T07:18:06.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74a67fc640 1 -- 172.21.15.70:0/1729779411 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac012750 con 0x7f74b0070fd0 2023-11-26T07:18:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00ab2d0 con 0x7f74b0070fd0 2023-11-26T07:18:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74a67fc640 1 -- 172.21.15.70:0/1729779411 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac012ae0 con 0x7f74b0070fd0 2023-11-26T07:18:06.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00aa850 con 0x7f74b0070fd0 2023-11-26T07:18:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b00aaad0 con 0x7f74b0070fd0 2023-11-26T07:18:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74a67fc640 1 -- 172.21.15.70:0/1729779411 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74ac012c40 con 0x7f74b0070fd0 2023-11-26T07:18:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74a67fc640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f74940664a0 0x7f7494068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.295+0000 7f74a67fc640 1 -- 172.21.15.70:0/1729779411 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74ac084320 con 0x7f74b0070fd0 2023-11-26T07:18:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.299+0000 7f74b51ae640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f74940664a0 0x7f7494068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.299+0000 7f74b51ae640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f74940664a0 0x7f7494068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74b00a8540 tx=0x7f74a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:06.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.299+0000 7f74a67fc640 1 -- 172.21.15.70:0/1729779411 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74b00aaad0 con 0x7f74b0070fd0 2023-11-26T07:18:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:06.479+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f74b00aaad0 con 0x7f74b0070fd0 2023-11-26T07:18:07.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.119+0000 7f74a67fc640 1 -- 172.21.15.70:0/1729779411 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74b00aaad0 con 0x7f74b0070fd0 2023-11-26T07:18:07.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f74940664a0 msgr2=0x7f7494068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f74940664a0 0x7f7494068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74b00a8540 tx=0x7f74a0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:07.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 msgr2=0x7f74b00abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b00abdb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00d5f0 tx=0x7f74ac00dab0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 shutdown_connections 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74b014b1e0 0x7f74b00ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74b00cf7c0 0x7f74b0142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f74940664a0 0x7f7494068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 --2- 172.21.15.70:0/1729779411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74b0070fd0 0x7f74b00abdb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 >> 172.21.15.70:0/1729779411 conn(0x7f74b006a890 msgr2=0x7f74b006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 shutdown_connections 2023-11-26T07:18:07.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.123+0000 7f74b7c13640 1 -- 172.21.15.70:0/1729779411 wait complete. 2023-11-26T07:18:07.147 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:18:07.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:07.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10eb31c640 1 Processor -- start 2023-11-26T07:18:07.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10eb31c640 1 -- start start 2023-11-26T07:18:07.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10eb31c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e40d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10eb31c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f10e40d3e60 0x7f10e40d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10eb31c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e40d21e0 con 0x7f10e40d1d30 2023-11-26T07:18:07.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10eb31c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e40d0bc0 con 0x7f10e40d3e60 2023-11-26T07:18:07.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10eb31c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40d0320 con 0x7f10e415d580 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10e90b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e40d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10e88b7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f10e40d3e60 0x7f10e40d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10e98b9640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f10e40d1d30 0x7f10e40cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40864/0 (socket says 172.21.15.70:40864) 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10e90b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e40d3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53750/0 (socket says 172.21.15.70:53750) 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.287+0000 7f10e98b9640 1 -- 172.21.15.70:0/4227824471 learned_addr learned my addr 172.21.15.70:0/4227824471 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10dbfff640 1 -- 172.21.15.70:0/4227824471 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28649282 0 0) 0x7f10e40d21e0 con 0x7f10e40d1d30 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10dbfff640 1 -- 172.21.15.70:0/4227824471 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d0003530 con 0x7f10e40d1d30 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10e90b8640 1 -- 172.21.15.70:0/4227824471 >> v2:172.21.15.120:3300/0 conn(0x7f10e40d3e60 msgr2=0x7f10e40d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10e90b8640 1 --2- 172.21.15.70:0/4227824471 >> v2:172.21.15.120:3300/0 conn(0x7f10e40d3e60 0x7f10e40d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10e90b8640 1 -- 172.21.15.70:0/4227824471 >> v1:172.21.15.120:6789/0 conn(0x7f10e40d1d30 legacy=0x7f10e40cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10e90b8640 1 -- 172.21.15.70:0/4227824471 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40d0600 con 0x7f10e415d580 2023-11-26T07:18:07.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10e88b7640 1 --2- 172.21.15.70:0/4227824471 >> v2:172.21.15.120:3300/0 conn(0x7f10e40d3e60 0x7f10e40d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:07.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10e90b8640 1 --2- 172.21.15.70:0/4227824471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e40d3920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e525fe6eb09843 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10dbfff640 1 -- 172.21.15.70:0/4227824471 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00ab650 con 0x7f10e415d580 2023-11-26T07:18:07.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10dbfff640 1 -- 172.21.15.70:0/4227824471 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e00ab7b0 con 0x7f10e415d580 2023-11-26T07:18:07.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10dbfff640 1 -- 172.21.15.70:0/4227824471 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00abb20 con 0x7f10e415d580 2023-11-26T07:18:07.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10eb31c640 1 -- 172.21.15.70:0/4227824471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 msgr2=0x7f10e40d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10eb31c640 1 --2- 172.21.15.70:0/4227824471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e40d3920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001c450 comp rx=0 tx=0).stop 2023-11-26T07:18:07.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10eb31c640 1 -- 172.21.15.70:0/4227824471 shutdown_connections 2023-11-26T07:18:07.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10eb31c640 1 --2- 172.21.15.70:0/4227824471 >> v2:172.21.15.120:3300/0 conn(0x7f10e40d3e60 0x7f10e40d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10eb31c640 1 --2- 172.21.15.70:0/4227824471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e40d3920 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.291+0000 7f10eb31c640 1 -- 172.21.15.70:0/4227824471 >> 172.21.15.70:0/4227824471 conn(0x7f10e409c550 msgr2=0x7f10e40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 -- 172.21.15.70:0/4227824471 shutdown_connections 2023-11-26T07:18:07.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 -- 172.21.15.70:0/4227824471 wait complete. 2023-11-26T07:18:07.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 Processor -- start 2023-11-26T07:18:07.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 -- start start 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10e40d1d30 0x7f10e4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e40d3e60 0x7f10e40cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e41582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40caed0 con 0x7f10e40d3e60 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e415a580 con 0x7f10e40d1d30 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10eb31c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40ccac0 con 0x7f10e415d580 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e90b8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10e40d1d30 0x7f10e4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e41582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e41582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53764/0 (socket says 172.21.15.70:53764) 2023-11-26T07:18:07.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 -- 172.21.15.70:0/2050285509 learned_addr learned my addr 172.21.15.70:0/2050285509 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:07.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e90b8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10e40d1d30 0x7f10e4155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52174/0 (socket says 172.21.15.70:52174) 2023-11-26T07:18:07.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e88b7640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e40d3e60 0x7f10e40cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 -- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10e40d1d30 msgr2=0x7f10e4155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10e40d1d30 0x7f10e4155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 -- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e40d3e60 msgr2=0x7f10e40cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e40d3e60 0x7f10e40cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e98b9640 1 -- 172.21.15.70:0/2050285509 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4009420 con 0x7f10e415d580 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.295+0000 7f10e90b8640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10e40d1d30 0x7f10e4155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10e98b9640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e41582b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00caa0 tx=0x7f10dc00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10d9ffb640 1 -- 172.21.15.70:0/2050285509 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00ac00 con 0x7f10e415d580 2023-11-26T07:18:07.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10d9ffb640 1 -- 172.21.15.70:0/2050285509 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc00ad60 con 0x7f10e415d580 2023-11-26T07:18:07.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10d9ffb640 1 -- 172.21.15.70:0/2050285509 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc012620 con 0x7f10e415d580 2023-11-26T07:18:07.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e0009420 con 0x7f10e415d580 2023-11-26T07:18:07.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e40cd080 con 0x7f10e415d580 2023-11-26T07:18:07.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4067680 con 0x7f10e415d580 2023-11-26T07:18:07.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10d9ffb640 1 -- 172.21.15.70:0/2050285509 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10dc007070 con 0x7f10e415d580 2023-11-26T07:18:07.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10d9ffb640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10c8066470 0x7f10c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10d9ffb640 1 -- 172.21.15.70:0/2050285509 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10dc083dd0 con 0x7f10e415d580 2023-11-26T07:18:07.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.299+0000 7f10e90b8640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10c8066470 0x7f10c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.303+0000 7f10e90b8640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10c8066470 0x7f10c8068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f10e00af000 tx=0x7f10e00b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.307+0000 7f10d9ffb640 1 -- 172.21.15.70:0/2050285509 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10dc0512f0 con 0x7f10e415d580 2023-11-26T07:18:07.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.487+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10e4156af0 con 0x7f10e415d580 2023-11-26T07:18:07.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.487+0000 7f10d9ffb640 1 -- 172.21.15.70:0/2050285509 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f10dc017090 con 0x7f10e415d580 2023-11-26T07:18:07.490 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:07.490 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:07.490 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10c8066470 msgr2=0x7f10c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10c8066470 0x7f10c8068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f10e00af000 tx=0x7f10e00b6040 comp rx=0 tx=0).stop 2023-11-26T07:18:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 msgr2=0x7f10e41582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e41582b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00caa0 tx=0x7f10dc00cf60 comp rx=0 tx=0).stop 2023-11-26T07:18:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 shutdown_connections 2023-11-26T07:18:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10c8066470 0x7f10c8068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10e40d3e60 0x7f10e40cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10e415d580 0x7f10e41582b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 --2- 172.21.15.70:0/2050285509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10e40d1d30 0x7f10e4155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 >> 172.21.15.70:0/2050285509 conn(0x7f10e409c550 msgr2=0x7f10e4159120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 shutdown_connections 2023-11-26T07:18:07.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.491+0000 7f10eb31c640 1 -- 172.21.15.70:0/2050285509 wait complete. 2023-11-26T07:18:07.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:07.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.643+0000 7faa547d1640 1 Processor -- start 2023-11-26T07:18:07.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.643+0000 7faa547d1640 1 -- start start 2023-11-26T07:18:07.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa547d1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faa4c143ac0 0x7faa4c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa547d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c0708b0 0x7faa4c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa547d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faa4c0cf7c0 0x7faa4c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa547d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c143ea0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa547d1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0cfbf0 con 0x7faa4c143ac0 2023-11-26T07:18:07.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa547d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0cc730 con 0x7faa4c0708b0 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faa4c0cf7c0 0x7faa4c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faa4c0cf7c0 0x7faa4c0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59860/0 (socket says 172.21.15.70:59860) 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 -- 172.21.15.70:0/4033629466 learned_addr learned my addr 172.21.15.70:0/4033629466 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa51d6c640 1 --2- 172.21.15.70:0/4033629466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c0708b0 0x7faa4c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa5256d640 1 --2- 172.21.15.70:0/4033629466 >> v2:172.21.15.120:3300/0 conn(0x7faa4c143ac0 0x7faa4c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 -- 172.21.15.70:0/4033629466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c0708b0 msgr2=0x7faa4c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 --2- 172.21.15.70:0/4033629466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c0708b0 0x7faa4c0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 -- 172.21.15.70:0/4033629466 >> v2:172.21.15.120:3300/0 conn(0x7faa4c143ac0 msgr2=0x7faa4c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 --2- 172.21.15.70:0/4033629466 >> v2:172.21.15.120:3300/0 conn(0x7faa4c143ac0 0x7faa4c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa52d6e640 1 -- 172.21.15.70:0/4033629466 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c070ee0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa51d6c640 1 --2- 172.21.15.70:0/4033629466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c0708b0 0x7faa4c0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.647+0000 7faa5256d640 1 --2- 172.21.15.70:0/4033629466 >> v2:172.21.15.120:3300/0 conn(0x7faa4c143ac0 0x7faa4c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:07.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa52d6e640 1 --2- 172.21.15.70:0/4033629466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c0b1ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa4c06dca0 tx=0x7faa4401e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16291a35704b4c59 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa5156b640 1 -- 172.21.15.70:0/4033629466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400b2d0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa5156b640 1 -- 172.21.15.70:0/4033629466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4400b430 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa5156b640 1 -- 172.21.15.70:0/4033629466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440a78d0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 -- 172.21.15.70:0/4033629466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 msgr2=0x7faa4c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 --2- 172.21.15.70:0/4033629466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c0b1ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa4c06dca0 tx=0x7faa4401e910 comp rx=0 tx=0).stop 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 -- 172.21.15.70:0/4033629466 shutdown_connections 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 --2- 172.21.15.70:0/4033629466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c0b1ef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 --2- 172.21.15.70:0/4033629466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c0708b0 0x7faa4c0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 --2- 172.21.15.70:0/4033629466 >> v2:172.21.15.120:3300/0 conn(0x7faa4c143ac0 0x7faa4c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 -- 172.21.15.70:0/4033629466 >> 172.21.15.70:0/4033629466 conn(0x7faa4c06a890 msgr2=0x7faa4c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 -- 172.21.15.70:0/4033629466 shutdown_connections 2023-11-26T07:18:07.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 -- 172.21.15.70:0/4033629466 wait complete. 2023-11-26T07:18:07.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 Processor -- start 2023-11-26T07:18:07.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.651+0000 7faa547d1640 1 -- start start 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c0708b0 0x7faa4c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c143ac0 0x7faa4c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0ad390 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0ad600 con 0x7faa4c0708b0 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0ad8e0 con 0x7faa4c143ac0 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59864/0 (socket says 172.21.15.70:59864) 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 -- 172.21.15.70:0/2159281627 learned_addr learned my addr 172.21.15.70:0/2159281627 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:07.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa5256d640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c0708b0 0x7faa4c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa52d6e640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c143ac0 0x7faa4c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 -- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c143ac0 msgr2=0x7faa4c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c143ac0 0x7faa4c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 -- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c0708b0 msgr2=0x7faa4c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c0708b0 0x7faa4c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 -- 172.21.15.70:0/2159281627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4400bd40 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa52d6e640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c143ac0 0x7faa4c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:07.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa51d6c640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c158ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00e810 tx=0x7faa3c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa42ffd640 1 -- 172.21.15.70:0/2159281627 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004030 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa42ffd640 1 -- 172.21.15.70:0/2159281627 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c004190 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c0adbc0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa42ffd640 1 -- 172.21.15.70:0/2159281627 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004520 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c159c30 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c067680 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.655+0000 7faa42ffd640 1 -- 172.21.15.70:0/2159281627 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa3c00c6d0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.659+0000 7faa42ffd640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa30066470 0x7faa30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.659+0000 7faa42ffd640 1 -- 172.21.15.70:0/2159281627 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa3c083aa0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.659+0000 7faa5256d640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa30066470 0x7faa30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.659+0000 7faa5256d640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa30066470 0x7faa30068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa480045f0 tx=0x7faa48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.663+0000 7faa42ffd640 1 -- 172.21.15.70:0/2159281627 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa3c050ea0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.811+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa4c0b1ef0 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.811+0000 7faa42ffd640 1 -- 172.21.15.70:0/2159281627 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7faa3c020090 con 0x7faa4c0cf7c0 2023-11-26T07:18:07.814 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:07.814 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:07.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa30066470 msgr2=0x7faa30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa30066470 0x7faa30068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa480045f0 tx=0x7faa48008040 comp rx=0 tx=0).stop 2023-11-26T07:18:07.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 msgr2=0x7faa4c158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c158ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00e810 tx=0x7faa3c00ecd0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 shutdown_connections 2023-11-26T07:18:07.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa30066470 0x7faa30068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa4c0cf7c0 0x7faa4c158ad0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa4c143ac0 0x7faa4c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 --2- 172.21.15.70:0/2159281627 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa4c0708b0 0x7faa4c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 >> 172.21.15.70:0/2159281627 conn(0x7faa4c06a890 msgr2=0x7faa4c15a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 shutdown_connections 2023-11-26T07:18:07.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.815+0000 7faa547d1640 1 -- 172.21.15.70:0/2159281627 wait complete. 2023-11-26T07:18:07.834 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:18:07.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7e52a640 1 Processor -- start 2023-11-26T07:18:07.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7e52a640 1 -- start start 2023-11-26T07:18:07.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7e52a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f780d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7e52a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6f780d1f00 0x7f6f780b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7e52a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780d0bc0 con 0x7f6f780d3e60 2023-11-26T07:18:07.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7e52a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f780d0320 con 0x7f6f780d1f00 2023-11-26T07:18:07.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7e52a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f780d0600 con 0x7f6f7815d580 2023-11-26T07:18:07.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f780d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f780d3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53786/0 (socket says 172.21.15.70:53786) 2023-11-26T07:18:07.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f7cac7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6f780d1f00 0x7f6f780b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f77fff640 1 -- 172.21.15.70:0/3521785290 learned_addr learned my addr 172.21.15.70:0/3521785290 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:07.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f77fff640 1 -- 172.21.15.70:0/3521785290 >> v2:172.21.15.120:3300/0 conn(0x7f6f780d1f00 msgr2=0x7f6f780b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:07.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f77fff640 1 --2- 172.21.15.70:0/3521785290 >> v2:172.21.15.120:3300/0 conn(0x7f6f780d1f00 0x7f6f780b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f77fff640 1 -- 172.21.15.70:0/3521785290 >> v1:172.21.15.120:6789/0 conn(0x7f6f780d3e60 legacy=0x7f6f780d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.971+0000 7f6f77fff640 1 -- 172.21.15.70:0/3521785290 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f780d08e0 con 0x7f6f7815d580 2023-11-26T07:18:07.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f77fff640 1 --2- 172.21.15.70:0/3521785290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f780d3920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009870 tx=0x7f6f6801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f7a31c7a0cc1dc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f76ffd640 1 -- 172.21.15.70:0/3521785290 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680ab640 con 0x7f6f7815d580 2023-11-26T07:18:07.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f76ffd640 1 -- 172.21.15.70:0/3521785290 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f680a7070 con 0x7f6f7815d580 2023-11-26T07:18:07.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f76ffd640 1 -- 172.21.15.70:0/3521785290 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680ab9c0 con 0x7f6f7815d580 2023-11-26T07:18:07.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 -- 172.21.15.70:0/3521785290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 msgr2=0x7f6f780d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/3521785290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f780d3920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009870 tx=0x7f6f6801c510 comp rx=0 tx=0).stop 2023-11-26T07:18:07.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 -- 172.21.15.70:0/3521785290 shutdown_connections 2023-11-26T07:18:07.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/3521785290 >> v2:172.21.15.120:3300/0 conn(0x7f6f780d1f00 0x7f6f780b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/3521785290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f780d3920 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 -- 172.21.15.70:0/3521785290 >> 172.21.15.70:0/3521785290 conn(0x7f6f7809c550 msgr2=0x7f6f780d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:07.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 -- 172.21.15.70:0/3521785290 shutdown_connections 2023-11-26T07:18:07.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.975+0000 7f6f7e52a640 1 -- 172.21.15.70:0/3521785290 wait complete. 2023-11-26T07:18:07.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 Processor -- start 2023-11-26T07:18:07.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 -- start start 2023-11-26T07:18:07.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f780d1f00 0x7f6f7814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f780d3e60 0x7f6f7815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f7815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7814fa80 con 0x7f6f780d3e60 2023-11-26T07:18:07.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7814f520 con 0x7f6f780d1f00 2023-11-26T07:18:07.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7815fc70 con 0x7f6f7815d580 2023-11-26T07:18:07.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f780d3e60 0x7f6f7815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f780d3e60 0x7f6f7815dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59874/0 (socket says 172.21.15.70:59874) 2023-11-26T07:18:07.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 -- 172.21.15.70:0/994158825 learned_addr learned my addr 172.21.15.70:0/994158825 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:07.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7cac7640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f7815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f77fff640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f780d1f00 0x7f6f7814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 -- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 msgr2=0x7f6f7815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f7815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 -- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f780d1f00 msgr2=0x7f6f7814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:07.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f780d1f00 0x7f6f7814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 -- 172.21.15.70:0/994158825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680094d0 con 0x7f6f780d3e60 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f777fe640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f780d3e60 0x7f6f7815dc60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c500 tx=0x7f6f6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f74ff9640 1 -- 172.21.15.70:0/994158825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c005220 con 0x7f6f780d3e60 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f74ff9640 1 -- 172.21.15.70:0/994158825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c005380 con 0x7f6f780d3e60 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f74ff9640 1 -- 172.21.15.70:0/994158825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c007270 con 0x7f6f780d3e60 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7815ff50 con 0x7f6f780d3e60 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f78160510 con 0x7f6f780d3e60 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.979+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f78067680 con 0x7f6f780d3e60 2023-11-26T07:18:07.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.983+0000 7f6f74ff9640 1 -- 172.21.15.70:0/994158825 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f6c0073d0 con 0x7f6f780d3e60 2023-11-26T07:18:07.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.983+0000 7f6f74ff9640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6f640664a0 0x7f6f64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:07.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.983+0000 7f6f74ff9640 1 -- 172.21.15.70:0/994158825 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f6c083680 con 0x7f6f780d3e60 2023-11-26T07:18:07.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.983+0000 7f6f77fff640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6f640664a0 0x7f6f64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:07.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.983+0000 7f6f77fff640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6f640664a0 0x7f6f64068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f680af000 tx=0x7f6f680a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:07.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:07.987+0000 7f6f74ff9640 1 -- 172.21.15.70:0/994158825 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f6c050b20 con 0x7f6f780d3e60 2023-11-26T07:18:08.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.135+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f780d15c0 con 0x7f6f640664a0 2023-11-26T07:18:08.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.143+0000 7f6f74ff9640 1 -- 172.21.15.70:0/994158825 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f6f680ab6a0 con 0x7f6f640664a0 2023-11-26T07:18:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:08.148 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:18:08.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6f640664a0 msgr2=0x7f6f64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6f640664a0 0x7f6f64068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f680af000 tx=0x7f6f680a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:08.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f780d3e60 msgr2=0x7f6f7815dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f780d3e60 0x7f6f7815dc60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c500 tx=0x7f6f6c00c9c0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 shutdown_connections 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6f640664a0 0x7f6f64068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f780d3e60 0x7f6f7815dc60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6f7815d580 0x7f6f7815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 --2- 172.21.15.70:0/994158825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6f780d1f00 0x7f6f7814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 >> 172.21.15.70:0/994158825 conn(0x7f6f7809c550 msgr2=0x7f6f780cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 shutdown_connections 2023-11-26T07:18:08.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.147+0000 7f6f7e52a640 1 -- 172.21.15.70:0/994158825 wait complete. 2023-11-26T07:18:08.167 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-26T07:18:07.990589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231596,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743124,"statfs":{"total":773094113280,"available":772856958976,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.908036"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977709+0000","last_change":"2023-11-26T07:18:03.803784+0000","last_active":"2023-11-26T07:18:04.977709+0000","last_peered":"2023-11-26T07:18:04.977709+0000","last_clean":"2023-11-26T07:18:04.977709+0000","last_became_active":"2023-11-26T07:18:03.803443+0000","last_became_peered":"2023-11-26T07:18:03.803443+0000","last_unstale":"2023-11-26T07:18:04.977709+0000","last_undegraded":"2023-11-26T07:18:04.977709+0000","last_fullsized":"2023-11-26T07:18:04.977709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965901+0000","last_change":"2023-11-26T07:18:03.788975+0000","last_active":"2023-11-26T07:18:04.965901+0000","last_peered":"2023-11-26T07:18:04.965901+0000","last_clean":"2023-11-26T07:18:04.965901+0000","last_became_active":"2023-11-26T07:18:03.788417+0000","last_became_peered":"2023-11-26T07:18:03.788417+0000","last_unstale":"2023-11-26T07:18:04.965901+0000","last_undegraded":"2023-11-26T07:18:04.965901+0000","last_fullsized":"2023-11-26T07:18:04.965901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938823+0000","last_change":"2023-11-26T07:18:03.794288+0000","last_active":"2023-11-26T07:18:04.938823+0000","last_peered":"2023-11-26T07:18:04.938823+0000","last_clean":"2023-11-26T07:18:04.938823+0000","last_became_active":"2023-11-26T07:18:03.794001+0000","last_became_peered":"2023-11-26T07:18:03.794001+0000","last_unstale":"2023-11-26T07:18:04.938823+0000","last_undegraded":"2023-11-26T07:18:04.938823+0000","last_fullsized":"2023-11-26T07:18:04.938823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978274+0000","last_change":"2023-11-26T07:18:03.799214+0000","last_active":"2023-11-26T07:18:04.978274+0000","last_peered":"2023-11-26T07:18:04.978274+0000","last_clean":"2023-11-26T07:18:04.978274+0000","last_became_active":"2023-11-26T07:18:03.798914+0000","last_became_peered":"2023-11-26T07:18:03.798914+0000","last_unstale":"2023-11-26T07:18:04.978274+0000","last_undegraded":"2023-11-26T07:18:04.978274+0000","last_fullsized":"2023-11-26T07:18:04.978274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977291+0000","last_change":"2023-11-26T07:18:03.802078+0000","last_active":"2023-11-26T07:18:04.977291+0000","last_peered":"2023-11-26T07:18:04.977291+0000","last_clean":"2023-11-26T07:18:04.977291+0000","last_became_active":"2023-11-26T07:18:03.801400+0000","last_became_peered":"2023-11-26T07:18:03.801400+0000","last_unstale":"2023-11-26T07:18:04.977291+0000","last_undegraded":"2023-11-26T07:18:04.977291+0000","last_fullsized":"2023-11-26T07:18:04.977291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978001+0000","last_change":"2023-11-26T07:18:03.797285+0000","last_active":"2023-11-26T07:18:04.978001+0000","last_peered":"2023-11-26T07:18:04.978001+0000","last_clean":"2023-11-26T07:18:04.978001+0000","last_became_active":"2023-11-26T07:18:03.796973+0000","last_became_peered":"2023-11-26T07:18:03.796973+0000","last_unstale":"2023-11-26T07:18:04.978001+0000","last_undegraded":"2023-11-26T07:18:04.978001+0000","last_fullsized":"2023-11-26T07:18:04.978001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977015+0000","last_change":"2023-11-26T07:18:03.801957+0000","last_active":"2023-11-26T07:18:04.977015+0000","last_peered":"2023-11-26T07:18:04.977015+0000","last_clean":"2023-11-26T07:18:04.977015+0000","last_became_active":"2023-11-26T07:18:03.801666+0000","last_became_peered":"2023-11-26T07:18:03.801666+0000","last_unstale":"2023-11-26T07:18:04.977015+0000","last_undegraded":"2023-11-26T07:18:04.977015+0000","last_fullsized":"2023-11-26T07:18:04.977015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777954+0000","last_change":"2023-11-26T07:18:03.795903+0000","last_active":"2023-11-26T07:18:04.777954+0000","last_peered":"2023-11-26T07:18:04.777954+0000","last_clean":"2023-11-26T07:18:04.777954+0000","last_became_active":"2023-11-26T07:18:03.795634+0000","last_became_peered":"2023-11-26T07:18:03.795634+0000","last_unstale":"2023-11-26T07:18:04.777954+0000","last_undegraded":"2023-11-26T07:18:04.777954+0000","last_fullsized":"2023-11-26T07:18:04.777954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977838+0000","last_change":"2023-11-26T07:18:03.807314+0000","last_active":"2023-11-26T07:18:04.977838+0000","last_peered":"2023-11-26T07:18:04.977838+0000","last_clean":"2023-11-26T07:18:04.977838+0000","last_became_active":"2023-11-26T07:18:03.806735+0000","last_became_peered":"2023-11-26T07:18:03.806735+0000","last_unstale":"2023-11-26T07:18:04.977838+0000","last_undegraded":"2023-11-26T07:18:04.977838+0000","last_fullsized":"2023-11-26T07:18:04.977838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:41:15.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977563+0000","last_change":"2023-11-26T07:18:03.799600+0000","last_active":"2023-11-26T07:18:04.977563+0000","last_peered":"2023-11-26T07:18:04.977563+0000","last_clean":"2023-11-26T07:18:04.977563+0000","last_became_active":"2023-11-26T07:18:03.799261+0000","last_became_peered":"2023-11-26T07:18:03.799261+0000","last_unstale":"2023-11-26T07:18:04.977563+0000","last_undegraded":"2023-11-26T07:18:04.977563+0000","last_fullsized":"2023-11-26T07:18:04.977563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977141+0000","last_change":"2023-11-26T07:18:03.800938+0000","last_active":"2023-11-26T07:18:04.977141+0000","last_peered":"2023-11-26T07:18:04.977141+0000","last_clean":"2023-11-26T07:18:04.977141+0000","last_became_active":"2023-11-26T07:18:03.800617+0000","last_became_peered":"2023-11-26T07:18:03.800617+0000","last_unstale":"2023-11-26T07:18:04.977141+0000","last_undegraded":"2023-11-26T07:18:04.977141+0000","last_fullsized":"2023-11-26T07:18:04.977141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777870+0000","last_change":"2023-11-26T07:18:03.782200+0000","last_active":"2023-11-26T07:18:04.777870+0000","last_peered":"2023-11-26T07:18:04.777870+0000","last_clean":"2023-11-26T07:18:04.777870+0000","last_became_active":"2023-11-26T07:18:03.781899+0000","last_became_peered":"2023-11-26T07:18:03.781899+0000","last_unstale":"2023-11-26T07:18:04.777870+0000","last_undegraded":"2023-11-26T07:18:04.777870+0000","last_fullsized":"2023-11-26T07:18:04.777870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778374+0000","last_change":"2023-11-26T07:18:03.779335+0000","last_active":"2023-11-26T07:18:04.778374+0000","last_peered":"2023-11-26T07:18:04.778374+0000","last_clean":"2023-11-26T07:18:04.778374+0000","last_became_active":"2023-11-26T07:18:03.779062+0000","last_became_peered":"2023-11-26T07:18:03.779062+0000","last_unstale":"2023-11-26T07:18:04.778374+0000","last_undegraded":"2023-11-26T07:18:04.778374+0000","last_fullsized":"2023-11-26T07:18:04.778374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938632+0000","last_change":"2023-11-26T07:18:03.785565+0000","last_active":"2023-11-26T07:18:04.938632+0000","last_peered":"2023-11-26T07:18:04.938632+0000","last_clean":"2023-11-26T07:18:04.938632+0000","last_became_active":"2023-11-26T07:18:03.785185+0000","last_became_peered":"2023-11-26T07:18:03.785185+0000","last_unstale":"2023-11-26T07:18:04.938632+0000","last_undegraded":"2023-11-26T07:18:04.938632+0000","last_fullsized":"2023-11-26T07:18:04.938632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:51.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965569+0000","last_change":"2023-11-26T07:18:03.794642+0000","last_active":"2023-11-26T07:18:04.965569+0000","last_peered":"2023-11-26T07:18:04.965569+0000","last_clean":"2023-11-26T07:18:04.965569+0000","last_became_active":"2023-11-26T07:18:03.794199+0000","last_became_peered":"2023-11-26T07:18:03.794199+0000","last_unstale":"2023-11-26T07:18:04.965569+0000","last_undegraded":"2023-11-26T07:18:04.965569+0000","last_fullsized":"2023-11-26T07:18:04.965569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977524+0000","last_change":"2023-11-26T07:18:03.793156+0000","last_active":"2023-11-26T07:18:04.977524+0000","last_peered":"2023-11-26T07:18:04.977524+0000","last_clean":"2023-11-26T07:18:04.977524+0000","last_became_active":"2023-11-26T07:18:03.792834+0000","last_became_peered":"2023-11-26T07:18:03.792834+0000","last_unstale":"2023-11-26T07:18:04.977524+0000","last_undegraded":"2023-11-26T07:18:04.977524+0000","last_fullsized":"2023-11-26T07:18:04.977524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978940+0000","last_change":"2023-11-26T07:18:03.805692+0000","last_active":"2023-11-26T07:18:04.978940+0000","last_peered":"2023-11-26T07:18:04.978940+0000","last_clean":"2023-11-26T07:18:04.978940+0000","last_became_active":"2023-11-26T07:18:03.805350+0000","last_became_peered":"2023-11-26T07:18:03.805350+0000","last_unstale":"2023-11-26T07:18:04.978940+0000","last_undegraded":"2023-11-26T07:18:04.978940+0000","last_fullsized":"2023-11-26T07:18:04.978940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777433+0000","last_change":"2023-11-26T07:18:03.786256+0000","last_active":"2023-11-26T07:18:04.777433+0000","last_peered":"2023-11-26T07:18:04.777433+0000","last_clean":"2023-11-26T07:18:04.777433+0000","last_became_active":"2023-11-26T07:18:03.785953+0000","last_became_peered":"2023-11-26T07:18:03.785953+0000","last_unstale":"2023-11-26T07:18:04.777433+0000","last_undegraded":"2023-11-26T07:18:04.777433+0000","last_fullsized":"2023-11-26T07:18:04.777433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978040+0000","last_change":"2023-11-26T07:18:03.803009+0000","last_active":"2023-11-26T07:18:04.978040+0000","last_peered":"2023-11-26T07:18:04.978040+0000","last_clean":"2023-11-26T07:18:04.978040+0000","last_became_active":"2023-11-26T07:18:03.802310+0000","last_became_peered":"2023-11-26T07:18:03.802310+0000","last_unstale":"2023-11-26T07:18:04.978040+0000","last_undegraded":"2023-11-26T07:18:04.978040+0000","last_fullsized":"2023-11-26T07:18:04.978040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:51.419753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977730+0000","last_change":"2023-11-26T07:18:03.785169+0000","last_active":"2023-11-26T07:18:04.977730+0000","last_peered":"2023-11-26T07:18:04.977730+0000","last_clean":"2023-11-26T07:18:04.977730+0000","last_became_active":"2023-11-26T07:18:03.784952+0000","last_became_peered":"2023-11-26T07:18:03.784952+0000","last_unstale":"2023-11-26T07:18:04.977730+0000","last_undegraded":"2023-11-26T07:18:04.977730+0000","last_fullsized":"2023-11-26T07:18:04.977730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938762+0000","last_change":"2023-11-26T07:18:03.788071+0000","last_active":"2023-11-26T07:18:04.938762+0000","last_peered":"2023-11-26T07:18:04.938762+0000","last_clean":"2023-11-26T07:18:04.938762+0000","last_became_active":"2023-11-26T07:18:03.787821+0000","last_became_peered":"2023-11-26T07:18:03.787821+0000","last_unstale":"2023-11-26T07:18:04.938762+0000","last_undegraded":"2023-11-26T07:18:04.938762+0000","last_fullsized":"2023-11-26T07:18:04.938762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978153+0000","last_change":"2023-11-26T07:18:03.804426+0000","last_active":"2023-11-26T07:18:04.978153+0000","last_peered":"2023-11-26T07:18:04.978153+0000","last_clean":"2023-11-26T07:18:04.978153+0000","last_became_active":"2023-11-26T07:18:03.804150+0000","last_became_peered":"2023-11-26T07:18:03.804150+0000","last_unstale":"2023-11-26T07:18:04.978153+0000","last_undegraded":"2023-11-26T07:18:04.978153+0000","last_fullsized":"2023-11-26T07:18:04.978153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778267+0000","last_change":"2023-11-26T07:18:03.787986+0000","last_active":"2023-11-26T07:18:04.778267+0000","last_peered":"2023-11-26T07:18:04.778267+0000","last_clean":"2023-11-26T07:18:04.778267+0000","last_became_active":"2023-11-26T07:18:03.787730+0000","last_became_peered":"2023-11-26T07:18:03.787730+0000","last_unstale":"2023-11-26T07:18:04.778267+0000","last_undegraded":"2023-11-26T07:18:04.778267+0000","last_fullsized":"2023-11-26T07:18:04.778267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978264+0000","last_change":"2023-11-26T07:18:03.792214+0000","last_active":"2023-11-26T07:18:04.978264+0000","last_peered":"2023-11-26T07:18:04.978264+0000","last_clean":"2023-11-26T07:18:04.978264+0000","last_became_active":"2023-11-26T07:18:03.791863+0000","last_became_peered":"2023-11-26T07:18:03.791863+0000","last_unstale":"2023-11-26T07:18:04.978264+0000","last_undegraded":"2023-11-26T07:18:04.978264+0000","last_fullsized":"2023-11-26T07:18:04.978264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778641+0000","last_change":"2023-11-26T07:18:03.788356+0000","last_active":"2023-11-26T07:18:04.778641+0000","last_peered":"2023-11-26T07:18:04.778641+0000","last_clean":"2023-11-26T07:18:04.778641+0000","last_became_active":"2023-11-26T07:18:03.788037+0000","last_became_peered":"2023-11-26T07:18:03.788037+0000","last_unstale":"2023-11-26T07:18:04.778641+0000","last_undegraded":"2023-11-26T07:18:04.778641+0000","last_fullsized":"2023-11-26T07:18:04.778641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977702+0000","last_change":"2023-11-26T07:18:03.798506+0000","last_active":"2023-11-26T07:18:04.977702+0000","last_peered":"2023-11-26T07:18:04.977702+0000","last_clean":"2023-11-26T07:18:04.977702+0000","last_became_active":"2023-11-26T07:18:03.798181+0000","last_became_peered":"2023-11-26T07:18:03.798181+0000","last_unstale":"2023-11-26T07:18:04.977702+0000","last_undegraded":"2023-11-26T07:18:04.977702+0000","last_fullsized":"2023-11-26T07:18:04.977702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965715+0000","last_change":"2023-11-26T07:18:03.792464+0000","last_active":"2023-11-26T07:18:04.965715+0000","last_peered":"2023-11-26T07:18:04.965715+0000","last_clean":"2023-11-26T07:18:04.965715+0000","last_became_active":"2023-11-26T07:18:03.792203+0000","last_became_peered":"2023-11-26T07:18:03.792203+0000","last_unstale":"2023-11-26T07:18:04.965715+0000","last_undegraded":"2023-11-26T07:18:04.965715+0000","last_fullsized":"2023-11-26T07:18:04.965715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778594+0000","last_change":"2023-11-26T07:18:03.788844+0000","last_active":"2023-11-26T07:18:04.778594+0000","last_peered":"2023-11-26T07:18:04.778594+0000","last_clean":"2023-11-26T07:18:04.778594+0000","last_became_active":"2023-11-26T07:18:03.786561+0000","last_became_peered":"2023-11-26T07:18:03.786561+0000","last_unstale":"2023-11-26T07:18:04.778594+0000","last_undegraded":"2023-11-26T07:18:04.778594+0000","last_fullsized":"2023-11-26T07:18:04.778594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938878+0000","last_change":"2023-11-26T07:18:03.791815+0000","last_active":"2023-11-26T07:18:04.938878+0000","last_peered":"2023-11-26T07:18:04.938878+0000","last_clean":"2023-11-26T07:18:04.938878+0000","last_became_active":"2023-11-26T07:18:03.790584+0000","last_became_peered":"2023-11-26T07:18:03.790584+0000","last_unstale":"2023-11-26T07:18:04.938878+0000","last_undegraded":"2023-11-26T07:18:04.938878+0000","last_fullsized":"2023-11-26T07:18:04.938878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978434+0000","last_change":"2023-11-26T07:18:03.792243+0000","last_active":"2023-11-26T07:18:04.978434+0000","last_peered":"2023-11-26T07:18:04.978434+0000","last_clean":"2023-11-26T07:18:04.978434+0000","last_became_active":"2023-11-26T07:18:03.791879+0000","last_became_peered":"2023-11-26T07:18:03.791879+0000","last_unstale":"2023-11-26T07:18:04.978434+0000","last_undegraded":"2023-11-26T07:18:04.978434+0000","last_fullsized":"2023-11-26T07:18:04.978434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777242+0000","last_change":"2023-11-26T07:18:03.795359+0000","last_active":"2023-11-26T07:18:04.777242+0000","last_peered":"2023-11-26T07:18:04.777242+0000","last_clean":"2023-11-26T07:18:04.777242+0000","last_became_active":"2023-11-26T07:18:03.795059+0000","last_became_peered":"2023-11-26T07:18:03.795059+0000","last_unstale":"2023-11-26T07:18:04.777242+0000","last_undegraded":"2023-11-26T07:18:04.777242+0000","last_fullsized":"2023-11-26T07:18:04.777242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977195+0000","last_change":"2023-11-26T07:18:03.788871+0000","last_active":"2023-11-26T07:18:04.977195+0000","last_peered":"2023-11-26T07:18:04.977195+0000","last_clean":"2023-11-26T07:18:04.977195+0000","last_became_active":"2023-11-26T07:18:03.788343+0000","last_became_peered":"2023-11-26T07:18:03.788343+0000","last_unstale":"2023-11-26T07:18:04.977195+0000","last_undegraded":"2023-11-26T07:18:04.977195+0000","last_fullsized":"2023-11-26T07:18:04.977195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777489+0000","last_change":"2023-11-26T07:18:03.782615+0000","last_active":"2023-11-26T07:18:04.777489+0000","last_peered":"2023-11-26T07:18:04.777489+0000","last_clean":"2023-11-26T07:18:04.777489+0000","last_became_active":"2023-11-26T07:18:03.782335+0000","last_became_peered":"2023-11-26T07:18:03.782335+0000","last_unstale":"2023-11-26T07:18:04.777489+0000","last_undegraded":"2023-11-26T07:18:04.777489+0000","last_fullsized":"2023-11-26T07:18:04.777489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:52:23.941794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778588+0000","last_change":"2023-11-26T07:18:03.122861+0000","last_active":"2023-11-26T07:18:04.778588+0000","last_peered":"2023-11-26T07:18:04.778588+0000","last_clean":"2023-11-26T07:18:04.778588+0000","last_became_active":"2023-11-26T07:18:03.122492+0000","last_became_peered":"2023-11-26T07:18:03.122492+0000","last_unstale":"2023-11-26T07:18:04.778588+0000","last_undegraded":"2023-11-26T07:18:04.778588+0000","last_fullsized":"2023-11-26T07:18:04.778588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938948+0000","last_change":"2023-11-26T07:18:03.798092+0000","last_active":"2023-11-26T07:18:04.938948+0000","last_peered":"2023-11-26T07:18:04.938948+0000","last_clean":"2023-11-26T07:18:04.938948+0000","last_became_active":"2023-11-26T07:18:03.797852+0000","last_became_peered":"2023-11-26T07:18:03.797852+0000","last_unstale":"2023-11-26T07:18:04.938948+0000","last_undegraded":"2023-11-26T07:18:04.938948+0000","last_fullsized":"2023-11-26T07:18:04.938948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977463+0000","last_change":"2023-11-26T07:18:03.119997+0000","last_active":"2023-11-26T07:18:04.977463+0000","last_peered":"2023-11-26T07:18:04.977463+0000","last_clean":"2023-11-26T07:18:04.977463+0000","last_became_active":"2023-11-26T07:18:03.118909+0000","last_became_peered":"2023-11-26T07:18:03.118909+0000","last_unstale":"2023-11-26T07:18:04.977463+0000","last_undegraded":"2023-11-26T07:18:04.977463+0000","last_fullsized":"2023-11-26T07:18:04.977463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:52.437449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778203+0000","last_change":"2023-11-26T07:18:03.122995+0000","last_active":"2023-11-26T07:18:04.778203+0000","last_peered":"2023-11-26T07:18:04.778203+0000","last_clean":"2023-11-26T07:18:04.778203+0000","last_became_active":"2023-11-26T07:18:03.122228+0000","last_became_peered":"2023-11-26T07:18:03.122228+0000","last_unstale":"2023-11-26T07:18:04.778203+0000","last_undegraded":"2023-11-26T07:18:04.778203+0000","last_fullsized":"2023-11-26T07:18:04.778203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777996+0000","last_change":"2023-11-26T07:18:03.782237+0000","last_active":"2023-11-26T07:18:04.777996+0000","last_peered":"2023-11-26T07:18:04.777996+0000","last_clean":"2023-11-26T07:18:04.777996+0000","last_became_active":"2023-11-26T07:18:03.782008+0000","last_became_peered":"2023-11-26T07:18:03.782008+0000","last_unstale":"2023-11-26T07:18:04.777996+0000","last_undegraded":"2023-11-26T07:18:04.777996+0000","last_fullsized":"2023-11-26T07:18:04.777996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977820+0000","last_change":"2023-11-26T07:18:03.131480+0000","last_active":"2023-11-26T07:18:04.977820+0000","last_peered":"2023-11-26T07:18:04.977820+0000","last_clean":"2023-11-26T07:18:04.977820+0000","last_became_active":"2023-11-26T07:18:03.131082+0000","last_became_peered":"2023-11-26T07:18:03.131082+0000","last_unstale":"2023-11-26T07:18:04.977820+0000","last_undegraded":"2023-11-26T07:18:04.977820+0000","last_fullsized":"2023-11-26T07:18:04.977820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965576+0000","last_change":"2023-11-26T07:18:03.796258+0000","last_active":"2023-11-26T07:18:04.965576+0000","last_peered":"2023-11-26T07:18:04.965576+0000","last_clean":"2023-11-26T07:18:04.965576+0000","last_became_active":"2023-11-26T07:18:03.795927+0000","last_became_peered":"2023-11-26T07:18:03.795927+0000","last_unstale":"2023-11-26T07:18:04.965576+0000","last_undegraded":"2023-11-26T07:18:04.965576+0000","last_fullsized":"2023-11-26T07:18:04.965576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978098+0000","last_change":"2023-11-26T07:18:03.129331+0000","last_active":"2023-11-26T07:18:04.978098+0000","last_peered":"2023-11-26T07:18:04.978098+0000","last_clean":"2023-11-26T07:18:04.978098+0000","last_became_active":"2023-11-26T07:18:03.129008+0000","last_became_peered":"2023-11-26T07:18:03.129008+0000","last_unstale":"2023-11-26T07:18:04.978098+0000","last_undegraded":"2023-11-26T07:18:04.978098+0000","last_fullsized":"2023-11-26T07:18:04.978098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978607+0000","last_change":"2023-11-26T07:18:03.805685+0000","last_active":"2023-11-26T07:18:04.978607+0000","last_peered":"2023-11-26T07:18:04.978607+0000","last_clean":"2023-11-26T07:18:04.978607+0000","last_became_active":"2023-11-26T07:18:03.805338+0000","last_became_peered":"2023-11-26T07:18:03.805338+0000","last_unstale":"2023-11-26T07:18:04.978607+0000","last_undegraded":"2023-11-26T07:18:04.978607+0000","last_fullsized":"2023-11-26T07:18:04.978607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978665+0000","last_change":"2023-11-26T07:18:03.126035+0000","last_active":"2023-11-26T07:18:04.978665+0000","last_peered":"2023-11-26T07:18:04.978665+0000","last_clean":"2023-11-26T07:18:04.978665+0000","last_became_active":"2023-11-26T07:18:03.125604+0000","last_became_peered":"2023-11-26T07:18:03.125604+0000","last_unstale":"2023-11-26T07:18:04.978665+0000","last_undegraded":"2023-11-26T07:18:04.978665+0000","last_fullsized":"2023-11-26T07:18:04.978665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938971+0000","last_change":"2023-11-26T07:18:03.804355+0000","last_active":"2023-11-26T07:18:04.938971+0000","last_peered":"2023-11-26T07:18:04.938971+0000","last_clean":"2023-11-26T07:18:04.938971+0000","last_became_active":"2023-11-26T07:18:03.804058+0000","last_became_peered":"2023-11-26T07:18:03.804058+0000","last_unstale":"2023-11-26T07:18:04.938971+0000","last_undegraded":"2023-11-26T07:18:04.938971+0000","last_fullsized":"2023-11-26T07:18:04.938971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965755+0000","last_change":"2023-11-26T07:18:03.126934+0000","last_active":"2023-11-26T07:18:04.965755+0000","last_peered":"2023-11-26T07:18:04.965755+0000","last_clean":"2023-11-26T07:18:04.965755+0000","last_became_active":"2023-11-26T07:18:03.126627+0000","last_became_peered":"2023-11-26T07:18:03.126627+0000","last_unstale":"2023-11-26T07:18:04.965755+0000","last_undegraded":"2023-11-26T07:18:04.965755+0000","last_fullsized":"2023-11-26T07:18:04.965755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777968+0000","last_change":"2023-11-26T07:18:03.800970+0000","last_active":"2023-11-26T07:18:04.777968+0000","last_peered":"2023-11-26T07:18:04.777968+0000","last_clean":"2023-11-26T07:18:04.777968+0000","last_became_active":"2023-11-26T07:18:03.800703+0000","last_became_peered":"2023-11-26T07:18:03.800703+0000","last_unstale":"2023-11-26T07:18:04.777968+0000","last_undegraded":"2023-11-26T07:18:04.777968+0000","last_fullsized":"2023-11-26T07:18:04.777968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977831+0000","last_change":"2023-11-26T07:18:03.121777+0000","last_active":"2023-11-26T07:18:04.977831+0000","last_peered":"2023-11-26T07:18:04.977831+0000","last_clean":"2023-11-26T07:18:04.977831+0000","last_became_active":"2023-11-26T07:18:03.121509+0000","last_became_peered":"2023-11-26T07:18:03.121509+0000","last_unstale":"2023-11-26T07:18:04.977831+0000","last_undegraded":"2023-11-26T07:18:04.977831+0000","last_fullsized":"2023-11-26T07:18:04.977831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977200+0000","last_change":"2023-11-26T07:18:03.802994+0000","last_active":"2023-11-26T07:18:04.977200+0000","last_peered":"2023-11-26T07:18:04.977200+0000","last_clean":"2023-11-26T07:18:04.977200+0000","last_became_active":"2023-11-26T07:18:03.801952+0000","last_became_peered":"2023-11-26T07:18:03.801952+0000","last_unstale":"2023-11-26T07:18:04.977200+0000","last_undegraded":"2023-11-26T07:18:04.977200+0000","last_fullsized":"2023-11-26T07:18:04.977200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.939000+0000","last_change":"2023-11-26T07:18:03.119803+0000","last_active":"2023-11-26T07:18:04.939000+0000","last_peered":"2023-11-26T07:18:04.939000+0000","last_clean":"2023-11-26T07:18:04.939000+0000","last_became_active":"2023-11-26T07:18:03.119500+0000","last_became_peered":"2023-11-26T07:18:03.119500+0000","last_unstale":"2023-11-26T07:18:04.939000+0000","last_undegraded":"2023-11-26T07:18:04.939000+0000","last_fullsized":"2023-11-26T07:18:04.939000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938639+0000","last_change":"2023-11-26T07:18:03.785862+0000","last_active":"2023-11-26T07:18:04.938639+0000","last_peered":"2023-11-26T07:18:04.938639+0000","last_clean":"2023-11-26T07:18:04.938639+0000","last_became_active":"2023-11-26T07:18:03.784616+0000","last_became_peered":"2023-11-26T07:18:03.784616+0000","last_unstale":"2023-11-26T07:18:04.938639+0000","last_undegraded":"2023-11-26T07:18:04.938639+0000","last_fullsized":"2023-11-26T07:18:04.938639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978559+0000","last_change":"2023-11-26T07:18:03.129914+0000","last_active":"2023-11-26T07:18:04.978559+0000","last_peered":"2023-11-26T07:18:04.978559+0000","last_clean":"2023-11-26T07:18:04.978559+0000","last_became_active":"2023-11-26T07:18:03.127006+0000","last_became_peered":"2023-11-26T07:18:03.127006+0000","last_unstale":"2023-11-26T07:18:04.978559+0000","last_undegraded":"2023-11-26T07:18:04.978559+0000","last_fullsized":"2023-11-26T07:18:04.978559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:54.492600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977454+0000","last_change":"2023-11-26T07:18:03.802395+0000","last_active":"2023-11-26T07:18:04.977454+0000","last_peered":"2023-11-26T07:18:04.977454+0000","last_clean":"2023-11-26T07:18:04.977454+0000","last_became_active":"2023-11-26T07:18:03.801740+0000","last_became_peered":"2023-11-26T07:18:03.801740+0000","last_unstale":"2023-11-26T07:18:04.977454+0000","last_undegraded":"2023-11-26T07:18:04.977454+0000","last_fullsized":"2023-11-26T07:18:04.977454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977360+0000","last_change":"2023-11-26T07:18:03.119783+0000","last_active":"2023-11-26T07:18:04.977360+0000","last_peered":"2023-11-26T07:18:04.977360+0000","last_clean":"2023-11-26T07:18:04.977360+0000","last_became_active":"2023-11-26T07:18:03.119326+0000","last_became_peered":"2023-11-26T07:18:03.119326+0000","last_unstale":"2023-11-26T07:18:04.977360+0000","last_undegraded":"2023-11-26T07:18:04.977360+0000","last_fullsized":"2023-11-26T07:18:04.977360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977326+0000","last_change":"2023-11-26T07:18:03.788692+0000","last_active":"2023-11-26T07:18:04.977326+0000","last_peered":"2023-11-26T07:18:04.977326+0000","last_clean":"2023-11-26T07:18:04.977326+0000","last_became_active":"2023-11-26T07:18:03.787971+0000","last_became_peered":"2023-11-26T07:18:03.787971+0000","last_unstale":"2023-11-26T07:18:04.977326+0000","last_undegraded":"2023-11-26T07:18:04.977326+0000","last_fullsized":"2023-11-26T07:18:04.977326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777168+0000","last_change":"2023-11-26T07:18:03.116346+0000","last_active":"2023-11-26T07:18:04.777168+0000","last_peered":"2023-11-26T07:18:04.777168+0000","last_clean":"2023-11-26T07:18:04.777168+0000","last_became_active":"2023-11-26T07:18:03.115334+0000","last_became_peered":"2023-11-26T07:18:03.115334+0000","last_unstale":"2023-11-26T07:18:04.777168+0000","last_undegraded":"2023-11-26T07:18:04.777168+0000","last_fullsized":"2023-11-26T07:18:04.777168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977145+0000","last_change":"2023-11-26T07:18:03.804750+0000","last_active":"2023-11-26T07:18:04.977145+0000","last_peered":"2023-11-26T07:18:04.977145+0000","last_clean":"2023-11-26T07:18:04.977145+0000","last_became_active":"2023-11-26T07:18:03.804469+0000","last_became_peered":"2023-11-26T07:18:03.804469+0000","last_unstale":"2023-11-26T07:18:04.977145+0000","last_undegraded":"2023-11-26T07:18:04.977145+0000","last_fullsized":"2023-11-26T07:18:04.977145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777925+0000","last_change":"2023-11-26T07:18:03.114861+0000","last_active":"2023-11-26T07:18:04.777925+0000","last_peered":"2023-11-26T07:18:04.777925+0000","last_clean":"2023-11-26T07:18:04.777925+0000","last_became_active":"2023-11-26T07:18:03.114411+0000","last_became_peered":"2023-11-26T07:18:03.114411+0000","last_unstale":"2023-11-26T07:18:04.777925+0000","last_undegraded":"2023-11-26T07:18:04.777925+0000","last_fullsized":"2023-11-26T07:18:04.777925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977491+0000","last_change":"2023-11-26T07:18:03.803915+0000","last_active":"2023-11-26T07:18:04.977491+0000","last_peered":"2023-11-26T07:18:04.977491+0000","last_clean":"2023-11-26T07:18:04.977491+0000","last_became_active":"2023-11-26T07:18:03.803548+0000","last_became_peered":"2023-11-26T07:18:03.803548+0000","last_unstale":"2023-11-26T07:18:04.977491+0000","last_undegraded":"2023-11-26T07:18:04.977491+0000","last_fullsized":"2023-11-26T07:18:04.977491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777516+0000","last_change":"2023-11-26T07:18:03.124858+0000","last_active":"2023-11-26T07:18:04.777516+0000","last_peered":"2023-11-26T07:18:04.777516+0000","last_clean":"2023-11-26T07:18:04.777516+0000","last_became_active":"2023-11-26T07:18:03.123588+0000","last_became_peered":"2023-11-26T07:18:03.123588+0000","last_unstale":"2023-11-26T07:18:04.777516+0000","last_undegraded":"2023-11-26T07:18:04.777516+0000","last_fullsized":"2023-11-26T07:18:04.777516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977979+0000","last_change":"2023-11-26T07:18:03.805118+0000","last_active":"2023-11-26T07:18:04.977979+0000","last_peered":"2023-11-26T07:18:04.977979+0000","last_clean":"2023-11-26T07:18:04.977979+0000","last_became_active":"2023-11-26T07:18:03.804832+0000","last_became_peered":"2023-11-26T07:18:03.804832+0000","last_unstale":"2023-11-26T07:18:04.977979+0000","last_undegraded":"2023-11-26T07:18:04.977979+0000","last_fullsized":"2023-11-26T07:18:04.977979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:53:49.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965859+0000","last_change":"2023-11-26T07:18:03.118704+0000","last_active":"2023-11-26T07:18:04.965859+0000","last_peered":"2023-11-26T07:18:04.965859+0000","last_clean":"2023-11-26T07:18:04.965859+0000","last_became_active":"2023-11-26T07:18:03.118402+0000","last_became_peered":"2023-11-26T07:18:03.118402+0000","last_unstale":"2023-11-26T07:18:04.965859+0000","last_undegraded":"2023-11-26T07:18:04.965859+0000","last_fullsized":"2023-11-26T07:18:04.965859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:50.691370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978517+0000","last_change":"2023-11-26T07:18:03.798976+0000","last_active":"2023-11-26T07:18:04.978517+0000","last_peered":"2023-11-26T07:18:04.978517+0000","last_clean":"2023-11-26T07:18:04.978517+0000","last_became_active":"2023-11-26T07:18:03.798378+0000","last_became_peered":"2023-11-26T07:18:03.798378+0000","last_unstale":"2023-11-26T07:18:04.978517+0000","last_undegraded":"2023-11-26T07:18:04.978517+0000","last_fullsized":"2023-11-26T07:18:04.978517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777254+0000","last_change":"2023-11-26T07:18:03.127701+0000","last_active":"2023-11-26T07:18:04.777254+0000","last_peered":"2023-11-26T07:18:04.777254+0000","last_clean":"2023-11-26T07:18:04.777254+0000","last_became_active":"2023-11-26T07:18:03.127297+0000","last_became_peered":"2023-11-26T07:18:03.127297+0000","last_unstale":"2023-11-26T07:18:04.777254+0000","last_undegraded":"2023-11-26T07:18:04.777254+0000","last_fullsized":"2023-11-26T07:18:04.777254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:07.033733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978097+0000","last_change":"2023-11-26T07:18:03.805806+0000","last_active":"2023-11-26T07:18:04.978097+0000","last_peered":"2023-11-26T07:18:04.978097+0000","last_clean":"2023-11-26T07:18:04.978097+0000","last_became_active":"2023-11-26T07:18:03.805531+0000","last_became_peered":"2023-11-26T07:18:03.805531+0000","last_unstale":"2023-11-26T07:18:04.978097+0000","last_undegraded":"2023-11-26T07:18:04.978097+0000","last_fullsized":"2023-11-26T07:18:04.978097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:20.912837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:18:03.786995+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:18:03.786995+0000","last_peered":"2023-11-26T07:18:03.786995+0000","last_clean":"2023-11-26T07:18:03.786995+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:18:03.786995+0000","last_undegraded":"2023-11-26T07:18:03.786995+0000","last_fullsized":"2023-11-26T07:18:03.786995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977910+0000","last_change":"2023-11-26T07:18:03.116264+0000","last_active":"2023-11-26T07:18:04.977910+0000","last_peered":"2023-11-26T07:18:04.977910+0000","last_clean":"2023-11-26T07:18:04.977910+0000","last_became_active":"2023-11-26T07:18:03.113528+0000","last_became_peered":"2023-11-26T07:18:03.113528+0000","last_unstale":"2023-11-26T07:18:04.977910+0000","last_undegraded":"2023-11-26T07:18:04.977910+0000","last_fullsized":"2023-11-26T07:18:04.977910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778371+0000","last_change":"2023-11-26T07:18:03.799200+0000","last_active":"2023-11-26T07:18:04.778371+0000","last_peered":"2023-11-26T07:18:04.778371+0000","last_clean":"2023-11-26T07:18:04.778371+0000","last_became_active":"2023-11-26T07:18:03.798900+0000","last_became_peered":"2023-11-26T07:18:03.798900+0000","last_unstale":"2023-11-26T07:18:04.778371+0000","last_undegraded":"2023-11-26T07:18:04.778371+0000","last_fullsized":"2023-11-26T07:18:04.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977542+0000","last_change":"2023-11-26T07:18:03.118573+0000","last_active":"2023-11-26T07:18:04.977542+0000","last_peered":"2023-11-26T07:18:04.977542+0000","last_clean":"2023-11-26T07:18:04.977542+0000","last_became_active":"2023-11-26T07:18:03.118279+0000","last_became_peered":"2023-11-26T07:18:03.118279+0000","last_unstale":"2023-11-26T07:18:04.977542+0000","last_undegraded":"2023-11-26T07:18:04.977542+0000","last_fullsized":"2023-11-26T07:18:04.977542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:32.911964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938502+0000","last_change":"2023-11-26T07:18:03.787057+0000","last_active":"2023-11-26T07:18:04.938502+0000","last_peered":"2023-11-26T07:18:04.938502+0000","last_clean":"2023-11-26T07:18:04.938502+0000","last_became_active":"2023-11-26T07:18:03.786791+0000","last_became_peered":"2023-11-26T07:18:03.786791+0000","last_unstale":"2023-11-26T07:18:04.938502+0000","last_undegraded":"2023-11-26T07:18:04.938502+0000","last_fullsized":"2023-11-26T07:18:04.938502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:47.452914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777253+0000","last_change":"2023-11-26T07:18:03.124374+0000","last_active":"2023-11-26T07:18:04.777253+0000","last_peered":"2023-11-26T07:18:04.777253+0000","last_clean":"2023-11-26T07:18:04.777253+0000","last_became_active":"2023-11-26T07:18:03.123071+0000","last_became_peered":"2023-11-26T07:18:03.123071+0000","last_unstale":"2023-11-26T07:18:04.777253+0000","last_undegraded":"2023-11-26T07:18:04.777253+0000","last_fullsized":"2023-11-26T07:18:04.777253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:02:12.811700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965635+0000","last_change":"2023-11-26T07:18:03.787012+0000","last_active":"2023-11-26T07:18:04.965635+0000","last_peered":"2023-11-26T07:18:04.965635+0000","last_clean":"2023-11-26T07:18:04.965635+0000","last_became_active":"2023-11-26T07:18:03.786759+0000","last_became_peered":"2023-11-26T07:18:03.786759+0000","last_unstale":"2023-11-26T07:18:04.965635+0000","last_undegraded":"2023-11-26T07:18:04.965635+0000","last_fullsized":"2023-11-26T07:18:04.965635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978667+0000","last_change":"2023-11-26T07:18:03.125780+0000","last_active":"2023-11-26T07:18:04.978667+0000","last_peered":"2023-11-26T07:18:04.978667+0000","last_clean":"2023-11-26T07:18:04.978667+0000","last_became_active":"2023-11-26T07:18:03.114090+0000","last_became_peered":"2023-11-26T07:18:03.114090+0000","last_unstale":"2023-11-26T07:18:04.978667+0000","last_undegraded":"2023-11-26T07:18:04.978667+0000","last_fullsized":"2023-11-26T07:18:04.978667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:31.621076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777652+0000","last_change":"2023-11-26T07:18:03.793309+0000","last_active":"2023-11-26T07:18:04.777652+0000","last_peered":"2023-11-26T07:18:04.777652+0000","last_clean":"2023-11-26T07:18:04.777652+0000","last_became_active":"2023-11-26T07:18:03.792978+0000","last_became_peered":"2023-11-26T07:18:03.792978+0000","last_unstale":"2023-11-26T07:18:04.777652+0000","last_undegraded":"2023-11-26T07:18:04.777652+0000","last_fullsized":"2023-11-26T07:18:04.777652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:53.444118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965659+0000","last_change":"2023-11-26T07:18:03.108277+0000","last_active":"2023-11-26T07:18:04.965659+0000","last_peered":"2023-11-26T07:18:04.965659+0000","last_clean":"2023-11-26T07:18:04.965659+0000","last_became_active":"2023-11-26T07:18:03.107849+0000","last_became_peered":"2023-11-26T07:18:03.107849+0000","last_unstale":"2023-11-26T07:18:04.965659+0000","last_undegraded":"2023-11-26T07:18:04.965659+0000","last_fullsized":"2023-11-26T07:18:04.965659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978391+0000","last_change":"2023-11-26T07:18:03.799853+0000","last_active":"2023-11-26T07:18:04.978391+0000","last_peered":"2023-11-26T07:18:04.978391+0000","last_clean":"2023-11-26T07:18:04.978391+0000","last_became_active":"2023-11-26T07:18:03.799496+0000","last_became_peered":"2023-11-26T07:18:03.799496+0000","last_unstale":"2023-11-26T07:18:04.978391+0000","last_undegraded":"2023-11-26T07:18:04.978391+0000","last_fullsized":"2023-11-26T07:18:04.978391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978123+0000","last_change":"2023-11-26T07:18:03.119202+0000","last_active":"2023-11-26T07:18:04.978123+0000","last_peered":"2023-11-26T07:18:04.978123+0000","last_clean":"2023-11-26T07:18:04.978123+0000","last_became_active":"2023-11-26T07:18:03.118804+0000","last_became_peered":"2023-11-26T07:18:03.118804+0000","last_unstale":"2023-11-26T07:18:04.978123+0000","last_undegraded":"2023-11-26T07:18:04.978123+0000","last_fullsized":"2023-11-26T07:18:04.978123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:26.724451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965884+0000","last_change":"2023-11-26T07:18:03.795950+0000","last_active":"2023-11-26T07:18:04.965884+0000","last_peered":"2023-11-26T07:18:04.965884+0000","last_clean":"2023-11-26T07:18:04.965884+0000","last_became_active":"2023-11-26T07:18:03.795701+0000","last_became_peered":"2023-11-26T07:18:03.795701+0000","last_unstale":"2023-11-26T07:18:04.965884+0000","last_undegraded":"2023-11-26T07:18:04.965884+0000","last_fullsized":"2023-11-26T07:18:04.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965886+0000","last_change":"2023-11-26T07:18:03.123835+0000","last_active":"2023-11-26T07:18:04.965886+0000","last_peered":"2023-11-26T07:18:04.965886+0000","last_clean":"2023-11-26T07:18:04.965886+0000","last_became_active":"2023-11-26T07:18:03.123563+0000","last_became_peered":"2023-11-26T07:18:03.123563+0000","last_unstale":"2023-11-26T07:18:04.965886+0000","last_undegraded":"2023-11-26T07:18:04.965886+0000","last_fullsized":"2023-11-26T07:18:04.965886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778740+0000","last_change":"2023-11-26T07:18:03.798789+0000","last_active":"2023-11-26T07:18:04.778740+0000","last_peered":"2023-11-26T07:18:04.778740+0000","last_clean":"2023-11-26T07:18:04.778740+0000","last_became_active":"2023-11-26T07:18:03.798536+0000","last_became_peered":"2023-11-26T07:18:03.798536+0000","last_unstale":"2023-11-26T07:18:04.778740+0000","last_undegraded":"2023-11-26T07:18:04.778740+0000","last_fullsized":"2023-11-26T07:18:04.778740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978222+0000","last_change":"2023-11-26T07:18:03.121938+0000","last_active":"2023-11-26T07:18:04.978222+0000","last_peered":"2023-11-26T07:18:04.978222+0000","last_clean":"2023-11-26T07:18:04.978222+0000","last_became_active":"2023-11-26T07:18:03.120860+0000","last_became_peered":"2023-11-26T07:18:03.120860+0000","last_unstale":"2023-11-26T07:18:04.978222+0000","last_undegraded":"2023-11-26T07:18:04.978222+0000","last_fullsized":"2023-11-26T07:18:04.978222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938909+0000","last_change":"2023-11-26T07:18:03.784898+0000","last_active":"2023-11-26T07:18:04.938909+0000","last_peered":"2023-11-26T07:18:04.938909+0000","last_clean":"2023-11-26T07:18:04.938909+0000","last_became_active":"2023-11-26T07:18:03.784582+0000","last_became_peered":"2023-11-26T07:18:03.784582+0000","last_unstale":"2023-11-26T07:18:04.938909+0000","last_undegraded":"2023-11-26T07:18:04.938909+0000","last_fullsized":"2023-11-26T07:18:04.938909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977094+0000","last_change":"2023-11-26T07:18:03.116934+0000","last_active":"2023-11-26T07:18:04.977094+0000","last_peered":"2023-11-26T07:18:04.977094+0000","last_clean":"2023-11-26T07:18:04.977094+0000","last_became_active":"2023-11-26T07:18:03.116587+0000","last_became_peered":"2023-11-26T07:18:03.116587+0000","last_unstale":"2023-11-26T07:18:04.977094+0000","last_undegraded":"2023-11-26T07:18:04.977094+0000","last_fullsized":"2023-11-26T07:18:04.977094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777610+0000","last_change":"2023-11-26T07:18:03.779690+0000","last_active":"2023-11-26T07:18:04.777610+0000","last_peered":"2023-11-26T07:18:04.777610+0000","last_clean":"2023-11-26T07:18:04.777610+0000","last_became_active":"2023-11-26T07:18:03.778339+0000","last_became_peered":"2023-11-26T07:18:03.778339+0000","last_unstale":"2023-11-26T07:18:04.777610+0000","last_undegraded":"2023-11-26T07:18:04.777610+0000","last_fullsized":"2023-11-26T07:18:04.777610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:41.605885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965725+0000","last_change":"2023-11-26T07:18:03.119668+0000","last_active":"2023-11-26T07:18:04.965725+0000","last_peered":"2023-11-26T07:18:04.965725+0000","last_clean":"2023-11-26T07:18:04.965725+0000","last_became_active":"2023-11-26T07:18:03.119332+0000","last_became_peered":"2023-11-26T07:18:03.119332+0000","last_unstale":"2023-11-26T07:18:04.965725+0000","last_undegraded":"2023-11-26T07:18:04.965725+0000","last_fullsized":"2023-11-26T07:18:04.965725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778026+0000","last_change":"2023-11-26T07:18:03.782878+0000","last_active":"2023-11-26T07:18:04.778026+0000","last_peered":"2023-11-26T07:18:04.778026+0000","last_clean":"2023-11-26T07:18:04.778026+0000","last_became_active":"2023-11-26T07:18:03.782504+0000","last_became_peered":"2023-11-26T07:18:03.782504+0000","last_unstale":"2023-11-26T07:18:04.778026+0000","last_undegraded":"2023-11-26T07:18:04.778026+0000","last_fullsized":"2023-11-26T07:18:04.778026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965870+0000","last_change":"2023-11-26T07:18:03.121787+0000","last_active":"2023-11-26T07:18:04.965870+0000","last_peered":"2023-11-26T07:18:04.965870+0000","last_clean":"2023-11-26T07:18:04.965870+0000","last_became_active":"2023-11-26T07:18:03.121345+0000","last_became_peered":"2023-11-26T07:18:03.121345+0000","last_unstale":"2023-11-26T07:18:04.965870+0000","last_undegraded":"2023-11-26T07:18:04.965870+0000","last_fullsized":"2023-11-26T07:18:04.965870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778470+0000","last_change":"2023-11-26T07:18:03.793669+0000","last_active":"2023-11-26T07:18:04.778470+0000","last_peered":"2023-11-26T07:18:04.778470+0000","last_clean":"2023-11-26T07:18:04.778470+0000","last_became_active":"2023-11-26T07:18:03.793355+0000","last_became_peered":"2023-11-26T07:18:03.793355+0000","last_unstale":"2023-11-26T07:18:04.778470+0000","last_undegraded":"2023-11-26T07:18:04.778470+0000","last_fullsized":"2023-11-26T07:18:04.778470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.124539+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.124258+0000","last_became_peered":"2023-11-26T07:18:03.124258+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.784788+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.784298+0000","last_became_peered":"2023-11-26T07:18:03.784298+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978292+0000","last_change":"2023-11-26T07:18:03.799951+0000","last_active":"2023-11-26T07:18:04.978292+0000","last_peered":"2023-11-26T07:18:04.978292+0000","last_clean":"2023-11-26T07:18:04.978292+0000","last_became_active":"2023-11-26T07:18:03.799683+0000","last_became_peered":"2023-11-26T07:18:03.799683+0000","last_unstale":"2023-11-26T07:18:04.978292+0000","last_undegraded":"2023-11-26T07:18:04.978292+0000","last_fullsized":"2023-11-26T07:18:04.978292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977125+0000","last_change":"2023-11-26T07:18:03.127894+0000","last_active":"2023-11-26T07:18:04.977125+0000","last_peered":"2023-11-26T07:18:04.977125+0000","last_clean":"2023-11-26T07:18:04.977125+0000","last_became_active":"2023-11-26T07:18:03.127553+0000","last_became_peered":"2023-11-26T07:18:03.127553+0000","last_unstale":"2023-11-26T07:18:04.977125+0000","last_undegraded":"2023-11-26T07:18:04.977125+0000","last_fullsized":"2023-11-26T07:18:04.977125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978401+0000","last_change":"2023-11-26T07:18:03.798787+0000","last_active":"2023-11-26T07:18:04.978401+0000","last_peered":"2023-11-26T07:18:04.978401+0000","last_clean":"2023-11-26T07:18:04.978401+0000","last_became_active":"2023-11-26T07:18:03.797918+0000","last_became_peered":"2023-11-26T07:18:03.797918+0000","last_unstale":"2023-11-26T07:18:04.978401+0000","last_undegraded":"2023-11-26T07:18:04.978401+0000","last_fullsized":"2023-11-26T07:18:04.978401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977895+0000","last_change":"2023-11-26T07:18:03.128111+0000","last_active":"2023-11-26T07:18:04.977895+0000","last_peered":"2023-11-26T07:18:04.977895+0000","last_clean":"2023-11-26T07:18:04.977895+0000","last_became_active":"2023-11-26T07:18:03.127727+0000","last_became_peered":"2023-11-26T07:18:03.127727+0000","last_unstale":"2023-11-26T07:18:04.977895+0000","last_undegraded":"2023-11-26T07:18:04.977895+0000","last_fullsized":"2023-11-26T07:18:04.977895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938927+0000","last_change":"2023-11-26T07:18:03.804397+0000","last_active":"2023-11-26T07:18:04.938927+0000","last_peered":"2023-11-26T07:18:04.938927+0000","last_clean":"2023-11-26T07:18:04.938927+0000","last_became_active":"2023-11-26T07:18:03.804157+0000","last_became_peered":"2023-11-26T07:18:03.804157+0000","last_unstale":"2023-11-26T07:18:04.938927+0000","last_undegraded":"2023-11-26T07:18:04.938927+0000","last_fullsized":"2023-11-26T07:18:04.938927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778691+0000","last_change":"2023-11-26T07:18:03.120821+0000","last_active":"2023-11-26T07:18:04.778691+0000","last_peered":"2023-11-26T07:18:04.778691+0000","last_clean":"2023-11-26T07:18:04.778691+0000","last_became_active":"2023-11-26T07:18:03.120551+0000","last_became_peered":"2023-11-26T07:18:03.120551+0000","last_unstale":"2023-11-26T07:18:04.778691+0000","last_undegraded":"2023-11-26T07:18:04.778691+0000","last_fullsized":"2023-11-26T07:18:04.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778654+0000","last_change":"2023-11-26T07:18:03.783374+0000","last_active":"2023-11-26T07:18:04.778654+0000","last_peered":"2023-11-26T07:18:04.778654+0000","last_clean":"2023-11-26T07:18:04.778654+0000","last_became_active":"2023-11-26T07:18:03.782911+0000","last_became_peered":"2023-11-26T07:18:03.782911+0000","last_unstale":"2023-11-26T07:18:04.778654+0000","last_undegraded":"2023-11-26T07:18:04.778654+0000","last_fullsized":"2023-11-26T07:18:04.778654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938985+0000","last_change":"2023-11-26T07:18:03.120489+0000","last_active":"2023-11-26T07:18:04.938985+0000","last_peered":"2023-11-26T07:18:04.938985+0000","last_clean":"2023-11-26T07:18:04.938985+0000","last_became_active":"2023-11-26T07:18:03.120191+0000","last_became_peered":"2023-11-26T07:18:03.120191+0000","last_unstale":"2023-11-26T07:18:04.938985+0000","last_undegraded":"2023-11-26T07:18:04.938985+0000","last_fullsized":"2023-11-26T07:18:04.938985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8019999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.573}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7789999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6879999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.516}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6390000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:08.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:08.325 INFO:tasks.ceph.mds.d.smithi120.stderr:2023-11-26T07:18:08.322+0000 7efed5ed8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:18:08.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 Processor -- start 2023-11-26T07:18:08.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 -- start start 2023-11-26T07:18:08.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe700d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efe7015d680 0x7efe700cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efe700d0e80 0x7efe700d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe700cdc40 con 0x7efe700d0e80 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe700ce7a0 con 0x7efe7015d680 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe77548640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700d1440 con 0x7efe7015d2a0 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efe700d0e80 0x7efe700d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efe700d0e80 0x7efe700d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59882/0 (socket says 172.21.15.70:59882) 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 -- 172.21.15.70:0/1310796282 learned_addr learned my addr 172.21.15.70:0/1310796282 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe75d45640 1 --2- 172.21.15.70:0/1310796282 >> v2:172.21.15.120:3300/0 conn(0x7efe7015d680 0x7efe700cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76546640 1 --2- 172.21.15.70:0/1310796282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe700d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 -- 172.21.15.70:0/1310796282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 msgr2=0x7efe700d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 --2- 172.21.15.70:0/1310796282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe700d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 -- 172.21.15.70:0/1310796282 >> v2:172.21.15.120:3300/0 conn(0x7efe7015d680 msgr2=0x7efe700cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:08.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 --2- 172.21.15.70:0/1310796282 >> v2:172.21.15.120:3300/0 conn(0x7efe7015d680 0x7efe700cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76d47640 1 -- 172.21.15.70:0/1310796282 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe700cde70 con 0x7efe700d0e80 2023-11-26T07:18:08.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.347+0000 7efe76546640 1 --2- 172.21.15.70:0/1310796282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe700d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:08.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe76d47640 1 --2- 172.21.15.70:0/1310796282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700d1680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe7006aa00 tx=0x7efe6801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b06cc19aa8d464 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe75544640 1 -- 172.21.15.70:0/1310796282 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680a5730 con 0x7efe700d0e80 2023-11-26T07:18:08.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe75544640 1 -- 172.21.15.70:0/1310796282 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe680a5890 con 0x7efe700d0e80 2023-11-26T07:18:08.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe75544640 1 -- 172.21.15.70:0/1310796282 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680a5c20 con 0x7efe700d0e80 2023-11-26T07:18:08.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 -- 172.21.15.70:0/1310796282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 msgr2=0x7efe700d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 --2- 172.21.15.70:0/1310796282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700d1680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe7006aa00 tx=0x7efe6801c9a0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 -- 172.21.15.70:0/1310796282 shutdown_connections 2023-11-26T07:18:08.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 --2- 172.21.15.70:0/1310796282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700d1680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 --2- 172.21.15.70:0/1310796282 >> v2:172.21.15.120:3300/0 conn(0x7efe7015d680 0x7efe700cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 --2- 172.21.15.70:0/1310796282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe700d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 -- 172.21.15.70:0/1310796282 >> 172.21.15.70:0/1310796282 conn(0x7efe700d30a0 msgr2=0x7efe700d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 -- 172.21.15.70:0/1310796282 shutdown_connections 2023-11-26T07:18:08.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 -- 172.21.15.70:0/1310796282 wait complete. 2023-11-26T07:18:08.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 Processor -- start 2023-11-26T07:18:08.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.351+0000 7efe77548640 1 -- start start 2023-11-26T07:18:08.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe70152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe7015d680 0x7efe70152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe700b3b70 con 0x7efe700d0e80 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70152e90 con 0x7efe7015d680 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700c6850 con 0x7efe7015d2a0 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59884/0 (socket says 172.21.15.70:59884) 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 -- 172.21.15.70:0/460925213 learned_addr learned my addr 172.21.15.70:0/460925213 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76d47640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe7015d680 0x7efe70152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe75d45640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe70152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 -- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 msgr2=0x7efe70152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe70152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 -- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe7015d680 msgr2=0x7efe70152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe7015d680 0x7efe70152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 -- 172.21.15.70:0/460925213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009b30 con 0x7efe700d0e80 2023-11-26T07:18:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe76546640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700c6310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c7c0 tx=0x7efe6c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe66ffd640 1 -- 172.21.15.70:0/460925213 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0079d0 con 0x7efe700d0e80 2023-11-26T07:18:08.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe66ffd640 1 -- 172.21.15.70:0/460925213 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c007b30 con 0x7efe700d0e80 2023-11-26T07:18:08.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe701530d0 con 0x7efe700d0e80 2023-11-26T07:18:08.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe66ffd640 1 -- 172.21.15.70:0/460925213 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00ce70 con 0x7efe700d0e80 2023-11-26T07:18:08.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe70153690 con 0x7efe700d0e80 2023-11-26T07:18:08.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.355+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe70160cf0 con 0x7efe700d0e80 2023-11-26T07:18:08.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.359+0000 7efe66ffd640 1 -- 172.21.15.70:0/460925213 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe6c0113f0 con 0x7efe700d0e80 2023-11-26T07:18:08.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.359+0000 7efe66ffd640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efe54066470 0x7efe54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.359+0000 7efe66ffd640 1 -- 172.21.15.70:0/460925213 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe6c083f50 con 0x7efe700d0e80 2023-11-26T07:18:08.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.359+0000 7efe75d45640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efe54066470 0x7efe54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.359+0000 7efe75d45640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efe54066470 0x7efe54068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe700ccbd0 tx=0x7efe60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.363+0000 7efe66ffd640 1 -- 172.21.15.70:0/460925213 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe6c0513e0 con 0x7efe700d0e80 2023-11-26T07:18:08.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.511+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe700d2360 con 0x7efe54066470 2023-11-26T07:18:08.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe66ffd640 1 -- 172.21.15.70:0/460925213 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7efe700d2360 con 0x7efe54066470 2023-11-26T07:18:08.521 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:08.523 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efe54066470 msgr2=0x7efe54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efe54066470 0x7efe54068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe700ccbd0 tx=0x7efe60008040 comp rx=0 tx=0).stop 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 msgr2=0x7efe700c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700c6310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c7c0 tx=0x7efe6c00cc80 comp rx=0 tx=0).stop 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 shutdown_connections 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe7015d680 0x7efe70152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efe7015d2a0 0x7efe70152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efe54066470 0x7efe54068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 --2- 172.21.15.70:0/460925213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe700d0e80 0x7efe700c6310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 >> 172.21.15.70:0/460925213 conn(0x7efe700d30a0 msgr2=0x7efe700b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 shutdown_connections 2023-11-26T07:18:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.519+0000 7efe77548640 1 -- 172.21.15.70:0/460925213 wait complete. 2023-11-26T07:18:08.542 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-26T07:18:07.990589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231596,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743124,"statfs":{"total":773094113280,"available":772856958976,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.908036"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977709+0000","last_change":"2023-11-26T07:18:03.803784+0000","last_active":"2023-11-26T07:18:04.977709+0000","last_peered":"2023-11-26T07:18:04.977709+0000","last_clean":"2023-11-26T07:18:04.977709+0000","last_became_active":"2023-11-26T07:18:03.803443+0000","last_became_peered":"2023-11-26T07:18:03.803443+0000","last_unstale":"2023-11-26T07:18:04.977709+0000","last_undegraded":"2023-11-26T07:18:04.977709+0000","last_fullsized":"2023-11-26T07:18:04.977709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965901+0000","last_change":"2023-11-26T07:18:03.788975+0000","last_active":"2023-11-26T07:18:04.965901+0000","last_peered":"2023-11-26T07:18:04.965901+0000","last_clean":"2023-11-26T07:18:04.965901+0000","last_became_active":"2023-11-26T07:18:03.788417+0000","last_became_peered":"2023-11-26T07:18:03.788417+0000","last_unstale":"2023-11-26T07:18:04.965901+0000","last_undegraded":"2023-11-26T07:18:04.965901+0000","last_fullsized":"2023-11-26T07:18:04.965901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938823+0000","last_change":"2023-11-26T07:18:03.794288+0000","last_active":"2023-11-26T07:18:04.938823+0000","last_peered":"2023-11-26T07:18:04.938823+0000","last_clean":"2023-11-26T07:18:04.938823+0000","last_became_active":"2023-11-26T07:18:03.794001+0000","last_became_peered":"2023-11-26T07:18:03.794001+0000","last_unstale":"2023-11-26T07:18:04.938823+0000","last_undegraded":"2023-11-26T07:18:04.938823+0000","last_fullsized":"2023-11-26T07:18:04.938823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978274+0000","last_change":"2023-11-26T07:18:03.799214+0000","last_active":"2023-11-26T07:18:04.978274+0000","last_peered":"2023-11-26T07:18:04.978274+0000","last_clean":"2023-11-26T07:18:04.978274+0000","last_became_active":"2023-11-26T07:18:03.798914+0000","last_became_peered":"2023-11-26T07:18:03.798914+0000","last_unstale":"2023-11-26T07:18:04.978274+0000","last_undegraded":"2023-11-26T07:18:04.978274+0000","last_fullsized":"2023-11-26T07:18:04.978274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977291+0000","last_change":"2023-11-26T07:18:03.802078+0000","last_active":"2023-11-26T07:18:04.977291+0000","last_peered":"2023-11-26T07:18:04.977291+0000","last_clean":"2023-11-26T07:18:04.977291+0000","last_became_active":"2023-11-26T07:18:03.801400+0000","last_became_peered":"2023-11-26T07:18:03.801400+0000","last_unstale":"2023-11-26T07:18:04.977291+0000","last_undegraded":"2023-11-26T07:18:04.977291+0000","last_fullsized":"2023-11-26T07:18:04.977291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978001+0000","last_change":"2023-11-26T07:18:03.797285+0000","last_active":"2023-11-26T07:18:04.978001+0000","last_peered":"2023-11-26T07:18:04.978001+0000","last_clean":"2023-11-26T07:18:04.978001+0000","last_became_active":"2023-11-26T07:18:03.796973+0000","last_became_peered":"2023-11-26T07:18:03.796973+0000","last_unstale":"2023-11-26T07:18:04.978001+0000","last_undegraded":"2023-11-26T07:18:04.978001+0000","last_fullsized":"2023-11-26T07:18:04.978001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977015+0000","last_change":"2023-11-26T07:18:03.801957+0000","last_active":"2023-11-26T07:18:04.977015+0000","last_peered":"2023-11-26T07:18:04.977015+0000","last_clean":"2023-11-26T07:18:04.977015+0000","last_became_active":"2023-11-26T07:18:03.801666+0000","last_became_peered":"2023-11-26T07:18:03.801666+0000","last_unstale":"2023-11-26T07:18:04.977015+0000","last_undegraded":"2023-11-26T07:18:04.977015+0000","last_fullsized":"2023-11-26T07:18:04.977015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777954+0000","last_change":"2023-11-26T07:18:03.795903+0000","last_active":"2023-11-26T07:18:04.777954+0000","last_peered":"2023-11-26T07:18:04.777954+0000","last_clean":"2023-11-26T07:18:04.777954+0000","last_became_active":"2023-11-26T07:18:03.795634+0000","last_became_peered":"2023-11-26T07:18:03.795634+0000","last_unstale":"2023-11-26T07:18:04.777954+0000","last_undegraded":"2023-11-26T07:18:04.777954+0000","last_fullsized":"2023-11-26T07:18:04.777954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977838+0000","last_change":"2023-11-26T07:18:03.807314+0000","last_active":"2023-11-26T07:18:04.977838+0000","last_peered":"2023-11-26T07:18:04.977838+0000","last_clean":"2023-11-26T07:18:04.977838+0000","last_became_active":"2023-11-26T07:18:03.806735+0000","last_became_peered":"2023-11-26T07:18:03.806735+0000","last_unstale":"2023-11-26T07:18:04.977838+0000","last_undegraded":"2023-11-26T07:18:04.977838+0000","last_fullsized":"2023-11-26T07:18:04.977838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:41:15.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977563+0000","last_change":"2023-11-26T07:18:03.799600+0000","last_active":"2023-11-26T07:18:04.977563+0000","last_peered":"2023-11-26T07:18:04.977563+0000","last_clean":"2023-11-26T07:18:04.977563+0000","last_became_active":"2023-11-26T07:18:03.799261+0000","last_became_peered":"2023-11-26T07:18:03.799261+0000","last_unstale":"2023-11-26T07:18:04.977563+0000","last_undegraded":"2023-11-26T07:18:04.977563+0000","last_fullsized":"2023-11-26T07:18:04.977563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977141+0000","last_change":"2023-11-26T07:18:03.800938+0000","last_active":"2023-11-26T07:18:04.977141+0000","last_peered":"2023-11-26T07:18:04.977141+0000","last_clean":"2023-11-26T07:18:04.977141+0000","last_became_active":"2023-11-26T07:18:03.800617+0000","last_became_peered":"2023-11-26T07:18:03.800617+0000","last_unstale":"2023-11-26T07:18:04.977141+0000","last_undegraded":"2023-11-26T07:18:04.977141+0000","last_fullsized":"2023-11-26T07:18:04.977141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777870+0000","last_change":"2023-11-26T07:18:03.782200+0000","last_active":"2023-11-26T07:18:04.777870+0000","last_peered":"2023-11-26T07:18:04.777870+0000","last_clean":"2023-11-26T07:18:04.777870+0000","last_became_active":"2023-11-26T07:18:03.781899+0000","last_became_peered":"2023-11-26T07:18:03.781899+0000","last_unstale":"2023-11-26T07:18:04.777870+0000","last_undegraded":"2023-11-26T07:18:04.777870+0000","last_fullsized":"2023-11-26T07:18:04.777870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778374+0000","last_change":"2023-11-26T07:18:03.779335+0000","last_active":"2023-11-26T07:18:04.778374+0000","last_peered":"2023-11-26T07:18:04.778374+0000","last_clean":"2023-11-26T07:18:04.778374+0000","last_became_active":"2023-11-26T07:18:03.779062+0000","last_became_peered":"2023-11-26T07:18:03.779062+0000","last_unstale":"2023-11-26T07:18:04.778374+0000","last_undegraded":"2023-11-26T07:18:04.778374+0000","last_fullsized":"2023-11-26T07:18:04.778374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938632+0000","last_change":"2023-11-26T07:18:03.785565+0000","last_active":"2023-11-26T07:18:04.938632+0000","last_peered":"2023-11-26T07:18:04.938632+0000","last_clean":"2023-11-26T07:18:04.938632+0000","last_became_active":"2023-11-26T07:18:03.785185+0000","last_became_peered":"2023-11-26T07:18:03.785185+0000","last_unstale":"2023-11-26T07:18:04.938632+0000","last_undegraded":"2023-11-26T07:18:04.938632+0000","last_fullsized":"2023-11-26T07:18:04.938632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:51.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965569+0000","last_change":"2023-11-26T07:18:03.794642+0000","last_active":"2023-11-26T07:18:04.965569+0000","last_peered":"2023-11-26T07:18:04.965569+0000","last_clean":"2023-11-26T07:18:04.965569+0000","last_became_active":"2023-11-26T07:18:03.794199+0000","last_became_peered":"2023-11-26T07:18:03.794199+0000","last_unstale":"2023-11-26T07:18:04.965569+0000","last_undegraded":"2023-11-26T07:18:04.965569+0000","last_fullsized":"2023-11-26T07:18:04.965569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977524+0000","last_change":"2023-11-26T07:18:03.793156+0000","last_active":"2023-11-26T07:18:04.977524+0000","last_peered":"2023-11-26T07:18:04.977524+0000","last_clean":"2023-11-26T07:18:04.977524+0000","last_became_active":"2023-11-26T07:18:03.792834+0000","last_became_peered":"2023-11-26T07:18:03.792834+0000","last_unstale":"2023-11-26T07:18:04.977524+0000","last_undegraded":"2023-11-26T07:18:04.977524+0000","last_fullsized":"2023-11-26T07:18:04.977524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978940+0000","last_change":"2023-11-26T07:18:03.805692+0000","last_active":"2023-11-26T07:18:04.978940+0000","last_peered":"2023-11-26T07:18:04.978940+0000","last_clean":"2023-11-26T07:18:04.978940+0000","last_became_active":"2023-11-26T07:18:03.805350+0000","last_became_peered":"2023-11-26T07:18:03.805350+0000","last_unstale":"2023-11-26T07:18:04.978940+0000","last_undegraded":"2023-11-26T07:18:04.978940+0000","last_fullsized":"2023-11-26T07:18:04.978940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777433+0000","last_change":"2023-11-26T07:18:03.786256+0000","last_active":"2023-11-26T07:18:04.777433+0000","last_peered":"2023-11-26T07:18:04.777433+0000","last_clean":"2023-11-26T07:18:04.777433+0000","last_became_active":"2023-11-26T07:18:03.785953+0000","last_became_peered":"2023-11-26T07:18:03.785953+0000","last_unstale":"2023-11-26T07:18:04.777433+0000","last_undegraded":"2023-11-26T07:18:04.777433+0000","last_fullsized":"2023-11-26T07:18:04.777433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978040+0000","last_change":"2023-11-26T07:18:03.803009+0000","last_active":"2023-11-26T07:18:04.978040+0000","last_peered":"2023-11-26T07:18:04.978040+0000","last_clean":"2023-11-26T07:18:04.978040+0000","last_became_active":"2023-11-26T07:18:03.802310+0000","last_became_peered":"2023-11-26T07:18:03.802310+0000","last_unstale":"2023-11-26T07:18:04.978040+0000","last_undegraded":"2023-11-26T07:18:04.978040+0000","last_fullsized":"2023-11-26T07:18:04.978040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:51.419753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977730+0000","last_change":"2023-11-26T07:18:03.785169+0000","last_active":"2023-11-26T07:18:04.977730+0000","last_peered":"2023-11-26T07:18:04.977730+0000","last_clean":"2023-11-26T07:18:04.977730+0000","last_became_active":"2023-11-26T07:18:03.784952+0000","last_became_peered":"2023-11-26T07:18:03.784952+0000","last_unstale":"2023-11-26T07:18:04.977730+0000","last_undegraded":"2023-11-26T07:18:04.977730+0000","last_fullsized":"2023-11-26T07:18:04.977730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938762+0000","last_change":"2023-11-26T07:18:03.788071+0000","last_active":"2023-11-26T07:18:04.938762+0000","last_peered":"2023-11-26T07:18:04.938762+0000","last_clean":"2023-11-26T07:18:04.938762+0000","last_became_active":"2023-11-26T07:18:03.787821+0000","last_became_peered":"2023-11-26T07:18:03.787821+0000","last_unstale":"2023-11-26T07:18:04.938762+0000","last_undegraded":"2023-11-26T07:18:04.938762+0000","last_fullsized":"2023-11-26T07:18:04.938762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978153+0000","last_change":"2023-11-26T07:18:03.804426+0000","last_active":"2023-11-26T07:18:04.978153+0000","last_peered":"2023-11-26T07:18:04.978153+0000","last_clean":"2023-11-26T07:18:04.978153+0000","last_became_active":"2023-11-26T07:18:03.804150+0000","last_became_peered":"2023-11-26T07:18:03.804150+0000","last_unstale":"2023-11-26T07:18:04.978153+0000","last_undegraded":"2023-11-26T07:18:04.978153+0000","last_fullsized":"2023-11-26T07:18:04.978153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778267+0000","last_change":"2023-11-26T07:18:03.787986+0000","last_active":"2023-11-26T07:18:04.778267+0000","last_peered":"2023-11-26T07:18:04.778267+0000","last_clean":"2023-11-26T07:18:04.778267+0000","last_became_active":"2023-11-26T07:18:03.787730+0000","last_became_peered":"2023-11-26T07:18:03.787730+0000","last_unstale":"2023-11-26T07:18:04.778267+0000","last_undegraded":"2023-11-26T07:18:04.778267+0000","last_fullsized":"2023-11-26T07:18:04.778267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978264+0000","last_change":"2023-11-26T07:18:03.792214+0000","last_active":"2023-11-26T07:18:04.978264+0000","last_peered":"2023-11-26T07:18:04.978264+0000","last_clean":"2023-11-26T07:18:04.978264+0000","last_became_active":"2023-11-26T07:18:03.791863+0000","last_became_peered":"2023-11-26T07:18:03.791863+0000","last_unstale":"2023-11-26T07:18:04.978264+0000","last_undegraded":"2023-11-26T07:18:04.978264+0000","last_fullsized":"2023-11-26T07:18:04.978264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778641+0000","last_change":"2023-11-26T07:18:03.788356+0000","last_active":"2023-11-26T07:18:04.778641+0000","last_peered":"2023-11-26T07:18:04.778641+0000","last_clean":"2023-11-26T07:18:04.778641+0000","last_became_active":"2023-11-26T07:18:03.788037+0000","last_became_peered":"2023-11-26T07:18:03.788037+0000","last_unstale":"2023-11-26T07:18:04.778641+0000","last_undegraded":"2023-11-26T07:18:04.778641+0000","last_fullsized":"2023-11-26T07:18:04.778641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977702+0000","last_change":"2023-11-26T07:18:03.798506+0000","last_active":"2023-11-26T07:18:04.977702+0000","last_peered":"2023-11-26T07:18:04.977702+0000","last_clean":"2023-11-26T07:18:04.977702+0000","last_became_active":"2023-11-26T07:18:03.798181+0000","last_became_peered":"2023-11-26T07:18:03.798181+0000","last_unstale":"2023-11-26T07:18:04.977702+0000","last_undegraded":"2023-11-26T07:18:04.977702+0000","last_fullsized":"2023-11-26T07:18:04.977702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965715+0000","last_change":"2023-11-26T07:18:03.792464+0000","last_active":"2023-11-26T07:18:04.965715+0000","last_peered":"2023-11-26T07:18:04.965715+0000","last_clean":"2023-11-26T07:18:04.965715+0000","last_became_active":"2023-11-26T07:18:03.792203+0000","last_became_peered":"2023-11-26T07:18:03.792203+0000","last_unstale":"2023-11-26T07:18:04.965715+0000","last_undegraded":"2023-11-26T07:18:04.965715+0000","last_fullsized":"2023-11-26T07:18:04.965715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778594+0000","last_change":"2023-11-26T07:18:03.788844+0000","last_active":"2023-11-26T07:18:04.778594+0000","last_peered":"2023-11-26T07:18:04.778594+0000","last_clean":"2023-11-26T07:18:04.778594+0000","last_became_active":"2023-11-26T07:18:03.786561+0000","last_became_peered":"2023-11-26T07:18:03.786561+0000","last_unstale":"2023-11-26T07:18:04.778594+0000","last_undegraded":"2023-11-26T07:18:04.778594+0000","last_fullsized":"2023-11-26T07:18:04.778594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938878+0000","last_change":"2023-11-26T07:18:03.791815+0000","last_active":"2023-11-26T07:18:04.938878+0000","last_peered":"2023-11-26T07:18:04.938878+0000","last_clean":"2023-11-26T07:18:04.938878+0000","last_became_active":"2023-11-26T07:18:03.790584+0000","last_became_peered":"2023-11-26T07:18:03.790584+0000","last_unstale":"2023-11-26T07:18:04.938878+0000","last_undegraded":"2023-11-26T07:18:04.938878+0000","last_fullsized":"2023-11-26T07:18:04.938878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978434+0000","last_change":"2023-11-26T07:18:03.792243+0000","last_active":"2023-11-26T07:18:04.978434+0000","last_peered":"2023-11-26T07:18:04.978434+0000","last_clean":"2023-11-26T07:18:04.978434+0000","last_became_active":"2023-11-26T07:18:03.791879+0000","last_became_peered":"2023-11-26T07:18:03.791879+0000","last_unstale":"2023-11-26T07:18:04.978434+0000","last_undegraded":"2023-11-26T07:18:04.978434+0000","last_fullsized":"2023-11-26T07:18:04.978434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777242+0000","last_change":"2023-11-26T07:18:03.795359+0000","last_active":"2023-11-26T07:18:04.777242+0000","last_peered":"2023-11-26T07:18:04.777242+0000","last_clean":"2023-11-26T07:18:04.777242+0000","last_became_active":"2023-11-26T07:18:03.795059+0000","last_became_peered":"2023-11-26T07:18:03.795059+0000","last_unstale":"2023-11-26T07:18:04.777242+0000","last_undegraded":"2023-11-26T07:18:04.777242+0000","last_fullsized":"2023-11-26T07:18:04.777242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977195+0000","last_change":"2023-11-26T07:18:03.788871+0000","last_active":"2023-11-26T07:18:04.977195+0000","last_peered":"2023-11-26T07:18:04.977195+0000","last_clean":"2023-11-26T07:18:04.977195+0000","last_became_active":"2023-11-26T07:18:03.788343+0000","last_became_peered":"2023-11-26T07:18:03.788343+0000","last_unstale":"2023-11-26T07:18:04.977195+0000","last_undegraded":"2023-11-26T07:18:04.977195+0000","last_fullsized":"2023-11-26T07:18:04.977195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777489+0000","last_change":"2023-11-26T07:18:03.782615+0000","last_active":"2023-11-26T07:18:04.777489+0000","last_peered":"2023-11-26T07:18:04.777489+0000","last_clean":"2023-11-26T07:18:04.777489+0000","last_became_active":"2023-11-26T07:18:03.782335+0000","last_became_peered":"2023-11-26T07:18:03.782335+0000","last_unstale":"2023-11-26T07:18:04.777489+0000","last_undegraded":"2023-11-26T07:18:04.777489+0000","last_fullsized":"2023-11-26T07:18:04.777489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:52:23.941794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778588+0000","last_change":"2023-11-26T07:18:03.122861+0000","last_active":"2023-11-26T07:18:04.778588+0000","last_peered":"2023-11-26T07:18:04.778588+0000","last_clean":"2023-11-26T07:18:04.778588+0000","last_became_active":"2023-11-26T07:18:03.122492+0000","last_became_peered":"2023-11-26T07:18:03.122492+0000","last_unstale":"2023-11-26T07:18:04.778588+0000","last_undegraded":"2023-11-26T07:18:04.778588+0000","last_fullsized":"2023-11-26T07:18:04.778588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938948+0000","last_change":"2023-11-26T07:18:03.798092+0000","last_active":"2023-11-26T07:18:04.938948+0000","last_peered":"2023-11-26T07:18:04.938948+0000","last_clean":"2023-11-26T07:18:04.938948+0000","last_became_active":"2023-11-26T07:18:03.797852+0000","last_became_peered":"2023-11-26T07:18:03.797852+0000","last_unstale":"2023-11-26T07:18:04.938948+0000","last_undegraded":"2023-11-26T07:18:04.938948+0000","last_fullsized":"2023-11-26T07:18:04.938948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977463+0000","last_change":"2023-11-26T07:18:03.119997+0000","last_active":"2023-11-26T07:18:04.977463+0000","last_peered":"2023-11-26T07:18:04.977463+0000","last_clean":"2023-11-26T07:18:04.977463+0000","last_became_active":"2023-11-26T07:18:03.118909+0000","last_became_peered":"2023-11-26T07:18:03.118909+0000","last_unstale":"2023-11-26T07:18:04.977463+0000","last_undegraded":"2023-11-26T07:18:04.977463+0000","last_fullsized":"2023-11-26T07:18:04.977463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:52.437449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778203+0000","last_change":"2023-11-26T07:18:03.122995+0000","last_active":"2023-11-26T07:18:04.778203+0000","last_peered":"2023-11-26T07:18:04.778203+0000","last_clean":"2023-11-26T07:18:04.778203+0000","last_became_active":"2023-11-26T07:18:03.122228+0000","last_became_peered":"2023-11-26T07:18:03.122228+0000","last_unstale":"2023-11-26T07:18:04.778203+0000","last_undegraded":"2023-11-26T07:18:04.778203+0000","last_fullsized":"2023-11-26T07:18:04.778203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777996+0000","last_change":"2023-11-26T07:18:03.782237+0000","last_active":"2023-11-26T07:18:04.777996+0000","last_peered":"2023-11-26T07:18:04.777996+0000","last_clean":"2023-11-26T07:18:04.777996+0000","last_became_active":"2023-11-26T07:18:03.782008+0000","last_became_peered":"2023-11-26T07:18:03.782008+0000","last_unstale":"2023-11-26T07:18:04.777996+0000","last_undegraded":"2023-11-26T07:18:04.777996+0000","last_fullsized":"2023-11-26T07:18:04.777996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977820+0000","last_change":"2023-11-26T07:18:03.131480+0000","last_active":"2023-11-26T07:18:04.977820+0000","last_peered":"2023-11-26T07:18:04.977820+0000","last_clean":"2023-11-26T07:18:04.977820+0000","last_became_active":"2023-11-26T07:18:03.131082+0000","last_became_peered":"2023-11-26T07:18:03.131082+0000","last_unstale":"2023-11-26T07:18:04.977820+0000","last_undegraded":"2023-11-26T07:18:04.977820+0000","last_fullsized":"2023-11-26T07:18:04.977820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965576+0000","last_change":"2023-11-26T07:18:03.796258+0000","last_active":"2023-11-26T07:18:04.965576+0000","last_peered":"2023-11-26T07:18:04.965576+0000","last_clean":"2023-11-26T07:18:04.965576+0000","last_became_active":"2023-11-26T07:18:03.795927+0000","last_became_peered":"2023-11-26T07:18:03.795927+0000","last_unstale":"2023-11-26T07:18:04.965576+0000","last_undegraded":"2023-11-26T07:18:04.965576+0000","last_fullsized":"2023-11-26T07:18:04.965576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978098+0000","last_change":"2023-11-26T07:18:03.129331+0000","last_active":"2023-11-26T07:18:04.978098+0000","last_peered":"2023-11-26T07:18:04.978098+0000","last_clean":"2023-11-26T07:18:04.978098+0000","last_became_active":"2023-11-26T07:18:03.129008+0000","last_became_peered":"2023-11-26T07:18:03.129008+0000","last_unstale":"2023-11-26T07:18:04.978098+0000","last_undegraded":"2023-11-26T07:18:04.978098+0000","last_fullsized":"2023-11-26T07:18:04.978098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978607+0000","last_change":"2023-11-26T07:18:03.805685+0000","last_active":"2023-11-26T07:18:04.978607+0000","last_peered":"2023-11-26T07:18:04.978607+0000","last_clean":"2023-11-26T07:18:04.978607+0000","last_became_active":"2023-11-26T07:18:03.805338+0000","last_became_peered":"2023-11-26T07:18:03.805338+0000","last_unstale":"2023-11-26T07:18:04.978607+0000","last_undegraded":"2023-11-26T07:18:04.978607+0000","last_fullsized":"2023-11-26T07:18:04.978607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978665+0000","last_change":"2023-11-26T07:18:03.126035+0000","last_active":"2023-11-26T07:18:04.978665+0000","last_peered":"2023-11-26T07:18:04.978665+0000","last_clean":"2023-11-26T07:18:04.978665+0000","last_became_active":"2023-11-26T07:18:03.125604+0000","last_became_peered":"2023-11-26T07:18:03.125604+0000","last_unstale":"2023-11-26T07:18:04.978665+0000","last_undegraded":"2023-11-26T07:18:04.978665+0000","last_fullsized":"2023-11-26T07:18:04.978665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938971+0000","last_change":"2023-11-26T07:18:03.804355+0000","last_active":"2023-11-26T07:18:04.938971+0000","last_peered":"2023-11-26T07:18:04.938971+0000","last_clean":"2023-11-26T07:18:04.938971+0000","last_became_active":"2023-11-26T07:18:03.804058+0000","last_became_peered":"2023-11-26T07:18:03.804058+0000","last_unstale":"2023-11-26T07:18:04.938971+0000","last_undegraded":"2023-11-26T07:18:04.938971+0000","last_fullsized":"2023-11-26T07:18:04.938971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965755+0000","last_change":"2023-11-26T07:18:03.126934+0000","last_active":"2023-11-26T07:18:04.965755+0000","last_peered":"2023-11-26T07:18:04.965755+0000","last_clean":"2023-11-26T07:18:04.965755+0000","last_became_active":"2023-11-26T07:18:03.126627+0000","last_became_peered":"2023-11-26T07:18:03.126627+0000","last_unstale":"2023-11-26T07:18:04.965755+0000","last_undegraded":"2023-11-26T07:18:04.965755+0000","last_fullsized":"2023-11-26T07:18:04.965755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777968+0000","last_change":"2023-11-26T07:18:03.800970+0000","last_active":"2023-11-26T07:18:04.777968+0000","last_peered":"2023-11-26T07:18:04.777968+0000","last_clean":"2023-11-26T07:18:04.777968+0000","last_became_active":"2023-11-26T07:18:03.800703+0000","last_became_peered":"2023-11-26T07:18:03.800703+0000","last_unstale":"2023-11-26T07:18:04.777968+0000","last_undegraded":"2023-11-26T07:18:04.777968+0000","last_fullsized":"2023-11-26T07:18:04.777968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977831+0000","last_change":"2023-11-26T07:18:03.121777+0000","last_active":"2023-11-26T07:18:04.977831+0000","last_peered":"2023-11-26T07:18:04.977831+0000","last_clean":"2023-11-26T07:18:04.977831+0000","last_became_active":"2023-11-26T07:18:03.121509+0000","last_became_peered":"2023-11-26T07:18:03.121509+0000","last_unstale":"2023-11-26T07:18:04.977831+0000","last_undegraded":"2023-11-26T07:18:04.977831+0000","last_fullsized":"2023-11-26T07:18:04.977831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977200+0000","last_change":"2023-11-26T07:18:03.802994+0000","last_active":"2023-11-26T07:18:04.977200+0000","last_peered":"2023-11-26T07:18:04.977200+0000","last_clean":"2023-11-26T07:18:04.977200+0000","last_became_active":"2023-11-26T07:18:03.801952+0000","last_became_peered":"2023-11-26T07:18:03.801952+0000","last_unstale":"2023-11-26T07:18:04.977200+0000","last_undegraded":"2023-11-26T07:18:04.977200+0000","last_fullsized":"2023-11-26T07:18:04.977200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.939000+0000","last_change":"2023-11-26T07:18:03.119803+0000","last_active":"2023-11-26T07:18:04.939000+0000","last_peered":"2023-11-26T07:18:04.939000+0000","last_clean":"2023-11-26T07:18:04.939000+0000","last_became_active":"2023-11-26T07:18:03.119500+0000","last_became_peered":"2023-11-26T07:18:03.119500+0000","last_unstale":"2023-11-26T07:18:04.939000+0000","last_undegraded":"2023-11-26T07:18:04.939000+0000","last_fullsized":"2023-11-26T07:18:04.939000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938639+0000","last_change":"2023-11-26T07:18:03.785862+0000","last_active":"2023-11-26T07:18:04.938639+0000","last_peered":"2023-11-26T07:18:04.938639+0000","last_clean":"2023-11-26T07:18:04.938639+0000","last_became_active":"2023-11-26T07:18:03.784616+0000","last_became_peered":"2023-11-26T07:18:03.784616+0000","last_unstale":"2023-11-26T07:18:04.938639+0000","last_undegraded":"2023-11-26T07:18:04.938639+0000","last_fullsized":"2023-11-26T07:18:04.938639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978559+0000","last_change":"2023-11-26T07:18:03.129914+0000","last_active":"2023-11-26T07:18:04.978559+0000","last_peered":"2023-11-26T07:18:04.978559+0000","last_clean":"2023-11-26T07:18:04.978559+0000","last_became_active":"2023-11-26T07:18:03.127006+0000","last_became_peered":"2023-11-26T07:18:03.127006+0000","last_unstale":"2023-11-26T07:18:04.978559+0000","last_undegraded":"2023-11-26T07:18:04.978559+0000","last_fullsized":"2023-11-26T07:18:04.978559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:54.492600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977454+0000","last_change":"2023-11-26T07:18:03.802395+0000","last_active":"2023-11-26T07:18:04.977454+0000","last_peered":"2023-11-26T07:18:04.977454+0000","last_clean":"2023-11-26T07:18:04.977454+0000","last_became_active":"2023-11-26T07:18:03.801740+0000","last_became_peered":"2023-11-26T07:18:03.801740+0000","last_unstale":"2023-11-26T07:18:04.977454+0000","last_undegraded":"2023-11-26T07:18:04.977454+0000","last_fullsized":"2023-11-26T07:18:04.977454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977360+0000","last_change":"2023-11-26T07:18:03.119783+0000","last_active":"2023-11-26T07:18:04.977360+0000","last_peered":"2023-11-26T07:18:04.977360+0000","last_clean":"2023-11-26T07:18:04.977360+0000","last_became_active":"2023-11-26T07:18:03.119326+0000","last_became_peered":"2023-11-26T07:18:03.119326+0000","last_unstale":"2023-11-26T07:18:04.977360+0000","last_undegraded":"2023-11-26T07:18:04.977360+0000","last_fullsized":"2023-11-26T07:18:04.977360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977326+0000","last_change":"2023-11-26T07:18:03.788692+0000","last_active":"2023-11-26T07:18:04.977326+0000","last_peered":"2023-11-26T07:18:04.977326+0000","last_clean":"2023-11-26T07:18:04.977326+0000","last_became_active":"2023-11-26T07:18:03.787971+0000","last_became_peered":"2023-11-26T07:18:03.787971+0000","last_unstale":"2023-11-26T07:18:04.977326+0000","last_undegraded":"2023-11-26T07:18:04.977326+0000","last_fullsized":"2023-11-26T07:18:04.977326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777168+0000","last_change":"2023-11-26T07:18:03.116346+0000","last_active":"2023-11-26T07:18:04.777168+0000","last_peered":"2023-11-26T07:18:04.777168+0000","last_clean":"2023-11-26T07:18:04.777168+0000","last_became_active":"2023-11-26T07:18:03.115334+0000","last_became_peered":"2023-11-26T07:18:03.115334+0000","last_unstale":"2023-11-26T07:18:04.777168+0000","last_undegraded":"2023-11-26T07:18:04.777168+0000","last_fullsized":"2023-11-26T07:18:04.777168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977145+0000","last_change":"2023-11-26T07:18:03.804750+0000","last_active":"2023-11-26T07:18:04.977145+0000","last_peered":"2023-11-26T07:18:04.977145+0000","last_clean":"2023-11-26T07:18:04.977145+0000","last_became_active":"2023-11-26T07:18:03.804469+0000","last_became_peered":"2023-11-26T07:18:03.804469+0000","last_unstale":"2023-11-26T07:18:04.977145+0000","last_undegraded":"2023-11-26T07:18:04.977145+0000","last_fullsized":"2023-11-26T07:18:04.977145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777925+0000","last_change":"2023-11-26T07:18:03.114861+0000","last_active":"2023-11-26T07:18:04.777925+0000","last_peered":"2023-11-26T07:18:04.777925+0000","last_clean":"2023-11-26T07:18:04.777925+0000","last_became_active":"2023-11-26T07:18:03.114411+0000","last_became_peered":"2023-11-26T07:18:03.114411+0000","last_unstale":"2023-11-26T07:18:04.777925+0000","last_undegraded":"2023-11-26T07:18:04.777925+0000","last_fullsized":"2023-11-26T07:18:04.777925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977491+0000","last_change":"2023-11-26T07:18:03.803915+0000","last_active":"2023-11-26T07:18:04.977491+0000","last_peered":"2023-11-26T07:18:04.977491+0000","last_clean":"2023-11-26T07:18:04.977491+0000","last_became_active":"2023-11-26T07:18:03.803548+0000","last_became_peered":"2023-11-26T07:18:03.803548+0000","last_unstale":"2023-11-26T07:18:04.977491+0000","last_undegraded":"2023-11-26T07:18:04.977491+0000","last_fullsized":"2023-11-26T07:18:04.977491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777516+0000","last_change":"2023-11-26T07:18:03.124858+0000","last_active":"2023-11-26T07:18:04.777516+0000","last_peered":"2023-11-26T07:18:04.777516+0000","last_clean":"2023-11-26T07:18:04.777516+0000","last_became_active":"2023-11-26T07:18:03.123588+0000","last_became_peered":"2023-11-26T07:18:03.123588+0000","last_unstale":"2023-11-26T07:18:04.777516+0000","last_undegraded":"2023-11-26T07:18:04.777516+0000","last_fullsized":"2023-11-26T07:18:04.777516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977979+0000","last_change":"2023-11-26T07:18:03.805118+0000","last_active":"2023-11-26T07:18:04.977979+0000","last_peered":"2023-11-26T07:18:04.977979+0000","last_clean":"2023-11-26T07:18:04.977979+0000","last_became_active":"2023-11-26T07:18:03.804832+0000","last_became_peered":"2023-11-26T07:18:03.804832+0000","last_unstale":"2023-11-26T07:18:04.977979+0000","last_undegraded":"2023-11-26T07:18:04.977979+0000","last_fullsized":"2023-11-26T07:18:04.977979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:53:49.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965859+0000","last_change":"2023-11-26T07:18:03.118704+0000","last_active":"2023-11-26T07:18:04.965859+0000","last_peered":"2023-11-26T07:18:04.965859+0000","last_clean":"2023-11-26T07:18:04.965859+0000","last_became_active":"2023-11-26T07:18:03.118402+0000","last_became_peered":"2023-11-26T07:18:03.118402+0000","last_unstale":"2023-11-26T07:18:04.965859+0000","last_undegraded":"2023-11-26T07:18:04.965859+0000","last_fullsized":"2023-11-26T07:18:04.965859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:50.691370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978517+0000","last_change":"2023-11-26T07:18:03.798976+0000","last_active":"2023-11-26T07:18:04.978517+0000","last_peered":"2023-11-26T07:18:04.978517+0000","last_clean":"2023-11-26T07:18:04.978517+0000","last_became_active":"2023-11-26T07:18:03.798378+0000","last_became_peered":"2023-11-26T07:18:03.798378+0000","last_unstale":"2023-11-26T07:18:04.978517+0000","last_undegraded":"2023-11-26T07:18:04.978517+0000","last_fullsized":"2023-11-26T07:18:04.978517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777254+0000","last_change":"2023-11-26T07:18:03.127701+0000","last_active":"2023-11-26T07:18:04.777254+0000","last_peered":"2023-11-26T07:18:04.777254+0000","last_clean":"2023-11-26T07:18:04.777254+0000","last_became_active":"2023-11-26T07:18:03.127297+0000","last_became_peered":"2023-11-26T07:18:03.127297+0000","last_unstale":"2023-11-26T07:18:04.777254+0000","last_undegraded":"2023-11-26T07:18:04.777254+0000","last_fullsized":"2023-11-26T07:18:04.777254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:07.033733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978097+0000","last_change":"2023-11-26T07:18:03.805806+0000","last_active":"2023-11-26T07:18:04.978097+0000","last_peered":"2023-11-26T07:18:04.978097+0000","last_clean":"2023-11-26T07:18:04.978097+0000","last_became_active":"2023-11-26T07:18:03.805531+0000","last_became_peered":"2023-11-26T07:18:03.805531+0000","last_unstale":"2023-11-26T07:18:04.978097+0000","last_undegraded":"2023-11-26T07:18:04.978097+0000","last_fullsized":"2023-11-26T07:18:04.978097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:20.912837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:18:03.786995+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:18:03.786995+0000","last_peered":"2023-11-26T07:18:03.786995+0000","last_clean":"2023-11-26T07:18:03.786995+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:18:03.786995+0000","last_undegraded":"2023-11-26T07:18:03.786995+0000","last_fullsized":"2023-11-26T07:18:03.786995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977910+0000","last_change":"2023-11-26T07:18:03.116264+0000","last_active":"2023-11-26T07:18:04.977910+0000","last_peered":"2023-11-26T07:18:04.977910+0000","last_clean":"2023-11-26T07:18:04.977910+0000","last_became_active":"2023-11-26T07:18:03.113528+0000","last_became_peered":"2023-11-26T07:18:03.113528+0000","last_unstale":"2023-11-26T07:18:04.977910+0000","last_undegraded":"2023-11-26T07:18:04.977910+0000","last_fullsized":"2023-11-26T07:18:04.977910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778371+0000","last_change":"2023-11-26T07:18:03.799200+0000","last_active":"2023-11-26T07:18:04.778371+0000","last_peered":"2023-11-26T07:18:04.778371+0000","last_clean":"2023-11-26T07:18:04.778371+0000","last_became_active":"2023-11-26T07:18:03.798900+0000","last_became_peered":"2023-11-26T07:18:03.798900+0000","last_unstale":"2023-11-26T07:18:04.778371+0000","last_undegraded":"2023-11-26T07:18:04.778371+0000","last_fullsized":"2023-11-26T07:18:04.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977542+0000","last_change":"2023-11-26T07:18:03.118573+0000","last_active":"2023-11-26T07:18:04.977542+0000","last_peered":"2023-11-26T07:18:04.977542+0000","last_clean":"2023-11-26T07:18:04.977542+0000","last_became_active":"2023-11-26T07:18:03.118279+0000","last_became_peered":"2023-11-26T07:18:03.118279+0000","last_unstale":"2023-11-26T07:18:04.977542+0000","last_undegraded":"2023-11-26T07:18:04.977542+0000","last_fullsized":"2023-11-26T07:18:04.977542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:32.911964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938502+0000","last_change":"2023-11-26T07:18:03.787057+0000","last_active":"2023-11-26T07:18:04.938502+0000","last_peered":"2023-11-26T07:18:04.938502+0000","last_clean":"2023-11-26T07:18:04.938502+0000","last_became_active":"2023-11-26T07:18:03.786791+0000","last_became_peered":"2023-11-26T07:18:03.786791+0000","last_unstale":"2023-11-26T07:18:04.938502+0000","last_undegraded":"2023-11-26T07:18:04.938502+0000","last_fullsized":"2023-11-26T07:18:04.938502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:47.452914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777253+0000","last_change":"2023-11-26T07:18:03.124374+0000","last_active":"2023-11-26T07:18:04.777253+0000","last_peered":"2023-11-26T07:18:04.777253+0000","last_clean":"2023-11-26T07:18:04.777253+0000","last_became_active":"2023-11-26T07:18:03.123071+0000","last_became_peered":"2023-11-26T07:18:03.123071+0000","last_unstale":"2023-11-26T07:18:04.777253+0000","last_undegraded":"2023-11-26T07:18:04.777253+0000","last_fullsized":"2023-11-26T07:18:04.777253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:02:12.811700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965635+0000","last_change":"2023-11-26T07:18:03.787012+0000","last_active":"2023-11-26T07:18:04.965635+0000","last_peered":"2023-11-26T07:18:04.965635+0000","last_clean":"2023-11-26T07:18:04.965635+0000","last_became_active":"2023-11-26T07:18:03.786759+0000","last_became_peered":"2023-11-26T07:18:03.786759+0000","last_unstale":"2023-11-26T07:18:04.965635+0000","last_undegraded":"2023-11-26T07:18:04.965635+0000","last_fullsized":"2023-11-26T07:18:04.965635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978667+0000","last_change":"2023-11-26T07:18:03.125780+0000","last_active":"2023-11-26T07:18:04.978667+0000","last_peered":"2023-11-26T07:18:04.978667+0000","last_clean":"2023-11-26T07:18:04.978667+0000","last_became_active":"2023-11-26T07:18:03.114090+0000","last_became_peered":"2023-11-26T07:18:03.114090+0000","last_unstale":"2023-11-26T07:18:04.978667+0000","last_undegraded":"2023-11-26T07:18:04.978667+0000","last_fullsized":"2023-11-26T07:18:04.978667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:31.621076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777652+0000","last_change":"2023-11-26T07:18:03.793309+0000","last_active":"2023-11-26T07:18:04.777652+0000","last_peered":"2023-11-26T07:18:04.777652+0000","last_clean":"2023-11-26T07:18:04.777652+0000","last_became_active":"2023-11-26T07:18:03.792978+0000","last_became_peered":"2023-11-26T07:18:03.792978+0000","last_unstale":"2023-11-26T07:18:04.777652+0000","last_undegraded":"2023-11-26T07:18:04.777652+0000","last_fullsized":"2023-11-26T07:18:04.777652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:53.444118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965659+0000","last_change":"2023-11-26T07:18:03.108277+0000","last_active":"2023-11-26T07:18:04.965659+0000","last_peered":"2023-11-26T07:18:04.965659+0000","last_clean":"2023-11-26T07:18:04.965659+0000","last_became_active":"2023-11-26T07:18:03.107849+0000","last_became_peered":"2023-11-26T07:18:03.107849+0000","last_unstale":"2023-11-26T07:18:04.965659+0000","last_undegraded":"2023-11-26T07:18:04.965659+0000","last_fullsized":"2023-11-26T07:18:04.965659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978391+0000","last_change":"2023-11-26T07:18:03.799853+0000","last_active":"2023-11-26T07:18:04.978391+0000","last_peered":"2023-11-26T07:18:04.978391+0000","last_clean":"2023-11-26T07:18:04.978391+0000","last_became_active":"2023-11-26T07:18:03.799496+0000","last_became_peered":"2023-11-26T07:18:03.799496+0000","last_unstale":"2023-11-26T07:18:04.978391+0000","last_undegraded":"2023-11-26T07:18:04.978391+0000","last_fullsized":"2023-11-26T07:18:04.978391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978123+0000","last_change":"2023-11-26T07:18:03.119202+0000","last_active":"2023-11-26T07:18:04.978123+0000","last_peered":"2023-11-26T07:18:04.978123+0000","last_clean":"2023-11-26T07:18:04.978123+0000","last_became_active":"2023-11-26T07:18:03.118804+0000","last_became_peered":"2023-11-26T07:18:03.118804+0000","last_unstale":"2023-11-26T07:18:04.978123+0000","last_undegraded":"2023-11-26T07:18:04.978123+0000","last_fullsized":"2023-11-26T07:18:04.978123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:26.724451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965884+0000","last_change":"2023-11-26T07:18:03.795950+0000","last_active":"2023-11-26T07:18:04.965884+0000","last_peered":"2023-11-26T07:18:04.965884+0000","last_clean":"2023-11-26T07:18:04.965884+0000","last_became_active":"2023-11-26T07:18:03.795701+0000","last_became_peered":"2023-11-26T07:18:03.795701+0000","last_unstale":"2023-11-26T07:18:04.965884+0000","last_undegraded":"2023-11-26T07:18:04.965884+0000","last_fullsized":"2023-11-26T07:18:04.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965886+0000","last_change":"2023-11-26T07:18:03.123835+0000","last_active":"2023-11-26T07:18:04.965886+0000","last_peered":"2023-11-26T07:18:04.965886+0000","last_clean":"2023-11-26T07:18:04.965886+0000","last_became_active":"2023-11-26T07:18:03.123563+0000","last_became_peered":"2023-11-26T07:18:03.123563+0000","last_unstale":"2023-11-26T07:18:04.965886+0000","last_undegraded":"2023-11-26T07:18:04.965886+0000","last_fullsized":"2023-11-26T07:18:04.965886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778740+0000","last_change":"2023-11-26T07:18:03.798789+0000","last_active":"2023-11-26T07:18:04.778740+0000","last_peered":"2023-11-26T07:18:04.778740+0000","last_clean":"2023-11-26T07:18:04.778740+0000","last_became_active":"2023-11-26T07:18:03.798536+0000","last_became_peered":"2023-11-26T07:18:03.798536+0000","last_unstale":"2023-11-26T07:18:04.778740+0000","last_undegraded":"2023-11-26T07:18:04.778740+0000","last_fullsized":"2023-11-26T07:18:04.778740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978222+0000","last_change":"2023-11-26T07:18:03.121938+0000","last_active":"2023-11-26T07:18:04.978222+0000","last_peered":"2023-11-26T07:18:04.978222+0000","last_clean":"2023-11-26T07:18:04.978222+0000","last_became_active":"2023-11-26T07:18:03.120860+0000","last_became_peered":"2023-11-26T07:18:03.120860+0000","last_unstale":"2023-11-26T07:18:04.978222+0000","last_undegraded":"2023-11-26T07:18:04.978222+0000","last_fullsized":"2023-11-26T07:18:04.978222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938909+0000","last_change":"2023-11-26T07:18:03.784898+0000","last_active":"2023-11-26T07:18:04.938909+0000","last_peered":"2023-11-26T07:18:04.938909+0000","last_clean":"2023-11-26T07:18:04.938909+0000","last_became_active":"2023-11-26T07:18:03.784582+0000","last_became_peered":"2023-11-26T07:18:03.784582+0000","last_unstale":"2023-11-26T07:18:04.938909+0000","last_undegraded":"2023-11-26T07:18:04.938909+0000","last_fullsized":"2023-11-26T07:18:04.938909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977094+0000","last_change":"2023-11-26T07:18:03.116934+0000","last_active":"2023-11-26T07:18:04.977094+0000","last_peered":"2023-11-26T07:18:04.977094+0000","last_clean":"2023-11-26T07:18:04.977094+0000","last_became_active":"2023-11-26T07:18:03.116587+0000","last_became_peered":"2023-11-26T07:18:03.116587+0000","last_unstale":"2023-11-26T07:18:04.977094+0000","last_undegraded":"2023-11-26T07:18:04.977094+0000","last_fullsized":"2023-11-26T07:18:04.977094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777610+0000","last_change":"2023-11-26T07:18:03.779690+0000","last_active":"2023-11-26T07:18:04.777610+0000","last_peered":"2023-11-26T07:18:04.777610+0000","last_clean":"2023-11-26T07:18:04.777610+0000","last_became_active":"2023-11-26T07:18:03.778339+0000","last_became_peered":"2023-11-26T07:18:03.778339+0000","last_unstale":"2023-11-26T07:18:04.777610+0000","last_undegraded":"2023-11-26T07:18:04.777610+0000","last_fullsized":"2023-11-26T07:18:04.777610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:41.605885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965725+0000","last_change":"2023-11-26T07:18:03.119668+0000","last_active":"2023-11-26T07:18:04.965725+0000","last_peered":"2023-11-26T07:18:04.965725+0000","last_clean":"2023-11-26T07:18:04.965725+0000","last_became_active":"2023-11-26T07:18:03.119332+0000","last_became_peered":"2023-11-26T07:18:03.119332+0000","last_unstale":"2023-11-26T07:18:04.965725+0000","last_undegraded":"2023-11-26T07:18:04.965725+0000","last_fullsized":"2023-11-26T07:18:04.965725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778026+0000","last_change":"2023-11-26T07:18:03.782878+0000","last_active":"2023-11-26T07:18:04.778026+0000","last_peered":"2023-11-26T07:18:04.778026+0000","last_clean":"2023-11-26T07:18:04.778026+0000","last_became_active":"2023-11-26T07:18:03.782504+0000","last_became_peered":"2023-11-26T07:18:03.782504+0000","last_unstale":"2023-11-26T07:18:04.778026+0000","last_undegraded":"2023-11-26T07:18:04.778026+0000","last_fullsized":"2023-11-26T07:18:04.778026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965870+0000","last_change":"2023-11-26T07:18:03.121787+0000","last_active":"2023-11-26T07:18:04.965870+0000","last_peered":"2023-11-26T07:18:04.965870+0000","last_clean":"2023-11-26T07:18:04.965870+0000","last_became_active":"2023-11-26T07:18:03.121345+0000","last_became_peered":"2023-11-26T07:18:03.121345+0000","last_unstale":"2023-11-26T07:18:04.965870+0000","last_undegraded":"2023-11-26T07:18:04.965870+0000","last_fullsized":"2023-11-26T07:18:04.965870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778470+0000","last_change":"2023-11-26T07:18:03.793669+0000","last_active":"2023-11-26T07:18:04.778470+0000","last_peered":"2023-11-26T07:18:04.778470+0000","last_clean":"2023-11-26T07:18:04.778470+0000","last_became_active":"2023-11-26T07:18:03.793355+0000","last_became_peered":"2023-11-26T07:18:03.793355+0000","last_unstale":"2023-11-26T07:18:04.778470+0000","last_undegraded":"2023-11-26T07:18:04.778470+0000","last_fullsized":"2023-11-26T07:18:04.778470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.124539+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.124258+0000","last_became_peered":"2023-11-26T07:18:03.124258+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.784788+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.784298+0000","last_became_peered":"2023-11-26T07:18:03.784298+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978292+0000","last_change":"2023-11-26T07:18:03.799951+0000","last_active":"2023-11-26T07:18:04.978292+0000","last_peered":"2023-11-26T07:18:04.978292+0000","last_clean":"2023-11-26T07:18:04.978292+0000","last_became_active":"2023-11-26T07:18:03.799683+0000","last_became_peered":"2023-11-26T07:18:03.799683+0000","last_unstale":"2023-11-26T07:18:04.978292+0000","last_undegraded":"2023-11-26T07:18:04.978292+0000","last_fullsized":"2023-11-26T07:18:04.978292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977125+0000","last_change":"2023-11-26T07:18:03.127894+0000","last_active":"2023-11-26T07:18:04.977125+0000","last_peered":"2023-11-26T07:18:04.977125+0000","last_clean":"2023-11-26T07:18:04.977125+0000","last_became_active":"2023-11-26T07:18:03.127553+0000","last_became_peered":"2023-11-26T07:18:03.127553+0000","last_unstale":"2023-11-26T07:18:04.977125+0000","last_undegraded":"2023-11-26T07:18:04.977125+0000","last_fullsized":"2023-11-26T07:18:04.977125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978401+0000","last_change":"2023-11-26T07:18:03.798787+0000","last_active":"2023-11-26T07:18:04.978401+0000","last_peered":"2023-11-26T07:18:04.978401+0000","last_clean":"2023-11-26T07:18:04.978401+0000","last_became_active":"2023-11-26T07:18:03.797918+0000","last_became_peered":"2023-11-26T07:18:03.797918+0000","last_unstale":"2023-11-26T07:18:04.978401+0000","last_undegraded":"2023-11-26T07:18:04.978401+0000","last_fullsized":"2023-11-26T07:18:04.978401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977895+0000","last_change":"2023-11-26T07:18:03.128111+0000","last_active":"2023-11-26T07:18:04.977895+0000","last_peered":"2023-11-26T07:18:04.977895+0000","last_clean":"2023-11-26T07:18:04.977895+0000","last_became_active":"2023-11-26T07:18:03.127727+0000","last_became_peered":"2023-11-26T07:18:03.127727+0000","last_unstale":"2023-11-26T07:18:04.977895+0000","last_undegraded":"2023-11-26T07:18:04.977895+0000","last_fullsized":"2023-11-26T07:18:04.977895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938927+0000","last_change":"2023-11-26T07:18:03.804397+0000","last_active":"2023-11-26T07:18:04.938927+0000","last_peered":"2023-11-26T07:18:04.938927+0000","last_clean":"2023-11-26T07:18:04.938927+0000","last_became_active":"2023-11-26T07:18:03.804157+0000","last_became_peered":"2023-11-26T07:18:03.804157+0000","last_unstale":"2023-11-26T07:18:04.938927+0000","last_undegraded":"2023-11-26T07:18:04.938927+0000","last_fullsized":"2023-11-26T07:18:04.938927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778691+0000","last_change":"2023-11-26T07:18:03.120821+0000","last_active":"2023-11-26T07:18:04.778691+0000","last_peered":"2023-11-26T07:18:04.778691+0000","last_clean":"2023-11-26T07:18:04.778691+0000","last_became_active":"2023-11-26T07:18:03.120551+0000","last_became_peered":"2023-11-26T07:18:03.120551+0000","last_unstale":"2023-11-26T07:18:04.778691+0000","last_undegraded":"2023-11-26T07:18:04.778691+0000","last_fullsized":"2023-11-26T07:18:04.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778654+0000","last_change":"2023-11-26T07:18:03.783374+0000","last_active":"2023-11-26T07:18:04.778654+0000","last_peered":"2023-11-26T07:18:04.778654+0000","last_clean":"2023-11-26T07:18:04.778654+0000","last_became_active":"2023-11-26T07:18:03.782911+0000","last_became_peered":"2023-11-26T07:18:03.782911+0000","last_unstale":"2023-11-26T07:18:04.778654+0000","last_undegraded":"2023-11-26T07:18:04.778654+0000","last_fullsized":"2023-11-26T07:18:04.778654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938985+0000","last_change":"2023-11-26T07:18:03.120489+0000","last_active":"2023-11-26T07:18:04.938985+0000","last_peered":"2023-11-26T07:18:04.938985+0000","last_clean":"2023-11-26T07:18:04.938985+0000","last_became_active":"2023-11-26T07:18:03.120191+0000","last_became_peered":"2023-11-26T07:18:03.120191+0000","last_unstale":"2023-11-26T07:18:04.938985+0000","last_undegraded":"2023-11-26T07:18:04.938985+0000","last_fullsized":"2023-11-26T07:18:04.938985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8019999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5640000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.573}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.7789999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.6879999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.516}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6390000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:08.546 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:18:08.546 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-26T07:18:08.547 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-26T07:18:08.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-26T07:18:08.548 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-26T07:18:08.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.719+0000 7f563c794640 1 Processor -- start 2023-11-26T07:18:08.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.719+0000 7f563c794640 1 -- start start 2023-11-26T07:18:08.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563c794640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f563406f000 0x7f563406d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563c794640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340cf260 con 0x7f5634099a70 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563c794640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563406c3c0 con 0x7f563406f3e0 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563c794640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563406d570 con 0x7f563406f000 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563ad31640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5634099a70 0x7f563406bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34286/0 (socket says 172.21.15.70:34286) 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563ad31640 1 -- 172.21.15.70:0/1871046050 learned_addr learned my addr 172.21.15.70:0/1871046050 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563a530640 1 --2- 172.21.15.70:0/1871046050 >> v2:172.21.15.120:3300/0 conn(0x7f563406f000 0x7f563406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563952e640 1 -- 172.21.15.70:0/1871046050 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682110640 0 0) 0x7f56340cf260 con 0x7f5634099a70 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563952e640 1 -- 172.21.15.70:0/1871046050 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5620003530 con 0x7f5634099a70 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563952e640 1 -- 172.21.15.70:0/1871046050 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055683198 0 0) 0x7f563406c3c0 con 0x7f563406f3e0 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563952e640 1 -- 172.21.15.70:0/1871046050 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56340cf260 con 0x7f563406f3e0 2023-11-26T07:18:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563a530640 1 -- 172.21.15.70:0/1871046050 >> v1:172.21.15.120:6789/0 conn(0x7f563406f3e0 legacy=0x7f563406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563a530640 1 -- 172.21.15.70:0/1871046050 >> v1:172.21.15.70:6789/0 conn(0x7f5634099a70 legacy=0x7f563406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.723+0000 7f563a530640 1 -- 172.21.15.70:0/1871046050 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563409a010 con 0x7f563406f000 2023-11-26T07:18:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563a530640 1 --2- 172.21.15.70:0/1871046050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f563406d030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56300097c0 tx=0x7f563001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6214b97474e5a461 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563952e640 1 -- 172.21.15.70:0/1871046050 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300a8970 con 0x7f563406f000 2023-11-26T07:18:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563952e640 1 -- 172.21.15.70:0/1871046050 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56300a8ad0 con 0x7f563406f000 2023-11-26T07:18:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563952e640 1 -- 172.21.15.70:0/1871046050 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300a8e60 con 0x7f563406f000 2023-11-26T07:18:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 -- 172.21.15.70:0/1871046050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 msgr2=0x7f563406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 --2- 172.21.15.70:0/1871046050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f563406d030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56300097c0 tx=0x7f563001ec70 comp rx=0 tx=0).stop 2023-11-26T07:18:08.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 -- 172.21.15.70:0/1871046050 shutdown_connections 2023-11-26T07:18:08.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 --2- 172.21.15.70:0/1871046050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f563406d030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 -- 172.21.15.70:0/1871046050 >> 172.21.15.70:0/1871046050 conn(0x7f56340b2d10 msgr2=0x7f56340b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 -- 172.21.15.70:0/1871046050 shutdown_connections 2023-11-26T07:18:08.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 -- 172.21.15.70:0/1871046050 wait complete. 2023-11-26T07:18:08.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 Processor -- start 2023-11-26T07:18:08.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.727+0000 7f563c794640 1 -- start start 2023-11-26T07:18:08.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f5634156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563406f3e0 0x7f56340c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5634099a70 0x7f56341600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340ca280 con 0x7f563406f3e0 2023-11-26T07:18:08.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5634156bd0 con 0x7f563406f000 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56340c9670 con 0x7f5634099a70 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563406f3e0 0x7f56340c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563406f3e0 0x7f56340c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59898/0 (socket says 172.21.15.70:59898) 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 -- 172.21.15.70:0/1924018715 learned_addr learned my addr 172.21.15.70:0/1924018715 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563a530640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f5634156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563ad31640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5634099a70 0x7f56341600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 -- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5634099a70 msgr2=0x7f56341600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5634099a70 0x7f56341600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 -- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 msgr2=0x7f5634156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f5634156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 -- 172.21.15.70:0/1924018715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630009420 con 0x7f563406f3e0 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563a530640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f5634156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f5639d2f640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563406f3e0 0x7f56340c8d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f562400c490 tx=0x7f562400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f562affd640 1 -- 172.21.15.70:0/1924018715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240052d0 con 0x7f563406f3e0 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f562affd640 1 -- 172.21.15.70:0/1924018715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624005430 con 0x7f563406f3e0 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56340c9950 con 0x7f563406f3e0 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f562affd640 1 -- 172.21.15.70:0/1924018715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624012870 con 0x7f563406f3e0 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56340c9f10 con 0x7f563406f3e0 2023-11-26T07:18:08.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340ca430 con 0x7f563406f3e0 2023-11-26T07:18:08.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.731+0000 7f562affd640 1 -- 172.21.15.70:0/1924018715 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56240129d0 con 0x7f563406f3e0 2023-11-26T07:18:08.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.735+0000 7f562affd640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5618066470 0x7f5618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:08.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.735+0000 7f562affd640 1 -- 172.21.15.70:0/1924018715 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5624083ac0 con 0x7f563406f3e0 2023-11-26T07:18:08.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.735+0000 7f563a530640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5618066470 0x7f5618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:08.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.735+0000 7f563a530640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5618066470 0x7f5618068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56300b2000 tx=0x7f5630008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:08.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.739+0000 7f562affd640 1 -- 172.21.15.70:0/1924018715 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56340ca430 con 0x7f563406f3e0 2023-11-26T07:18:08.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.923+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5634067680 con 0x7f563406f3e0 2023-11-26T07:18:08.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.927+0000 7f562affd640 1 -- 172.21.15.70:0/1924018715 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164432 (secure 0 0 0) 0x7f5624050e20 con 0x7f563406f3e0 2023-11-26T07:18:08.931 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:08.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5618066470 msgr2=0x7f5618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5618066470 0x7f5618068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56300b2000 tx=0x7f5630008040 comp rx=0 tx=0).stop 2023-11-26T07:18:08.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563406f3e0 msgr2=0x7f56340c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563406f3e0 0x7f56340c8d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f562400c490 tx=0x7f562400c950 comp rx=0 tx=0).stop 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 shutdown_connections 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5618066470 0x7f5618068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f563406f3e0 0x7f56340c8d00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5634099a70 0x7f56341600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 --2- 172.21.15.70:0/1924018715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f563406f000 0x7f5634156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 >> 172.21.15.70:0/1924018715 conn(0x7f56340b2d10 msgr2=0x7f56340b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 shutdown_connections 2023-11-26T07:18:08.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:08.931+0000 7f563c794640 1 -- 172.21.15.70:0/1924018715 wait complete. 2023-11-26T07:18:08.950 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2418872727},{"type":"v1","addr":"172.21.15.70:6833","nonce":2418872727}]},"active_addr":"172.21.15.70:6833/2418872727","active_change":"2023-11-26T07:17:43.976572+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":4132013962}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3174520841}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1705554656}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3544244442}]}]} 2023-11-26T07:18:08.954 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-26T07:18:08.954 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-26T07:18:08.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:09.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08dae68640 1 Processor -- start 2023-11-26T07:18:09.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08dae68640 1 -- start start 2023-11-26T07:18:09.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08dae68640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f08d40d1bc0 0x7f08d40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08dae68640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d40cf0e0 con 0x7f08d415d6e0 2023-11-26T07:18:09.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08dae68640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d40ceb20 con 0x7f08d40b2160 2023-11-26T07:18:09.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08dae68640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d415dac0 con 0x7f08d40d1bc0 2023-11-26T07:18:09.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08cbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f08d40d1bc0 0x7f08d40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08cbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f08d40d1bc0 0x7f08d40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59908/0 (socket says 172.21.15.70:59908) 2023-11-26T07:18:09.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08cbfff640 1 -- 172.21.15.70:0/1005949803 learned_addr learned my addr 172.21.15.70:0/1005949803 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08cbfff640 1 -- 172.21.15.70:0/1005949803 >> v1:172.21.15.120:6789/0 conn(0x7f08d40b2160 legacy=0x7f08d40b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08cbfff640 1 -- 172.21.15.70:0/1005949803 >> v1:172.21.15.70:6789/0 conn(0x7f08d415d6e0 legacy=0x7f08d40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.091+0000 7f08cbfff640 1 -- 172.21.15.70:0/1005949803 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40cee00 con 0x7f08d40d1bc0 2023-11-26T07:18:09.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08cbfff640 1 --2- 172.21.15.70:0/1005949803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d40d1bc0 0x7f08d40d0df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009870 tx=0x7f08c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9084df95c8296d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08cb7fe640 1 -- 172.21.15.70:0/1005949803 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40ab5f0 con 0x7f08d40d1bc0 2023-11-26T07:18:09.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08cb7fe640 1 -- 172.21.15.70:0/1005949803 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c40ab750 con 0x7f08d40d1bc0 2023-11-26T07:18:09.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08cb7fe640 1 -- 172.21.15.70:0/1005949803 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40abae0 con 0x7f08d40d1bc0 2023-11-26T07:18:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08dae68640 1 -- 172.21.15.70:0/1005949803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d40d1bc0 msgr2=0x7f08d40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08dae68640 1 --2- 172.21.15.70:0/1005949803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d40d1bc0 0x7f08d40d0df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009870 tx=0x7f08c401c500 comp rx=0 tx=0).stop 2023-11-26T07:18:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08dae68640 1 -- 172.21.15.70:0/1005949803 shutdown_connections 2023-11-26T07:18:09.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08dae68640 1 --2- 172.21.15.70:0/1005949803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d40d1bc0 0x7f08d40d0df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08dae68640 1 -- 172.21.15.70:0/1005949803 >> 172.21.15.70:0/1005949803 conn(0x7f08d409c550 msgr2=0x7f08d40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08dae68640 1 -- 172.21.15.70:0/1005949803 shutdown_connections 2023-11-26T07:18:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.095+0000 7f08dae68640 1 -- 172.21.15.70:0/1005949803 wait complete. 2023-11-26T07:18:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 Processor -- start 2023-11-26T07:18:09.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 -- start start 2023-11-26T07:18:09.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08d40b2160 0x7f08d4160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f08d40d1bc0 0x7f08d4143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d415d6e0 0x7f08d4144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4152550 con 0x7f08d415d6e0 2023-11-26T07:18:09.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4157440 con 0x7f08d40b2160 2023-11-26T07:18:09.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d4157720 con 0x7f08d40d1bc0 2023-11-26T07:18:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d415d6e0 0x7f08d4144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d415d6e0 0x7f08d4144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59920/0 (socket says 172.21.15.70:59920) 2023-11-26T07:18:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 -- 172.21.15.70:0/1495049475 learned_addr learned my addr 172.21.15.70:0/1495049475 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d8c04640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08d40b2160 0x7f08d4160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 -- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f08d40d1bc0 msgr2=0x7f08d4143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08cbfff640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f08d40d1bc0 0x7f08d4143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f08d40d1bc0 0x7f08d4143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 -- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08d40b2160 msgr2=0x7f08d4160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08d40b2160 0x7f08d4160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 -- 172.21.15.70:0/1495049475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40094d0 con 0x7f08d415d6e0 2023-11-26T07:18:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08cbfff640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f08d40d1bc0 0x7f08d4143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:09.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08d9405640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d415d6e0 0x7f08d4144480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00c780 tx=0x7f08cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08c97fa640 1 -- 172.21.15.70:0/1495049475 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00a9f0 con 0x7f08d415d6e0 2023-11-26T07:18:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08c97fa640 1 -- 172.21.15.70:0/1495049475 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00ce90 con 0x7f08d415d6e0 2023-11-26T07:18:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08c97fa640 1 -- 172.21.15.70:0/1495049475 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00add0 con 0x7f08d415d6e0 2023-11-26T07:18:09.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d4157a00 con 0x7f08d415d6e0 2023-11-26T07:18:09.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.099+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d4154d80 con 0x7f08d415d6e0 2023-11-26T07:18:09.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.103+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d4067680 con 0x7f08d415d6e0 2023-11-26T07:18:09.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.103+0000 7f08c97fa640 1 -- 172.21.15.70:0/1495049475 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08cc012420 con 0x7f08d415d6e0 2023-11-26T07:18:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.103+0000 7f08c97fa640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f08c00664a0 0x7f08c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.103+0000 7f08c97fa640 1 -- 172.21.15.70:0/1495049475 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08cc083d80 con 0x7f08d415d6e0 2023-11-26T07:18:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.103+0000 7f08d8c04640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f08c00664a0 0x7f08c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.103+0000 7f08d8c04640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f08c00664a0 0x7f08c0068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000f70 tx=0x7f08d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.107+0000 7f08c97fa640 1 -- 172.21.15.70:0/1495049475 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08cc051160 con 0x7f08d415d6e0 2023-11-26T07:18:09.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08d40d0540 con 0x7f08d415d6e0 2023-11-26T07:18:09.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08c97fa640 1 -- 172.21.15.70:0/1495049475 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f08cc016090 con 0x7f08d415d6e0 2023-11-26T07:18:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:09.261 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f08c00664a0 msgr2=0x7f08c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f08c00664a0 0x7f08c0068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000f70 tx=0x7f08d0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d415d6e0 msgr2=0x7f08d4144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d415d6e0 0x7f08d4144480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00c780 tx=0x7f08cc00cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 shutdown_connections 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f08c00664a0 0x7f08c0068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08d415d6e0 0x7f08d4144480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f08d40d1bc0 0x7f08d4143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 --2- 172.21.15.70:0/1495049475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f08d40b2160 0x7f08d4160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.259+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 >> 172.21.15.70:0/1495049475 conn(0x7f08d409c550 msgr2=0x7f08d40b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.263+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 shutdown_connections 2023-11-26T07:18:09.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.263+0000 7f08dae68640 1 -- 172.21.15.70:0/1495049475 wait complete. 2023-11-26T07:18:09.282 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-26T07:18:09.282 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:09.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc8a1c17640 1 Processor -- start 2023-11-26T07:18:09.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc8a1c17640 1 -- start start 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc8a1c17640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c0d1bc0 0x7fc89c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc8a1c17640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc89c0b2160 0x7fc89c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc8a1c17640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89c0cf0e0 con 0x7fc89c15d6e0 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc8a1c17640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c15dac0 con 0x7fc89c0b2160 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc8a1c17640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c0ceb20 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc893fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c0d1bc0 0x7fc89c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc89bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc89c0b2160 0x7fc89c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc89b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc89c15d6e0 0x7fc89c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40924/0 (socket says 172.21.15.70:40924) 2023-11-26T07:18:09.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc89b7fe640 1 -- 172.21.15.70:0/3127238389 learned_addr learned my addr 172.21.15.70:0/3127238389 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:09.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc89bfff640 1 -- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c0d1bc0 msgr2=0x7fc89c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc89bfff640 1 --2- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c0d1bc0 0x7fc89c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc89bfff640 1 -- 172.21.15.70:0/3127238389 >> v1:172.21.15.120:6789/0 conn(0x7fc89c15d6e0 legacy=0x7fc89c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc89bfff640 1 -- 172.21.15.70:0/3127238389 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0cee00 con 0x7fc89c0b2160 2023-11-26T07:18:09.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.419+0000 7fc893fff640 1 --2- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c0d1bc0 0x7fc89c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:09.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc89bfff640 1 --2- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 0x7fc89c0b0750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc894009d90 tx=0x7fc89401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50ded57c67a9c50a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc89affd640 1 -- 172.21.15.70:0/3127238389 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8940a5900 con 0x7fc89c0b2160 2023-11-26T07:18:09.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc89affd640 1 -- 172.21.15.70:0/3127238389 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8940a5a60 con 0x7fc89c0b2160 2023-11-26T07:18:09.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc89affd640 1 -- 172.21.15.70:0/3127238389 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8940a5df0 con 0x7fc89c0b2160 2023-11-26T07:18:09.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 -- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 msgr2=0x7fc89c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 0x7fc89c0b0750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc894009d90 tx=0x7fc89401c950 comp rx=0 tx=0).stop 2023-11-26T07:18:09.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 -- 172.21.15.70:0/3127238389 shutdown_connections 2023-11-26T07:18:09.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 0x7fc89c0b0750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/3127238389 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c0d1bc0 0x7fc89c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 -- 172.21.15.70:0/3127238389 >> 172.21.15.70:0/3127238389 conn(0x7fc89c09c550 msgr2=0x7fc89c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 -- 172.21.15.70:0/3127238389 shutdown_connections 2023-11-26T07:18:09.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.423+0000 7fc8a1c17640 1 -- 172.21.15.70:0/3127238389 wait complete. 2023-11-26T07:18:09.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 Processor -- start 2023-11-26T07:18:09.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 -- start start 2023-11-26T07:18:09.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 0x7fc89c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0d1bc0 0x7fc89c0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c15d6e0 0x7fc89c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c154250 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c160600 con 0x7fc89c0b2160 2023-11-26T07:18:09.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c1608e0 con 0x7fc89c15d6e0 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0d1bc0 0x7fc89c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0d1bc0 0x7fc89c0ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59930/0 (socket says 172.21.15.70:59930) 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 -- 172.21.15.70:0/1981154904 learned_addr learned my addr 172.21.15.70:0/1981154904 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc89bfff640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c15d6e0 0x7fc89c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc89b7fe640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 0x7fc89c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 -- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c15d6e0 msgr2=0x7fc89c15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c15d6e0 0x7fc89c15fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 -- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 msgr2=0x7fc89c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 0x7fc89c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 -- 172.21.15.70:0/1981154904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc884009420 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc893fff640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0d1bc0 0x7fc89c0ca2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc88400ebe0 tx=0x7fc88400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc898ff9640 1 -- 172.21.15.70:0/1981154904 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400eee0 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc898ff9640 1 -- 172.21.15.70:0/1981154904 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88400cc30 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc894009a70 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc898ff9640 1 -- 172.21.15.70:0/1981154904 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884013470 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.427+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c154710 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.431+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c067680 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.431+0000 7fc898ff9640 1 -- 172.21.15.70:0/1981154904 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8840135d0 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.431+0000 7fc898ff9640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc87c066470 0x7fc87c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.431+0000 7fc898ff9640 1 -- 172.21.15.70:0/1981154904 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc884084130 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.431+0000 7fc89b7fe640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc87c066470 0x7fc87c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.431+0000 7fc89b7fe640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc87c066470 0x7fc87c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc88c005890 tx=0x7fc88c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.435+0000 7fc898ff9640 1 -- 172.21.15.70:0/1981154904 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8840515a0 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.583+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc89c160aa0 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc898ff9640 1 -- 172.21.15.70:0/1981154904 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fc884054bc0 con 0x7fc89c0d1bc0 2023-11-26T07:18:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:09.588 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:09.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc87c066470 msgr2=0x7fc87c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc87c066470 0x7fc87c068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc88c005890 tx=0x7fc88c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0d1bc0 msgr2=0x7fc89c0ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0d1bc0 0x7fc89c0ca2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc88400ebe0 tx=0x7fc88400c520 comp rx=0 tx=0).stop 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 shutdown_connections 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc87c066470 0x7fc87c068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0d1bc0 0x7fc89c0ca2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc89c15d6e0 0x7fc89c15fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 --2- 172.21.15.70:0/1981154904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc89c0b2160 0x7fc89c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 >> 172.21.15.70:0/1981154904 conn(0x7fc89c09c550 msgr2=0x7fc89c159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 shutdown_connections 2023-11-26T07:18:09.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.587+0000 7fc8a1c17640 1 -- 172.21.15.70:0/1981154904 wait complete. 2023-11-26T07:18:09.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-26T07:18:09.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-26T07:18:09.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-26T07:18:09.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-26T07:18:09.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-26T07:18:09.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-26T07:18:09.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-26T07:18:09.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-26T07:18:09.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.847+0000 7fe66fa79640 1 Processor -- start 2023-11-26T07:18:09.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.847+0000 7fe66fa79640 1 -- start start 2023-11-26T07:18:09.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66fa79640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe6680b1710 0x7fe66806d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66fa79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe668070370 0x7fe6680707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66d014640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe6680ce310 0x7fe6681590e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34312/0 (socket says 172.21.15.70:34312) 2023-11-26T07:18:09.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66d014640 1 -- 172.21.15.70:0/505459142 learned_addr learned my addr 172.21.15.70:0/505459142 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:09.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66806cf30 con 0x7fe6680ce310 2023-11-26T07:18:09.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66d815640 1 --2- 172.21.15.70:0/505459142 >> v2:172.21.15.70:3300/0 conn(0x7fe6680b1710 0x7fe66806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680cb0e0 con 0x7fe6680b1710 2023-11-26T07:18:09.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680cb2f0 con 0x7fe668070370 2023-11-26T07:18:09.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66e016640 1 --2- 172.21.15.70:0/505459142 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe668070370 0x7fe6680707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66e016640 1 -- 172.21.15.70:0/505459142 >> v2:172.21.15.70:3300/0 conn(0x7fe6680b1710 msgr2=0x7fe66806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66e016640 1 --2- 172.21.15.70:0/505459142 >> v2:172.21.15.70:3300/0 conn(0x7fe6680b1710 0x7fe66806d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66e016640 1 -- 172.21.15.70:0/505459142 >> v1:172.21.15.70:6789/0 conn(0x7fe6680ce310 legacy=0x7fe6681590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.851+0000 7fe66e016640 1 -- 172.21.15.70:0/505459142 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680cb5d0 con 0x7fe668070370 2023-11-26T07:18:09.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f3b54854640 1 Processor -- start 2023-11-26T07:18:09.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f3b54854640 1 -- start start 2023-11-26T07:18:09.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f3b54854640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f56910fe640 1 Processor -- start 2023-11-26T07:18:09.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f3b54854640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3b500d36a0 0x7f3b500b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f3b54854640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b500d2040 con 0x7f3b500d18a0 2023-11-26T07:18:09.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f3b54854640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500b3460 con 0x7f3b500d36a0 2023-11-26T07:18:09.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f3b54854640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500b3740 con 0x7f3b5015d4a0 2023-11-26T07:18:09.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.855+0000 7f56910fe640 1 -- start start 2023-11-26T07:18:09.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4f59e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3b500d36a0 0x7f3b500b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4e59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4e59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53862/0 (socket says 172.21.15.70:53862) 2023-11-26T07:18:09.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4e59c640 1 -- 172.21.15.70:0/1082257067 learned_addr learned my addr 172.21.15.70:0/1082257067 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4e59c640 1 -- 172.21.15.70:0/1082257067 >> v2:172.21.15.70:3300/0 conn(0x7f3b500d36a0 msgr2=0x7f3b500b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4e59c640 1 --2- 172.21.15.70:0/1082257067 >> v2:172.21.15.70:3300/0 conn(0x7f3b500d36a0 0x7f3b500b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4e59c640 1 -- 172.21.15.70:0/1082257067 >> v1:172.21.15.70:6789/0 conn(0x7f3b500d18a0 legacy=0x7f3b500d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f3b4e59c640 1 -- 172.21.15.70:0/1082257067 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500b3a20 con 0x7f3b5015d4a0 2023-11-26T07:18:09.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66e016640 1 --2- 172.21.15.70:0/505459142 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe668070370 0x7fe6680707b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe660009d90 tx=0x7fe66001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9e8a6752a75560 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f56910fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b3cc0 0x7f568c06dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f56910fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f568c0b47b0 0x7f568c146850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f56910fe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c06c9b0 con 0x7f568c1463f0 2023-11-26T07:18:09.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f56910fe640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c06d810 con 0x7f568c0b47b0 2023-11-26T07:18:09.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f56910fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c06cc00 con 0x7f568c0b3cc0 2023-11-26T07:18:09.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66c813640 1 -- 172.21.15.70:0/505459142 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600a5920 con 0x7fe668070370 2023-11-26T07:18:09.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66c813640 1 -- 172.21.15.70:0/505459142 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6600a5a80 con 0x7fe668070370 2023-11-26T07:18:09.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66c813640 1 -- 172.21.15.70:0/505459142 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600a5920 con 0x7fe668070370 2023-11-26T07:18:09.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f568b59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f568c0b47b0 0x7f568c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f568b59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f568c0b47b0 0x7f568c146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52264/0 (socket says 172.21.15.70:52264) 2023-11-26T07:18:09.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f568b59e640 1 -- 172.21.15.70:0/3280347354 learned_addr learned my addr 172.21.15.70:0/3280347354 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f568b59e640 1 -- 172.21.15.70:0/3280347354 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b3cc0 msgr2=0x7f568c06dca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:18:09.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe668070370 msgr2=0x7fe6680707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66fa79640 1 --2- 172.21.15.70:0/505459142 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe668070370 0x7fe6680707b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe660009d90 tx=0x7fe66001c950 comp rx=0 tx=0).stop 2023-11-26T07:18:09.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 shutdown_connections 2023-11-26T07:18:09.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66fa79640 1 --2- 172.21.15.70:0/505459142 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe668070370 0x7fe6680707b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66fa79640 1 --2- 172.21.15.70:0/505459142 >> v2:172.21.15.70:3300/0 conn(0x7fe6680b1710 0x7fe66806d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 >> 172.21.15.70:0/505459142 conn(0x7fe6680b0bf0 msgr2=0x7fe6680b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.863+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 shutdown_connections 2023-11-26T07:18:09.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.863+0000 7fe66fa79640 1 -- 172.21.15.70:0/505459142 wait complete. 2023-11-26T07:18:09.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.863+0000 7f3b4e59c640 1 --2- 172.21.15.70:0/1082257067 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500d1150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009870 tx=0x7f3b4001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce32aeab8a0ba412 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.863+0000 7fe66fa79640 1 Processor -- start 2023-11-26T07:18:09.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.863+0000 7fe66fa79640 1 -- start start 2023-11-26T07:18:09.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f568b59e640 1 --2- 172.21.15.70:0/3280347354 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b3cc0 0x7f568c06dca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f568b59e640 1 -- 172.21.15.70:0/3280347354 >> v1:172.21.15.70:6789/0 conn(0x7f568c1463f0 legacy=0x7f568c0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.859+0000 7f568b59e640 1 -- 172.21.15.70:0/3280347354 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c06cee0 con 0x7f568c0b47b0 2023-11-26T07:18:09.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f568b59e640 1 --2- 172.21.15.70:0/3280347354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c0b47b0 0x7f568c146850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5684009e50 tx=0x7f568401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5190da3cb38d6540 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66fa79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe668070370 0x7fe66815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66fa79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6680b1710 0x7fe6681fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66fa79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6680ce310 0x7fe668147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66fa79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681557f0 con 0x7fe6680b1710 2023-11-26T07:18:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66fa79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681fb800 con 0x7fe668070370 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66fa79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66815ae70 con 0x7fe6680ce310 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66d815640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe668070370 0x7fe66815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6680ce310 0x7fe668147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6680ce310 0x7fe668147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53870/0 (socket says 172.21.15.70:53870) 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 -- 172.21.15.70:0/721821669 learned_addr learned my addr 172.21.15.70:0/721821669 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66d014640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6680b1710 0x7fe6681fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 -- 172.21.15.70:0/721821669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe668070370 msgr2=0x7fe66815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe668070370 0x7fe66815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 -- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6680b1710 msgr2=0x7fe6681fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6680b1710 0x7fe6681fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66e016640 1 -- 172.21.15.70:0/721821669 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660009a70 con 0x7fe6680ce310 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f5689d9b640 1 -- 172.21.15.70:0/3280347354 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840a57b0 con 0x7f568c0b47b0 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f5689d9b640 1 -- 172.21.15.70:0/3280347354 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56840a5910 con 0x7f568c0b47b0 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f5689d9b640 1 -- 172.21.15.70:0/3280347354 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840a5ca0 con 0x7f568c0b47b0 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 -- 172.21.15.70:0/3280347354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c0b47b0 msgr2=0x7f568c146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 --2- 172.21.15.70:0/3280347354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c0b47b0 0x7f568c146850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5684009e50 tx=0x7f568401c930 comp rx=0 tx=0).stop 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 -- 172.21.15.70:0/3280347354 shutdown_connections 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 --2- 172.21.15.70:0/3280347354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c0b47b0 0x7f568c146850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 --2- 172.21.15.70:0/3280347354 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b3cc0 0x7f568c06dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 -- 172.21.15.70:0/3280347354 >> 172.21.15.70:0/3280347354 conn(0x7f568c0aea10 msgr2=0x7f568c0aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 -- 172.21.15.70:0/3280347354 shutdown_connections 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f56910fe640 1 -- 172.21.15.70:0/3280347354 wait complete. 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b4d59a640 1 -- 172.21.15.70:0/1082257067 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b400ab600 con 0x7f3b5015d4a0 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b4d59a640 1 -- 172.21.15.70:0/1082257067 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b400a7050 con 0x7f3b5015d4a0 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b4d59a640 1 -- 172.21.15.70:0/1082257067 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b400ab980 con 0x7f3b5015d4a0 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 -- 172.21.15.70:0/1082257067 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 msgr2=0x7f3b500d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 --2- 172.21.15.70:0/1082257067 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500d1150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009870 tx=0x7f3b4001c470 comp rx=0 tx=0).stop 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 -- 172.21.15.70:0/1082257067 shutdown_connections 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 --2- 172.21.15.70:0/1082257067 >> v2:172.21.15.70:3300/0 conn(0x7f3b500d36a0 0x7f3b500b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 --2- 172.21.15.70:0/1082257067 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500d1150 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 -- 172.21.15.70:0/1082257067 >> 172.21.15.70:0/1082257067 conn(0x7f3b5008cce0 msgr2=0x7f3b5009c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 -- 172.21.15.70:0/1082257067 shutdown_connections 2023-11-26T07:18:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f3b54854640 1 -- 172.21.15.70:0/1082257067 wait complete. 2023-11-26T07:18:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f0595b57640 1 Processor -- start 2023-11-26T07:18:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7f0595b57640 1 -- start start 2023-11-26T07:18:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7efc69e6b640 1 Processor -- start 2023-11-26T07:18:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7efc69e6b640 1 -- start start 2023-11-26T07:18:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7fe66d014640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6680b1710 0x7fe6681fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.867+0000 7efc69e6b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efc640b1710 0x7efc6406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7fe66e016640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6680ce310 0x7fe668147f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe66001b000 tx=0x7fe6600196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f0595b57640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05900b2160 0x7f05900d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f0595b57640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05900cf0e0 con 0x7f05900d1bc0 2023-11-26T07:18:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f0595b57640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05900ceb20 con 0x7f059015d6e0 2023-11-26T07:18:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f0595b57640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059015dac0 con 0x7f05900b2160 2023-11-26T07:18:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc69e6b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc640ce310 0x7efc64158f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc69e6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc64159450 0x7efc64070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600a5920 con 0x7fe6680ce310 2023-11-26T07:18:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660009450 con 0x7fe6680ce310 2023-11-26T07:18:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc69e6b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc640cb0e0 con 0x7efc640ce310 2023-11-26T07:18:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600b7410 con 0x7fe6680ce310 2023-11-26T07:18:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc69e6b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6406cf30 con 0x7efc640b1710 2023-11-26T07:18:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc69e6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc640cb5d0 con 0x7efc64159450 2023-11-26T07:18:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efc640b1710 0x7efc6406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efc640b1710 0x7efc6406d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52288/0 (socket says 172.21.15.70:52288) 2023-11-26T07:18:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 -- 172.21.15.70:0/2028761165 learned_addr learned my addr 172.21.15.70:0/2028761165 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc63fff640 1 --2- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc64159450 0x7efc64070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 -- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc64159450 msgr2=0x7efc64070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 --2- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc64159450 0x7efc64070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 -- 172.21.15.70:0/2028761165 >> v2:172.21.15.70:3300/0 conn(0x7efc640ce310 msgr2=0x7efc64158f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:18:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc62ffd640 1 --2- 172.21.15.70:0/2028761165 >> v2:172.21.15.70:3300/0 conn(0x7efc640ce310 0x7efc64158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66815b150 con 0x7fe6680ce310 2023-11-26T07:18:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66815b710 con 0x7fe6680ce310 2023-11-26T07:18:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe66806d9f0 con 0x7fe6680ce310 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f56910fe640 1 Processor -- start 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f56910fe640 1 -- start start 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f56910fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f568c0b3cc0 0x7f568c142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f56910fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b47b0 0x7f568c13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f56910fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c1463f0 0x7f568c13c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f56910fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c13ef90 con 0x7f568c0b3cc0 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f56910fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c142680 con 0x7f568c1463f0 2023-11-26T07:18:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f568a59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b47b0 0x7f568c13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f3b54854640 1 Processor -- start 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f3b54854640 1 -- start start 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b500d18a0 0x7f3b5015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b500d36a0 0x7f3b50155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50153a30 con 0x7f3b500d36a0 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500cd210 con 0x7f3b500d18a0 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50153c40 con 0x7f3b5015d4a0 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53900/0 (socket says 172.21.15.70:53900) 2023-11-26T07:18:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 -- 172.21.15.70:0/2212681363 learned_addr learned my addr 172.21.15.70:0/2212681363 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4e59c640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b500d18a0 0x7f3b5015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4dd9b640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b500d36a0 0x7f3b50155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 -- 172.21.15.70:0/2212681363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b500d18a0 msgr2=0x7f3b5015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b500d18a0 0x7f3b5015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 -- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b500d36a0 msgr2=0x7f3b50155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b500d36a0 0x7f3b50155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 -- 172.21.15.70:0/2212681363 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400094d0 con 0x7f3b5015d4a0 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4dd9b640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b500d36a0 0x7f3b50155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:09.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058effd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f05900d1bc0 0x7f05900b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34350/0 (socket says 172.21.15.70:34350) 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058effd640 1 -- 172.21.15.70:0/952219314 learned_addr learned my addr 172.21.15.70:0/952219314 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058f7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f059015d6e0 0x7f05900d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40934/0 (socket says 172.21.15.70:40934) 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644950182 0 0) 0x7f05900ceb20 con 0x7f059015d6e0 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0578003530 con 0x7f059015d6e0 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058ffff640 1 --2- 172.21.15.70:0/952219314 >> v2:172.21.15.70:3300/0 conn(0x7f05900b2160 0x7f05900d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 <== mon.1 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 488052667 0 0) 0x7f0578003530 con 0x7f059015d6e0 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 >> v2:172.21.15.70:3300/0 conn(0x7f05900b2160 msgr2=0x7f05900d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 --2- 172.21.15.70:0/952219314 >> v2:172.21.15.70:3300/0 conn(0x7f05900b2160 0x7f05900d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 >> v1:172.21.15.70:6789/0 conn(0x7f05900d1bc0 legacy=0x7f05900b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900cee00 con 0x7f059015d6e0 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 <== mon.1 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f0580001680 con 0x7f059015d6e0 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 >> v1:172.21.15.120:6789/0 conn(0x7f059015d6e0 legacy=0x7f05900d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780039d0 0x7f0578003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05780047d0 0x7f0578004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780051e0 0x7f057800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059015dac0 con 0x7f05780051e0 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057800c130 con 0x7f05780039d0 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057800c2f0 con 0x7f05780047d0 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7f058ffff640 1 --2- 172.21.15.70:0/952219314 >> v2:172.21.15.70:3300/0 conn(0x7f05900b2160 0x7f05900d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058f7fe640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780039d0 0x7f0578003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058effd640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05780047d0 0x7f0578004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058effd640 1 -- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780039d0 msgr2=0x7f0578003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058effd640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780039d0 0x7f0578003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058effd640 1 -- 172.21.15.70:0/952219314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780051e0 msgr2=0x7f057800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058effd640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780051e0 0x7f057800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058effd640 1 -- 172.21.15.70:0/952219314 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900cee00 con 0x7f05780047d0 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f058ffff640 1 -- 172.21.15.70:0/952219314 reap_dead start 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 --2- 172.21.15.70:0/2028761165 >> v2:172.21.15.70:3300/0 conn(0x7efc640ce310 0x7efc64158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.871+0000 7efc637fe640 1 -- 172.21.15.70:0/2028761165 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6406d180 con 0x7efc640b1710 2023-11-26T07:18:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f56910fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c13c980 con 0x7f568c0b47b0 2023-11-26T07:18:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f568a59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b47b0 0x7f568c13ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53910/0 (socket says 172.21.15.70:53910) 2023-11-26T07:18:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f568a59c640 1 -- 172.21.15.70:0/2284876977 learned_addr learned my addr 172.21.15.70:0/2284876977 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b4f59e640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500c8b60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b48007e60 tx=0x7f3b4800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f568b59e640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c1463f0 0x7f568c13c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48014420 con 0x7f3b5015d4a0 2023-11-26T07:18:09.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b480145a0 con 0x7f3b5015d4a0 2023-11-26T07:18:09.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48014950 con 0x7f3b5015d4a0 2023-11-26T07:18:09.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50153f20 con 0x7f3b5015d4a0 2023-11-26T07:18:09.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b501544e0 con 0x7f3b5015d4a0 2023-11-26T07:18:09.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.875+0000 7efc637fe640 1 --2- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640b1710 0x7efc6406d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc64072100 tx=0x7efc5801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cb1431800951935 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f568b59e640 1 -- 172.21.15.70:0/2284876977 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b47b0 msgr2=0x7f568c13ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7efc627fc640 1 -- 172.21.15.70:0/2028761165 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640cebe0 con 0x7efc640b1710 2023-11-26T07:18:09.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f568b59e640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f568c0b47b0 0x7f568c13ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f568b59e640 1 -- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f568c0b3cc0 msgr2=0x7f568c142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f568b59e640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f568c0b3cc0 0x7f568c142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f568b59e640 1 -- 172.21.15.70:0/2284876977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684009b30 con 0x7f568c1463f0 2023-11-26T07:18:09.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7efc627fc640 1 -- 172.21.15.70:0/2028761165 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc580ab610 con 0x7efc640b1710 2023-11-26T07:18:09.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7efc627fc640 1 -- 172.21.15.70:0/2028761165 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580ab9a0 con 0x7efc640b1710 2023-11-26T07:18:09.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6600b4050 con 0x7fe6680ce310 2023-11-26T07:18:09.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe1c31c1640 1 Processor -- start 2023-11-26T07:18:09.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f058effd640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05780047d0 0x7f0578004c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0584001780 tx=0x7f058401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8afbcc5d069b476 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe1c31c1640 1 -- start start 2023-11-26T07:18:09.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b48014ab0 con 0x7f3b5015d4a0 2023-11-26T07:18:09.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f568b59e640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c1463f0 0x7f568c13c440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56840ab000 tx=0x7f56840196d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b50067720 con 0x7f3b5015d4a0 2023-11-26T07:18:09.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584004ab0 con 0x7f05780047d0 2023-11-26T07:18:09.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840b8470 con 0x7f568c1463f0 2023-11-26T07:18:09.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56840b85d0 con 0x7f568c1463f0 2023-11-26T07:18:09.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c141790 con 0x7f568c1463f0 2023-11-26T07:18:09.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840b8960 con 0x7f568c1463f0 2023-11-26T07:18:09.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c141d50 con 0x7f568c1463f0 2023-11-26T07:18:09.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584004c10 con 0x7f05780047d0 2023-11-26T07:18:09.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f058e7fc640 1 -- 172.21.15.70:0/952219314 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584007110 con 0x7f05780047d0 2023-11-26T07:18:09.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f7e56013640 1 Processor -- start 2023-11-26T07:18:09.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b3effd640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b48084640 con 0x7f3b5015d4a0 2023-11-26T07:18:09.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f0595b57640 1 -- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05780047d0 msgr2=0x7f0578004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f0595b57640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05780047d0 0x7f0578004c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0584001780 tx=0x7f058401c3e0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b3effd640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f3b3006e610 0x7f3b30070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f7e56013640 1 -- start start 2023-11-26T07:18:09.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 --> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b300710e0 con 0x7f3b3006e610 2023-11-26T07:18:09.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b48086cd0 con 0x7f3b5015d4a0 2023-11-26T07:18:09.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7f3b4e59c640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe1c31c1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1bc0cf990 0x7fe1bc0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe1c31c1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe1bc070e00 0x7fe1bc162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe1c31c1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1bc162080 con 0x7fe1bc14b1e0 2023-11-26T07:18:09.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe1c31c1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1bc161d70 con 0x7fe1bc070e00 2023-11-26T07:18:09.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe1c31c1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1bc14b5c0 con 0x7fe1bc0cf990 2023-11-26T07:18:09.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7efc69e6b640 1 -- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640b1710 msgr2=0x7efc6406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7efc69e6b640 1 --2- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640b1710 0x7efc6406d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc64072100 tx=0x7efc5801c470 comp rx=0 tx=0).stop 2023-11-26T07:18:09.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f568c067500 con 0x7f568c1463f0 2023-11-26T07:18:09.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1b3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1bc0cf990 0x7fe1bc0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1b3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1bc0cf990 0x7fe1bc0708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52336/0 (socket says 172.21.15.70:52336) 2023-11-26T07:18:09.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1b3fff640 1 -- 172.21.15.70:0/2252987198 learned_addr learned my addr 172.21.15.70:0/2252987198 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f0595b57640 1 -- 172.21.15.70:0/952219314 shutdown_connections 2023-11-26T07:18:09.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f0595b57640 1 --2- 172.21.15.70:0/952219314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05780047d0 0x7f0578004c50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f0595b57640 1 -- 172.21.15.70:0/952219314 >> 172.21.15.70:0/952219314 conn(0x7f059009c550 msgr2=0x7f05900d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe65a7fc640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe64c066470 0x7fe64c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.879+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe66011f6f0 con 0x7fe6680ce310 2023-11-26T07:18:09.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe65a7fc640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7fe64c06e690 0x7fe64c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 --> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe64c071160 con 0x7fe64c06e690 2023-11-26T07:18:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe66011faa0 con 0x7fe6680ce310 2023-11-26T07:18:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1c175e640 1 --2- 172.21.15.70:0/2252987198 >> v2:172.21.15.70:3300/0 conn(0x7fe1bc070e00 0x7fe1bc162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 -- 172.21.15.70:0/2028761165 shutdown_connections 2023-11-26T07:18:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 --2- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc64159450 0x7efc64070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 --2- 172.21.15.70:0/2028761165 >> v2:172.21.15.70:3300/0 conn(0x7efc640ce310 0x7efc64158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 --2- 172.21.15.70:0/2028761165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640b1710 0x7efc6406d680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 -- 172.21.15.70:0/2028761165 >> 172.21.15.70:0/2028761165 conn(0x7efc640b0bf0 msgr2=0x7efc640b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f3b4e59c640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008db20 tx=0x7f3b400a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1c175e640 1 -- 172.21.15.70:0/2252987198 >> v2:172.21.15.120:3300/0 conn(0x7fe1bc0cf990 msgr2=0x7fe1bc0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1c175e640 1 --2- 172.21.15.70:0/2252987198 >> v2:172.21.15.120:3300/0 conn(0x7fe1bc0cf990 0x7fe1bc0708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1c175e640 1 -- 172.21.15.70:0/2252987198 >> v1:172.21.15.70:6789/0 conn(0x7fe1bc14b1e0 legacy=0x7fe1bc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe1c175e640 1 -- 172.21.15.70:0/2252987198 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc071580 con 0x7fe1bc070e00 2023-11-26T07:18:09.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7fe66d815640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe64c066470 0x7fe64c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e56013640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e5014b1e0 0x7f7e500cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e56013640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e50070fd0 0x7f7e50162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e56013640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e500cfc20 con 0x7f7e500cf7c0 2023-11-26T07:18:09.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e56013640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e50162080 con 0x7f7e5014b1e0 2023-11-26T07:18:09.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e56013640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50161d70 con 0x7f7e50070fd0 2023-11-26T07:18:09.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f0595b57640 1 -- 172.21.15.70:0/952219314 shutdown_connections 2023-11-26T07:18:09.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f76141df640 1 Processor -- start 2023-11-26T07:18:09.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e5014b1e0 0x7f7e500cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e5014b1e0 0x7f7e500cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59994/0 (socket says 172.21.15.70:59994) 2023-11-26T07:18:09.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4f7fe640 1 -- 172.21.15.70:0/3486512104 learned_addr learned my addr 172.21.15.70:0/3486512104 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4ffff640 1 --2- 172.21.15.70:0/3486512104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e50070fd0 0x7f7e50162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f76141df640 1 -- start start 2023-11-26T07:18:09.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4ffff640 1 -- 172.21.15.70:0/3486512104 >> v2:172.21.15.70:3300/0 conn(0x7f7e5014b1e0 msgr2=0x7f7e500cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4ffff640 1 --2- 172.21.15.70:0/3486512104 >> v2:172.21.15.70:3300/0 conn(0x7f7e5014b1e0 0x7f7e500cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4ffff640 1 -- 172.21.15.70:0/3486512104 >> v1:172.21.15.120:6789/0 conn(0x7f7e500cf7c0 legacy=0x7f7e500708c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:18:09.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f7e4ffff640 1 -- 172.21.15.70:0/3486512104 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5014b5c0 con 0x7f7e50070fd0 2023-11-26T07:18:09.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56840b8ac0 con 0x7f568c1463f0 2023-11-26T07:18:09.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f56737fe640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5678066470 0x7f5678068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f568411ee80 con 0x7f568c1463f0 2023-11-26T07:18:09.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f56737fe640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7f567806e610 0x7f5678070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 --> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56780710e0 con 0x7f567806e610 2023-11-26T07:18:09.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5684121520 con 0x7f568c1463f0 2023-11-26T07:18:09.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 -- 172.21.15.70:0/2028761165 shutdown_connections 2023-11-26T07:18:09.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 -- 172.21.15.70:0/2028761165 wait complete. 2023-11-26T07:18:09.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7efc69e6b640 1 Processor -- start 2023-11-26T07:18:09.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f0595b57640 1 -- 172.21.15.70:0/952219314 wait complete. 2023-11-26T07:18:09.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f568a59c640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7f567806e610 0x7f5678070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe66d815640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe64c066470 0x7fe64c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe664009af0 tx=0x7fe664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7efc69e6b640 1 -- start start 2023-11-26T07:18:09.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f568ad9d640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5678066470 0x7f5678068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe66d014640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7fe64c06e690 0x7fe64c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f3b4dd9b640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f3b3006e610 0x7f3b30070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe66d014640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7fe64c06e690 0x7fe64c070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f568a59c640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7f567806e610 0x7f5678070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f76141df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0d1f30 0x7f760c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.883+0000 7f76141df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f760c0b36b0 0x7f760c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f76141df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0ce590 con 0x7f760c15d5b0 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f76141df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0cdf80 con 0x7f760c0b36b0 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f76141df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b3ea0 con 0x7f760c0d1f30 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7611f7b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f760c15d5b0 0x7f760c0d1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40950/0 (socket says 172.21.15.70:40950) 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7611f7b640 1 -- 172.21.15.70:0/2736601827 learned_addr learned my addr 172.21.15.70:0/2736601827 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705201956 0 0) 0x7f760c0ce590 con 0x7f760c15d5b0 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f8003530 con 0x7f760c15d5b0 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f761277c640 1 --2- 172.21.15.70:0/2736601827 >> v2:172.21.15.120:3300/0 conn(0x7f760c0b36b0 0x7f760c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f568ad9d640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5678066470 0x7f5678068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f567c009650 tx=0x7f567c006bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f761177a640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0d1f30 0x7f760c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 <== mon.1 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1437569185 0 0) 0x7f75f8003530 con 0x7f760c15d5b0 2023-11-26T07:18:09.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0d1f30 msgr2=0x7f760c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0d1f30 0x7f760c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f0595b57640 1 Processor -- start 2023-11-26T07:18:09.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 >> v2:172.21.15.120:3300/0 conn(0x7f760c0b36b0 msgr2=0x7f760c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe1c175e640 1 --2- 172.21.15.70:0/2252987198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc070e00 0x7fe1bc162510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc06dfa0 tx=0x7fe1b401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736f4508ce7f4e41 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f3b4dd9b640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f3b3006e610 0x7f3b30070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== osd.0 v2:172.21.15.70:6824/1953415072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe64c071160 con 0x7fe64c06e690 2023-11-26T07:18:09.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe1bbfff640 1 -- 172.21.15.70:0/2252987198 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40a7070 con 0x7fe1bc070e00 2023-11-26T07:18:09.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe1bbfff640 1 -- 172.21.15.70:0/2252987198 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b40ab430 con 0x7fe1bc070e00 2023-11-26T07:18:09.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7fe1bbfff640 1 -- 172.21.15.70:0/2252987198 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40ab7c0 con 0x7fe1bc070e00 2023-11-26T07:18:09.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7efc69e6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc640b1710 0x7efc64157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7efc69e6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640ce310 0x7efc641f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7efc69e6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc64159450 0x7efc641f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 --2- 172.21.15.70:0/2736601827 >> v2:172.21.15.120:3300/0 conn(0x7f760c0b36b0 0x7f760c0cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0ce220 con 0x7f760c15d5b0 2023-11-26T07:18:09.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 <== mon.1 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f7608001680 con 0x7f760c15d5b0 2023-11-26T07:18:09.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 >> v1:172.21.15.120:6789/0 conn(0x7f760c15d5b0 legacy=0x7f760c0d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f8003980 0x7f75f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f80047d0 0x7f75f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75f8005190 0x7f75f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0cdf80 con 0x7f75f8003980 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b3ea0 con 0x7f75f8005190 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80147e0 con 0x7f75f80047d0 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f761277c640 1 --2- 172.21.15.70:0/2736601827 >> v2:172.21.15.120:3300/0 conn(0x7f760c0b36b0 0x7f760c0cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f7611f7b640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f8003980 0x7f75f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f761177a640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f80047d0 0x7f75f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f761277c640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75f8005190 0x7f75f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.887+0000 7f0595b57640 1 -- start start 2023-11-26T07:18:09.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640ce310 0x7efc641f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7e4ffff640 1 --2- 172.21.15.70:0/3486512104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e50070fd0 0x7f7e50162510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e480097c0 tx=0x7f7e4801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351926f2b8345502 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc637fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc640b1710 0x7efc64157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640ce310 0x7efc641f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52368/0 (socket says 172.21.15.70:52368) 2023-11-26T07:18:09.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 -- 172.21.15.70:0/2252987198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc070e00 msgr2=0x7fe1bc162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 --2- 172.21.15.70:0/2252987198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc070e00 0x7fe1bc162510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc06dfa0 tx=0x7fe1b401c430 comp rx=0 tx=0).stop 2023-11-26T07:18:09.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== osd.1 v2:172.21.15.70:6803/1649140554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f56780710e0 con 0x7f567806e610 2023-11-26T07:18:09.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 -- 172.21.15.70:0/2252987198 shutdown_connections 2023-11-26T07:18:09.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 --2- 172.21.15.70:0/2252987198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc070e00 0x7fe1bc162510 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 --2- 172.21.15.70:0/2252987198 >> v2:172.21.15.120:3300/0 conn(0x7fe1bc0cf990 0x7fe1bc0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 -- 172.21.15.70:0/2252987198 >> 172.21.15.70:0/2252987198 conn(0x7fe1bc06a890 msgr2=0x7fe1bc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc637fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc640b1710 0x7efc64157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53928/0 (socket says 172.21.15.70:53928) 2023-11-26T07:18:09.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7611f7b640 1 -- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f80047d0 msgr2=0x7f75f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7611f7b640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f80047d0 0x7f75f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7611f7b640 1 -- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75f8005190 msgr2=0x7f75f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:09.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7611f7b640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75f8005190 0x7f75f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7611f7b640 1 -- 172.21.15.70:0/2736601827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0ce220 con 0x7f75f8003980 2023-11-26T07:18:09.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 -- 172.21.15.70:0/2252987198 shutdown_connections 2023-11-26T07:18:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc64159450 0x7efc641f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc63fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc64159450 0x7efc641f33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60018/0 (socket says 172.21.15.70:60018) 2023-11-26T07:18:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc69e6b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc641f72e0 con 0x7efc64159450 2023-11-26T07:18:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 -- 172.21.15.70:0/435861949 learned_addr learned my addr 172.21.15.70:0/435861949 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== osd.2 v2:172.21.15.70:6804/4252988777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3b300710e0 con 0x7f3b3006e610 2023-11-26T07:18:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc641f75c0 con 0x7efc640ce310 2023-11-26T07:18:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc641f78a0 con 0x7efc640b1710 2023-11-26T07:18:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f0595b57640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780047d0 0x7f05901fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f0595b57640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059015e300 0x7f05900c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f0595b57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f059006c370 0x7f059015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f0595b57640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05900c93c0 con 0x7f059015e300 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f0595b57640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05901fabd0 con 0x7f05780047d0 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f0595b57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05901faeb0 con 0x7f059006c370 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059015e300 0x7f05900c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059015e300 0x7f05900c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60024/0 (socket says 172.21.15.70:60024) 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 -- 172.21.15.70:0/3768523749 learned_addr learned my addr 172.21.15.70:0/3768523749 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058ffff640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f059006c370 0x7f059015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058f7fe640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780047d0 0x7f05901fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 -- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc640b1710 msgr2=0x7efc64157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 -- 172.21.15.70:0/3768523749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f059006c370 msgr2=0x7f059015bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f059006c370 0x7f059015bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 -- 172.21.15.70:0/3768523749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780047d0 msgr2=0x7f05901fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05780047d0 0x7f05901fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 -- 172.21.15.70:0/3768523749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05901fb190 con 0x7f059015e300 2023-11-26T07:18:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc640b1710 0x7efc64157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 -- 172.21.15.70:0/435861949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc64159450 msgr2=0x7efc641f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc64159450 0x7efc641f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580094d0 con 0x7efc640ce310 2023-11-26T07:18:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f058effd640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059015e300 0x7f05900c8e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f058401c210 tx=0x7f0578005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc62ffd640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640ce310 0x7efc641f2e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c7f0 tx=0x7efc5400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 -- 172.21.15.70:0/2252987198 wait complete. 2023-11-26T07:18:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54004220 con 0x7efc640ce310 2023-11-26T07:18:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc54004380 con 0x7efc640ce310 2023-11-26T07:18:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54003860 con 0x7efc640ce310 2023-11-26T07:18:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc641f7b80 con 0x7efc640ce310 2023-11-26T07:18:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc641f6570 con 0x7efc640ce310 2023-11-26T07:18:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7e4effd640 1 -- 172.21.15.70:0/3486512104 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480ac630 con 0x7f7e50070fd0 2023-11-26T07:18:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7e4effd640 1 -- 172.21.15.70:0/3486512104 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e480ac790 con 0x7f7e50070fd0 2023-11-26T07:18:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7f7e4effd640 1 -- 172.21.15.70:0/3486512104 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480acb20 con 0x7f7e50070fd0 2023-11-26T07:18:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.891+0000 7fe1c31c1640 1 Processor -- start 2023-11-26T07:18:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840b8640 con 0x7f059015e300 2023-11-26T07:18:09.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840b87a0 con 0x7f059015e300 2023-11-26T07:18:09.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840b8b10 con 0x7f059015e300 2023-11-26T07:18:09.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc44000fd0 con 0x7efc640ce310 2023-11-26T07:18:09.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f0595b57640 1 -- 172.21.15.70:0/3768523749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05900b5ee0 con 0x7f059015e300 2023-11-26T07:18:09.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f0595b57640 1 -- 172.21.15.70:0/3768523749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059006c800 con 0x7f059015e300 2023-11-26T07:18:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f7611f7b640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f8003980 0x7f75f8003da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f760800c290 tx=0x7f760801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26717a84ae7fe288 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76080058e0 con 0x7f75f8003980 2023-11-26T07:18:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608005a40 con 0x7f75f8003980 2023-11-26T07:18:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f7610f79640 1 -- 172.21.15.70:0/2736601827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608005e50 con 0x7f75f8003980 2023-11-26T07:18:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f0595b57640 1 -- 172.21.15.70:0/3768523749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05900ce810 con 0x7f059015e300 2023-11-26T07:18:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc54003bd0 con 0x7efc640ce310 2023-11-26T07:18:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7fe1c31c1640 1 -- start start 2023-11-26T07:18:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f76141df640 1 -- 172.21.15.70:0/2736601827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f8003980 msgr2=0x7f75f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f76141df640 1 --2- 172.21.15.70:0/2736601827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f8003980 0x7f75f8003da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f760800c290 tx=0x7f760801cc80 comp rx=0 tx=0).stop 2023-11-26T07:18:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f761277c640 1 -- 172.21.15.70:0/2736601827 reap_dead start 2023-11-26T07:18:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f76141df640 1 -- 172.21.15.70:0/2736601827 shutdown_connections 2023-11-26T07:18:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f76141df640 1 -- 172.21.15.70:0/2736601827 >> 172.21.15.70:0/2736601827 conn(0x7f760c08cc60 msgr2=0x7f760c09c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7fe1c31c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1bc070e00 0x7fe1bc143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f7e56013640 1 -- 172.21.15.70:0/3486512104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e50070fd0 msgr2=0x7f7e50162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7f7e56013640 1 --2- 172.21.15.70:0/3486512104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e50070fd0 0x7f7e50162510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e480097c0 tx=0x7f7e4801c410 comp rx=0 tx=0).stop 2023-11-26T07:18:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7efc4bfff640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc50066470 0x7efc50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc54083dc0 con 0x7efc640ce310 2023-11-26T07:18:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7fe1c31c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1bc0cf990 0x7fe1bc1460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7fe1c31c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc14b1e0 0x7fe1bc1465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7fe1c31c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc14bb40 con 0x7fe1bc14b1e0 2023-11-26T07:18:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7fe1c31c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc14b7f0 con 0x7fe1bc070e00 2023-11-26T07:18:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.895+0000 7fe1c31c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc143650 con 0x7fe1bc0cf990 2023-11-26T07:18:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f7e56013640 1 -- 172.21.15.70:0/3486512104 shutdown_connections 2023-11-26T07:18:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f7e56013640 1 --2- 172.21.15.70:0/3486512104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e50070fd0 0x7f7e50162510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f7e56013640 1 --2- 172.21.15.70:0/3486512104 >> v2:172.21.15.70:3300/0 conn(0x7f7e5014b1e0 0x7f7e500cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f7e56013640 1 -- 172.21.15.70:0/3486512104 >> 172.21.15.70:0/3486512104 conn(0x7f7e5006a890 msgr2=0x7f7e5006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc4bfff640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7efc5006e690 0x7efc50070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc50071160 con 0x7efc5006e690 2023-11-26T07:18:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc540863e0 con 0x7efc640ce310 2023-11-26T07:18:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f7e56013640 1 -- 172.21.15.70:0/3486512104 shutdown_connections 2023-11-26T07:18:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c175e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc14b1e0 0x7fe1bc1465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f7e56013640 1 -- 172.21.15.70:0/3486512104 wait complete. 2023-11-26T07:18:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c175e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc14b1e0 0x7fe1bc1465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60032/0 (socket says 172.21.15.70:60032) 2023-11-26T07:18:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c175e640 1 -- 172.21.15.70:0/766303490 learned_addr learned my addr 172.21.15.70:0/766303490 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c0f5d640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1bc070e00 0x7fe1bc143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc63fff640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7efc5006e690 0x7efc50070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f76141df640 1 -- 172.21.15.70:0/2736601827 shutdown_connections 2023-11-26T07:18:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1b3fff640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1bc0cf990 0x7fe1bc1460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f05840b8c70 con 0x7f059015e300 2023-11-26T07:18:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f76141df640 1 -- 172.21.15.70:0/2736601827 wait complete. 2023-11-26T07:18:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c0f5d640 1 -- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1bc0cf990 msgr2=0x7fe1bc1460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c0f5d640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1bc0cf990 0x7fe1bc1460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c0f5d640 1 -- 172.21.15.70:0/766303490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc14b1e0 msgr2=0x7fe1bc1465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c0f5d640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1bc14b1e0 0x7fe1bc1465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c0f5d640 1 -- 172.21.15.70:0/766303490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4009420 con 0x7fe1bc070e00 2023-11-26T07:18:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc63fff640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7efc5006e690 0x7efc50070ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c0f5d640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1bc070e00 0x7fe1bc143110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c760 tx=0x7fe1ac00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc637fe640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc50066470 0x7efc50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac006d60 con 0x7fe1bc070e00 2023-11-26T07:18:09.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f0577fff640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f057c066540 0x7f057c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1bc161220 con 0x7fe1bc070e00 2023-11-26T07:18:09.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1bc1617e0 con 0x7fe1bc070e00 2023-11-26T07:18:09.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f058411dfc0 con 0x7f059015e300 2023-11-26T07:18:09.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f7e56013640 1 Processor -- start 2023-11-26T07:18:09.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== osd.5 v2:172.21.15.120:6800/1452349968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efc50071160 con 0x7efc5006e690 2023-11-26T07:18:09.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7efc637fe640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc50066470 0x7efc50068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc580af000 tx=0x7efc580b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f058f7fe640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f057c066540 0x7f057c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f0577fff640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f057c06e760 0x7f057c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 --> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f057c071230 con 0x7f057c06e760 2023-11-26T07:18:09.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f058411e370 con 0x7f059015e300 2023-11-26T07:18:09.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac00ce10 con 0x7fe1bc070e00 2023-11-26T07:18:09.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac006d60 con 0x7fe1bc070e00 2023-11-26T07:18:09.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1a0000fd0 con 0x7fe1bc070e00 2023-11-26T07:18:09.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.899+0000 7f76141df640 1 Processor -- start 2023-11-26T07:18:09.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f76141df640 1 -- start start 2023-11-26T07:18:09.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f058f7fe640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f057c066540 0x7f057c068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0580000fc0 tx=0x7f0580009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f058ffff640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f057c06e760 0x7f057c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f7e56013640 1 -- start start 2023-11-26T07:18:09.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f058ffff640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f057c06e760 0x7f057c070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f7e56013640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e50070fd0 0x7f7e50161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f7e56013640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e500cf7c0 0x7f7e501450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f7e56013640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e5014b1e0 0x7f7e50140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f7e56013640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50161770 con 0x7f7e50070fd0 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f7e4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e50070fd0 0x7f7e50161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f7e56013640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50144570 con 0x7f7e500cf7c0 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e56013640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50144a00 con 0x7f7e5014b1e0 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e500cf7c0 0x7f7e501450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e500cf7c0 0x7f7e501450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52378/0 (socket says 172.21.15.70:52378) 2023-11-26T07:18:09.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 -- 172.21.15.70:0/1267268843 learned_addr learned my addr 172.21.15.70:0/1267268843 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f76141df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f760c06c4c0 0x7f760c162170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f76141df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f760c156940 0x7f760c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.903+0000 7f76141df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0cc860 0x7f760c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f76141df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c15de50 con 0x7f760c06c4c0 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f76141df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0cbf00 con 0x7f760c156940 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f76141df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c162a70 con 0x7f760c0cc860 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7611f7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f760c06c4c0 0x7f760c162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f761277c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0cc860 0x7f760c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f761277c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0cc860 0x7f760c155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53970/0 (socket says 172.21.15.70:53970) 2023-11-26T07:18:09.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f761277c640 1 -- 172.21.15.70:0/4028189168 learned_addr learned my addr 172.21.15.70:0/4028189168 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:09.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f761177a640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f760c156940 0x7f760c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 -- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e5014b1e0 msgr2=0x7f7e50140fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:18:09.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e5014b1e0 0x7f7e50140fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 -- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e50070fd0 msgr2=0x7f7e50161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e50070fd0 0x7f7e50161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e4f7fe640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e50070fd0 0x7f7e50161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:09.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7611f7b640 1 -- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0cc860 msgr2=0x7f760c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 -- 172.21.15.70:0/1267268843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48009420 con 0x7f7e500cf7c0 2023-11-26T07:18:09.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7611f7b640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0cc860 0x7f760c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7611f7b640 1 -- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f760c156940 msgr2=0x7f760c0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7611f7b640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f760c156940 0x7f760c0cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7611f7b640 1 -- 172.21.15.70:0/4028189168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c162d50 con 0x7f760c06c4c0 2023-11-26T07:18:09.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f761277c640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f760c0cc860 0x7f760c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:09.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f761177a640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f760c156940 0x7f760c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:09.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7611f7b640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f760c06c4c0 0x7f760c162170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f75f8005770 tx=0x7f75f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1ac003980 con 0x7fe1bc070e00 2023-11-26T07:18:09.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7fe1b9ffb640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe19c066530 0x7fe19c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== osd.3 v2:172.21.15.70:6800/102590499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f057c071230 con 0x7f057c06e760 2023-11-26T07:18:09.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e46ffd640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e500cf7c0 0x7f7e501450c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b4a0 tx=0x7f7e3800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38010610 con 0x7f7e500cf7c0 2023-11-26T07:18:09.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76080048b0 con 0x7f760c06c4c0 2023-11-26T07:18:09.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7fe1b3fff640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe19c066530 0x7fe19c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e50143960 con 0x7f7e500cf7c0 2023-11-26T07:18:09.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e50143f20 con 0x7f7e500cf7c0 2023-11-26T07:18:09.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.907+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0cbb20 con 0x7f760c06c4c0 2023-11-26T07:18:09.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c06c8a0 con 0x7f760c06c4c0 2023-11-26T07:18:09.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1ac084070 con 0x7fe1bc070e00 2023-11-26T07:18:09.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7fe1b9ffb640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fe19c06e6d0 0x7fe19c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7fe1b3fff640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe19c066530 0x7fe19c0689f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc06dd60 tx=0x7fe1a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 --> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe19c0711a0 con 0x7fe19c06e6d0 2023-11-26T07:18:09.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1ac006d60 con 0x7fe1bc070e00 2023-11-26T07:18:09.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e500cea50 con 0x7f7e500cf7c0 2023-11-26T07:18:09.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38010770 con 0x7f7e500cf7c0 2023-11-26T07:18:09.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38010610 con 0x7f7e500cf7c0 2023-11-26T07:18:09.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7fe1c175e640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fe19c06e6d0 0x7fe19c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76080b2070 con 0x7f760c06c4c0 2023-11-26T07:18:09.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.911+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608004c10 con 0x7f760c06c4c0 2023-11-26T07:18:09.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75f4000fd0 con 0x7f760c06c4c0 2023-11-26T07:18:09.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76080a5850 con 0x7f760c06c4c0 2023-11-26T07:18:09.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 --> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f568c1427c0 con 0x7f567806e610 2023-11-26T07:18:09.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e38010940 con 0x7f7e500cf7c0 2023-11-26T07:18:09.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f7e4cff9640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e30066500 0x7f7e300689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e38083d60 con 0x7f7e500cf7c0 2023-11-26T07:18:09.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f7e4cff9640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f7e3006e6a0 0x7f7e30070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 --> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e30071170 con 0x7f7e3006e6a0 2023-11-26T07:18:09.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e380840d0 con 0x7f7e500cf7c0 2023-11-26T07:18:09.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f76027fc640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75f0066470 0x7f75f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f760811d4c0 con 0x7f760c06c4c0 2023-11-26T07:18:09.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f76027fc640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f75f006e610 0x7f75f0070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:09.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 --> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75f00710e0 con 0x7f75f006e610 2023-11-26T07:18:09.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f760811fb80 con 0x7f760c06c4c0 2023-11-26T07:18:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f56737fe640 1 -- 172.21.15.70:0/2284876977 <== osd.1 v2:172.21.15.70:6803/1649140554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f56800051e0 con 0x7f567806e610 2023-11-26T07:18:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.915+0000 7f7e4f7fe640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e30066500 0x7f7e300689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7fe1c175e640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fe19c06e6d0 0x7fe19c070af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 --> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b500d4170 con 0x7f3b3006e610 2023-11-26T07:18:09.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f761177a640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75f0066470 0x7f75f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f761277c640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f75f006e610 0x7f75f0070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f7e4ffff640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f7e3006e6a0 0x7f7e30070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:09.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7f567806e610 msgr2=0x7f5678070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7f567806e610 0x7f5678070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f761277c640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f75f006e610 0x7f75f0070a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b3effd640 1 -- 172.21.15.70:0/2212681363 <== osd.2 v2:172.21.15.70:6804/4252988777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b500d4170 con 0x7f3b3006e610 2023-11-26T07:18:09.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== osd.4 v2:172.21.15.120:6824/2950360410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe19c0711a0 con 0x7fe19c06e6d0 2023-11-26T07:18:09.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5678066470 msgr2=0x7f5678068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5678066470 0x7f5678068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f567c009650 tx=0x7f567c006bb0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c1463f0 msgr2=0x7f568c13c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 --2- 172.21.15.70:0/2284876977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f568c1463f0 0x7f568c13c440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f56840ab000 tx=0x7f56840196d0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f568b59e640 1 -- 172.21.15.70:0/2284876977 reap_dead start 2023-11-26T07:18:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 shutdown_connections 2023-11-26T07:18:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 >> 172.21.15.70:0/2284876977 conn(0x7f568c0aea10 msgr2=0x7f568c145b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f3b3006e610 msgr2=0x7f3b30070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f3b3006e610 0x7f3b30070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 msgr2=0x7f3b30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008db20 tx=0x7f3b400a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 msgr2=0x7f3b500c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 --2- 172.21.15.70:0/2212681363 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b5015d4a0 0x7f3b500c8b60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b48007e60 tx=0x7f3b4800e4b0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f7e4ffff640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f7e3006e6a0 0x7f7e30070ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f7e4f7fe640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e30066500 0x7f7e300689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009dd0 tx=0x7f7e4000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== osd.7 v2:172.21.15.120:6808/3467251727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f75f00710e0 con 0x7f75f006e610 2023-11-26T07:18:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b4f59e640 1 -- 172.21.15.70:0/2212681363 reap_dead start 2023-11-26T07:18:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== osd.6 v2:172.21.15.120:6809/1672802144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7e30071170 con 0x7f7e3006e6a0 2023-11-26T07:18:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 shutdown_connections 2023-11-26T07:18:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 >> 172.21.15.70:0/2212681363 conn(0x7f3b5008cce0 msgr2=0x7f3b5006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 shutdown_connections 2023-11-26T07:18:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f761177a640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75f0066470 0x7f75f0068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f760c156d80 tx=0x7f75fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 shutdown_connections 2023-11-26T07:18:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f3b54854640 1 -- 172.21.15.70:0/2212681363 wait complete. 2023-11-26T07:18:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.919+0000 7f56910fe640 1 -- 172.21.15.70:0/2284876977 wait complete. 2023-11-26T07:18:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.927+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 --> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe668067680 con 0x7fe64c06e690 2023-11-26T07:18:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.927+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 --> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc44002cc0 con 0x7efc5006e690 2023-11-26T07:18:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc4bfff640 1 -- 172.21.15.70:0/435861949 <== osd.5 v2:172.21.15.120:6800/1452349968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc44002cc0 con 0x7efc5006e690 2023-11-26T07:18:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7fe65a7fc640 1 -- 172.21.15.70:0/721821669 <== osd.0 v2:172.21.15.70:6824/1953415072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe668067680 con 0x7fe64c06e690 2023-11-26T07:18:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7fe64c06e690 msgr2=0x7fe64c070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7fe66fa79640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7fe64c06e690 0x7fe64c070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7efc5006e690 msgr2=0x7efc50070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7efc5006e690 0x7efc50070ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc50066470 msgr2=0x7efc50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc50066470 0x7efc50068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc580af000 tx=0x7efc580b6040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640ce310 msgr2=0x7efc641f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 --2- 172.21.15.70:0/435861949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc640ce310 0x7efc641f2e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c7f0 tx=0x7efc5400ccb0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc63fff640 1 -- 172.21.15.70:0/435861949 reap_dead start 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 shutdown_connections 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 >> 172.21.15.70:0/435861949 conn(0x7efc640b0bf0 msgr2=0x7efc640b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 shutdown_connections 2023-11-26T07:18:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.931+0000 7efc69e6b640 1 -- 172.21.15.70:0/435861949 wait complete. 2023-11-26T07:18:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe64c066470 msgr2=0x7fe64c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe64c066470 0x7fe64c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe664009af0 tx=0x7fe664008040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6680ce310 msgr2=0x7fe668147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 --2- 172.21.15.70:0/721821669 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6680ce310 0x7fe668147f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe66001b000 tx=0x7fe6600196f0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66e016640 1 -- 172.21.15.70:0/721821669 reap_dead start 2023-11-26T07:18:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 shutdown_connections 2023-11-26T07:18:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 >> 172.21.15.70:0/721821669 conn(0x7fe6680b0bf0 msgr2=0x7fe6680aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 shutdown_connections 2023-11-26T07:18:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7fe66fa79640 1 -- 172.21.15.70:0/721821669 wait complete. 2023-11-26T07:18:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.935+0000 7f0595b57640 1 -- 172.21.15.70:0/3768523749 --> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05900b0230 con 0x7f057c06e760 2023-11-26T07:18:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.939+0000 7f0577fff640 1 -- 172.21.15.70:0/3768523749 <== osd.3 v2:172.21.15.70:6800/102590499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0588009810 con 0x7f057c06e760 2023-11-26T07:18:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 -- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f057c06e760 msgr2=0x7f057c070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f057c06e760 0x7f057c070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 --> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1a0002cc0 con 0x7fe19c06e6d0 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 -- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f057c066540 msgr2=0x7f057c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f057c066540 0x7f057c068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0580000fc0 tx=0x7f0580009040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 -- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059015e300 msgr2=0x7f05900c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 --2- 172.21.15.70:0/3768523749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059015e300 0x7f05900c8e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f058401c210 tx=0x7f0578005800 comp rx=0 tx=0).stop 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f058ffff640 1 -- 172.21.15.70:0/3768523749 reap_dead start 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 -- 172.21.15.70:0/3768523749 shutdown_connections 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 -- 172.21.15.70:0/3768523749 >> 172.21.15.70:0/3768523749 conn(0x7f059009c550 msgr2=0x7f05900cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1b9ffb640 1 -- 172.21.15.70:0/766303490 <== osd.4 v2:172.21.15.120:6824/2950360410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe1a0002cc0 con 0x7fe19c06e6d0 2023-11-26T07:18:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 -- 172.21.15.70:0/3768523749 shutdown_connections 2023-11-26T07:18:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f0575ffb640 1 -- 172.21.15.70:0/3768523749 wait complete. 2023-11-26T07:18:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fe19c06e6d0 msgr2=0x7fe19c070af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fe19c06e6d0 0x7fe19c070af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe19c066530 msgr2=0x7fe19c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe19c066530 0x7fe19c0689f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc06dd60 tx=0x7fe1a4008040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 --> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e5006e130 con 0x7f7e3006e6a0 2023-11-26T07:18:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1bc070e00 msgr2=0x7fe1bc143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 --2- 172.21.15.70:0/766303490 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1bc070e00 0x7fe1bc143110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c760 tx=0x7fe1ac00cc20 comp rx=0 tx=0).stop 2023-11-26T07:18:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c175e640 1 -- 172.21.15.70:0/766303490 reap_dead start 2023-11-26T07:18:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 shutdown_connections 2023-11-26T07:18:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 >> 172.21.15.70:0/766303490 conn(0x7fe1bc06a890 msgr2=0x7fe1bc0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 shutdown_connections 2023-11-26T07:18:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7f7e4cff9640 1 -- 172.21.15.70:0/1267268843 <== osd.6 v2:172.21.15.120:6809/1672802144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e5006e130 con 0x7f7e3006e6a0 2023-11-26T07:18:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.943+0000 7fe1c31c1640 1 -- 172.21.15.70:0/766303490 wait complete. 2023-11-26T07:18:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f7e3006e6a0 msgr2=0x7f7e30070ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f7e3006e6a0 0x7f7e30070ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e30066500 msgr2=0x7f7e300689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e30066500 0x7f7e300689c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009dd0 tx=0x7f7e4000b040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e500cf7c0 msgr2=0x7f7e501450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 --2- 172.21.15.70:0/1267268843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e500cf7c0 0x7f7e501450c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b4a0 tx=0x7f7e3800b960 comp rx=0 tx=0).stop 2023-11-26T07:18:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e4ffff640 1 -- 172.21.15.70:0/1267268843 reap_dead start 2023-11-26T07:18:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 --> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75f4002cc0 con 0x7f75f006e610 2023-11-26T07:18:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 shutdown_connections 2023-11-26T07:18:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 >> 172.21.15.70:0/1267268843 conn(0x7f7e5006a890 msgr2=0x7f7e500708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 shutdown_connections 2023-11-26T07:18:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.947+0000 7f7e56013640 1 -- 172.21.15.70:0/1267268843 wait complete. 2023-11-26T07:18:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f76027fc640 1 -- 172.21.15.70:0/4028189168 <== osd.7 v2:172.21.15.120:6808/3467251727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75f4002cc0 con 0x7f75f006e610 2023-11-26T07:18:09.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f75f006e610 msgr2=0x7f75f0070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f76141df640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f75f006e610 0x7f75f0070a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:09.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75f0066470 msgr2=0x7f75f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f76141df640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75f0066470 0x7f75f0068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f760c156d80 tx=0x7f75fc008040 comp rx=0 tx=0).stop 2023-11-26T07:18:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f760c06c4c0 msgr2=0x7f760c162170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f76141df640 1 --2- 172.21.15.70:0/4028189168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f760c06c4c0 0x7f760c162170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f75f8005770 tx=0x7f75f8005800 comp rx=0 tx=0).stop 2023-11-26T07:18:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.951+0000 7f761277c640 1 -- 172.21.15.70:0/4028189168 reap_dead start 2023-11-26T07:18:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.955+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 shutdown_connections 2023-11-26T07:18:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.955+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 >> 172.21.15.70:0/4028189168 conn(0x7f760c08cc60 msgr2=0x7f760c0c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:09.980 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2023-11-26T07:18:09.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-26T07:18:09.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.955+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 shutdown_connections 2023-11-26T07:18:09.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:09.955+0000 7f76141df640 1 -- 172.21.15.70:0/4028189168 wait complete. 2023-11-26T07:18:09.981 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:09.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-26T07:18:09.982 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2023-11-26T07:18:09.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-26T07:18:09.983 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2023-11-26T07:18:09.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-26T07:18:09.984 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:09.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-26T07:18:09.986 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:09.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-26T07:18:09.989 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2023-11-26T07:18:09.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-26T07:18:09.991 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:09.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-26T07:18:10.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.207+0000 7f7957a68640 1 Processor -- start 2023-11-26T07:18:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.211+0000 7f7957a68640 1 -- start start 2023-11-26T07:18:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.211+0000 7f7957a68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f795015a440 0x7f79500b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.211+0000 7f7955804640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f795015a440 0x7f79500b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.211+0000 7f7955804640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f795015a440 0x7f79500b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53976/0 (socket says 172.21.15.70:53976) 2023-11-26T07:18:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.211+0000 7f7957a68640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500cc790 con 0x7f79500b0540 2023-11-26T07:18:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7957a68640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500b4ae0 con 0x7f79500cd4a0 2023-11-26T07:18:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7956005640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f79500cd4a0 0x7f79500b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40958/0 (socket says 172.21.15.70:40958) 2023-11-26T07:18:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7956005640 1 -- 172.21.15.70:0/2001127976 learned_addr learned my addr 172.21.15.70:0/2001127976 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7957a68640 1 -- 172.21.15.70:0/2001127976 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500cc9c0 con 0x7f795015a440 2023-11-26T07:18:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.211+0000 7fa529965640 1 Processor -- start 2023-11-26T07:18:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.211+0000 7fa529965640 1 -- start start 2023-11-26T07:18:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7fa529965640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa5240b4510 0x7fa5240b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7fa529965640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240cc800 con 0x7fa5240b3db0 2023-11-26T07:18:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7fa529965640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52414b380 con 0x7fa52414afa0 2023-11-26T07:18:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7fa529965640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5240b4230 con 0x7fa5240b4510 2023-11-26T07:18:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7fa5237fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa5240b3db0 0x7fa5240ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34384/0 (socket says 172.21.15.70:34384) 2023-11-26T07:18:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7fa5237fe640 1 -- 172.21.15.70:0/1837172007 learned_addr learned my addr 172.21.15.70:0/1837172007 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7955804640 1 -- 172.21.15.70:0/2001127976 >> v1:172.21.15.120:6789/0 conn(0x7f79500cd4a0 legacy=0x7f79500b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7955804640 1 -- 172.21.15.70:0/2001127976 >> v1:172.21.15.70:6789/0 conn(0x7f79500b0540 legacy=0x7f795006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7954802640 1 -- 172.21.15.70:0/2001127976 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777109386 0 0) 0x7f79500cc790 con 0x7f79500b0540 2023-11-26T07:18:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.215+0000 7f7955804640 1 -- 172.21.15.70:0/2001127976 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500ccca0 con 0x7f795015a440 2023-11-26T07:18:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa5227fc640 1 --2- 172.21.15.70:0/1837172007 >> v2:172.21.15.120:3300/0 conn(0x7fa5240b4510 0x7fa5240b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918347359 0 0) 0x7fa5240cc800 con 0x7fa5240b3db0 2023-11-26T07:18:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c003530 con 0x7fa5240b3db0 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208148099 0 0) 0x7fa50c003530 con 0x7fa5240b3db0 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 >> v2:172.21.15.120:3300/0 conn(0x7fa5240b4510 msgr2=0x7fa5240b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 --2- 172.21.15.70:0/1837172007 >> v2:172.21.15.120:3300/0 conn(0x7fa5240b4510 0x7fa5240b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 >> v1:172.21.15.120:6789/0 conn(0x7fa52414afa0 legacy=0x7fa52406ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52406d510 con 0x7fa5240b3db0 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fa514001680 con 0x7fa5240b3db0 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 >> v1:172.21.15.70:6789/0 conn(0x7fa5240b3db0 legacy=0x7fa5240ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c003980 0x7fa50c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa50c0047d0 0x7fa50c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa50c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240b4230 con 0x7fa50c0047d0 2023-11-26T07:18:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00c0e0 con 0x7fa50c003980 2023-11-26T07:18:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00c2a0 con 0x7fa50c005190 2023-11-26T07:18:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa5237fe640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa50c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa5237fe640 1 -- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c003980 msgr2=0x7fa50c003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:18:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa5237fe640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c003980 0x7fa50c003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa5237fe640 1 -- 172.21.15.70:0/1837172007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa50c0047d0 msgr2=0x7fa50c004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-26T07:18:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa5237fe640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa50c0047d0 0x7fa50c004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.219+0000 7fa5237fe640 1 -- 172.21.15.70:0/1837172007 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52406d510 con 0x7fa50c005190 2023-11-26T07:18:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7955804640 1 --2- 172.21.15.70:0/2001127976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f795015a440 0x7f79500b3e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f79400097f0 tx=0x7f794001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1f21aca33db0bf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7954802640 1 -- 172.21.15.70:0/2001127976 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400ad640 con 0x7f795015a440 2023-11-26T07:18:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7954802640 1 -- 172.21.15.70:0/2001127976 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79400ad7a0 con 0x7f795015a440 2023-11-26T07:18:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7954802640 1 -- 172.21.15.70:0/2001127976 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400adb30 con 0x7f795015a440 2023-11-26T07:18:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7957a68640 1 -- 172.21.15.70:0/2001127976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f795015a440 msgr2=0x7f79500b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7957a68640 1 --2- 172.21.15.70:0/2001127976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f795015a440 0x7f79500b3e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f79400097f0 tx=0x7f794001c370 comp rx=0 tx=0).stop 2023-11-26T07:18:10.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7fe353108640 1 Processor -- start 2023-11-26T07:18:10.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7fe353108640 1 -- start start 2023-11-26T07:18:10.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7957a68640 1 -- 172.21.15.70:0/2001127976 shutdown_connections 2023-11-26T07:18:10.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7957a68640 1 --2- 172.21.15.70:0/2001127976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f795015a440 0x7f79500b3e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.223+0000 7f7957a68640 1 -- 172.21.15.70:0/2001127976 >> 172.21.15.70:0/2001127976 conn(0x7f79500aea10 msgr2=0x7f79500aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f7957a68640 1 -- 172.21.15.70:0/2001127976 shutdown_connections 2023-11-26T07:18:10.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa5237fe640 1 -- 172.21.15.70:0/1837172007 reap_dead start 2023-11-26T07:18:10.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f7957a68640 1 -- 172.21.15.70:0/2001127976 wait complete. 2023-11-26T07:18:10.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f4adabf8640 1 Processor -- start 2023-11-26T07:18:10.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f4adabf8640 1 -- start start 2023-11-26T07:18:10.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe353108640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe34c14b110 0x7fe34c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe353108640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe34c0b4150 0x7fe34c071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa5237fe640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa50c00b990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa51400c210 tx=0x7fa51401f3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5db5b7e793a447c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514005ae0 con 0x7fa50c005190 2023-11-26T07:18:10.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5140ab070 con 0x7fa50c005190 2023-11-26T07:18:10.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa521ffb640 1 -- 172.21.15.70:0/1837172007 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514007070 con 0x7fa50c005190 2023-11-26T07:18:10.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe353108640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c0b30a0 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe353108640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c070340 con 0x7fe34c14b110 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe353108640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c070620 con 0x7fe34c0b4150 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe3516a5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe34c0b4150 0x7fe34c071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe3516a5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe34c0b4150 0x7fe34c071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52414/0 (socket says 172.21.15.70:52414) 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe3516a5640 1 -- 172.21.15.70:0/3944828637 learned_addr learned my addr 172.21.15.70:0/3944828637 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe350ea4640 1 --2- 172.21.15.70:0/3944828637 >> v2:172.21.15.70:3300/0 conn(0x7fe34c14b110 0x7fe34c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa529965640 1 -- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 msgr2=0x7fa50c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa529965640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa50c00b990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa51400c210 tx=0x7fa51401f3b0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f7957a68640 1 Processor -- start 2023-11-26T07:18:10.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa529965640 1 -- 172.21.15.70:0/1837172007 shutdown_connections 2023-11-26T07:18:10.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f4adabf8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc04e730 0x7f4acc033990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f4adabf8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4acc038610 0x7f4acc0500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f4adabf8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc0505e0 con 0x7f4acc039e30 2023-11-26T07:18:10.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f4adabf8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc050cf0 con 0x7f4acc038610 2023-11-26T07:18:10.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f4adabf8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc050fd0 con 0x7f4acc04e730 2023-11-26T07:18:10.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa529965640 1 --2- 172.21.15.70:0/1837172007 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa50c00b990 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fa529965640 1 -- 172.21.15.70:0/1837172007 >> 172.21.15.70:0/1837172007 conn(0x7fa5240aea10 msgr2=0x7fa5240aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7f7957a68640 1 -- start start 2023-11-26T07:18:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe3516a5640 1 -- 172.21.15.70:0/3944828637 >> v2:172.21.15.70:3300/0 conn(0x7fe34c14b110 msgr2=0x7fe34c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe3516a5640 1 --2- 172.21.15.70:0/3944828637 >> v2:172.21.15.70:3300/0 conn(0x7fe34c14b110 0x7fe34c0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe3516a5640 1 -- 172.21.15.70:0/3944828637 >> v1:172.21.15.120:6789/0 conn(0x7fe34c0cc8f0 legacy=0x7fe34c0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.227+0000 7fe3516a5640 1 -- 172.21.15.70:0/3944828637 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c070900 con 0x7fe34c0b4150 2023-11-26T07:18:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad9bf6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc04e730 0x7f4acc033990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad93f5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4acc038610 0x7f4acc0500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad9bf6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc04e730 0x7f4acc033990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:53990/0 (socket says 172.21.15.70:53990) 2023-11-26T07:18:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad93f5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4acc038610 0x7f4acc0500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60080/0 (socket says 172.21.15.70:60080) 2023-11-26T07:18:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad93f5640 1 -- 172.21.15.70:0/2646723977 learned_addr learned my addr 172.21.15.70:0/2646723977 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ada3f7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4acc039e30 0x7f4acc03a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40976/0 (socket says 172.21.15.70:40976) 2023-11-26T07:18:10.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79500b0540 0x7f7950149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79500cd4a0 0x7f795014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f795015a440 0x7f795014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015f100 con 0x7f79500cd4a0 2023-11-26T07:18:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015f350 con 0x7f795015a440 2023-11-26T07:18:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795015f630 con 0x7f79500b0540 2023-11-26T07:18:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad93f5640 1 -- 172.21.15.70:0/2646723977 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc04e730 msgr2=0x7f4acc033990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad93f5640 1 --2- 172.21.15.70:0/2646723977 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc04e730 0x7f4acc033990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad93f5640 1 -- 172.21.15.70:0/2646723977 >> v1:172.21.15.120:6789/0 conn(0x7f4acc039e30 legacy=0x7f4acc03a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad8bf4640 1 -- 172.21.15.70:0/2646723977 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520199190 0 0) 0x7f4acc0505e0 con 0x7f4acc039e30 2023-11-26T07:18:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f795015a440 0x7f795014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f795015a440 0x7f795014b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52418/0 (socket says 172.21.15.70:52418) 2023-11-26T07:18:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 -- 172.21.15.70:0/4044622154 learned_addr learned my addr 172.21.15.70:0/4044622154 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7955003640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79500cd4a0 0x7f795014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad93f5640 1 -- 172.21.15.70:0/2646723977 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0512b0 con 0x7f4acc038610 2023-11-26T07:18:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 -- 172.21.15.70:0/4044622154 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79500b0540 msgr2=0x7f7950149f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:18:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79500b0540 0x7f7950149f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 -- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79500cd4a0 msgr2=0x7f795014f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79500cd4a0 0x7f795014f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 -- 172.21.15.70:0/4044622154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009420 con 0x7f795015a440 2023-11-26T07:18:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f4ad9bf6640 1 --2- 172.21.15.70:0/2646723977 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc04e730 0x7f4acc033990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7956005640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f795015a440 0x7f795014b160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f794c009e00 tx=0x7f794c00c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f79467fc640 1 -- 172.21.15.70:0/4044622154 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0078f0 con 0x7f795015a440 2023-11-26T07:18:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f79467fc640 1 -- 172.21.15.70:0/4044622154 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c007a50 con 0x7f795015a440 2023-11-26T07:18:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f79467fc640 1 -- 172.21.15.70:0/4044622154 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c007de0 con 0x7f795015a440 2023-11-26T07:18:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7fe3516a5640 1 --2- 172.21.15.70:0/3944828637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 0x7fe34c071100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0746e0 tx=0x7fe34401c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc7ef2a372dfa2e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795015f910 con 0x7f795015a440 2023-11-26T07:18:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.231+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795015fed0 con 0x7f795015a440 2023-11-26T07:18:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe34b7fe640 1 -- 172.21.15.70:0/3944828637 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5600 con 0x7fe34c0b4150 2023-11-26T07:18:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe34b7fe640 1 -- 172.21.15.70:0/3944828637 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0b2e90 con 0x7fe34c0b4150 2023-11-26T07:18:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe34b7fe640 1 -- 172.21.15.70:0/3944828637 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5600 con 0x7fe34c0b4150 2023-11-26T07:18:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79501600f0 con 0x7f795015a440 2023-11-26T07:18:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe353108640 1 -- 172.21.15.70:0/3944828637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 msgr2=0x7fe34c071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe353108640 1 --2- 172.21.15.70:0/3944828637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 0x7fe34c071100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0746e0 tx=0x7fe34401c7c0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe353108640 1 -- 172.21.15.70:0/3944828637 shutdown_connections 2023-11-26T07:18:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe353108640 1 --2- 172.21.15.70:0/3944828637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 0x7fe34c071100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe353108640 1 --2- 172.21.15.70:0/3944828637 >> v2:172.21.15.70:3300/0 conn(0x7fe34c14b110 0x7fe34c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fe353108640 1 -- 172.21.15.70:0/3944828637 >> 172.21.15.70:0/3944828637 conn(0x7fe34c06c3f0 msgr2=0x7fe34c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f4ad93f5640 1 --2- 172.21.15.70:0/2646723977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc038610 0x7f4acc0500a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009870 tx=0x7f4ac401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d27bc13c2cd2e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f79467fc640 1 -- 172.21.15.70:0/4044622154 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f794c009070 con 0x7f795015a440 2023-11-26T07:18:10.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f4ad8bf4640 1 -- 172.21.15.70:0/2646723977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40ad640 con 0x7f4acc038610 2023-11-26T07:18:10.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f4ad8bf4640 1 -- 172.21.15.70:0/2646723977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40ad7a0 con 0x7f4acc038610 2023-11-26T07:18:10.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f4ad8bf4640 1 -- 172.21.15.70:0/2646723977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40ad640 con 0x7f4acc038610 2023-11-26T07:18:10.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 -- 172.21.15.70:0/2646723977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc038610 msgr2=0x7f4acc0500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 --2- 172.21.15.70:0/2646723977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc038610 0x7f4acc0500a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009870 tx=0x7f4ac401c480 comp rx=0 tx=0).stop 2023-11-26T07:18:10.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fe353108640 1 -- 172.21.15.70:0/3944828637 shutdown_connections 2023-11-26T07:18:10.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fa529965640 1 -- 172.21.15.70:0/1837172007 shutdown_connections 2023-11-26T07:18:10.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7fa529965640 1 -- 172.21.15.70:0/1837172007 wait complete. 2023-11-26T07:18:10.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f57e25c3640 1 Processor -- start 2023-11-26T07:18:10.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.235+0000 7f57e25c3640 1 -- start start 2023-11-26T07:18:10.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f79467fc640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f79340664c0 0x7f7934068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f79467fc640 1 -- 172.21.15.70:0/4044622154 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f794c0861c0 con 0x7f795015a440 2023-11-26T07:18:10.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 -- 172.21.15.70:0/2646723977 shutdown_connections 2023-11-26T07:18:10.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 --2- 172.21.15.70:0/2646723977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc038610 0x7f4acc0500a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 --2- 172.21.15.70:0/2646723977 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc04e730 0x7f4acc033990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 Processor -- start 2023-11-26T07:18:10.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 -- 172.21.15.70:0/2646723977 >> 172.21.15.70:0/2646723977 conn(0x7f4acc009f90 msgr2=0x7f4acc00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f7955804640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f79340664c0 0x7f7934068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 -- start start 2023-11-26T07:18:10.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 -- 172.21.15.70:0/2646723977 shutdown_connections 2023-11-26T07:18:10.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f7955804640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f79340664c0 0x7f7934068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f79400af000 tx=0x7f79400a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fe353108640 1 -- 172.21.15.70:0/3944828637 wait complete. 2023-11-26T07:18:10.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f57e25c3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f57dc153780 0x7f57dc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f91e8372640 1 Processor -- start 2023-11-26T07:18:10.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa5241e9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5241fa870 0x7fa5241f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f57e25c3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc159eb0 con 0x7f57dc0724a0 2023-11-26T07:18:10.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f91e8372640 1 -- start start 2023-11-26T07:18:10.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f4adabf8640 1 -- 172.21.15.70:0/2646723977 wait complete. 2023-11-26T07:18:10.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5241facf0 0x7fa5241f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241ea120 con 0x7fa5241fa870 2023-11-26T07:18:10.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241ea3d0 con 0x7fa5241facf0 2023-11-26T07:18:10.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa529965640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241ea6b0 con 0x7fa50c005190 2023-11-26T07:18:10.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f57e25c3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc15a720 con 0x7f57dc0b2f20 2023-11-26T07:18:10.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f57e15c1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f57dc153780 0x7f57dc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f57e15c1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f57dc153780 0x7f57dc15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52426/0 (socket says 172.21.15.70:52426) 2023-11-26T07:18:10.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f57e15c1640 1 -- 172.21.15.70:0/3928379109 learned_addr learned my addr 172.21.15.70:0/3928379109 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7f57e25c3640 1 -- 172.21.15.70:0/3928379109 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc15a160 con 0x7f57dc153780 2023-11-26T07:18:10.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa5227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5241fa870 0x7fa5241f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa5227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5241fa870 0x7fa5241f6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60092/0 (socket says 172.21.15.70:60092) 2023-11-26T07:18:10.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa5227fc640 1 -- 172.21.15.70:0/1922476729 learned_addr learned my addr 172.21.15.70:0/1922476729 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.239+0000 7fa5237fe640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5241facf0 0x7fa5241f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa522ffd640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa5241e9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 Processor -- start 2023-11-26T07:18:10.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f57e15c1640 1 -- 172.21.15.70:0/3928379109 >> v1:172.21.15.120:6789/0 conn(0x7f57dc0b2f20 legacy=0x7f57dc0cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f57e15c1640 1 -- 172.21.15.70:0/3928379109 >> v1:172.21.15.70:6789/0 conn(0x7f57dc0724a0 legacy=0x7f57dc1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f57e15c1640 1 -- 172.21.15.70:0/3928379109 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc15a440 con 0x7f57dc153780 2023-11-26T07:18:10.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 -- start start 2023-11-26T07:18:10.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 Processor -- start 2023-11-26T07:18:10.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa522ffd640 1 -- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5241facf0 msgr2=0x7fa5241f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 -- start start 2023-11-26T07:18:10.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e8372640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f91e00b1710 0x7f91e006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa522ffd640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5241facf0 0x7fa5241f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa522ffd640 1 -- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5241fa870 msgr2=0x7fa5241f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa522ffd640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5241fa870 0x7fa5241f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e8372640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91e00ce310 0x7f91e0159170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e8372640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e0070370 0x7f91e00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f79467fc640 1 -- 172.21.15.70:0/4044622154 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f794c0537b0 con 0x7f795015a440 2023-11-26T07:18:10.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e590d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91e00ce310 0x7f91e0159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e590d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91e00ce310 0x7f91e0159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52440/0 (socket says 172.21.15.70:52440) 2023-11-26T07:18:10.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e590d640 1 -- 172.21.15.70:0/2245711971 learned_addr learned my addr 172.21.15.70:0/2245711971 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc038610 0x7f4acc0d3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc039e30 0x7f4acc0dbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa522ffd640 1 -- 172.21.15.70:0/1922476729 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5241ea990 con 0x7fa50c005190 2023-11-26T07:18:10.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e690f640 1 --2- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e0070370 0x7f91e00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e610e640 1 --2- 172.21.15.70:0/2245711971 >> v2:172.21.15.70:3300/0 conn(0x7f91e00b1710 0x7f91e006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e00cb0e0 con 0x7f91e00b1710 2023-11-26T07:18:10.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e006cf30 con 0x7f91e00ce310 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00cb2f0 con 0x7f91e0070370 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4ad9bf6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc038610 0x7f4acc0d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4ad9bf6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc038610 0x7f4acc0d3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:54016/0 (socket says 172.21.15.70:54016) 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4ad9bf6640 1 -- 172.21.15.70:0/543736939 learned_addr learned my addr 172.21.15.70:0/543736939 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4ad93f5640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc039e30 0x7f4acc0dbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0eb650 0x7f4acc0525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0db880 con 0x7f4acc0eb650 2023-11-26T07:18:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0e3240 con 0x7f4acc039e30 2023-11-26T07:18:10.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 0x7fe34c14a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34c0cc8f0 0x7fe34c1469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe34c14b110 0x7fe34c163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c1417a0 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c149c70 con 0x7fe34c0b4150 2023-11-26T07:18:10.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fe353108640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c149060 con 0x7fe34c14b110 2023-11-26T07:18:10.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa522ffd640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa5241e9be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c730 tx=0x7fa51c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0e3520 con 0x7f4acc038610 2023-11-26T07:18:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4ad93f5640 1 -- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc038610 msgr2=0x7f4acc0d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7f4ad93f5640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc038610 0x7f4acc0d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4ad93f5640 1 -- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0eb650 msgr2=0x7f4acc0525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4ad93f5640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0eb650 0x7f4acc0525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4ad93f5640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad404edd0 con 0x7f4acc039e30 2023-11-26T07:18:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f91e590d640 1 -- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e0070370 msgr2=0x7f91e00707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4ad93f5640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc039e30 0x7f4acc0dbfb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40ac000 tx=0x7f4ac4019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f91e590d640 1 --2- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e0070370 0x7f91e00707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f91e590d640 1 -- 172.21.15.70:0/2245711971 >> v2:172.21.15.70:3300/0 conn(0x7f91e00b1710 msgr2=0x7f91e006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f91e590d640 1 --2- 172.21.15.70:0/2245711971 >> v2:172.21.15.70:3300/0 conn(0x7f91e00b1710 0x7f91e006d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f91e590d640 1 -- 172.21.15.70:0/2245711971 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00cb5d0 con 0x7f91e00ce310 2023-11-26T07:18:10.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4aca7fc640 1 -- 172.21.15.70:0/543736939 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40bc070 con 0x7f4acc039e30 2023-11-26T07:18:10.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34c0cc8f0 0x7fe34c1469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34c0cc8f0 0x7fe34c1469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60126/0 (socket says 172.21.15.70:60126) 2023-11-26T07:18:10.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 -- 172.21.15.70:0/3007768179 learned_addr learned my addr 172.21.15.70:0/3007768179 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57e15c1640 1 --2- 172.21.15.70:0/3928379109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc153780 0x7f57dc15d630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57d40096b0 tx=0x7f57d401ddb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f957989b666d8159 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4aca7fc640 1 -- 172.21.15.70:0/543736939 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40a6040 con 0x7f4acc039e30 2023-11-26T07:18:10.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 -- 172.21.15.70:0/3007768179 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe34c14b110 msgr2=0x7fe34c163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe34c14b110 0x7fe34c163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 -- 172.21.15.70:0/3007768179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 msgr2=0x7fe34c14a100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:18:10.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 0x7fe34c14a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 -- 172.21.15.70:0/3007768179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344009b30 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe34bfff640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34c0cc8f0 0x7fe34c1469c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c750 tx=0x7fe33c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57d3fff640 1 -- 172.21.15.70:0/3928379109 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d40a6c70 con 0x7f57dc153780 2023-11-26T07:18:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57d3fff640 1 -- 172.21.15.70:0/3928379109 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d40a6dd0 con 0x7f57dc153780 2023-11-26T07:18:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57d3fff640 1 -- 172.21.15.70:0/3928379109 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d40ae610 con 0x7f57dc153780 2023-11-26T07:18:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4aca7fc640 1 -- 172.21.15.70:0/543736939 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4003620 con 0x7f4acc039e30 2023-11-26T07:18:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57e25c3640 1 -- 172.21.15.70:0/3928379109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc153780 msgr2=0x7f57dc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57e25c3640 1 --2- 172.21.15.70:0/3928379109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc153780 0x7f57dc15d630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57d40096b0 tx=0x7f57d401ddb0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac40094d0 con 0x7f4acc039e30 2023-11-26T07:18:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc0dba90 con 0x7f4acc039e30 2023-11-26T07:18:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa50bfff640 1 -- 172.21.15.70:0/1922476729 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c003b80 con 0x7fa50c005190 2023-11-26T07:18:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa50bfff640 1 -- 172.21.15.70:0/1922476729 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c003ce0 con 0x7fa50c005190 2023-11-26T07:18:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa50bfff640 1 -- 172.21.15.70:0/1922476729 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00aa90 con 0x7fa50c005190 2023-11-26T07:18:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa529965640 1 -- 172.21.15.70:0/1922476729 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5241eac70 con 0x7fa50c005190 2023-11-26T07:18:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.243+0000 7fa529965640 1 -- 172.21.15.70:0/1922476729 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5241eb470 con 0x7fa50c005190 2023-11-26T07:18:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa524067500 con 0x7fa50c005190 2023-11-26T07:18:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57e25c3640 1 -- 172.21.15.70:0/3928379109 shutdown_connections 2023-11-26T07:18:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57e25c3640 1 --2- 172.21.15.70:0/3928379109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc153780 0x7f57dc15d630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7f57e25c3640 1 -- 172.21.15.70:0/3928379109 >> 172.21.15.70:0/3928379109 conn(0x7f57dc0b0b10 msgr2=0x7f57dc0b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.247+0000 7fe3497fa640 1 -- 172.21.15.70:0/3007768179 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c005270 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fe3497fa640 1 -- 172.21.15.70:0/3007768179 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c0053d0 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fe3497fa640 1 -- 172.21.15.70:0/3007768179 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c00a840 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c149340 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c149900 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc0dbc80 con 0x7f4acc039e30 2023-11-26T07:18:10.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e590d640 1 --2- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e00ce310 0x7f91e0159170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91e00b1bb0 tx=0x7f91d401e670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f37be8cf49f7465f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c005260 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f57e25c3640 1 -- 172.21.15.70:0/3928379109 shutdown_connections 2023-11-26T07:18:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e510c640 1 -- 172.21.15.70:0/2245711971 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d40aa660 con 0x7f91e00ce310 2023-11-26T07:18:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e510c640 1 -- 172.21.15.70:0/2245711971 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d40aa7c0 con 0x7f91e00ce310 2023-11-26T07:18:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e510c640 1 -- 172.21.15.70:0/2245711971 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d40aab50 con 0x7f91e00ce310 2023-11-26T07:18:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e00ce310 msgr2=0x7f91e0159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e8372640 1 --2- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e00ce310 0x7f91e0159170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91e00b1bb0 tx=0x7f91d401e670 comp rx=0 tx=0).stop 2023-11-26T07:18:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 shutdown_connections 2023-11-26T07:18:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e8372640 1 --2- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e0070370 0x7f91e00707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e8372640 1 --2- 172.21.15.70:0/2245711971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e00ce310 0x7f91e0159170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e8372640 1 --2- 172.21.15.70:0/2245711971 >> v2:172.21.15.70:3300/0 conn(0x7f91e00b1710 0x7f91e006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 >> 172.21.15.70:0/2245711971 conn(0x7f91e00b0bf0 msgr2=0x7f91e00b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f4aca7fc640 1 -- 172.21.15.70:0/543736939 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ac4003780 con 0x7f4acc039e30 2023-11-26T07:18:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f4aca7fc640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4ab8066540 0x7f4ab8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f4aca7fc640 1 -- 172.21.15.70:0/543736939 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ac411e1a0 con 0x7f4acc039e30 2023-11-26T07:18:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f4ad9bf6640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4ab8066540 0x7f4ab8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fa50bfff640 1 -- 172.21.15.70:0/1922476729 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa51c00abf0 con 0x7fa50c005190 2023-11-26T07:18:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fa50bfff640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5100664c0 0x7fa510068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7f57e25c3640 1 -- 172.21.15.70:0/3928379109 wait complete. 2023-11-26T07:18:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 Processor -- start 2023-11-26T07:18:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 -- start start 2023-11-26T07:18:10.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f4ad9bf6640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4ab8066540 0x7f4ab8068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4068c10 tx=0x7f4ad404f230 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f57dc0724a0 0x7f57dc13ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc0b2f20 0x7f57dc13a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc153780 0x7f57dc14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc14b120 con 0x7f57dc153780 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc13aba0 con 0x7f57dc0b2f20 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e25c3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc14f170 con 0x7f57dc0724a0 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc0b2f20 0x7f57dc13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc0b2f20 0x7f57dc13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52466/0 (socket says 172.21.15.70:52466) 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 -- 172.21.15.70:0/580888742 learned_addr learned my addr 172.21.15.70:0/580888742 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e1dc2640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc153780 0x7f57dc14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e15c1640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f57dc0724a0 0x7f57dc13ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 -- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f57dc0724a0 msgr2=0x7f57dc13ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f57dc0724a0 0x7f57dc13ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 -- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc153780 msgr2=0x7f57dc14e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc153780 0x7f57dc14e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7f57e0dc0640 1 -- 172.21.15.70:0/580888742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d400c3d0 con 0x7f57dc0b2f20 2023-11-26T07:18:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.251+0000 7fa50bfff640 1 -- 172.21.15.70:0/1922476729 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa51c084670 con 0x7fa50c005190 2023-11-26T07:18:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.255+0000 7fa50bfff640 1 -- 172.21.15.70:0/1922476729 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa51c051b80 con 0x7fa50c005190 2023-11-26T07:18:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7fe3497fa640 1 -- 172.21.15.70:0/3007768179 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe33c00a9a0 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f57e1dc2640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc153780 0x7f57dc14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:10.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 shutdown_connections 2023-11-26T07:18:10.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f91e8372640 1 -- 172.21.15.70:0/2245711971 wait complete. 2023-11-26T07:18:10.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f4aca7fc640 1 -- 172.21.15.70:0/543736939 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ac40eb690 con 0x7f4acc039e30 2023-11-26T07:18:10.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7fe3497fa640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe3380664a0 0x7fe338068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7fe3497fa640 1 -- 172.21.15.70:0/3007768179 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe33c083940 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f57e0dc0640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc0b2f20 0x7f57dc13a660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c390 tx=0x7f57d800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f57d1ffb640 1 -- 172.21.15.70:0/580888742 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80052d0 con 0x7f57dc0b2f20 2023-11-26T07:18:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f91e8372640 1 Processor -- start 2023-11-26T07:18:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7fa5227fc640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5100664c0 0x7fa510068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7fe350ea4640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe3380664a0 0x7fe338068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7fa5227fc640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5100664c0 0x7fa510068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5241f8150 tx=0x7fa518008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7fe350ea4640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe3380664a0 0x7fe338068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe34000b7f0 tx=0x7fe340008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7f91e8372640 1 -- start start 2023-11-26T07:18:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7f91e8372640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91e0070370 0x7f91e0150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f57d1ffb640 1 -- 172.21.15.70:0/580888742 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8005430 con 0x7f57dc0b2f20 2023-11-26T07:18:10.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.259+0000 7f57d1ffb640 1 -- 172.21.15.70:0/580888742 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8003820 con 0x7f57dc0b2f20 2023-11-26T07:18:10.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc14f450 con 0x7f57dc0b2f20 2023-11-26T07:18:10.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.263+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc14fa10 con 0x7f57dc0b2f20 2023-11-26T07:18:10.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e610e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91e0070370 0x7f91e0150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e610e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91e0070370 0x7f91e0150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60154/0 (socket says 172.21.15.70:60154) 2023-11-26T07:18:10.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e610e640 1 -- 172.21.15.70:0/2327307109 learned_addr learned my addr 172.21.15.70:0/2327307109 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e00b1710 0x7f91e014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7fe3497fa640 1 -- 172.21.15.70:0/3007768179 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe33c050e50 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e014c500 0x7f91e0205830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e590d640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e00b1710 0x7f91e014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00a84d0 con 0x7f91e0070370 2023-11-26T07:18:10.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e690f640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e014c500 0x7f91e0205830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc072310 con 0x7f57dc0b2f20 2023-11-26T07:18:10.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01ec060 con 0x7f91e014c500 2023-11-26T07:18:10.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01ec2b0 con 0x7f91e00b1710 2023-11-26T07:18:10.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e690f640 1 -- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e00b1710 msgr2=0x7f91e014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e690f640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e00b1710 0x7f91e014bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e690f640 1 -- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91e0070370 msgr2=0x7f91e0150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e690f640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91e0070370 0x7f91e0150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e690f640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40094d0 con 0x7f91e014c500 2023-11-26T07:18:10.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f57d1ffb640 1 -- 172.21.15.70:0/580888742 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57d8003980 con 0x7f57dc0b2f20 2023-11-26T07:18:10.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.267+0000 7f91e690f640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e014c500 0x7f91e0205830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e7f0 tx=0x7f91d800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f57d1ffb640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f57c0066540 0x7f57c0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f57d1ffb640 1 -- 172.21.15.70:0/580888742 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57d80832d0 con 0x7f57dc0b2f20 2023-11-26T07:18:10.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f57e15c1640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f57c0066540 0x7f57c0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f57e15c1640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f57c0066540 0x7f57c0068a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57d40af000 tx=0x7f57d40a8070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f91deffd640 1 -- 172.21.15.70:0/2327307109 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800eea0 con 0x7f91e014c500 2023-11-26T07:18:10.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.275+0000 7f57d1ffb640 1 -- 172.21.15.70:0/580888742 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57d8050870 con 0x7f57dc0b2f20 2023-11-26T07:18:10.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f91deffd640 1 -- 172.21.15.70:0/2327307109 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d800c940 con 0x7f91e014c500 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f91deffd640 1 -- 172.21.15.70:0/2327307109 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800eea0 con 0x7f91e014c500 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.271+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e01ec590 con 0x7f91e014c500 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.275+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e01ecb50 con 0x7f91e014c500 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.279+0000 7f91deffd640 1 -- 172.21.15.70:0/2327307109 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91d800cab0 con 0x7f91e014c500 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.279+0000 7f91deffd640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f91cc0664d0 0x7f91cc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.279+0000 7f91deffd640 1 -- 172.21.15.70:0/2327307109 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91d80837c0 con 0x7f91e014c500 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.279+0000 7f91e610e640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f91cc0664d0 0x7f91cc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.283+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e00cfd80 con 0x7f91e014c500 2023-11-26T07:18:10.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.283+0000 7f91e610e640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f91cc0664d0 0x7f91cc068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91d0003b90 tx=0x7f91d00098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.291+0000 7f91deffd640 1 -- 172.21.15.70:0/2327307109 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91d8050c50 con 0x7f91e014c500 2023-11-26T07:18:10.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.295+0000 7f0e8589a640 1 Processor -- start 2023-11-26T07:18:10.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.295+0000 7f0e8589a640 1 -- start start 2023-11-26T07:18:10.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.295+0000 7f0e8589a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0e800cf310 0x7f0e800c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.295+0000 7f0e8589a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e80162550 con 0x7f0e800ce440 2023-11-26T07:18:10.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.295+0000 7f0e8589a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800d1b40 con 0x7f0e801629e0 2023-11-26T07:18:10.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.295+0000 7f0e8589a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e800d1e20 con 0x7f0e800cf310 2023-11-26T07:18:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.295+0000 7f0e7effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0e800cf310 0x7f0e800c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7e7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0e801629e0 0x7f0e800cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:40992/0 (socket says 172.21.15.70:40992) 2023-11-26T07:18:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7e7fc640 1 -- 172.21.15.70:0/32578337 learned_addr learned my addr 172.21.15.70:0/32578337 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151078432 0 0) 0x7f0e800d1b40 con 0x7f0e801629e0 2023-11-26T07:18:10.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e68003530 con 0x7f0e801629e0 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 <== mon.1 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2801068923 0 0) 0x7f0e68003530 con 0x7f0e801629e0 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 >> v2:172.21.15.70:3300/0 conn(0x7f0e800cf310 msgr2=0x7f0e800c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 --2- 172.21.15.70:0/32578337 >> v2:172.21.15.70:3300/0 conn(0x7f0e800cf310 0x7f0e800c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 >> v1:172.21.15.70:6789/0 conn(0x7f0e800ce440 legacy=0x7f0e80165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e801621e0 con 0x7f0e801629e0 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 <== mon.1 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f0e74001680 con 0x7f0e801629e0 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 >> v1:172.21.15.120:6789/0 conn(0x7f0e801629e0 legacy=0x7f0e800cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68003980 0x7f0e68003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e680047d0 0x7f0e68004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800d1e20 con 0x7f0e68003980 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6800c030 con 0x7f0e68005190 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6800c1f0 con 0x7f0e680047d0 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7e7fc640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e680047d0 0x7f0e68004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7f7fe640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7f7fe640 1 -- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e680047d0 msgr2=0x7f0e68004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7f7fe640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e680047d0 0x7f0e68004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7f7fe640 1 -- 172.21.15.70:0/32578337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68003980 msgr2=0x7f0e68003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7f7fe640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68003980 0x7f0e68003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7f7fe640 1 -- 172.21.15.70:0/32578337 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e801621e0 con 0x7f0e68005190 2023-11-26T07:18:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.299+0000 7f0e7e7fc640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e680047d0 0x7f0e68004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.303+0000 7f00d9df8640 1 Processor -- start 2023-11-26T07:18:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.303+0000 7f0e7f7fe640 1 -- 172.21.15.70:0/32578337 reap_dead start 2023-11-26T07:18:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.303+0000 7f00d9df8640 1 -- start start 2023-11-26T07:18:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.303+0000 7f0e7f7fe640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e6800b990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e78001e70 tx=0x7f0e7801c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b2659fdd93fc18 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78003b80 con 0x7f0e68005190 2023-11-26T07:18:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78003d20 con 0x7f0e68005190 2023-11-26T07:18:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e7dffb640 1 -- 172.21.15.70:0/32578337 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78005310 con 0x7f0e68005190 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e8589a640 1 -- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 msgr2=0x7f0e6800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e8589a640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e6800b990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0e78001e70 tx=0x7f0e7801c760 comp rx=0 tx=0).stop 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d9df8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc0336e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d9df8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00cc050760 0x7f00cc006700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d9df8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f00cc006c40 0x7f00cc0e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d9df8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc0070d0 con 0x7f00cc050760 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d9df8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc038500 con 0x7f00cc006c40 2023-11-26T07:18:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d9df8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc052cd0 con 0x7f00cc0df7b0 2023-11-26T07:18:10.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e8589a640 1 -- 172.21.15.70:0/32578337 shutdown_connections 2023-11-26T07:18:10.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e8589a640 1 --2- 172.21.15.70:0/32578337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e6800b990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e8589a640 1 -- 172.21.15.70:0/32578337 >> 172.21.15.70:0/32578337 conn(0x7f0e8009c550 msgr2=0x7f0e800d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e8589a640 1 -- 172.21.15.70:0/32578337 shutdown_connections 2023-11-26T07:18:10.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f0e8589a640 1 -- 172.21.15.70:0/32578337 wait complete. 2023-11-26T07:18:10.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f00cc006c40 0x7f00cc0e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f00cc006c40 0x7f00cc0e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52502/0 (socket says 172.21.15.70:52502) 2023-11-26T07:18:10.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 -- 172.21.15.70:0/2962686378 learned_addr learned my addr 172.21.15.70:0/2962686378 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d8df6640 1 --2- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc0336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d3fff640 1 --2- 172.21.15.70:0/2962686378 >> v2:172.21.15.70:3300/0 conn(0x7f00cc050760 0x7f00cc006700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 -- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 msgr2=0x7f00cc0336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 --2- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc0336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 -- 172.21.15.70:0/2962686378 >> v2:172.21.15.70:3300/0 conn(0x7f00cc050760 msgr2=0x7f00cc006700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 --2- 172.21.15.70:0/2962686378 >> v2:172.21.15.70:3300/0 conn(0x7f00cc050760 0x7f00cc006700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d95f7640 1 -- 172.21.15.70:0/2962686378 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc033fe0 con 0x7f00cc006c40 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d8df6640 1 --2- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc0336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.307+0000 7f00d3fff640 1 --2- 172.21.15.70:0/2962686378 >> v2:172.21.15.70:3300/0 conn(0x7f00cc050760 0x7f00cc006700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:10.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.311+0000 7f0e8589a640 1 Processor -- start 2023-11-26T07:18:10.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.311+0000 7f0e8589a640 1 -- start start 2023-11-26T07:18:10.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.311+0000 7f0e8589a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e801549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.311+0000 7f0e8589a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e80152bd0 0x7f0e80154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.311+0000 7f0e8589a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e800b8530 0x7f0e800b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e8589a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80151880 con 0x7f0e80152bd0 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e8589a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80150c70 con 0x7f0e68005190 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e80152bd0 0x7f0e80154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e8589a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80150f50 con 0x7f0e800b8530 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e801549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e801549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52510/0 (socket says 172.21.15.70:52510) 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 -- 172.21.15.70:0/626703248 learned_addr learned my addr 172.21.15.70:0/626703248 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7f7fe640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e800b8530 0x7f0e800b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 -- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e800b8530 msgr2=0x7f0e800b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e800b8530 0x7f0e800b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 -- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e80152bd0 msgr2=0x7f0e80154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e80152bd0 0x7f0e80154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 -- 172.21.15.70:0/626703248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80151230 con 0x7f0e68005190 2023-11-26T07:18:10.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e7effd640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e801549b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000e7c0 tx=0x7f0e7000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e67fff640 1 -- 172.21.15.70:0/626703248 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000ee70 con 0x7f0e68005190 2023-11-26T07:18:10.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f00d95f7640 1 --2- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0e31b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00c8006fd0 tx=0x7f00c801e8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4993f9be7d93fea3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e80151510 con 0x7f0e68005190 2023-11-26T07:18:10.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e800c65e0 con 0x7f0e68005190 2023-11-26T07:18:10.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e67fff640 1 -- 172.21.15.70:0/626703248 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7000c940 con 0x7f0e68005190 2023-11-26T07:18:10.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f0e67fff640 1 -- 172.21.15.70:0/626703248 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000ee70 con 0x7f0e68005190 2023-11-26T07:18:10.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f00d37fe640 1 -- 172.21.15.70:0/2962686378 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004230 con 0x7f00cc006c40 2023-11-26T07:18:10.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f00d37fe640 1 -- 172.21.15.70:0/2962686378 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c80ab070 con 0x7f00cc006c40 2023-11-26T07:18:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.315+0000 7f00d37fe640 1 -- 172.21.15.70:0/2962686378 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80a7700 con 0x7f00cc006c40 2023-11-26T07:18:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 -- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 msgr2=0x7f00cc0e31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 --2- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0e31b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00c8006fd0 tx=0x7f00c801e8f0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 -- 172.21.15.70:0/2962686378 shutdown_connections 2023-11-26T07:18:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 --2- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0e31b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 --2- 172.21.15.70:0/2962686378 >> v2:172.21.15.70:3300/0 conn(0x7f00cc050760 0x7f00cc006700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 --2- 172.21.15.70:0/2962686378 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc0336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 -- 172.21.15.70:0/2962686378 >> 172.21.15.70:0/2962686378 conn(0x7f00cc009f90 msgr2=0x7f00cc00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 -- 172.21.15.70:0/2962686378 shutdown_connections 2023-11-26T07:18:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f00d9df8640 1 -- 172.21.15.70:0/2962686378 wait complete. 2023-11-26T07:18:10.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e60005260 con 0x7f0e68005190 2023-11-26T07:18:10.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f0e67fff640 1 -- 172.21.15.70:0/626703248 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e7000cab0 con 0x7f0e68005190 2023-11-26T07:18:10.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.319+0000 7f0e67fff640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0e6c066500 0x7f0e6c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d9df8640 1 Processor -- start 2023-11-26T07:18:10.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f0e67fff640 1 -- 172.21.15.70:0/626703248 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e70083a50 con 0x7f0e68005190 2023-11-26T07:18:10.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d9df8640 1 -- start start 2023-11-26T07:18:10.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d9df8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d9df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00cc050760 0x7f00cc048760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d8df6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d8df6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52518/0 (socket says 172.21.15.70:52518) 2023-11-26T07:18:10.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d9df8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc04a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f0e67fff640 1 -- 172.21.15.70:0/626703248 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e70050f70 con 0x7f0e68005190 2023-11-26T07:18:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00cc050760 0x7f00cc048760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.323+0000 7f00d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00cc050760 0x7f00cc048760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60204/0 (socket says 172.21.15.70:60204) 2023-11-26T07:18:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d9df8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc0ca430 con 0x7f00cc050760 2023-11-26T07:18:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d9df8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc04d1b0 con 0x7f00cc006c40 2023-11-26T07:18:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d9df8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc04d490 con 0x7f00cc0df7b0 2023-11-26T07:18:10.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc04a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f0e7e7fc640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0e6c066500 0x7f0e6c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f0e7e7fc640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0e6c066500 0x7f0e6c0689c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e74007fd0 tx=0x7f0e74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc04a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:54084/0 (socket says 172.21.15.70:54084) 2023-11-26T07:18:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 -- 172.21.15.70:0/1932450660 learned_addr learned my addr 172.21.15.70:0/1932450660 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 -- 172.21.15.70:0/1932450660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 msgr2=0x7f00cc0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 -- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00cc050760 msgr2=0x7f00cc048760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00cc050760 0x7f00cc048760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 -- 172.21.15.70:0/1932450660 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d404edd0 con 0x7f00cc0df7b0 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d95f7640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc04a2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00c8006fd0 tx=0x7f00c801b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d17fa640 1 -- 172.21.15.70:0/1932450660 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80a89a0 con 0x7f00cc0df7b0 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d17fa640 1 -- 172.21.15.70:0/1932450660 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c80a8b00 con 0x7f00cc0df7b0 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d17fa640 1 -- 172.21.15.70:0/1932450660 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80a8e90 con 0x7f00cc0df7b0 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c800b780 con 0x7f00cc0df7b0 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc034db0 con 0x7f00cc0df7b0 2023-11-26T07:18:10.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.327+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc0089b0 con 0x7f00cc0df7b0 2023-11-26T07:18:10.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.331+0000 7f00d17fa640 1 -- 172.21.15.70:0/1932450660 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00c8003620 con 0x7f00cc0df7b0 2023-11-26T07:18:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.331+0000 7f00d17fa640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f00b8066470 0x7f00b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:10.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.331+0000 7f00d8df6640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f00b8066470 0x7f00b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.335+0000 7f00d8df6640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f00b8066470 0x7f00b8068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00d404f6a0 tx=0x7f00d404f230 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.335+0000 7f00d17fa640 1 -- 172.21.15.70:0/1932450660 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00c812ef80 con 0x7f00cc0df7b0 2023-11-26T07:18:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.339+0000 7f00d17fa640 1 -- 172.21.15.70:0/1932450660 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00c80fc660 con 0x7f00cc0df7b0 2023-11-26T07:18:10.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.583+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7950067500 con 0x7f795015a440 2023-11-26T07:18:10.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.583+0000 7f79467fc640 1 -- 172.21.15.70:0/4044622154 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f794c056dd0 con 0x7f795015a440 2023-11-26T07:18:10.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.583+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe32c0057e0 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.585 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2023-11-26T07:18:10.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.583+0000 7fe3497fa640 1 -- 172.21.15.70:0/3007768179 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe33c017090 con 0x7fe34c0cc8f0 2023-11-26T07:18:10.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f79340664c0 msgr2=0x7f7934068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f79340664c0 0x7f7934068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f79400af000 tx=0x7f79400a7070 comp rx=0 tx=0).stop 2023-11-26T07:18:10.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f795015a440 msgr2=0x7f795014b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f795015a440 0x7f795014b160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f794c009e00 tx=0x7f794c00c430 comp rx=0 tx=0).stop 2023-11-26T07:18:10.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 shutdown_connections 2023-11-26T07:18:10.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f79340664c0 0x7f7934068980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79500cd4a0 0x7f795014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f795015a440 0x7f795014b160 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 --2- 172.21.15.70:0/4044622154 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79500b0540 0x7f7950149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 >> 172.21.15.70:0/4044622154 conn(0x7f79500aea10 msgr2=0x7f7950153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 shutdown_connections 2023-11-26T07:18:10.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f7957a68640 1 -- 172.21.15.70:0/4044622154 wait complete. 2023-11-26T07:18:10.590 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:10.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f57dc0cbbb0 con 0x7f57dc0b2f20 2023-11-26T07:18:10.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f57d1ffb640 1 -- 172.21.15.70:0/580888742 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57dc0cbbb0 con 0x7f57dc0b2f20 2023-11-26T07:18:10.591 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2023-11-26T07:18:10.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe3380664a0 msgr2=0x7fe338068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe3380664a0 0x7fe338068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe34000b7f0 tx=0x7fe340008040 comp rx=0 tx=0).stop 2023-11-26T07:18:10.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34c0cc8f0 msgr2=0x7fe34c1469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34c0cc8f0 0x7fe34c1469c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c750 tx=0x7fe33c00cc10 comp rx=0 tx=0).stop 2023-11-26T07:18:10.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 shutdown_connections 2023-11-26T07:18:10.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe3380664a0 0x7fe338068960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe34c0cc8f0 0x7fe34c1469c0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c750 tx=0x7fe33c00cc10 comp rx=0 tx=0).stop 2023-11-26T07:18:10.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4acc005370 con 0x7f4acc039e30 2023-11-26T07:18:10.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe34c14b110 0x7fe34c163260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 --2- 172.21.15.70:0/3007768179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe34c0b4150 0x7fe34c14a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 >> 172.21.15.70:0/3007768179 conn(0x7fe34c06c3f0 msgr2=0x7fe34c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.587+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa5241ec470 con 0x7fa50c005190 2023-11-26T07:18:10.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 shutdown_connections 2023-11-26T07:18:10.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7fa50bfff640 1 -- 172.21.15.70:0/1922476729 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa51c0551a0 con 0x7fa50c005190 2023-11-26T07:18:10.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7fe353108640 1 -- 172.21.15.70:0/3007768179 wait complete. 2023-11-26T07:18:10.595 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2023-11-26T07:18:10.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f4aca7fc640 1 -- 172.21.15.70:0/543736939 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ac40eecb0 con 0x7f4acc039e30 2023-11-26T07:18:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f57c0066540 msgr2=0x7f57c0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f57c0066540 0x7f57c0068a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57d40af000 tx=0x7f57d40a8070 comp rx=0 tx=0).stop 2023-11-26T07:18:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc0b2f20 msgr2=0x7f57dc13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc0b2f20 0x7f57dc13a660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c390 tx=0x7f57d800c850 comp rx=0 tx=0).stop 2023-11-26T07:18:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 shutdown_connections 2023-11-26T07:18:10.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f57c0066540 0x7f57c0068a00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc153780 0x7f57dc14e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57dc0b2f20 0x7f57dc13a660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 --2- 172.21.15.70:0/580888742 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f57dc0724a0 0x7f57dc13ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 >> 172.21.15.70:0/580888742 conn(0x7f57dc0b0b10 msgr2=0x7f57dc0cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.597 INFO:teuthology.orchestra.run.smithi070.stdout:55834574852 2023-11-26T07:18:10.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 shutdown_connections 2023-11-26T07:18:10.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.591+0000 7f57e25c3640 1 -- 172.21.15.70:0/580888742 wait complete. 2023-11-26T07:18:10.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5100664c0 msgr2=0x7fa510068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5100664c0 0x7fa510068980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5241f8150 tx=0x7fa518008040 comp rx=0 tx=0).stop 2023-11-26T07:18:10.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 msgr2=0x7fa5241e9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa5241e9be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c730 tx=0x7fa51c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 shutdown_connections 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5100664c0 0x7fa510068980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5241fa870 0x7fa5241f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5241facf0 0x7fa5241f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 --2- 172.21.15.70:0/1922476729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa50c005190 0x7fa5241e9be0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 >> 172.21.15.70:0/1922476729 conn(0x7fa5240aea10 msgr2=0x7fa5241ec990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4ab8066540 msgr2=0x7f4ab8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4ab8066540 0x7f4ab8068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4068c10 tx=0x7f4ad404f230 comp rx=0 tx=0).stop 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc039e30 msgr2=0x7f4acc0dbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc039e30 0x7f4acc0dbfb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40ac000 tx=0x7f4ac4019220 comp rx=0 tx=0).stop 2023-11-26T07:18:10.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 shutdown_connections 2023-11-26T07:18:10.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 shutdown_connections 2023-11-26T07:18:10.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4ab8066540 0x7f4ab8068a00 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4068c10 tx=0x7f4ad404f230 comp rx=0 tx=0).stop 2023-11-26T07:18:10.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0eb650 0x7f4acc0525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc039e30 0x7f4acc0dbfb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 --2- 172.21.15.70:0/543736939 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc038610 0x7f4acc0d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 >> 172.21.15.70:0/543736939 conn(0x7f4acc009f90 msgr2=0x7f4acc04bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7fa509ffb640 1 -- 172.21.15.70:0/1922476729 wait complete. 2023-11-26T07:18:10.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 shutdown_connections 2023-11-26T07:18:10.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.595+0000 7f4adabf8640 1 -- 172.21.15.70:0/543736939 wait complete. 2023-11-26T07:18:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.619+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f91e0067680 con 0x7f91e014c500 2023-11-26T07:18:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.623+0000 7f91deffd640 1 -- 172.21.15.70:0/2327307109 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91d8021070 con 0x7f91e014c500 2023-11-26T07:18:10.626 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2023-11-26T07:18:10.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-26T07:18:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f91cc0664d0 msgr2=0x7f91cc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f91cc0664d0 0x7f91cc068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91d0003b90 tx=0x7f91d00098d0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e014c500 msgr2=0x7f91e0205830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e014c500 0x7f91e0205830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e7f0 tx=0x7f91d800ecb0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 shutdown_connections 2023-11-26T07:18:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91e014c500 0x7f91e0205830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f91e00b1710 0x7f91e014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f91cc0664d0 0x7f91cc068990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 --2- 172.21.15.70:0/2327307109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91e0070370 0x7f91e0150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 >> 172.21.15.70:0/2327307109 conn(0x7f91e00b0bf0 msgr2=0x7f91e014d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 shutdown_connections 2023-11-26T07:18:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.627+0000 7f91e8372640 1 -- 172.21.15.70:0/2327307109 wait complete. 2023-11-26T07:18:10.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-11-26T07:18:10.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-11-26T07:18:10.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-11-26T07:18:10.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-11-26T07:18:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0e60005510 con 0x7f0e68005190 2023-11-26T07:18:10.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e67fff640 1 -- 172.21.15.70:0/626703248 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e70017090 con 0x7f0e68005190 2023-11-26T07:18:10.648 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:10.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f00cc005370 con 0x7f00cc0df7b0 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0e6c066500 msgr2=0x7f0e6c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0e6c066500 0x7f0e6c0689c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e74007fd0 tx=0x7f0e74009040 comp rx=0 tx=0).stop 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 msgr2=0x7f0e801549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e801549b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000e7c0 tx=0x7f0e7000ec80 comp rx=0 tx=0).stop 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 shutdown_connections 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0e6c066500 0x7f0e6c0689c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e80152bd0 0x7f0e80154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0e800b8530 0x7f0e800b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 --2- 172.21.15.70:0/626703248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e68005190 0x7f0e801549b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 >> 172.21.15.70:0/626703248 conn(0x7f0e8009c550 msgr2=0x7f0e80156550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 shutdown_connections 2023-11-26T07:18:10.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f0e8589a640 1 -- 172.21.15.70:0/626703248 wait complete. 2023-11-26T07:18:10.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.647+0000 7f00d17fa640 1 -- 172.21.15.70:0/1932450660 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00c80ad020 con 0x7f00cc0df7b0 2023-11-26T07:18:10.652 INFO:teuthology.orchestra.run.smithi070.stdout:55834574853 2023-11-26T07:18:10.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f00b8066470 msgr2=0x7f00b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f00b8066470 0x7f00b8068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00d404f6a0 tx=0x7f00d404f230 comp rx=0 tx=0).stop 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 msgr2=0x7f00cc04a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc04a2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f00c8006fd0 tx=0x7f00c801b690 comp rx=0 tx=0).stop 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 shutdown_connections 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f00b8066470 0x7f00b8068930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00cc050760 0x7f00cc048760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f00cc0df7b0 0x7f00cc04a2b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 --2- 172.21.15.70:0/1932450660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f00cc006c40 0x7f00cc0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 >> 172.21.15.70:0/1932450660 conn(0x7f00cc009f90 msgr2=0x7f00cc053060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 shutdown_connections 2023-11-26T07:18:10.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:10.651+0000 7f00d9df8640 1 -- 172.21.15.70:0/1932450660 wait complete. 2023-11-26T07:18:10.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-26T07:18:10.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-11-26T07:18:10.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-11-26T07:18:11.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-26T07:18:11.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-26T07:18:11.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-26T07:18:11.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-26T07:18:11.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-26T07:18:11.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-26T07:18:11.672 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-26T07:18:11.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-26T07:18:11.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.835+0000 7f73b5079640 1 Processor -- start 2023-11-26T07:18:11.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.835+0000 7f73b5079640 1 -- start start 2023-11-26T07:18:11.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73b5079640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f73b006db20 0x7f73b00b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73b5079640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b00cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73b5079640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00cc790 con 0x7f73b00cd9e0 2023-11-26T07:18:11.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73b5079640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b00b4ae0 con 0x7f73b006db20 2023-11-26T07:18:11.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73b5079640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00b4800 con 0x7f73b015a440 2023-11-26T07:18:11.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73aed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f73b006db20 0x7f73b00b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73aed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f73b006db20 0x7f73b00b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60208/0 (socket says 172.21.15.70:60208) 2023-11-26T07:18:11.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.839+0000 7f73aed9d640 1 -- 172.21.15.70:0/3564301146 learned_addr learned my addr 172.21.15.70:0/3564301146 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.843+0000 7f73aed9d640 1 -- 172.21.15.70:0/3564301146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 msgr2=0x7f73b00cd4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-26T07:18:11.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.843+0000 7f73aed9d640 1 --2- 172.21.15.70:0/3564301146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b00cd4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.843+0000 7f73aed9d640 1 -- 172.21.15.70:0/3564301146 >> v1:172.21.15.70:6789/0 conn(0x7f73b00cd9e0 legacy=0x7f73b00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.843+0000 7f73aed9d640 1 -- 172.21.15.70:0/3564301146 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00cc9c0 con 0x7f73b006db20 2023-11-26T07:18:11.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73aed9d640 1 --2- 172.21.15.70:0/3564301146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b006db20 0x7f73b00b3e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009870 tx=0x7f73a001d600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a2569d5342070f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73add9b640 1 -- 172.21.15.70:0/3564301146 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00aa670 con 0x7f73b006db20 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73add9b640 1 -- 172.21.15.70:0/3564301146 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00aa7d0 con 0x7f73b006db20 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73add9b640 1 -- 172.21.15.70:0/3564301146 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00aab60 con 0x7f73b006db20 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73b5079640 1 -- 172.21.15.70:0/3564301146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b006db20 msgr2=0x7f73b00b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73b5079640 1 --2- 172.21.15.70:0/3564301146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b006db20 0x7f73b00b3e60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009870 tx=0x7f73a001d600 comp rx=0 tx=0).stop 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73b5079640 1 -- 172.21.15.70:0/3564301146 shutdown_connections 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73b5079640 1 --2- 172.21.15.70:0/3564301146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b00cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73b5079640 1 --2- 172.21.15.70:0/3564301146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b006db20 0x7f73b00b3e60 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009870 tx=0x7f73a001d600 comp rx=0 tx=0).stop 2023-11-26T07:18:11.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.847+0000 7f73b5079640 1 -- 172.21.15.70:0/3564301146 >> 172.21.15.70:0/3564301146 conn(0x7f73b00aea10 msgr2=0x7f73b00aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.851+0000 7f73b5079640 1 -- 172.21.15.70:0/3564301146 shutdown_connections 2023-11-26T07:18:11.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.851+0000 7f73b5079640 1 -- 172.21.15.70:0/3564301146 wait complete. 2023-11-26T07:18:11.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.851+0000 7f73b5079640 1 Processor -- start 2023-11-26T07:18:11.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73b5079640 1 -- start start 2023-11-26T07:18:11.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73b5079640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b00cd9e0 0x7f73b0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73b5079640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73aed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b00cd9e0 0x7f73b0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73aed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b00cd9e0 0x7f73b0155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52520/0 (socket says 172.21.15.70:52520) 2023-11-26T07:18:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73ae59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73ae59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b014d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:54102/0 (socket says 172.21.15.70:54102) 2023-11-26T07:18:11.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73b5079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b0163500 0x7f73b00aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73aed9d640 1 -- 172.21.15.70:0/3723244903 learned_addr learned my addr 172.21.15.70:0/3723244903 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01556a0 con 0x7f73b0163500 2023-11-26T07:18:11.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.855+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0156070 con 0x7f73b00cd9e0 2023-11-26T07:18:11.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73af59e640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b0163500 0x7f73b00aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0154a90 con 0x7f73b015a440 2023-11-26T07:18:11.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73af59e640 1 -- 172.21.15.70:0/3723244903 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 msgr2=0x7f73b014d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73af59e640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b014d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73af59e640 1 -- 172.21.15.70:0/3723244903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b00cd9e0 msgr2=0x7f73b0155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73af59e640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b00cd9e0 0x7f73b0155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73af59e640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00094d0 con 0x7f73b0163500 2023-11-26T07:18:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73ae59c640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:11.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73af59e640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b0163500 0x7f73b00aedf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c780 tx=0x7f73a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73977fe640 1 -- 172.21.15.70:0/3723244903 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800aa50 con 0x7f73b0163500 2023-11-26T07:18:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73977fe640 1 -- 172.21.15.70:0/3723244903 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a800abb0 con 0x7f73b0163500 2023-11-26T07:18:11.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73977fe640 1 -- 172.21.15.70:0/3723244903 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800ce30 con 0x7f73b0163500 2023-11-26T07:18:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.859+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b0154d70 con 0x7f73b0163500 2023-11-26T07:18:11.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.863+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b0155330 con 0x7f73b0163500 2023-11-26T07:18:11.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.863+0000 7f73977fe640 1 -- 172.21.15.70:0/3723244903 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73a8012420 con 0x7f73b0163500 2023-11-26T07:18:11.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.867+0000 7f73977fe640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f739c0664a0 0x7f739c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.867+0000 7f73977fe640 1 -- 172.21.15.70:0/3723244903 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73a8083e30 con 0x7f73b0163500 2023-11-26T07:18:11.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.867+0000 7f73aed9d640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f739c0664a0 0x7f739c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.867+0000 7f73aed9d640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f739c0664a0 0x7f739c068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73a001d640 tx=0x7f73a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.871+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b01554f0 con 0x7f73b0163500 2023-11-26T07:18:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.879+0000 7f73977fe640 1 -- 172.21.15.70:0/3723244903 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73a8051360 con 0x7f73b0163500 2023-11-26T07:18:11.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.915+0000 7eff433df640 1 Processor -- start 2023-11-26T07:18:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.915+0000 7eff433df640 1 -- start start 2023-11-26T07:18:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff433df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c0cd4a0 0x7eff3c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff433df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c0cc790 con 0x7eff3c0b0540 2023-11-26T07:18:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff433df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c0b4ae0 con 0x7eff3c15a440 2023-11-26T07:18:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff433df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0b4570 con 0x7eff3c0cd4a0 2023-11-26T07:18:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff4097a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7eff3c0b0540 0x7eff3c0b3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34428/0 (socket says 172.21.15.70:34428) 2023-11-26T07:18:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff4097a640 1 -- 172.21.15.70:0/4119751485 learned_addr learned my addr 172.21.15.70:0/4119751485 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff4197c640 1 --2- 172.21.15.70:0/4119751485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c0cd4a0 0x7eff3c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff33fff640 1 -- 172.21.15.70:0/4119751485 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973148809 0 0) 0x7eff3c0cc790 con 0x7eff3c0b0540 2023-11-26T07:18:11.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff33fff640 1 -- 172.21.15.70:0/4119751485 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff28003530 con 0x7eff3c0b0540 2023-11-26T07:18:11.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.919+0000 7eff4197c640 1 -- 172.21.15.70:0/4119751485 >> v1:172.21.15.120:6789/0 conn(0x7eff3c15a440 legacy=0x7eff3c06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.923+0000 7eff4197c640 1 -- 172.21.15.70:0/4119751485 >> v1:172.21.15.70:6789/0 conn(0x7eff3c0b0540 legacy=0x7eff3c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.923+0000 7eff4197c640 1 -- 172.21.15.70:0/4119751485 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0b4800 con 0x7eff3c0cd4a0 2023-11-26T07:18:11.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.927+0000 7eff4197c640 1 --2- 172.21.15.70:0/4119751485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c0cd4a0 0x7eff3c0cd950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0097f0 tx=0x7eff2c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b001c97bcaa173a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.927+0000 7eff33fff640 1 -- 172.21.15.70:0/4119751485 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0ac620 con 0x7eff3c0cd4a0 2023-11-26T07:18:11.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe014832640 1 Processor -- start 2023-11-26T07:18:11.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.927+0000 7eff33fff640 1 -- 172.21.15.70:0/4119751485 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c0ac780 con 0x7eff3c0cd4a0 2023-11-26T07:18:11.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.927+0000 7eff33fff640 1 -- 172.21.15.70:0/4119751485 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0acb10 con 0x7eff3c0cd4a0 2023-11-26T07:18:11.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe014832640 1 -- start start 2023-11-26T07:18:11.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7eff433df640 1 -- 172.21.15.70:0/4119751485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c0cd4a0 msgr2=0x7eff3c0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7eff433df640 1 --2- 172.21.15.70:0/4119751485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c0cd4a0 0x7eff3c0cd950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0097f0 tx=0x7eff2c01c3c0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7eff433df640 1 -- 172.21.15.70:0/4119751485 shutdown_connections 2023-11-26T07:18:11.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7eff433df640 1 --2- 172.21.15.70:0/4119751485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c0cd4a0 0x7eff3c0cd950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7eff433df640 1 -- 172.21.15.70:0/4119751485 >> 172.21.15.70:0/4119751485 conn(0x7eff3c0aea10 msgr2=0x7eff3c0aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7eff433df640 1 -- 172.21.15.70:0/4119751485 shutdown_connections 2023-11-26T07:18:11.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7eff433df640 1 -- 172.21.15.70:0/4119751485 wait complete. 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe014832640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe0080e31e0 0x7fe008058480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe014832640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00803c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe014832640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe008006d80 con 0x7fe0080589c0 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe014832640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00803bfc0 con 0x7fe0080e31e0 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe014832640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe008007c30 con 0x7fe008054000 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00e59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe0080e31e0 0x7fe008058480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00f59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00803c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00f59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00803c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:54130/0 (socket says 172.21.15.70:54130) 2023-11-26T07:18:11.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00f59e640 1 -- 172.21.15.70:0/2038003120 learned_addr learned my addr 172.21.15.70:0/2038003120 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00f59e640 1 -- 172.21.15.70:0/2038003120 >> v2:172.21.15.120:3300/0 conn(0x7fe0080e31e0 msgr2=0x7fe008058480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00d59a640 1 -- 172.21.15.70:0/2038003120 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127330332 0 0) 0x7fe008006d80 con 0x7fe0080589c0 2023-11-26T07:18:11.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00f59e640 1 --2- 172.21.15.70:0/2038003120 >> v2:172.21.15.120:3300/0 conn(0x7fe0080e31e0 0x7fe008058480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 Processor -- start 2023-11-26T07:18:11.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fbe9b0c9640 1 Processor -- start 2023-11-26T07:18:11.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fbe9b0c9640 1 -- start start 2023-11-26T07:18:11.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe9b0c9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbe94071f70 0x7fbe940b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2535606640 1 Processor -- start 2023-11-26T07:18:11.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2535606640 1 -- start start 2023-11-26T07:18:11.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe9b0c9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbe940b1da0 0x7fbe940b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe9b0c9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe940b30a0 con 0x7fbe9414b110 2023-11-26T07:18:11.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe9b0c9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe94070340 con 0x7fbe94071f70 2023-11-26T07:18:11.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe9b0c9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe94070620 con 0x7fbe940b1da0 2023-11-26T07:18:11.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 -- start start 2023-11-26T07:18:11.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff3c0b0540 0x7eff3c15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe93fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbe94071f70 0x7fbe940b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe98e65640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbe9414b110 0x7fbe940cc3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:41034/0 (socket says 172.21.15.70:41034) 2023-11-26T07:18:11.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe98e65640 1 -- 172.21.15.70:0/3272387991 learned_addr learned my addr 172.21.15.70:0/3272387991 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:11.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe99666640 1 --2- 172.21.15.70:0/3272387991 >> v2:172.21.15.120:3300/0 conn(0x7fbe940b1da0 0x7fbe940b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453430817 0 0) 0x7fbe940b30a0 con 0x7fbe9414b110 2023-11-26T07:18:11.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe7c003530 con 0x7fbe9414b110 2023-11-26T07:18:11.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2535606640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 0x7f253006cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 <== mon.1 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188598058 0 0) 0x7fbe7c003530 con 0x7fbe9414b110 2023-11-26T07:18:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 >> v2:172.21.15.120:3300/0 conn(0x7fbe940b1da0 msgr2=0x7fbe940b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2535606640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2530159690 0x7f25300b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2535606640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2530159c00 con 0x7f2530153930 2023-11-26T07:18:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2535606640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300b1e10 con 0x7f2530159690 2023-11-26T07:18:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2535606640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2530159ee0 con 0x7f2530153550 2023-11-26T07:18:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.931+0000 7fe00f59e640 1 -- 172.21.15.70:0/2038003120 >> v1:172.21.15.120:6789/0 conn(0x7fe0080589c0 legacy=0x7fe0080538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fe00f59e640 1 -- 172.21.15.70:0/2038003120 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080e35c0 con 0x7fe008054000 2023-11-26T07:18:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 --2- 172.21.15.70:0/3272387991 >> v2:172.21.15.120:3300/0 conn(0x7fbe940b1da0 0x7fbe940b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 >> v2:172.21.15.70:3300/0 conn(0x7fbe94071f70 msgr2=0x7fbe940b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 --2- 172.21.15.70:0/3272387991 >> v2:172.21.15.70:3300/0 conn(0x7fbe94071f70 0x7fbe940b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f2534e05640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2530159690 0x7f25300b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f252f7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2530153930 0x7f25300cc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:41042/0 (socket says 172.21.15.70:41042) 2023-11-26T07:18:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f252f7fe640 1 -- 172.21.15.70:0/2038422009 learned_addr learned my addr 172.21.15.70:0/2038422009 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7f252ffff640 1 --2- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 0x7f253006cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94070900 con 0x7fbe9414b110 2023-11-26T07:18:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7f252effd640 1 -- 172.21.15.70:0/2038422009 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024813648 0 0) 0x7f2530159c00 con 0x7f2530153930 2023-11-26T07:18:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7f252effd640 1 -- 172.21.15.70:0/2038422009 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2518003530 con 0x7f2530153930 2023-11-26T07:18:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 <== mon.1 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fbe84001680 con 0x7fbe9414b110 2023-11-26T07:18:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 >> v1:172.21.15.120:6789/0 conn(0x7fbe9414b110 legacy=0x7fbe940cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0039d0 0x7fbe7c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe7c0047d0 0x7fbe7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7c005190 0x7fbe7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7f2534e05640 1 -- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 msgr2=0x7f253006cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7f2534e05640 1 --2- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 0x7f253006cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7f2534e05640 1 -- 172.21.15.70:0/2038422009 >> v1:172.21.15.120:6789/0 conn(0x7f2530153930 legacy=0x7f25300cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7f2534e05640 1 -- 172.21.15.70:0/2038422009 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253015a1c0 con 0x7f2530159690 2023-11-26T07:18:11.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c0cd4a0 0x7eff3c0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c15a440 0x7eff3c0adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c15d230 con 0x7eff3c0cd4a0 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c15c620 con 0x7eff3c0b0540 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff433df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c15c900 con 0x7eff3c15a440 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff3c0b0540 0x7eff3c15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff3c0b0540 0x7eff3c15bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52542/0 (socket says 172.21.15.70:52542) 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 -- 172.21.15.70:0/1451013808 learned_addr learned my addr 172.21.15.70:0/1451013808 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 -- 172.21.15.70:0/1451013808 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c15a440 msgr2=0x7eff3c0adee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c15a440 0x7eff3c0adee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 -- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c0cd4a0 msgr2=0x7eff3c0ad9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-26T07:18:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c0cd4a0 0x7eff3c0ad9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7eff4117b640 1 -- 172.21.15.70:0/1451013808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c009420 con 0x7eff3c0b0540 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7eff4117b640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff3c0b0540 0x7eff3c15bd20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff3800b410 tx=0x7eff3800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7eff31ffb640 1 -- 172.21.15.70:0/1451013808 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38004020 con 0x7eff3c0b0540 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7eff31ffb640 1 -- 172.21.15.70:0/1451013808 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38004180 con 0x7eff3c0b0540 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7eff31ffb640 1 -- 172.21.15.70:0/1451013808 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38011630 con 0x7eff3c0b0540 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c15cbe0 con 0x7eff3c0b0540 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c15c260 con 0x7eff3c0b0540 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94070340 con 0x7fbe7c005190 2023-11-26T07:18:11.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94070620 con 0x7fbe7c0039d0 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.935+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c00c0b0 con 0x7fbe7c0047d0 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe93fff640 1 --2- 172.21.15.70:0/3272387991 >> v2:172.21.15.70:3300/0 conn(0x7fbe94071f70 0x7fbe940b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe99666640 1 --2- 172.21.15.70:0/3272387991 >> v2:172.21.15.120:3300/0 conn(0x7fbe940b1da0 0x7fbe940b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe99666640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7c005190 0x7fbe7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe98e65640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0039d0 0x7fbe7c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe93fff640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe7c0047d0 0x7fbe7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe93fff640 1 -- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0039d0 msgr2=0x7fbe7c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe93fff640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0039d0 0x7fbe7c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe93fff640 1 -- 172.21.15.70:0/3272387991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7c005190 msgr2=0x7fbe7c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe93fff640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7c005190 0x7fbe7c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe93fff640 1 -- 172.21.15.70:0/3272387991 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c003530 con 0x7fbe7c0047d0 2023-11-26T07:18:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fbe99666640 1 -- 172.21.15.70:0/3272387991 reap_dead start 2023-11-26T07:18:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fe00f59e640 1 --2- 172.21.15.70:0/2038003120 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00803c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe010000b70 tx=0x7fe010096b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64b9eb39c11e1aaf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fe00d59a640 1 -- 172.21.15.70:0/2038003120 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01011f900 con 0x7fe008054000 2023-11-26T07:18:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c067500 con 0x7eff3c0b0540 2023-11-26T07:18:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fe00d59a640 1 -- 172.21.15.70:0/2038003120 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01011fa60 con 0x7fe008054000 2023-11-26T07:18:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.939+0000 7fe00d59a640 1 -- 172.21.15.70:0/2038003120 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01011fe50 con 0x7fe008054000 2023-11-26T07:18:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f8008216640 1 Processor -- start 2023-11-26T07:18:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b5ae9c640 1 Processor -- start 2023-11-26T07:18:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7eff31ffb640 1 -- 172.21.15.70:0/1451013808 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff38011790 con 0x7eff3c0b0540 2023-11-26T07:18:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f8008216640 1 -- start start 2023-11-26T07:18:11.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 -- 172.21.15.70:0/2038003120 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 msgr2=0x7fe00803c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 --2- 172.21.15.70:0/2038003120 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00803c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe010000b70 tx=0x7fe010096b70 comp rx=0 tx=0).stop 2023-11-26T07:18:11.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b5ae9c640 1 -- start start 2023-11-26T07:18:11.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f37ed357640 1 Processor -- start 2023-11-26T07:18:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 -- 172.21.15.70:0/2038003120 shutdown_connections 2023-11-26T07:18:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 --2- 172.21.15.70:0/2038003120 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00803c2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 --2- 172.21.15.70:0/2038003120 >> v2:172.21.15.120:3300/0 conn(0x7fe0080e31e0 0x7fe008058480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 -- 172.21.15.70:0/2038003120 >> 172.21.15.70:0/2038003120 conn(0x7fe008059090 msgr2=0x7fe0080594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f2534e05640 1 --2- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530159690 0x7f25300b38d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2528009d90 tx=0x7f252801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba8435cb91d84e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 -- 172.21.15.70:0/2038003120 shutdown_connections 2023-11-26T07:18:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fe014832640 1 -- 172.21.15.70:0/2038003120 wait complete. 2023-11-26T07:18:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fbe93fff640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe7c0047d0 0x7fbe7c004c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009cb0 tx=0x7fbe8801cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b17437adc4328a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880a5720 con 0x7fbe7c0047d0 2023-11-26T07:18:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe880a5880 con 0x7fbe7c0047d0 2023-11-26T07:18:11.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fbe937fe640 1 -- 172.21.15.70:0/3272387991 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880a5c70 con 0x7fbe7c0047d0 2023-11-26T07:18:11.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f37ed357640 1 -- start start 2023-11-26T07:18:11.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7eff31ffb640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff200664c0 0x7eff20068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7eff31ffb640 1 -- 172.21.15.70:0/1451013808 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff38083b20 con 0x7eff3c0b0540 2023-11-26T07:18:11.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7eff4097a640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff200664c0 0x7eff20068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f8008216640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8000159170 0x7f800006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b5ae9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b5ae9c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b540b36b0 0x7f7b540cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe7c0047d0 msgr2=0x7fbe7c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe7c0047d0 0x7fbe7c004c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009cb0 tx=0x7fbe8801cbb0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b5ae9c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540ce590 con 0x7f7b5415d5b0 2023-11-26T07:18:11.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b5ae9c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b540cdf80 con 0x7f7b540b36b0 2023-11-26T07:18:11.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b5ae9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540b3ea0 con 0x7f7b540d1f30 2023-11-26T07:18:11.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b58c38640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7b5415d5b0 0x7f7b540d1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34430/0 (socket says 172.21.15.70:34430) 2023-11-26T07:18:11.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b58c38640 1 -- 172.21.15.70:0/125384107 learned_addr learned my addr 172.21.15.70:0/125384107 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:11.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f8008216640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80000ce310 0x7f8000070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f8008216640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8000070fc0 con 0x7f80000b1710 2023-11-26T07:18:11.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f8008216640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000cb0e0 con 0x7f80000ce310 2023-11-26T07:18:11.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f8008216640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800006cf30 con 0x7f8000159170 2023-11-26T07:18:11.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b59439640 1 --2- 172.21.15.70:0/125384107 >> v2:172.21.15.120:3300/0 conn(0x7f7b540b36b0 0x7f7b540cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.943+0000 7f7b53fff640 1 --2- 172.21.15.70:0/125384107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f8005fb2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8000159170 0x7f800006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f8005fb2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8000159170 0x7f800006d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:54184/0 (socket says 172.21.15.70:54184) 2023-11-26T07:18:11.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f8005fb2640 1 -- 172.21.15.70:0/2801428724 learned_addr learned my addr 172.21.15.70:0/2801428724 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f7b53fff640 1 -- 172.21.15.70:0/125384107 >> v2:172.21.15.120:3300/0 conn(0x7f7b540b36b0 msgr2=0x7f7b540cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f7b53fff640 1 --2- 172.21.15.70:0/125384107 >> v2:172.21.15.120:3300/0 conn(0x7f7b540b36b0 0x7f7b540cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f7b53fff640 1 -- 172.21.15.70:0/125384107 >> v1:172.21.15.70:6789/0 conn(0x7f7b5415d5b0 legacy=0x7f7b540d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f7b53fff640 1 -- 172.21.15.70:0/125384107 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540ce220 con 0x7f7b540d1f30 2023-11-26T07:18:11.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f7b537fe640 1 -- 172.21.15.70:0/125384107 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623705189 0 0) 0x7f7b540ce590 con 0x7f7b5415d5b0 2023-11-26T07:18:11.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f8005fb2640 1 -- 172.21.15.70:0/2801428724 >> v2:172.21.15.70:3300/0 conn(0x7f80000ce310 msgr2=0x7f8000070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f8005fb2640 1 --2- 172.21.15.70:0/2801428724 >> v2:172.21.15.70:3300/0 conn(0x7f80000ce310 0x7f8000070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f8005fb2640 1 -- 172.21.15.70:0/2801428724 >> v1:172.21.15.70:6789/0 conn(0x7f80000b1710 legacy=0x7f80000708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37ed357640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f37e815d5b0 0x7f37e80d1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 Processor -- start 2023-11-26T07:18:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/3272387991 shutdown_connections 2023-11-26T07:18:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/3272387991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe7c0047d0 0x7fbe7c004c50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/3272387991 >> 172.21.15.70:0/3272387991 conn(0x7fbe9406c3f0 msgr2=0x7fbe9406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e6ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f37e815d5b0 0x7f37e80d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e6ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f37e815d5b0 0x7f37e80d1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52584/0 (socket says 172.21.15.70:52584) 2023-11-26T07:18:11.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e6ffd640 1 -- 172.21.15.70:0/150141903 learned_addr learned my addr 172.21.15.70:0/150141903 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 -- start start 2023-11-26T07:18:11.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/3272387991 shutdown_connections 2023-11-26T07:18:11.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37ed357640 1 --2- 172.21.15.70:0/150141903 >> v2:172.21.15.70:3300/0 conn(0x7f37e80b3880 0x7f37e80cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7eff4097a640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff200664c0 0x7eff20068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff340012f0 tx=0x7eff34001430 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e80d21c0 con 0x7f37e80d1d60 2023-11-26T07:18:11.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e77fe640 1 --2- 172.21.15.70:0/150141903 >> v2:172.21.15.70:3300/0 conn(0x7f37e80b3880 0x7f37e80cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f8005fb2640 1 -- 172.21.15.70:0/2801428724 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000cb2f0 con 0x7f8000159170 2023-11-26T07:18:11.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f252effd640 1 -- 172.21.15.70:0/2038422009 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280a58c0 con 0x7f2530159690 2023-11-26T07:18:11.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/3272387991 wait complete. 2023-11-26T07:18:11.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80ce590 con 0x7f37e80b3880 2023-11-26T07:18:11.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80cdf80 con 0x7f37e815d5b0 2023-11-26T07:18:11.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e5ffb640 1 -- 172.21.15.70:0/150141903 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857864442 0 0) 0x7f37e80d21c0 con 0x7f37e80d1d60 2023-11-26T07:18:11.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f252effd640 1 -- 172.21.15.70:0/2038422009 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25280a5a20 con 0x7f2530159690 2023-11-26T07:18:11.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e5ffb640 1 -- 172.21.15.70:0/150141903 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37d0003530 con 0x7f37e80d1d60 2023-11-26T07:18:11.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00802fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0080589c0 0x7fe008032480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0080e31e0 0x7fe0080329c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080517e0 con 0x7fe0080e31e0 2023-11-26T07:18:11.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080511b0 con 0x7fe0080589c0 2023-11-26T07:18:11.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe014832640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080df130 con 0x7fe008054000 2023-11-26T07:18:11.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f252effd640 1 -- 172.21.15.70:0/2038422009 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280a58c0 con 0x7f2530159690 2023-11-26T07:18:11.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00802fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00802fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:54190/0 (socket says 172.21.15.70:54190) 2023-11-26T07:18:11.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 -- 172.21.15.70:0/3363023281 learned_addr learned my addr 172.21.15.70:0/3363023281 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00dd9b640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0080589c0 0x7fe008032480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f2535606640 1 -- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530159690 msgr2=0x7f25300b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f2535606640 1 --2- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530159690 0x7f25300b38d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2528009d90 tx=0x7f252801c950 comp rx=0 tx=0).stop 2023-11-26T07:18:11.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 -- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0080589c0 msgr2=0x7fe008032480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0080589c0 0x7fe008032480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 -- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0080e31e0 msgr2=0x7fe0080329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0080e31e0 0x7fe0080329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7fe00e59c640 1 -- 172.21.15.70:0/3363023281 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01004f0a0 con 0x7fe008054000 2023-11-26T07:18:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f2535606640 1 -- 172.21.15.70:0/2038422009 shutdown_connections 2023-11-26T07:18:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f2535606640 1 --2- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530159690 0x7f25300b38d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f2535606640 1 --2- 172.21.15.70:0/2038422009 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 0x7f253006cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f2535606640 1 -- 172.21.15.70:0/2038422009 >> 172.21.15.70:0/2038422009 conn(0x7f253006a890 msgr2=0x7f253006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7eff31ffb640 1 -- 172.21.15.70:0/1451013808 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff38051080 con 0x7eff3c0b0540 2023-11-26T07:18:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f2535606640 1 -- 172.21.15.70:0/2038422009 shutdown_connections 2023-11-26T07:18:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f2535606640 1 -- 172.21.15.70:0/2038422009 wait complete. 2023-11-26T07:18:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fe00dd9b640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0080589c0 0x7fe008032480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fe00e59c640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00802fa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe00000d5f0 tx=0x7fe00000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fdffeffd640 1 -- 172.21.15.70:0/3363023281 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0000125f0 con 0x7fe008054000 2023-11-26T07:18:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fdffeffd640 1 -- 172.21.15.70:0/3363023281 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe000012750 con 0x7fe008054000 2023-11-26T07:18:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fdffeffd640 1 -- 172.21.15.70:0/3363023281 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000012ae0 con 0x7fe008054000 2023-11-26T07:18:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 Processor -- start 2023-11-26T07:18:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 -- start start 2023-11-26T07:18:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0080df410 con 0x7fe008054000 2023-11-26T07:18:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00802ffc0 con 0x7fe008054000 2023-11-26T07:18:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e6ffd640 1 -- 172.21.15.70:0/150141903 >> v2:172.21.15.70:3300/0 conn(0x7f37e80b3880 msgr2=0x7f37e80cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e6ffd640 1 --2- 172.21.15.70:0/150141903 >> v2:172.21.15.70:3300/0 conn(0x7f37e80b3880 0x7f37e80cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e6ffd640 1 -- 172.21.15.70:0/150141903 >> v1:172.21.15.120:6789/0 conn(0x7f37e80d1d60 legacy=0x7f37e80b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.947+0000 7f37e6ffd640 1 -- 172.21.15.70:0/150141903 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80b3ea0 con 0x7f37e815d5b0 2023-11-26T07:18:11.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f37e77fe640 1 --2- 172.21.15.70:0/150141903 >> v2:172.21.15.70:3300/0 conn(0x7f37e80b3880 0x7f37e80cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:11.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f2535606640 1 Processor -- start 2023-11-26T07:18:11.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f7b53fff640 1 --2- 172.21.15.70:0/125384107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b3170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097c0 tx=0x7f7b4001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c288129fdd25d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f8005fb2640 1 --2- 172.21.15.70:0/2801428724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8000159170 0x7f800006d680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000bb10 tx=0x7f7ff001eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a836d5d4b2daff server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f2535606640 1 -- start start 2023-11-26T07:18:11.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe008051920 con 0x7fe008054000 2023-11-26T07:18:11.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f7b537fe640 1 -- 172.21.15.70:0/125384107 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400ac410 con 0x7f7b540d1f30 2023-11-26T07:18:11.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f7b537fe640 1 -- 172.21.15.70:0/125384107 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400ac570 con 0x7f7b540d1f30 2023-11-26T07:18:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0047d0 0x7fbe940aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe940a8e90 0x7fbe94160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe940a9310 0x7fbe941610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94148c90 con 0x7fbe940a9310 2023-11-26T07:18:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94148ea0 con 0x7fbe7c0047d0 2023-11-26T07:18:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7fbe9b0c9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94149180 con 0x7fbe940a8e90 2023-11-26T07:18:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f7b537fe640 1 -- 172.21.15.70:0/125384107 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400ac900 con 0x7f7b540d1f30 2023-11-26T07:18:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f2535606640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 0x7f253014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f2535606640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530153930 0x7f2530141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f8004fb0640 1 -- 172.21.15.70:0/2801428724 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00a7ba0 con 0x7f8000159170 2023-11-26T07:18:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f8004fb0640 1 -- 172.21.15.70:0/2801428724 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff00a7d00 con 0x7f8000159170 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.951+0000 7f8004fb0640 1 -- 172.21.15.70:0/2801428724 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00af660 con 0x7f8000159170 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f2535606640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2530159690 0x7f25301f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f2535606640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301f5e00 con 0x7f2530159690 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f2535606640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253014ee10 con 0x7f2530153930 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f2535606640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253014f0f0 con 0x7f2530153550 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530153930 0x7f2530141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530153930 0x7f2530141760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52600/0 (socket says 172.21.15.70:52600) 2023-11-26T07:18:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 -- 172.21.15.70:0/1316570592 learned_addr learned my addr 172.21.15.70:0/1316570592 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe93fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe940a8e90 0x7fbe94160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe98e65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0047d0 0x7fbe940aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe98e65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0047d0 0x7fbe940aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52604/0 (socket says 172.21.15.70:52604) 2023-11-26T07:18:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe98e65640 1 -- 172.21.15.70:0/2715044692 learned_addr learned my addr 172.21.15.70:0/2715044692 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 -- 172.21.15.70:0/1316570592 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 msgr2=0x7f253014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 0x7f253014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 -- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2530159690 msgr2=0x7f25301f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2530159690 0x7f25301f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe93fff640 1 -- 172.21.15.70:0/2715044692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0047d0 msgr2=0x7fbe940aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe93fff640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0047d0 0x7fbe940aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe93fff640 1 -- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe940a9310 msgr2=0x7fbe941610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe93fff640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe940a9310 0x7fbe941610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 -- 172.21.15.70:0/2801428724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8000159170 msgr2=0x7f800006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 --2- 172.21.15.70:0/2801428724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8000159170 0x7f800006d680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000bb10 tx=0x7f7ff001eb10 comp rx=0 tx=0).stop 2023-11-26T07:18:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/125384107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 msgr2=0x7f7b540b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/125384107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b3170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b400097c0 tx=0x7f7b4001c480 comp rx=0 tx=0).stop 2023-11-26T07:18:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe93fff640 1 -- 172.21.15.70:0/2715044692 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94149460 con 0x7fbe940a8e90 2023-11-26T07:18:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f37e6ffd640 1 --2- 172.21.15.70:0/150141903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e80d1820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37e80a11c0 tx=0x7f37dc01cf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b222ede95df7003 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 -- 172.21.15.70:0/1316570592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009a70 con 0x7f2530153930 2023-11-26T07:18:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fdffeffd640 1 -- 172.21.15.70:0/3363023281 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe000012c40 con 0x7fe008054000 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252f7fe640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530153930 0x7f2530141760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f252400c450 tx=0x7f252400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 -- 172.21.15.70:0/2801428724 shutdown_connections 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 --2- 172.21.15.70:0/2801428724 >> v2:172.21.15.70:3300/0 conn(0x7f80000ce310 0x7f8000070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 --2- 172.21.15.70:0/2801428724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8000159170 0x7f800006d680 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 -- 172.21.15.70:0/2801428724 >> 172.21.15.70:0/2801428724 conn(0x7f80000b0bf0 msgr2=0x7f80000b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 -- 172.21.15.70:0/2801428724 shutdown_connections 2023-11-26T07:18:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f37e5ffb640 1 -- 172.21.15.70:0/150141903 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0aa610 con 0x7f37e815d5b0 2023-11-26T07:18:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f8008216640 1 -- 172.21.15.70:0/2801428724 wait complete. 2023-11-26T07:18:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f37e5ffb640 1 -- 172.21.15.70:0/150141903 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc0a6040 con 0x7f37e815d5b0 2023-11-26T07:18:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f37e5ffb640 1 -- 172.21.15.70:0/150141903 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0aa970 con 0x7f37e815d5b0 2023-11-26T07:18:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/125384107 shutdown_connections 2023-11-26T07:18:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/125384107 >> v2:172.21.15.120:3300/0 conn(0x7f7b540b36b0 0x7f7b540cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/125384107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b3170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/125384107 >> 172.21.15.70:0/125384107 conn(0x7f7b5408cc60 msgr2=0x7f7b5409c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252cff9640 1 -- 172.21.15.70:0/1316570592 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524005cf0 con 0x7f2530153930 2023-11-26T07:18:11.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252cff9640 1 -- 172.21.15.70:0/1316570592 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524005e50 con 0x7f2530153930 2023-11-26T07:18:11.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f252cff9640 1 -- 172.21.15.70:0/1316570592 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524007290 con 0x7f2530153930 2023-11-26T07:18:11.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253014f3d0 con 0x7f2530153930 2023-11-26T07:18:11.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253014ea50 con 0x7f2530153930 2023-11-26T07:18:11.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/125384107 shutdown_connections 2023-11-26T07:18:11.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fbe93fff640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe940a8e90 0x7fbe94160ba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe880ac000 tx=0x7fbe88019950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2510005260 con 0x7f2530153930 2023-11-26T07:18:11.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 msgr2=0x7f37e80d1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 --2- 172.21.15.70:0/150141903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e80d1820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f37e80a11c0 tx=0x7f37dc01cf10 comp rx=0 tx=0).stop 2023-11-26T07:18:11.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/125384107 wait complete. 2023-11-26T07:18:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.955+0000 7fdffeffd640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdff0066540 0x7fdff0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7fdffeffd640 1 -- 172.21.15.70:0/3363023281 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0000842f0 con 0x7fe008054000 2023-11-26T07:18:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 Processor -- start 2023-11-26T07:18:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 -- start start 2023-11-26T07:18:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7fe00dd9b640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdff0066540 0x7fdff0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f252cff9640 1 -- 172.21.15.70:0/1316570592 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25240073f0 con 0x7f2530153930 2023-11-26T07:18:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 shutdown_connections 2023-11-26T07:18:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 --2- 172.21.15.70:0/150141903 >> v2:172.21.15.70:3300/0 conn(0x7f37e80b3880 0x7f37e80cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 --2- 172.21.15.70:0/150141903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e80d1820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 >> 172.21.15.70:0/150141903 conn(0x7f37e808cc60 msgr2=0x7f37e809c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 Processor -- start 2023-11-26T07:18:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 shutdown_connections 2023-11-26T07:18:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 -- start start 2023-11-26T07:18:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f252cff9640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f251c066470 0x7f251c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f252cff9640 1 -- 172.21.15.70:0/1316570592 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25240834e0 con 0x7f2530153930 2023-11-26T07:18:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80000b1710 0x7f80002021e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80000ce310 0x7f800015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8000159170 0x7f800015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000202aa0 con 0x7f80000b1710 2023-11-26T07:18:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800015c4d0 con 0x7f8000159170 2023-11-26T07:18:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f8008216640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800015cce0 con 0x7f80000ce310 2023-11-26T07:18:11.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f252ffff640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f251c066470 0x7f251c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7fe00dd9b640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdff0066540 0x7fdff0068a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0080e2f30 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7fdffeffd640 1 -- 172.21.15.70:0/3363023281 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe008051920 con 0x7fe008054000 2023-11-26T07:18:11.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80057b1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80000ce310 0x7f800015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8000159170 0x7f800015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8000159170 0x7f800015bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:52610/0 (socket says 172.21.15.70:52610) 2023-11-26T07:18:11.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 -- 172.21.15.70:0/3349211713 learned_addr learned my addr 172.21.15.70:0/3349211713 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f37ed357640 1 -- 172.21.15.70:0/150141903 wait complete. 2023-11-26T07:18:11.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f252ffff640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f251c066470 0x7f251c068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2520006aa0 tx=0x7f2520006a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b540b36b0 0x7f7b54155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 -- 172.21.15.70:0/3349211713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80000ce310 msgr2=0x7f800015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80000ce310 0x7f800015ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 -- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80000b1710 msgr2=0x7f80002021e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80000b1710 0x7f80002021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 -- 172.21.15.70:0/3349211713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff000b770 con 0x7f8000159170 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5415d5b0 0x7f7b541fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54160620 con 0x7f7b5415d5b0 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5415fd80 con 0x7f7b540b36b0 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b5ae9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54160060 con 0x7f7b540d1f30 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b53fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b53fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:54216/0 (socket says 172.21.15.70:54216) 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b53fff640 1 -- 172.21.15.70:0/73528957 learned_addr learned my addr 172.21.15.70:0/73528957 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:11.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f7b58c38640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b540b36b0 0x7f7b54155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.959+0000 7f80067b3640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8000159170 0x7f800015bf90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c7b0 tx=0x7f7ff800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f37ed357640 1 Processor -- start 2023-11-26T07:18:11.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f37ed357640 1 -- start start 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b53fff640 1 -- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b540b36b0 msgr2=0x7f7b54155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b53fff640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b540b36b0 0x7f7b54155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b53fff640 1 -- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5415d5b0 msgr2=0x7f7b541fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b53fff640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5415d5b0 0x7f7b541fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b53fff640 1 -- 172.21.15.70:0/73528957 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40009420 con 0x7f7b540d1f30 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b58c38640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b540b36b0 0x7f7b54155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b53fff640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b60c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b40019090 tx=0x7f7b540b4390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b517fa640 1 -- 172.21.15.70:0/73528957 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400b5400 con 0x7f7b540d1f30 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b517fa640 1 -- 172.21.15.70:0/73528957 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400b5560 con 0x7f7b540d1f30 2023-11-26T07:18:11.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b517fa640 1 -- 172.21.15.70:0/73528957 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400b58f0 con 0x7f7b540d1f30 2023-11-26T07:18:11.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7fbe917fa640 1 -- 172.21.15.70:0/2715044692 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880ad640 con 0x7fbe940a8e90 2023-11-26T07:18:11.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7fbe917fa640 1 -- 172.21.15.70:0/2715044692 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe880ad7e0 con 0x7fbe940a8e90 2023-11-26T07:18:11.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7fbe917fa640 1 -- 172.21.15.70:0/2715044692 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880adb90 con 0x7fbe940a8e90 2023-11-26T07:18:11.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe94149740 con 0x7fbe940a8e90 2023-11-26T07:18:11.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe94146dd0 con 0x7fbe940a8e90 2023-11-26T07:18:11.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f252cff9640 1 -- 172.21.15.70:0/1316570592 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25240508c0 con 0x7f2530153930 2023-11-26T07:18:11.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f37ed357640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e80b3880 0x7f37e815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:11.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe94166090 con 0x7fbe940a8e90 2023-11-26T07:18:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f37e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e80b3880 0x7f37e815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f37e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e80b3880 0x7f37e815be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60300/0 (socket says 172.21.15.70:60300) 2023-11-26T07:18:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b54160340 con 0x7f7b540d1f30 2023-11-26T07:18:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.963+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b541559e0 con 0x7f7b540d1f30 2023-11-26T07:18:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f7ff67fc640 1 -- 172.21.15.70:0/3349211713 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800aa50 con 0x7f8000159170 2023-11-26T07:18:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f7ff67fc640 1 -- 172.21.15.70:0/3349211713 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800abb0 con 0x7f8000159170 2023-11-26T07:18:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f7ff67fc640 1 -- 172.21.15.70:0/3349211713 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800ce60 con 0x7f8000159170 2023-11-26T07:18:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e6ffd640 1 -- 172.21.15.70:0/3617462963 learned_addr learned my addr 172.21.15.70:0/3617462963 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37e80d1d60 0x7f37e806c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80aff00 con 0x7f37e80b3880 2023-11-26T07:18:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e67fc640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37e80d1d60 0x7f37e806c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8155320 con 0x7f37e815d5b0 2023-11-26T07:18:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80b0a20 con 0x7f37e80d1d60 2023-11-26T07:18:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8000202720 con 0x7f8000159170 2023-11-26T07:18:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800015ca00 con 0x7f8000159170 2023-11-26T07:18:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000202be0 con 0x7f8000159170 2023-11-26T07:18:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7fbe917fa640 1 -- 172.21.15.70:0/2715044692 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe880b4040 con 0x7fbe940a8e90 2023-11-26T07:18:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e67fc640 1 -- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 msgr2=0x7f37e815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e77fe640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e67fc640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e815a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f7b517fa640 1 -- 172.21.15.70:0/73528957 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b400b3040 con 0x7f7b540d1f30 2023-11-26T07:18:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e67fc640 1 -- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e80b3880 msgr2=0x7f37e815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e67fc640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e80b3880 0x7f37e815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e67fc640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0094d0 con 0x7f37e80d1d60 2023-11-26T07:18:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e6ffd640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e80b3880 0x7f37e815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e77fe640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.967+0000 7f37e67fc640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37e80d1d60 0x7f37e806c4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c460 tx=0x7f37d800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7b517fa640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7b38066470 0x7f7b38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b540b0a00 con 0x7f7b540d1f30 2023-11-26T07:18:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7b517fa640 1 -- 172.21.15.70:0/73528957 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b4011dae0 con 0x7f7b540d1f30 2023-11-26T07:18:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7b58c38640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7b38066470 0x7f7b38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7fbe917fa640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbe80066470 0x7fbe80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7ff67fc640 1 -- 172.21.15.70:0/3349211713 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ff8012420 con 0x7f8000159170 2023-11-26T07:18:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7fbe917fa640 1 -- 172.21.15.70:0/2715044692 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe8811e530 con 0x7fbe940a8e90 2023-11-26T07:18:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7b58c38640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7b38066470 0x7f7b38068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b48007fd0 tx=0x7f7b48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7fbe98e65640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbe80066470 0x7fbe80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7ff67fc640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fe40664c0 0x7f7fe4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f7ff67fc640 1 -- 172.21.15.70:0/3349211713 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ff80846a0 con 0x7f8000159170 2023-11-26T07:18:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f8005fb2640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fe40664c0 0x7f7fe4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f37cf7fe640 1 -- 172.21.15.70:0/3617462963 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8005480 con 0x7f37e80d1d60 2023-11-26T07:18:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e81555c0 con 0x7f37e80d1d60 2023-11-26T07:18:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e814fc30 con 0x7f37e80d1d60 2023-11-26T07:18:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.971+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e80b0770 con 0x7f37e80d1d60 2023-11-26T07:18:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.975+0000 7fbe917fa640 1 -- 172.21.15.70:0/2715044692 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe880eba50 con 0x7fbe940a8e90 2023-11-26T07:18:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.975+0000 7f8005fb2640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fe40664c0 0x7f7fe4068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00b1000 tx=0x7f7ff0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.975+0000 7f7ff67fc640 1 -- 172.21.15.70:0/3349211713 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ff8051c90 con 0x7f8000159170 2023-11-26T07:18:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.975+0000 7fbe98e65640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbe80066470 0x7fbe80068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe84007c20 tx=0x7fbe84001de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.975+0000 7f37cf7fe640 1 -- 172.21.15.70:0/3617462963 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8003600 con 0x7f37e80d1d60 2023-11-26T07:18:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.975+0000 7f37cf7fe640 1 -- 172.21.15.70:0/3617462963 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8003970 con 0x7f37e80d1d60 2023-11-26T07:18:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.975+0000 7f7b517fa640 1 -- 172.21.15.70:0/73528957 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b540b0a00 con 0x7f7b540d1f30 2023-11-26T07:18:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.979+0000 7f37cf7fe640 1 -- 172.21.15.70:0/3617462963 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37d8012400 con 0x7f37e80d1d60 2023-11-26T07:18:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.979+0000 7f37cf7fe640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f37d4066470 0x7f37d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.983+0000 7f37cf7fe640 1 -- 172.21.15.70:0/3617462963 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37d8083b50 con 0x7f37e80d1d60 2023-11-26T07:18:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.983+0000 7f37cf7fe640 1 -- 172.21.15.70:0/3617462963 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37d80ae280 con 0x7f37e80d1d60 2023-11-26T07:18:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.983+0000 7f37e6ffd640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f37d4066470 0x7f37d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:11.987+0000 7f37e6ffd640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f37d4066470 0x7f37d4068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f37dc01a0e0 tx=0x7f37dc0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.223+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73b0155810 con 0x7f73b0163500 2023-11-26T07:18:12.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.227+0000 7f73977fe640 1 -- 172.21.15.70:0/3723244903 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73a8054980 con 0x7f73b0163500 2023-11-26T07:18:12.228 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2023-11-26T07:18:12.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.227+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f739c0664a0 msgr2=0x7f739c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.227+0000 7f73b5079640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f739c0664a0 0x7f739c068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73a001d640 tx=0x7f73a0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b0163500 msgr2=0x7f73b00aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b0163500 0x7f73b00aedf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c780 tx=0x7f73a800cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 shutdown_connections 2023-11-26T07:18:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f739c0664a0 0x7f739c068960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b0163500 0x7f73b00aedf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b015a440 0x7f73b014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 --2- 172.21.15.70:0/3723244903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b00cd9e0 0x7f73b0155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 >> 172.21.15.70:0/3723244903 conn(0x7f73b00aea10 msgr2=0x7f73b0071670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 shutdown_connections 2023-11-26T07:18:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.231+0000 7f73b5079640 1 -- 172.21.15.70:0/3723244903 wait complete. 2023-11-26T07:18:12.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2023-11-26T07:18:12.266 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.275+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2510005510 con 0x7f2530153930 2023-11-26T07:18:12.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f252cff9640 1 -- 172.21.15.70:0/1316570592 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2524017090 con 0x7f2530153930 2023-11-26T07:18:12.280 INFO:teuthology.orchestra.run.smithi070.stdout:55834574856 2023-11-26T07:18:12.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f251c066470 msgr2=0x7f251c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f251c066470 0x7f251c068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2520006aa0 tx=0x7f2520006a30 comp rx=0 tx=0).stop 2023-11-26T07:18:12.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530153930 msgr2=0x7f2530141760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530153930 0x7f2530141760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f252400c450 tx=0x7f252400c910 comp rx=0 tx=0).stop 2023-11-26T07:18:12.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 shutdown_connections 2023-11-26T07:18:12.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f251c066470 0x7f251c068930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2530159690 0x7f25301f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2530153930 0x7f2530141760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 --2- 172.21.15.70:0/1316570592 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2530153550 0x7f253014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 >> 172.21.15.70:0/1316570592 conn(0x7f253006a890 msgr2=0x7f25300ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 shutdown_connections 2023-11-26T07:18:12.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.279+0000 7f2535606640 1 -- 172.21.15.70:0/1316570592 wait complete. 2023-11-26T07:18:12.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.283+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7eff3c0aa530 con 0x7eff3c0b0540 2023-11-26T07:18:12.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.283+0000 7eff31ffb640 1 -- 172.21.15.70:0/1451013808 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff38015090 con 0x7eff3c0b0540 2023-11-26T07:18:12.285 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff200664c0 msgr2=0x7eff20068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff200664c0 0x7eff20068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff340012f0 tx=0x7eff34001430 comp rx=0 tx=0).stop 2023-11-26T07:18:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff3c0b0540 msgr2=0x7eff3c15bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff3c0b0540 0x7eff3c15bd20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7eff3800b410 tx=0x7eff3800b8d0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 shutdown_connections 2023-11-26T07:18:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff200664c0 0x7eff20068980 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff340012f0 tx=0x7eff34001430 comp rx=0 tx=0).stop 2023-11-26T07:18:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff3c0cd4a0 0x7eff3c0ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff3c15a440 0x7eff3c0adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 --2- 172.21.15.70:0/1451013808 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff3c0b0540 0x7eff3c15bd20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 >> 172.21.15.70:0/1451013808 conn(0x7eff3c0aea10 msgr2=0x7eff3c0afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 shutdown_connections 2023-11-26T07:18:12.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.287+0000 7eff433df640 1 -- 172.21.15.70:0/1451013808 wait complete. 2023-11-26T07:18:12.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.295+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe008051920 con 0x7fe008054000 2023-11-26T07:18:12.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.295+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe94067500 con 0x7fbe940a8e90 2023-11-26T07:18:12.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.299+0000 7fdffeffd640 1 -- 172.21.15.70:0/3363023281 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe008051920 con 0x7fe008054000 2023-11-26T07:18:12.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.299+0000 7fbe917fa640 1 -- 172.21.15.70:0/2715044692 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe880ef070 con 0x7fbe940a8e90 2023-11-26T07:18:12.301 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2023-11-26T07:18:12.301 INFO:teuthology.orchestra.run.smithi070.stdout:55834574854 2023-11-26T07:18:12.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdff0066540 msgr2=0x7fdff0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdff0066540 0x7fdff0068a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0080e2f30 tx=0x7fe004009040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 msgr2=0x7fe00802fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00802fa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe00000d5f0 tx=0x7fe00000dab0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.299+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbe80066470 msgr2=0x7fbe80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbe80066470 0x7fbe80068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe84007c20 tx=0x7fbe84001de0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe940a8e90 msgr2=0x7fbe94160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe940a8e90 0x7fbe94160ba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe880ac000 tx=0x7fbe88019950 comp rx=0 tx=0).stop 2023-11-26T07:18:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 shutdown_connections 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdff0066540 0x7fdff0068a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0080e31e0 0x7fe0080329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0080589c0 0x7fe008032480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 --2- 172.21.15.70:0/3363023281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe008054000 0x7fe00802fa80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 >> 172.21.15.70:0/3363023281 conn(0x7fe008059090 msgr2=0x7fe008038a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 shutdown_connections 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbe80066470 0x7fbe80068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe940a9310 0x7fbe941610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbe940a8e90 0x7fbe94160ba0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 --2- 172.21.15.70:0/2715044692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe7c0047d0 0x7fbe940aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 >> 172.21.15.70:0/2715044692 conn(0x7fbe9406c3f0 msgr2=0x7fbe940cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 shutdown_connections 2023-11-26T07:18:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fe014832640 1 -- 172.21.15.70:0/3363023281 wait complete. 2023-11-26T07:18:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 shutdown_connections 2023-11-26T07:18:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7fbe9b0c9640 1 -- 172.21.15.70:0/2715044692 wait complete. 2023-11-26T07:18:12.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8000202be0 con 0x7f8000159170 2023-11-26T07:18:12.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7b540b0a00 con 0x7f7b540d1f30 2023-11-26T07:18:12.307 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2023-11-26T07:18:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7f7ff67fc640 1 -- 172.21.15.70:0/3349211713 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8000202be0 con 0x7f8000159170 2023-11-26T07:18:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.303+0000 7f7b517fa640 1 -- 172.21.15.70:0/73528957 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b540b0a00 con 0x7f7b540d1f30 2023-11-26T07:18:12.308 INFO:teuthology.orchestra.run.smithi070.stdout:55834574855 2023-11-26T07:18:12.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2023-11-26T07:18:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fe40664c0 msgr2=0x7f7fe4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fe40664c0 0x7f7fe4068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00b1000 tx=0x7f7ff0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8000159170 msgr2=0x7f800015bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8000159170 0x7f800015bf90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c7b0 tx=0x7f7ff800cc70 comp rx=0 tx=0).stop 2023-11-26T07:18:12.310 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7b38066470 msgr2=0x7f7b38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7b38066470 0x7f7b38068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b48007fd0 tx=0x7f7b48009040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 msgr2=0x7f7b540b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b60c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7b40019090 tx=0x7f7b540b4390 comp rx=0 tx=0).stop 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 shutdown_connections 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8000159170 0x7f800015bf90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80000ce310 0x7f800015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fe40664c0 0x7f7fe4068980 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 --2- 172.21.15.70:0/3349211713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80000b1710 0x7f80002021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 >> 172.21.15.70:0/3349211713 conn(0x7f80000b0bf0 msgr2=0x7f80000b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 shutdown_connections 2023-11-26T07:18:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7b38066470 0x7f7b38068930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b5415d5b0 0x7f7b541fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b540d1f30 0x7f7b540b60c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 --2- 172.21.15.70:0/73528957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b540b36b0 0x7f7b54155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 shutdown_connections 2023-11-26T07:18:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f8008216640 1 -- 172.21.15.70:0/3349211713 wait complete. 2023-11-26T07:18:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 >> 172.21.15.70:0/73528957 conn(0x7f7b5408cc60 msgr2=0x7f7b540c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 shutdown_connections 2023-11-26T07:18:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f7b5ae9c640 1 -- 172.21.15.70:0/73528957 wait complete. 2023-11-26T07:18:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.307+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f37e80b0b60 con 0x7f37e80d1d60 2023-11-26T07:18:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37cf7fe640 1 -- 172.21.15.70:0/3617462963 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37d8017020 con 0x7f37e80d1d60 2023-11-26T07:18:12.314 INFO:teuthology.orchestra.run.smithi070.stdout:55834574856 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f37d4066470 msgr2=0x7f37d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f37d4066470 0x7f37d4068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f37dc01a0e0 tx=0x7f37dc0b5040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37e80d1d60 msgr2=0x7f37e806c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37e80d1d60 0x7f37e806c4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c460 tx=0x7f37d800c920 comp rx=0 tx=0).stop 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 shutdown_connections 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37e815d5b0 0x7f37e815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37e80d1d60 0x7f37e806c4b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f37d4066470 0x7f37d4068930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 --2- 172.21.15.70:0/3617462963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e80b3880 0x7f37e815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 >> 172.21.15.70:0/3617462963 conn(0x7f37e808cc60 msgr2=0x7f37e80d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 shutdown_connections 2023-11-26T07:18:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.311+0000 7f37ed357640 1 -- 172.21.15.70:0/3617462963 wait complete. 2023-11-26T07:18:12.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2023-11-26T07:18:12.322 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-11-26T07:18:12.340 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-11-26T07:18:12.341 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.7 2023-11-26T07:18:12.346 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-11-26T07:18:12.350 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2023-11-26T07:18:12.351 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:12.351 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-26T07:18:12.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:12.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.527+0000 7fd2b2468640 1 Processor -- start 2023-11-26T07:18:12.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.527+0000 7fd2b2468640 1 -- start start 2023-11-26T07:18:12.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2b2468640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac143ac0 0x7fd2ac070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2b2468640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd2ac0708b0 0x7fd2ac0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2b2468640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0cfbf0 con 0x7fd2ac0cf7c0 2023-11-26T07:18:12.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2b2468640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac143ea0 con 0x7fd2ac0708b0 2023-11-26T07:18:12.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2b2468640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0cc730 con 0x7fd2ac143ac0 2023-11-26T07:18:12.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac143ac0 0x7fd2ac070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2ab7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd2ac0708b0 0x7fd2ac0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2b0a05640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd2ac0cf7c0 0x7fd2ac0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:41054/0 (socket says 172.21.15.70:41054) 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2b0a05640 1 -- 172.21.15.70:0/1034340241 learned_addr learned my addr 172.21.15.70:0/1034340241 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2aaffd640 1 -- 172.21.15.70:0/1034340241 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984252202 0 0) 0x7fd2ac0cfbf0 con 0x7fd2ac0cf7c0 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2aaffd640 1 -- 172.21.15.70:0/1034340241 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd294003530 con 0x7fd2ac0cf7c0 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2abfff640 1 -- 172.21.15.70:0/1034340241 >> v2:172.21.15.120:3300/0 conn(0x7fd2ac0708b0 msgr2=0x7fd2ac0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2abfff640 1 --2- 172.21.15.70:0/1034340241 >> v2:172.21.15.120:3300/0 conn(0x7fd2ac0708b0 0x7fd2ac0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2abfff640 1 -- 172.21.15.70:0/1034340241 >> v1:172.21.15.120:6789/0 conn(0x7fd2ac0cf7c0 legacy=0x7fd2ac0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2abfff640 1 -- 172.21.15.70:0/1034340241 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac070ee0 con 0x7fd2ac143ac0 2023-11-26T07:18:12.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.531+0000 7fd2ab7fe640 1 --2- 172.21.15.70:0/1034340241 >> v2:172.21.15.120:3300/0 conn(0x7fd2ac0708b0 0x7fd2ac0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:12.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2abfff640 1 --2- 172.21.15.70:0/1034340241 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac143ac0 0x7fd2ac070370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d73a1532efbc318 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2aaffd640 1 -- 172.21.15.70:0/1034340241 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0ad640 con 0x7fd2ac143ac0 2023-11-26T07:18:12.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2aaffd640 1 -- 172.21.15.70:0/1034340241 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0ad7a0 con 0x7fd2ac143ac0 2023-11-26T07:18:12.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2aaffd640 1 -- 172.21.15.70:0/1034340241 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0adb30 con 0x7fd2ac143ac0 2023-11-26T07:18:12.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 -- 172.21.15.70:0/1034340241 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac143ac0 msgr2=0x7fd2ac070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1034340241 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac143ac0 0x7fd2ac070370 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097c0 tx=0x7fd29c01c480 comp rx=0 tx=0).stop 2023-11-26T07:18:12.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 -- 172.21.15.70:0/1034340241 shutdown_connections 2023-11-26T07:18:12.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1034340241 >> v2:172.21.15.120:3300/0 conn(0x7fd2ac0708b0 0x7fd2ac0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1034340241 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac143ac0 0x7fd2ac070370 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 -- 172.21.15.70:0/1034340241 >> 172.21.15.70:0/1034340241 conn(0x7fd2ac06a890 msgr2=0x7fd2ac06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 -- 172.21.15.70:0/1034340241 shutdown_connections 2023-11-26T07:18:12.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.535+0000 7fd2b2468640 1 -- 172.21.15.70:0/1034340241 wait complete. 2023-11-26T07:18:12.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 Processor -- start 2023-11-26T07:18:12.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 -- start start 2023-11-26T07:18:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac0708b0 0x7fd2ac0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2ac0cf7c0 0x7fd2ac13f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2ac143ac0 0x7fd2ac142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac15d940 con 0x7fd2ac143ac0 2023-11-26T07:18:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac160160 con 0x7fd2ac0cf7c0 2023-11-26T07:18:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac160440 con 0x7fd2ac0708b0 2023-11-26T07:18:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2ac143ac0 0x7fd2ac142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2ac143ac0 0x7fd2ac142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60308/0 (socket says 172.21.15.70:60308) 2023-11-26T07:18:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac0708b0 0x7fd2ac0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 -- 172.21.15.70:0/1655400792 learned_addr learned my addr 172.21.15.70:0/1655400792 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2ab7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2ac0cf7c0 0x7fd2ac13f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 -- 172.21.15.70:0/1655400792 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac0708b0 msgr2=0x7fd2ac0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac0708b0 0x7fd2ac0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 -- 172.21.15.70:0/1655400792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2ac0cf7c0 msgr2=0x7fd2ac13f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2ac0cf7c0 0x7fd2ac13f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 -- 172.21.15.70:0/1655400792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0009420 con 0x7fd2ac143ac0 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b0a05640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2ac143ac0 0x7fd2ac142630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400cb30 tx=0x7fd2a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2a8ff9640 1 -- 172.21.15.70:0/1655400792 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400aca0 con 0x7fd2ac143ac0 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2a8ff9640 1 -- 172.21.15.70:0/1655400792 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a400ae00 con 0x7fd2ac143ac0 2023-11-26T07:18:12.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2a8ff9640 1 -- 172.21.15.70:0/1655400792 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4012600 con 0x7fd2ac143ac0 2023-11-26T07:18:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c009420 con 0x7fd2ac143ac0 2023-11-26T07:18:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.539+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac15dc00 con 0x7fd2ac143ac0 2023-11-26T07:18:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.543+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac15ddf0 con 0x7fd2ac143ac0 2023-11-26T07:18:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.543+0000 7fd2a8ff9640 1 -- 172.21.15.70:0/1655400792 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2a4012820 con 0x7fd2ac143ac0 2023-11-26T07:18:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.543+0000 7fd2a8ff9640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd298066470 0x7fd298068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.543+0000 7fd2a8ff9640 1 -- 172.21.15.70:0/1655400792 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2a4083d50 con 0x7fd2ac143ac0 2023-11-26T07:18:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.543+0000 7fd2abfff640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd298066470 0x7fd298068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.543+0000 7fd2abfff640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd298066470 0x7fd298068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0af000 tx=0x7fd29c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.547+0000 7fd2a8ff9640 1 -- 172.21.15.70:0/1655400792 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2a4051270 con 0x7fd2ac143ac0 2023-11-26T07:18:12.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.691+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2ac071c30 con 0x7fd298066470 2023-11-26T07:18:12.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.699+0000 7fd2a8ff9640 1 -- 172.21.15.70:0/1655400792 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264572 (secure 0 0 0) 0x7fd29c0a6040 con 0x7fd298066470 2023-11-26T07:18:12.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:12.705 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:18:12.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd298066470 msgr2=0x7fd298068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd298066470 0x7fd298068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0af000 tx=0x7fd29c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:12.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2ac143ac0 msgr2=0x7fd2ac142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2ac143ac0 0x7fd2ac142630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400cb30 tx=0x7fd2a400a060 comp rx=0 tx=0).stop 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 shutdown_connections 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd298066470 0x7fd298068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2ac143ac0 0x7fd2ac142630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2ac0cf7c0 0x7fd2ac13f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 --2- 172.21.15.70:0/1655400792 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2ac0708b0 0x7fd2ac0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 >> 172.21.15.70:0/1655400792 conn(0x7fd2ac06a890 msgr2=0x7fd2ac0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 shutdown_connections 2023-11-26T07:18:12.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.703+0000 7fd2b2468640 1 -- 172.21.15.70:0/1655400792 wait complete. 2023-11-26T07:18:12.724 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-26T07:18:11.995779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231596,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743124,"statfs":{"total":773094113280,"available":772856958976,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.226740"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977709+0000","last_change":"2023-11-26T07:18:03.803784+0000","last_active":"2023-11-26T07:18:04.977709+0000","last_peered":"2023-11-26T07:18:04.977709+0000","last_clean":"2023-11-26T07:18:04.977709+0000","last_became_active":"2023-11-26T07:18:03.803443+0000","last_became_peered":"2023-11-26T07:18:03.803443+0000","last_unstale":"2023-11-26T07:18:04.977709+0000","last_undegraded":"2023-11-26T07:18:04.977709+0000","last_fullsized":"2023-11-26T07:18:04.977709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965901+0000","last_change":"2023-11-26T07:18:03.788975+0000","last_active":"2023-11-26T07:18:04.965901+0000","last_peered":"2023-11-26T07:18:04.965901+0000","last_clean":"2023-11-26T07:18:04.965901+0000","last_became_active":"2023-11-26T07:18:03.788417+0000","last_became_peered":"2023-11-26T07:18:03.788417+0000","last_unstale":"2023-11-26T07:18:04.965901+0000","last_undegraded":"2023-11-26T07:18:04.965901+0000","last_fullsized":"2023-11-26T07:18:04.965901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938823+0000","last_change":"2023-11-26T07:18:03.794288+0000","last_active":"2023-11-26T07:18:04.938823+0000","last_peered":"2023-11-26T07:18:04.938823+0000","last_clean":"2023-11-26T07:18:04.938823+0000","last_became_active":"2023-11-26T07:18:03.794001+0000","last_became_peered":"2023-11-26T07:18:03.794001+0000","last_unstale":"2023-11-26T07:18:04.938823+0000","last_undegraded":"2023-11-26T07:18:04.938823+0000","last_fullsized":"2023-11-26T07:18:04.938823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978274+0000","last_change":"2023-11-26T07:18:03.799214+0000","last_active":"2023-11-26T07:18:04.978274+0000","last_peered":"2023-11-26T07:18:04.978274+0000","last_clean":"2023-11-26T07:18:04.978274+0000","last_became_active":"2023-11-26T07:18:03.798914+0000","last_became_peered":"2023-11-26T07:18:03.798914+0000","last_unstale":"2023-11-26T07:18:04.978274+0000","last_undegraded":"2023-11-26T07:18:04.978274+0000","last_fullsized":"2023-11-26T07:18:04.978274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977291+0000","last_change":"2023-11-26T07:18:03.802078+0000","last_active":"2023-11-26T07:18:04.977291+0000","last_peered":"2023-11-26T07:18:04.977291+0000","last_clean":"2023-11-26T07:18:04.977291+0000","last_became_active":"2023-11-26T07:18:03.801400+0000","last_became_peered":"2023-11-26T07:18:03.801400+0000","last_unstale":"2023-11-26T07:18:04.977291+0000","last_undegraded":"2023-11-26T07:18:04.977291+0000","last_fullsized":"2023-11-26T07:18:04.977291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978001+0000","last_change":"2023-11-26T07:18:03.797285+0000","last_active":"2023-11-26T07:18:04.978001+0000","last_peered":"2023-11-26T07:18:04.978001+0000","last_clean":"2023-11-26T07:18:04.978001+0000","last_became_active":"2023-11-26T07:18:03.796973+0000","last_became_peered":"2023-11-26T07:18:03.796973+0000","last_unstale":"2023-11-26T07:18:04.978001+0000","last_undegraded":"2023-11-26T07:18:04.978001+0000","last_fullsized":"2023-11-26T07:18:04.978001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977015+0000","last_change":"2023-11-26T07:18:03.801957+0000","last_active":"2023-11-26T07:18:04.977015+0000","last_peered":"2023-11-26T07:18:04.977015+0000","last_clean":"2023-11-26T07:18:04.977015+0000","last_became_active":"2023-11-26T07:18:03.801666+0000","last_became_peered":"2023-11-26T07:18:03.801666+0000","last_unstale":"2023-11-26T07:18:04.977015+0000","last_undegraded":"2023-11-26T07:18:04.977015+0000","last_fullsized":"2023-11-26T07:18:04.977015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777954+0000","last_change":"2023-11-26T07:18:03.795903+0000","last_active":"2023-11-26T07:18:04.777954+0000","last_peered":"2023-11-26T07:18:04.777954+0000","last_clean":"2023-11-26T07:18:04.777954+0000","last_became_active":"2023-11-26T07:18:03.795634+0000","last_became_peered":"2023-11-26T07:18:03.795634+0000","last_unstale":"2023-11-26T07:18:04.777954+0000","last_undegraded":"2023-11-26T07:18:04.777954+0000","last_fullsized":"2023-11-26T07:18:04.777954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977838+0000","last_change":"2023-11-26T07:18:03.807314+0000","last_active":"2023-11-26T07:18:04.977838+0000","last_peered":"2023-11-26T07:18:04.977838+0000","last_clean":"2023-11-26T07:18:04.977838+0000","last_became_active":"2023-11-26T07:18:03.806735+0000","last_became_peered":"2023-11-26T07:18:03.806735+0000","last_unstale":"2023-11-26T07:18:04.977838+0000","last_undegraded":"2023-11-26T07:18:04.977838+0000","last_fullsized":"2023-11-26T07:18:04.977838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:41:15.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977563+0000","last_change":"2023-11-26T07:18:03.799600+0000","last_active":"2023-11-26T07:18:04.977563+0000","last_peered":"2023-11-26T07:18:04.977563+0000","last_clean":"2023-11-26T07:18:04.977563+0000","last_became_active":"2023-11-26T07:18:03.799261+0000","last_became_peered":"2023-11-26T07:18:03.799261+0000","last_unstale":"2023-11-26T07:18:04.977563+0000","last_undegraded":"2023-11-26T07:18:04.977563+0000","last_fullsized":"2023-11-26T07:18:04.977563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977141+0000","last_change":"2023-11-26T07:18:03.800938+0000","last_active":"2023-11-26T07:18:04.977141+0000","last_peered":"2023-11-26T07:18:04.977141+0000","last_clean":"2023-11-26T07:18:04.977141+0000","last_became_active":"2023-11-26T07:18:03.800617+0000","last_became_peered":"2023-11-26T07:18:03.800617+0000","last_unstale":"2023-11-26T07:18:04.977141+0000","last_undegraded":"2023-11-26T07:18:04.977141+0000","last_fullsized":"2023-11-26T07:18:04.977141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777870+0000","last_change":"2023-11-26T07:18:03.782200+0000","last_active":"2023-11-26T07:18:04.777870+0000","last_peered":"2023-11-26T07:18:04.777870+0000","last_clean":"2023-11-26T07:18:04.777870+0000","last_became_active":"2023-11-26T07:18:03.781899+0000","last_became_peered":"2023-11-26T07:18:03.781899+0000","last_unstale":"2023-11-26T07:18:04.777870+0000","last_undegraded":"2023-11-26T07:18:04.777870+0000","last_fullsized":"2023-11-26T07:18:04.777870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778374+0000","last_change":"2023-11-26T07:18:03.779335+0000","last_active":"2023-11-26T07:18:04.778374+0000","last_peered":"2023-11-26T07:18:04.778374+0000","last_clean":"2023-11-26T07:18:04.778374+0000","last_became_active":"2023-11-26T07:18:03.779062+0000","last_became_peered":"2023-11-26T07:18:03.779062+0000","last_unstale":"2023-11-26T07:18:04.778374+0000","last_undegraded":"2023-11-26T07:18:04.778374+0000","last_fullsized":"2023-11-26T07:18:04.778374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938632+0000","last_change":"2023-11-26T07:18:03.785565+0000","last_active":"2023-11-26T07:18:04.938632+0000","last_peered":"2023-11-26T07:18:04.938632+0000","last_clean":"2023-11-26T07:18:04.938632+0000","last_became_active":"2023-11-26T07:18:03.785185+0000","last_became_peered":"2023-11-26T07:18:03.785185+0000","last_unstale":"2023-11-26T07:18:04.938632+0000","last_undegraded":"2023-11-26T07:18:04.938632+0000","last_fullsized":"2023-11-26T07:18:04.938632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:51.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965569+0000","last_change":"2023-11-26T07:18:03.794642+0000","last_active":"2023-11-26T07:18:04.965569+0000","last_peered":"2023-11-26T07:18:04.965569+0000","last_clean":"2023-11-26T07:18:04.965569+0000","last_became_active":"2023-11-26T07:18:03.794199+0000","last_became_peered":"2023-11-26T07:18:03.794199+0000","last_unstale":"2023-11-26T07:18:04.965569+0000","last_undegraded":"2023-11-26T07:18:04.965569+0000","last_fullsized":"2023-11-26T07:18:04.965569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977524+0000","last_change":"2023-11-26T07:18:03.793156+0000","last_active":"2023-11-26T07:18:04.977524+0000","last_peered":"2023-11-26T07:18:04.977524+0000","last_clean":"2023-11-26T07:18:04.977524+0000","last_became_active":"2023-11-26T07:18:03.792834+0000","last_became_peered":"2023-11-26T07:18:03.792834+0000","last_unstale":"2023-11-26T07:18:04.977524+0000","last_undegraded":"2023-11-26T07:18:04.977524+0000","last_fullsized":"2023-11-26T07:18:04.977524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978940+0000","last_change":"2023-11-26T07:18:03.805692+0000","last_active":"2023-11-26T07:18:04.978940+0000","last_peered":"2023-11-26T07:18:04.978940+0000","last_clean":"2023-11-26T07:18:04.978940+0000","last_became_active":"2023-11-26T07:18:03.805350+0000","last_became_peered":"2023-11-26T07:18:03.805350+0000","last_unstale":"2023-11-26T07:18:04.978940+0000","last_undegraded":"2023-11-26T07:18:04.978940+0000","last_fullsized":"2023-11-26T07:18:04.978940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777433+0000","last_change":"2023-11-26T07:18:03.786256+0000","last_active":"2023-11-26T07:18:04.777433+0000","last_peered":"2023-11-26T07:18:04.777433+0000","last_clean":"2023-11-26T07:18:04.777433+0000","last_became_active":"2023-11-26T07:18:03.785953+0000","last_became_peered":"2023-11-26T07:18:03.785953+0000","last_unstale":"2023-11-26T07:18:04.777433+0000","last_undegraded":"2023-11-26T07:18:04.777433+0000","last_fullsized":"2023-11-26T07:18:04.777433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978040+0000","last_change":"2023-11-26T07:18:03.803009+0000","last_active":"2023-11-26T07:18:04.978040+0000","last_peered":"2023-11-26T07:18:04.978040+0000","last_clean":"2023-11-26T07:18:04.978040+0000","last_became_active":"2023-11-26T07:18:03.802310+0000","last_became_peered":"2023-11-26T07:18:03.802310+0000","last_unstale":"2023-11-26T07:18:04.978040+0000","last_undegraded":"2023-11-26T07:18:04.978040+0000","last_fullsized":"2023-11-26T07:18:04.978040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:51.419753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977730+0000","last_change":"2023-11-26T07:18:03.785169+0000","last_active":"2023-11-26T07:18:04.977730+0000","last_peered":"2023-11-26T07:18:04.977730+0000","last_clean":"2023-11-26T07:18:04.977730+0000","last_became_active":"2023-11-26T07:18:03.784952+0000","last_became_peered":"2023-11-26T07:18:03.784952+0000","last_unstale":"2023-11-26T07:18:04.977730+0000","last_undegraded":"2023-11-26T07:18:04.977730+0000","last_fullsized":"2023-11-26T07:18:04.977730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938762+0000","last_change":"2023-11-26T07:18:03.788071+0000","last_active":"2023-11-26T07:18:04.938762+0000","last_peered":"2023-11-26T07:18:04.938762+0000","last_clean":"2023-11-26T07:18:04.938762+0000","last_became_active":"2023-11-26T07:18:03.787821+0000","last_became_peered":"2023-11-26T07:18:03.787821+0000","last_unstale":"2023-11-26T07:18:04.938762+0000","last_undegraded":"2023-11-26T07:18:04.938762+0000","last_fullsized":"2023-11-26T07:18:04.938762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978153+0000","last_change":"2023-11-26T07:18:03.804426+0000","last_active":"2023-11-26T07:18:04.978153+0000","last_peered":"2023-11-26T07:18:04.978153+0000","last_clean":"2023-11-26T07:18:04.978153+0000","last_became_active":"2023-11-26T07:18:03.804150+0000","last_became_peered":"2023-11-26T07:18:03.804150+0000","last_unstale":"2023-11-26T07:18:04.978153+0000","last_undegraded":"2023-11-26T07:18:04.978153+0000","last_fullsized":"2023-11-26T07:18:04.978153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778267+0000","last_change":"2023-11-26T07:18:03.787986+0000","last_active":"2023-11-26T07:18:04.778267+0000","last_peered":"2023-11-26T07:18:04.778267+0000","last_clean":"2023-11-26T07:18:04.778267+0000","last_became_active":"2023-11-26T07:18:03.787730+0000","last_became_peered":"2023-11-26T07:18:03.787730+0000","last_unstale":"2023-11-26T07:18:04.778267+0000","last_undegraded":"2023-11-26T07:18:04.778267+0000","last_fullsized":"2023-11-26T07:18:04.778267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978264+0000","last_change":"2023-11-26T07:18:03.792214+0000","last_active":"2023-11-26T07:18:04.978264+0000","last_peered":"2023-11-26T07:18:04.978264+0000","last_clean":"2023-11-26T07:18:04.978264+0000","last_became_active":"2023-11-26T07:18:03.791863+0000","last_became_peered":"2023-11-26T07:18:03.791863+0000","last_unstale":"2023-11-26T07:18:04.978264+0000","last_undegraded":"2023-11-26T07:18:04.978264+0000","last_fullsized":"2023-11-26T07:18:04.978264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778641+0000","last_change":"2023-11-26T07:18:03.788356+0000","last_active":"2023-11-26T07:18:04.778641+0000","last_peered":"2023-11-26T07:18:04.778641+0000","last_clean":"2023-11-26T07:18:04.778641+0000","last_became_active":"2023-11-26T07:18:03.788037+0000","last_became_peered":"2023-11-26T07:18:03.788037+0000","last_unstale":"2023-11-26T07:18:04.778641+0000","last_undegraded":"2023-11-26T07:18:04.778641+0000","last_fullsized":"2023-11-26T07:18:04.778641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977702+0000","last_change":"2023-11-26T07:18:03.798506+0000","last_active":"2023-11-26T07:18:04.977702+0000","last_peered":"2023-11-26T07:18:04.977702+0000","last_clean":"2023-11-26T07:18:04.977702+0000","last_became_active":"2023-11-26T07:18:03.798181+0000","last_became_peered":"2023-11-26T07:18:03.798181+0000","last_unstale":"2023-11-26T07:18:04.977702+0000","last_undegraded":"2023-11-26T07:18:04.977702+0000","last_fullsized":"2023-11-26T07:18:04.977702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965715+0000","last_change":"2023-11-26T07:18:03.792464+0000","last_active":"2023-11-26T07:18:04.965715+0000","last_peered":"2023-11-26T07:18:04.965715+0000","last_clean":"2023-11-26T07:18:04.965715+0000","last_became_active":"2023-11-26T07:18:03.792203+0000","last_became_peered":"2023-11-26T07:18:03.792203+0000","last_unstale":"2023-11-26T07:18:04.965715+0000","last_undegraded":"2023-11-26T07:18:04.965715+0000","last_fullsized":"2023-11-26T07:18:04.965715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778594+0000","last_change":"2023-11-26T07:18:03.788844+0000","last_active":"2023-11-26T07:18:04.778594+0000","last_peered":"2023-11-26T07:18:04.778594+0000","last_clean":"2023-11-26T07:18:04.778594+0000","last_became_active":"2023-11-26T07:18:03.786561+0000","last_became_peered":"2023-11-26T07:18:03.786561+0000","last_unstale":"2023-11-26T07:18:04.778594+0000","last_undegraded":"2023-11-26T07:18:04.778594+0000","last_fullsized":"2023-11-26T07:18:04.778594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938878+0000","last_change":"2023-11-26T07:18:03.791815+0000","last_active":"2023-11-26T07:18:04.938878+0000","last_peered":"2023-11-26T07:18:04.938878+0000","last_clean":"2023-11-26T07:18:04.938878+0000","last_became_active":"2023-11-26T07:18:03.790584+0000","last_became_peered":"2023-11-26T07:18:03.790584+0000","last_unstale":"2023-11-26T07:18:04.938878+0000","last_undegraded":"2023-11-26T07:18:04.938878+0000","last_fullsized":"2023-11-26T07:18:04.938878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978434+0000","last_change":"2023-11-26T07:18:03.792243+0000","last_active":"2023-11-26T07:18:04.978434+0000","last_peered":"2023-11-26T07:18:04.978434+0000","last_clean":"2023-11-26T07:18:04.978434+0000","last_became_active":"2023-11-26T07:18:03.791879+0000","last_became_peered":"2023-11-26T07:18:03.791879+0000","last_unstale":"2023-11-26T07:18:04.978434+0000","last_undegraded":"2023-11-26T07:18:04.978434+0000","last_fullsized":"2023-11-26T07:18:04.978434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777242+0000","last_change":"2023-11-26T07:18:03.795359+0000","last_active":"2023-11-26T07:18:04.777242+0000","last_peered":"2023-11-26T07:18:04.777242+0000","last_clean":"2023-11-26T07:18:04.777242+0000","last_became_active":"2023-11-26T07:18:03.795059+0000","last_became_peered":"2023-11-26T07:18:03.795059+0000","last_unstale":"2023-11-26T07:18:04.777242+0000","last_undegraded":"2023-11-26T07:18:04.777242+0000","last_fullsized":"2023-11-26T07:18:04.777242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977195+0000","last_change":"2023-11-26T07:18:03.788871+0000","last_active":"2023-11-26T07:18:04.977195+0000","last_peered":"2023-11-26T07:18:04.977195+0000","last_clean":"2023-11-26T07:18:04.977195+0000","last_became_active":"2023-11-26T07:18:03.788343+0000","last_became_peered":"2023-11-26T07:18:03.788343+0000","last_unstale":"2023-11-26T07:18:04.977195+0000","last_undegraded":"2023-11-26T07:18:04.977195+0000","last_fullsized":"2023-11-26T07:18:04.977195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777489+0000","last_change":"2023-11-26T07:18:03.782615+0000","last_active":"2023-11-26T07:18:04.777489+0000","last_peered":"2023-11-26T07:18:04.777489+0000","last_clean":"2023-11-26T07:18:04.777489+0000","last_became_active":"2023-11-26T07:18:03.782335+0000","last_became_peered":"2023-11-26T07:18:03.782335+0000","last_unstale":"2023-11-26T07:18:04.777489+0000","last_undegraded":"2023-11-26T07:18:04.777489+0000","last_fullsized":"2023-11-26T07:18:04.777489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:52:23.941794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778588+0000","last_change":"2023-11-26T07:18:03.122861+0000","last_active":"2023-11-26T07:18:04.778588+0000","last_peered":"2023-11-26T07:18:04.778588+0000","last_clean":"2023-11-26T07:18:04.778588+0000","last_became_active":"2023-11-26T07:18:03.122492+0000","last_became_peered":"2023-11-26T07:18:03.122492+0000","last_unstale":"2023-11-26T07:18:04.778588+0000","last_undegraded":"2023-11-26T07:18:04.778588+0000","last_fullsized":"2023-11-26T07:18:04.778588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938948+0000","last_change":"2023-11-26T07:18:03.798092+0000","last_active":"2023-11-26T07:18:04.938948+0000","last_peered":"2023-11-26T07:18:04.938948+0000","last_clean":"2023-11-26T07:18:04.938948+0000","last_became_active":"2023-11-26T07:18:03.797852+0000","last_became_peered":"2023-11-26T07:18:03.797852+0000","last_unstale":"2023-11-26T07:18:04.938948+0000","last_undegraded":"2023-11-26T07:18:04.938948+0000","last_fullsized":"2023-11-26T07:18:04.938948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977463+0000","last_change":"2023-11-26T07:18:03.119997+0000","last_active":"2023-11-26T07:18:04.977463+0000","last_peered":"2023-11-26T07:18:04.977463+0000","last_clean":"2023-11-26T07:18:04.977463+0000","last_became_active":"2023-11-26T07:18:03.118909+0000","last_became_peered":"2023-11-26T07:18:03.118909+0000","last_unstale":"2023-11-26T07:18:04.977463+0000","last_undegraded":"2023-11-26T07:18:04.977463+0000","last_fullsized":"2023-11-26T07:18:04.977463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:52.437449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778203+0000","last_change":"2023-11-26T07:18:03.122995+0000","last_active":"2023-11-26T07:18:04.778203+0000","last_peered":"2023-11-26T07:18:04.778203+0000","last_clean":"2023-11-26T07:18:04.778203+0000","last_became_active":"2023-11-26T07:18:03.122228+0000","last_became_peered":"2023-11-26T07:18:03.122228+0000","last_unstale":"2023-11-26T07:18:04.778203+0000","last_undegraded":"2023-11-26T07:18:04.778203+0000","last_fullsized":"2023-11-26T07:18:04.778203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777996+0000","last_change":"2023-11-26T07:18:03.782237+0000","last_active":"2023-11-26T07:18:04.777996+0000","last_peered":"2023-11-26T07:18:04.777996+0000","last_clean":"2023-11-26T07:18:04.777996+0000","last_became_active":"2023-11-26T07:18:03.782008+0000","last_became_peered":"2023-11-26T07:18:03.782008+0000","last_unstale":"2023-11-26T07:18:04.777996+0000","last_undegraded":"2023-11-26T07:18:04.777996+0000","last_fullsized":"2023-11-26T07:18:04.777996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977820+0000","last_change":"2023-11-26T07:18:03.131480+0000","last_active":"2023-11-26T07:18:04.977820+0000","last_peered":"2023-11-26T07:18:04.977820+0000","last_clean":"2023-11-26T07:18:04.977820+0000","last_became_active":"2023-11-26T07:18:03.131082+0000","last_became_peered":"2023-11-26T07:18:03.131082+0000","last_unstale":"2023-11-26T07:18:04.977820+0000","last_undegraded":"2023-11-26T07:18:04.977820+0000","last_fullsized":"2023-11-26T07:18:04.977820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965576+0000","last_change":"2023-11-26T07:18:03.796258+0000","last_active":"2023-11-26T07:18:04.965576+0000","last_peered":"2023-11-26T07:18:04.965576+0000","last_clean":"2023-11-26T07:18:04.965576+0000","last_became_active":"2023-11-26T07:18:03.795927+0000","last_became_peered":"2023-11-26T07:18:03.795927+0000","last_unstale":"2023-11-26T07:18:04.965576+0000","last_undegraded":"2023-11-26T07:18:04.965576+0000","last_fullsized":"2023-11-26T07:18:04.965576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978098+0000","last_change":"2023-11-26T07:18:03.129331+0000","last_active":"2023-11-26T07:18:04.978098+0000","last_peered":"2023-11-26T07:18:04.978098+0000","last_clean":"2023-11-26T07:18:04.978098+0000","last_became_active":"2023-11-26T07:18:03.129008+0000","last_became_peered":"2023-11-26T07:18:03.129008+0000","last_unstale":"2023-11-26T07:18:04.978098+0000","last_undegraded":"2023-11-26T07:18:04.978098+0000","last_fullsized":"2023-11-26T07:18:04.978098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978607+0000","last_change":"2023-11-26T07:18:03.805685+0000","last_active":"2023-11-26T07:18:04.978607+0000","last_peered":"2023-11-26T07:18:04.978607+0000","last_clean":"2023-11-26T07:18:04.978607+0000","last_became_active":"2023-11-26T07:18:03.805338+0000","last_became_peered":"2023-11-26T07:18:03.805338+0000","last_unstale":"2023-11-26T07:18:04.978607+0000","last_undegraded":"2023-11-26T07:18:04.978607+0000","last_fullsized":"2023-11-26T07:18:04.978607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978665+0000","last_change":"2023-11-26T07:18:03.126035+0000","last_active":"2023-11-26T07:18:04.978665+0000","last_peered":"2023-11-26T07:18:04.978665+0000","last_clean":"2023-11-26T07:18:04.978665+0000","last_became_active":"2023-11-26T07:18:03.125604+0000","last_became_peered":"2023-11-26T07:18:03.125604+0000","last_unstale":"2023-11-26T07:18:04.978665+0000","last_undegraded":"2023-11-26T07:18:04.978665+0000","last_fullsized":"2023-11-26T07:18:04.978665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938971+0000","last_change":"2023-11-26T07:18:03.804355+0000","last_active":"2023-11-26T07:18:04.938971+0000","last_peered":"2023-11-26T07:18:04.938971+0000","last_clean":"2023-11-26T07:18:04.938971+0000","last_became_active":"2023-11-26T07:18:03.804058+0000","last_became_peered":"2023-11-26T07:18:03.804058+0000","last_unstale":"2023-11-26T07:18:04.938971+0000","last_undegraded":"2023-11-26T07:18:04.938971+0000","last_fullsized":"2023-11-26T07:18:04.938971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965755+0000","last_change":"2023-11-26T07:18:03.126934+0000","last_active":"2023-11-26T07:18:04.965755+0000","last_peered":"2023-11-26T07:18:04.965755+0000","last_clean":"2023-11-26T07:18:04.965755+0000","last_became_active":"2023-11-26T07:18:03.126627+0000","last_became_peered":"2023-11-26T07:18:03.126627+0000","last_unstale":"2023-11-26T07:18:04.965755+0000","last_undegraded":"2023-11-26T07:18:04.965755+0000","last_fullsized":"2023-11-26T07:18:04.965755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777968+0000","last_change":"2023-11-26T07:18:03.800970+0000","last_active":"2023-11-26T07:18:04.777968+0000","last_peered":"2023-11-26T07:18:04.777968+0000","last_clean":"2023-11-26T07:18:04.777968+0000","last_became_active":"2023-11-26T07:18:03.800703+0000","last_became_peered":"2023-11-26T07:18:03.800703+0000","last_unstale":"2023-11-26T07:18:04.777968+0000","last_undegraded":"2023-11-26T07:18:04.777968+0000","last_fullsized":"2023-11-26T07:18:04.777968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977831+0000","last_change":"2023-11-26T07:18:03.121777+0000","last_active":"2023-11-26T07:18:04.977831+0000","last_peered":"2023-11-26T07:18:04.977831+0000","last_clean":"2023-11-26T07:18:04.977831+0000","last_became_active":"2023-11-26T07:18:03.121509+0000","last_became_peered":"2023-11-26T07:18:03.121509+0000","last_unstale":"2023-11-26T07:18:04.977831+0000","last_undegraded":"2023-11-26T07:18:04.977831+0000","last_fullsized":"2023-11-26T07:18:04.977831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977200+0000","last_change":"2023-11-26T07:18:03.802994+0000","last_active":"2023-11-26T07:18:04.977200+0000","last_peered":"2023-11-26T07:18:04.977200+0000","last_clean":"2023-11-26T07:18:04.977200+0000","last_became_active":"2023-11-26T07:18:03.801952+0000","last_became_peered":"2023-11-26T07:18:03.801952+0000","last_unstale":"2023-11-26T07:18:04.977200+0000","last_undegraded":"2023-11-26T07:18:04.977200+0000","last_fullsized":"2023-11-26T07:18:04.977200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.939000+0000","last_change":"2023-11-26T07:18:03.119803+0000","last_active":"2023-11-26T07:18:04.939000+0000","last_peered":"2023-11-26T07:18:04.939000+0000","last_clean":"2023-11-26T07:18:04.939000+0000","last_became_active":"2023-11-26T07:18:03.119500+0000","last_became_peered":"2023-11-26T07:18:03.119500+0000","last_unstale":"2023-11-26T07:18:04.939000+0000","last_undegraded":"2023-11-26T07:18:04.939000+0000","last_fullsized":"2023-11-26T07:18:04.939000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938639+0000","last_change":"2023-11-26T07:18:03.785862+0000","last_active":"2023-11-26T07:18:04.938639+0000","last_peered":"2023-11-26T07:18:04.938639+0000","last_clean":"2023-11-26T07:18:04.938639+0000","last_became_active":"2023-11-26T07:18:03.784616+0000","last_became_peered":"2023-11-26T07:18:03.784616+0000","last_unstale":"2023-11-26T07:18:04.938639+0000","last_undegraded":"2023-11-26T07:18:04.938639+0000","last_fullsized":"2023-11-26T07:18:04.938639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978559+0000","last_change":"2023-11-26T07:18:03.129914+0000","last_active":"2023-11-26T07:18:04.978559+0000","last_peered":"2023-11-26T07:18:04.978559+0000","last_clean":"2023-11-26T07:18:04.978559+0000","last_became_active":"2023-11-26T07:18:03.127006+0000","last_became_peered":"2023-11-26T07:18:03.127006+0000","last_unstale":"2023-11-26T07:18:04.978559+0000","last_undegraded":"2023-11-26T07:18:04.978559+0000","last_fullsized":"2023-11-26T07:18:04.978559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:54.492600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977454+0000","last_change":"2023-11-26T07:18:03.802395+0000","last_active":"2023-11-26T07:18:04.977454+0000","last_peered":"2023-11-26T07:18:04.977454+0000","last_clean":"2023-11-26T07:18:04.977454+0000","last_became_active":"2023-11-26T07:18:03.801740+0000","last_became_peered":"2023-11-26T07:18:03.801740+0000","last_unstale":"2023-11-26T07:18:04.977454+0000","last_undegraded":"2023-11-26T07:18:04.977454+0000","last_fullsized":"2023-11-26T07:18:04.977454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977360+0000","last_change":"2023-11-26T07:18:03.119783+0000","last_active":"2023-11-26T07:18:04.977360+0000","last_peered":"2023-11-26T07:18:04.977360+0000","last_clean":"2023-11-26T07:18:04.977360+0000","last_became_active":"2023-11-26T07:18:03.119326+0000","last_became_peered":"2023-11-26T07:18:03.119326+0000","last_unstale":"2023-11-26T07:18:04.977360+0000","last_undegraded":"2023-11-26T07:18:04.977360+0000","last_fullsized":"2023-11-26T07:18:04.977360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977326+0000","last_change":"2023-11-26T07:18:03.788692+0000","last_active":"2023-11-26T07:18:04.977326+0000","last_peered":"2023-11-26T07:18:04.977326+0000","last_clean":"2023-11-26T07:18:04.977326+0000","last_became_active":"2023-11-26T07:18:03.787971+0000","last_became_peered":"2023-11-26T07:18:03.787971+0000","last_unstale":"2023-11-26T07:18:04.977326+0000","last_undegraded":"2023-11-26T07:18:04.977326+0000","last_fullsized":"2023-11-26T07:18:04.977326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777168+0000","last_change":"2023-11-26T07:18:03.116346+0000","last_active":"2023-11-26T07:18:04.777168+0000","last_peered":"2023-11-26T07:18:04.777168+0000","last_clean":"2023-11-26T07:18:04.777168+0000","last_became_active":"2023-11-26T07:18:03.115334+0000","last_became_peered":"2023-11-26T07:18:03.115334+0000","last_unstale":"2023-11-26T07:18:04.777168+0000","last_undegraded":"2023-11-26T07:18:04.777168+0000","last_fullsized":"2023-11-26T07:18:04.777168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977145+0000","last_change":"2023-11-26T07:18:03.804750+0000","last_active":"2023-11-26T07:18:04.977145+0000","last_peered":"2023-11-26T07:18:04.977145+0000","last_clean":"2023-11-26T07:18:04.977145+0000","last_became_active":"2023-11-26T07:18:03.804469+0000","last_became_peered":"2023-11-26T07:18:03.804469+0000","last_unstale":"2023-11-26T07:18:04.977145+0000","last_undegraded":"2023-11-26T07:18:04.977145+0000","last_fullsized":"2023-11-26T07:18:04.977145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777925+0000","last_change":"2023-11-26T07:18:03.114861+0000","last_active":"2023-11-26T07:18:04.777925+0000","last_peered":"2023-11-26T07:18:04.777925+0000","last_clean":"2023-11-26T07:18:04.777925+0000","last_became_active":"2023-11-26T07:18:03.114411+0000","last_became_peered":"2023-11-26T07:18:03.114411+0000","last_unstale":"2023-11-26T07:18:04.777925+0000","last_undegraded":"2023-11-26T07:18:04.777925+0000","last_fullsized":"2023-11-26T07:18:04.777925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977491+0000","last_change":"2023-11-26T07:18:03.803915+0000","last_active":"2023-11-26T07:18:04.977491+0000","last_peered":"2023-11-26T07:18:04.977491+0000","last_clean":"2023-11-26T07:18:04.977491+0000","last_became_active":"2023-11-26T07:18:03.803548+0000","last_became_peered":"2023-11-26T07:18:03.803548+0000","last_unstale":"2023-11-26T07:18:04.977491+0000","last_undegraded":"2023-11-26T07:18:04.977491+0000","last_fullsized":"2023-11-26T07:18:04.977491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777516+0000","last_change":"2023-11-26T07:18:03.124858+0000","last_active":"2023-11-26T07:18:04.777516+0000","last_peered":"2023-11-26T07:18:04.777516+0000","last_clean":"2023-11-26T07:18:04.777516+0000","last_became_active":"2023-11-26T07:18:03.123588+0000","last_became_peered":"2023-11-26T07:18:03.123588+0000","last_unstale":"2023-11-26T07:18:04.777516+0000","last_undegraded":"2023-11-26T07:18:04.777516+0000","last_fullsized":"2023-11-26T07:18:04.777516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977979+0000","last_change":"2023-11-26T07:18:03.805118+0000","last_active":"2023-11-26T07:18:04.977979+0000","last_peered":"2023-11-26T07:18:04.977979+0000","last_clean":"2023-11-26T07:18:04.977979+0000","last_became_active":"2023-11-26T07:18:03.804832+0000","last_became_peered":"2023-11-26T07:18:03.804832+0000","last_unstale":"2023-11-26T07:18:04.977979+0000","last_undegraded":"2023-11-26T07:18:04.977979+0000","last_fullsized":"2023-11-26T07:18:04.977979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:53:49.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965859+0000","last_change":"2023-11-26T07:18:03.118704+0000","last_active":"2023-11-26T07:18:04.965859+0000","last_peered":"2023-11-26T07:18:04.965859+0000","last_clean":"2023-11-26T07:18:04.965859+0000","last_became_active":"2023-11-26T07:18:03.118402+0000","last_became_peered":"2023-11-26T07:18:03.118402+0000","last_unstale":"2023-11-26T07:18:04.965859+0000","last_undegraded":"2023-11-26T07:18:04.965859+0000","last_fullsized":"2023-11-26T07:18:04.965859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:50.691370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978517+0000","last_change":"2023-11-26T07:18:03.798976+0000","last_active":"2023-11-26T07:18:04.978517+0000","last_peered":"2023-11-26T07:18:04.978517+0000","last_clean":"2023-11-26T07:18:04.978517+0000","last_became_active":"2023-11-26T07:18:03.798378+0000","last_became_peered":"2023-11-26T07:18:03.798378+0000","last_unstale":"2023-11-26T07:18:04.978517+0000","last_undegraded":"2023-11-26T07:18:04.978517+0000","last_fullsized":"2023-11-26T07:18:04.978517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777254+0000","last_change":"2023-11-26T07:18:03.127701+0000","last_active":"2023-11-26T07:18:04.777254+0000","last_peered":"2023-11-26T07:18:04.777254+0000","last_clean":"2023-11-26T07:18:04.777254+0000","last_became_active":"2023-11-26T07:18:03.127297+0000","last_became_peered":"2023-11-26T07:18:03.127297+0000","last_unstale":"2023-11-26T07:18:04.777254+0000","last_undegraded":"2023-11-26T07:18:04.777254+0000","last_fullsized":"2023-11-26T07:18:04.777254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:07.033733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978097+0000","last_change":"2023-11-26T07:18:03.805806+0000","last_active":"2023-11-26T07:18:04.978097+0000","last_peered":"2023-11-26T07:18:04.978097+0000","last_clean":"2023-11-26T07:18:04.978097+0000","last_became_active":"2023-11-26T07:18:03.805531+0000","last_became_peered":"2023-11-26T07:18:03.805531+0000","last_unstale":"2023-11-26T07:18:04.978097+0000","last_undegraded":"2023-11-26T07:18:04.978097+0000","last_fullsized":"2023-11-26T07:18:04.978097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:20.912837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:18:03.786995+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:18:03.786995+0000","last_peered":"2023-11-26T07:18:03.786995+0000","last_clean":"2023-11-26T07:18:03.786995+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:18:03.786995+0000","last_undegraded":"2023-11-26T07:18:03.786995+0000","last_fullsized":"2023-11-26T07:18:03.786995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977910+0000","last_change":"2023-11-26T07:18:03.116264+0000","last_active":"2023-11-26T07:18:04.977910+0000","last_peered":"2023-11-26T07:18:04.977910+0000","last_clean":"2023-11-26T07:18:04.977910+0000","last_became_active":"2023-11-26T07:18:03.113528+0000","last_became_peered":"2023-11-26T07:18:03.113528+0000","last_unstale":"2023-11-26T07:18:04.977910+0000","last_undegraded":"2023-11-26T07:18:04.977910+0000","last_fullsized":"2023-11-26T07:18:04.977910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778371+0000","last_change":"2023-11-26T07:18:03.799200+0000","last_active":"2023-11-26T07:18:04.778371+0000","last_peered":"2023-11-26T07:18:04.778371+0000","last_clean":"2023-11-26T07:18:04.778371+0000","last_became_active":"2023-11-26T07:18:03.798900+0000","last_became_peered":"2023-11-26T07:18:03.798900+0000","last_unstale":"2023-11-26T07:18:04.778371+0000","last_undegraded":"2023-11-26T07:18:04.778371+0000","last_fullsized":"2023-11-26T07:18:04.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977542+0000","last_change":"2023-11-26T07:18:03.118573+0000","last_active":"2023-11-26T07:18:04.977542+0000","last_peered":"2023-11-26T07:18:04.977542+0000","last_clean":"2023-11-26T07:18:04.977542+0000","last_became_active":"2023-11-26T07:18:03.118279+0000","last_became_peered":"2023-11-26T07:18:03.118279+0000","last_unstale":"2023-11-26T07:18:04.977542+0000","last_undegraded":"2023-11-26T07:18:04.977542+0000","last_fullsized":"2023-11-26T07:18:04.977542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:32.911964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938502+0000","last_change":"2023-11-26T07:18:03.787057+0000","last_active":"2023-11-26T07:18:04.938502+0000","last_peered":"2023-11-26T07:18:04.938502+0000","last_clean":"2023-11-26T07:18:04.938502+0000","last_became_active":"2023-11-26T07:18:03.786791+0000","last_became_peered":"2023-11-26T07:18:03.786791+0000","last_unstale":"2023-11-26T07:18:04.938502+0000","last_undegraded":"2023-11-26T07:18:04.938502+0000","last_fullsized":"2023-11-26T07:18:04.938502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:47.452914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777253+0000","last_change":"2023-11-26T07:18:03.124374+0000","last_active":"2023-11-26T07:18:04.777253+0000","last_peered":"2023-11-26T07:18:04.777253+0000","last_clean":"2023-11-26T07:18:04.777253+0000","last_became_active":"2023-11-26T07:18:03.123071+0000","last_became_peered":"2023-11-26T07:18:03.123071+0000","last_unstale":"2023-11-26T07:18:04.777253+0000","last_undegraded":"2023-11-26T07:18:04.777253+0000","last_fullsized":"2023-11-26T07:18:04.777253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:02:12.811700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965635+0000","last_change":"2023-11-26T07:18:03.787012+0000","last_active":"2023-11-26T07:18:04.965635+0000","last_peered":"2023-11-26T07:18:04.965635+0000","last_clean":"2023-11-26T07:18:04.965635+0000","last_became_active":"2023-11-26T07:18:03.786759+0000","last_became_peered":"2023-11-26T07:18:03.786759+0000","last_unstale":"2023-11-26T07:18:04.965635+0000","last_undegraded":"2023-11-26T07:18:04.965635+0000","last_fullsized":"2023-11-26T07:18:04.965635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978667+0000","last_change":"2023-11-26T07:18:03.125780+0000","last_active":"2023-11-26T07:18:04.978667+0000","last_peered":"2023-11-26T07:18:04.978667+0000","last_clean":"2023-11-26T07:18:04.978667+0000","last_became_active":"2023-11-26T07:18:03.114090+0000","last_became_peered":"2023-11-26T07:18:03.114090+0000","last_unstale":"2023-11-26T07:18:04.978667+0000","last_undegraded":"2023-11-26T07:18:04.978667+0000","last_fullsized":"2023-11-26T07:18:04.978667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:31.621076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777652+0000","last_change":"2023-11-26T07:18:03.793309+0000","last_active":"2023-11-26T07:18:04.777652+0000","last_peered":"2023-11-26T07:18:04.777652+0000","last_clean":"2023-11-26T07:18:04.777652+0000","last_became_active":"2023-11-26T07:18:03.792978+0000","last_became_peered":"2023-11-26T07:18:03.792978+0000","last_unstale":"2023-11-26T07:18:04.777652+0000","last_undegraded":"2023-11-26T07:18:04.777652+0000","last_fullsized":"2023-11-26T07:18:04.777652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:53.444118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965659+0000","last_change":"2023-11-26T07:18:03.108277+0000","last_active":"2023-11-26T07:18:04.965659+0000","last_peered":"2023-11-26T07:18:04.965659+0000","last_clean":"2023-11-26T07:18:04.965659+0000","last_became_active":"2023-11-26T07:18:03.107849+0000","last_became_peered":"2023-11-26T07:18:03.107849+0000","last_unstale":"2023-11-26T07:18:04.965659+0000","last_undegraded":"2023-11-26T07:18:04.965659+0000","last_fullsized":"2023-11-26T07:18:04.965659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978391+0000","last_change":"2023-11-26T07:18:03.799853+0000","last_active":"2023-11-26T07:18:04.978391+0000","last_peered":"2023-11-26T07:18:04.978391+0000","last_clean":"2023-11-26T07:18:04.978391+0000","last_became_active":"2023-11-26T07:18:03.799496+0000","last_became_peered":"2023-11-26T07:18:03.799496+0000","last_unstale":"2023-11-26T07:18:04.978391+0000","last_undegraded":"2023-11-26T07:18:04.978391+0000","last_fullsized":"2023-11-26T07:18:04.978391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978123+0000","last_change":"2023-11-26T07:18:03.119202+0000","last_active":"2023-11-26T07:18:04.978123+0000","last_peered":"2023-11-26T07:18:04.978123+0000","last_clean":"2023-11-26T07:18:04.978123+0000","last_became_active":"2023-11-26T07:18:03.118804+0000","last_became_peered":"2023-11-26T07:18:03.118804+0000","last_unstale":"2023-11-26T07:18:04.978123+0000","last_undegraded":"2023-11-26T07:18:04.978123+0000","last_fullsized":"2023-11-26T07:18:04.978123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:26.724451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965884+0000","last_change":"2023-11-26T07:18:03.795950+0000","last_active":"2023-11-26T07:18:04.965884+0000","last_peered":"2023-11-26T07:18:04.965884+0000","last_clean":"2023-11-26T07:18:04.965884+0000","last_became_active":"2023-11-26T07:18:03.795701+0000","last_became_peered":"2023-11-26T07:18:03.795701+0000","last_unstale":"2023-11-26T07:18:04.965884+0000","last_undegraded":"2023-11-26T07:18:04.965884+0000","last_fullsized":"2023-11-26T07:18:04.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:05.790378+0000","last_change":"2023-11-26T07:18:03.123835+0000","last_active":"2023-11-26T07:18:05.790378+0000","last_peered":"2023-11-26T07:18:05.790378+0000","last_clean":"2023-11-26T07:18:05.790378+0000","last_became_active":"2023-11-26T07:18:03.123563+0000","last_became_peered":"2023-11-26T07:18:03.123563+0000","last_unstale":"2023-11-26T07:18:05.790378+0000","last_undegraded":"2023-11-26T07:18:05.790378+0000","last_fullsized":"2023-11-26T07:18:05.790378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778740+0000","last_change":"2023-11-26T07:18:03.798789+0000","last_active":"2023-11-26T07:18:04.778740+0000","last_peered":"2023-11-26T07:18:04.778740+0000","last_clean":"2023-11-26T07:18:04.778740+0000","last_became_active":"2023-11-26T07:18:03.798536+0000","last_became_peered":"2023-11-26T07:18:03.798536+0000","last_unstale":"2023-11-26T07:18:04.778740+0000","last_undegraded":"2023-11-26T07:18:04.778740+0000","last_fullsized":"2023-11-26T07:18:04.778740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978222+0000","last_change":"2023-11-26T07:18:03.121938+0000","last_active":"2023-11-26T07:18:04.978222+0000","last_peered":"2023-11-26T07:18:04.978222+0000","last_clean":"2023-11-26T07:18:04.978222+0000","last_became_active":"2023-11-26T07:18:03.120860+0000","last_became_peered":"2023-11-26T07:18:03.120860+0000","last_unstale":"2023-11-26T07:18:04.978222+0000","last_undegraded":"2023-11-26T07:18:04.978222+0000","last_fullsized":"2023-11-26T07:18:04.978222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938909+0000","last_change":"2023-11-26T07:18:03.784898+0000","last_active":"2023-11-26T07:18:04.938909+0000","last_peered":"2023-11-26T07:18:04.938909+0000","last_clean":"2023-11-26T07:18:04.938909+0000","last_became_active":"2023-11-26T07:18:03.784582+0000","last_became_peered":"2023-11-26T07:18:03.784582+0000","last_unstale":"2023-11-26T07:18:04.938909+0000","last_undegraded":"2023-11-26T07:18:04.938909+0000","last_fullsized":"2023-11-26T07:18:04.938909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977094+0000","last_change":"2023-11-26T07:18:03.116934+0000","last_active":"2023-11-26T07:18:04.977094+0000","last_peered":"2023-11-26T07:18:04.977094+0000","last_clean":"2023-11-26T07:18:04.977094+0000","last_became_active":"2023-11-26T07:18:03.116587+0000","last_became_peered":"2023-11-26T07:18:03.116587+0000","last_unstale":"2023-11-26T07:18:04.977094+0000","last_undegraded":"2023-11-26T07:18:04.977094+0000","last_fullsized":"2023-11-26T07:18:04.977094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777610+0000","last_change":"2023-11-26T07:18:03.779690+0000","last_active":"2023-11-26T07:18:04.777610+0000","last_peered":"2023-11-26T07:18:04.777610+0000","last_clean":"2023-11-26T07:18:04.777610+0000","last_became_active":"2023-11-26T07:18:03.778339+0000","last_became_peered":"2023-11-26T07:18:03.778339+0000","last_unstale":"2023-11-26T07:18:04.777610+0000","last_undegraded":"2023-11-26T07:18:04.777610+0000","last_fullsized":"2023-11-26T07:18:04.777610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:41.605885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965725+0000","last_change":"2023-11-26T07:18:03.119668+0000","last_active":"2023-11-26T07:18:04.965725+0000","last_peered":"2023-11-26T07:18:04.965725+0000","last_clean":"2023-11-26T07:18:04.965725+0000","last_became_active":"2023-11-26T07:18:03.119332+0000","last_became_peered":"2023-11-26T07:18:03.119332+0000","last_unstale":"2023-11-26T07:18:04.965725+0000","last_undegraded":"2023-11-26T07:18:04.965725+0000","last_fullsized":"2023-11-26T07:18:04.965725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778026+0000","last_change":"2023-11-26T07:18:03.782878+0000","last_active":"2023-11-26T07:18:04.778026+0000","last_peered":"2023-11-26T07:18:04.778026+0000","last_clean":"2023-11-26T07:18:04.778026+0000","last_became_active":"2023-11-26T07:18:03.782504+0000","last_became_peered":"2023-11-26T07:18:03.782504+0000","last_unstale":"2023-11-26T07:18:04.778026+0000","last_undegraded":"2023-11-26T07:18:04.778026+0000","last_fullsized":"2023-11-26T07:18:04.778026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965870+0000","last_change":"2023-11-26T07:18:03.121787+0000","last_active":"2023-11-26T07:18:04.965870+0000","last_peered":"2023-11-26T07:18:04.965870+0000","last_clean":"2023-11-26T07:18:04.965870+0000","last_became_active":"2023-11-26T07:18:03.121345+0000","last_became_peered":"2023-11-26T07:18:03.121345+0000","last_unstale":"2023-11-26T07:18:04.965870+0000","last_undegraded":"2023-11-26T07:18:04.965870+0000","last_fullsized":"2023-11-26T07:18:04.965870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778470+0000","last_change":"2023-11-26T07:18:03.793669+0000","last_active":"2023-11-26T07:18:04.778470+0000","last_peered":"2023-11-26T07:18:04.778470+0000","last_clean":"2023-11-26T07:18:04.778470+0000","last_became_active":"2023-11-26T07:18:03.793355+0000","last_became_peered":"2023-11-26T07:18:03.793355+0000","last_unstale":"2023-11-26T07:18:04.778470+0000","last_undegraded":"2023-11-26T07:18:04.778470+0000","last_fullsized":"2023-11-26T07:18:04.778470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.124539+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.124258+0000","last_became_peered":"2023-11-26T07:18:03.124258+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.784788+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.784298+0000","last_became_peered":"2023-11-26T07:18:03.784298+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978292+0000","last_change":"2023-11-26T07:18:03.799951+0000","last_active":"2023-11-26T07:18:04.978292+0000","last_peered":"2023-11-26T07:18:04.978292+0000","last_clean":"2023-11-26T07:18:04.978292+0000","last_became_active":"2023-11-26T07:18:03.799683+0000","last_became_peered":"2023-11-26T07:18:03.799683+0000","last_unstale":"2023-11-26T07:18:04.978292+0000","last_undegraded":"2023-11-26T07:18:04.978292+0000","last_fullsized":"2023-11-26T07:18:04.978292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977125+0000","last_change":"2023-11-26T07:18:03.127894+0000","last_active":"2023-11-26T07:18:04.977125+0000","last_peered":"2023-11-26T07:18:04.977125+0000","last_clean":"2023-11-26T07:18:04.977125+0000","last_became_active":"2023-11-26T07:18:03.127553+0000","last_became_peered":"2023-11-26T07:18:03.127553+0000","last_unstale":"2023-11-26T07:18:04.977125+0000","last_undegraded":"2023-11-26T07:18:04.977125+0000","last_fullsized":"2023-11-26T07:18:04.977125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978401+0000","last_change":"2023-11-26T07:18:03.798787+0000","last_active":"2023-11-26T07:18:04.978401+0000","last_peered":"2023-11-26T07:18:04.978401+0000","last_clean":"2023-11-26T07:18:04.978401+0000","last_became_active":"2023-11-26T07:18:03.797918+0000","last_became_peered":"2023-11-26T07:18:03.797918+0000","last_unstale":"2023-11-26T07:18:04.978401+0000","last_undegraded":"2023-11-26T07:18:04.978401+0000","last_fullsized":"2023-11-26T07:18:04.978401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977895+0000","last_change":"2023-11-26T07:18:03.128111+0000","last_active":"2023-11-26T07:18:04.977895+0000","last_peered":"2023-11-26T07:18:04.977895+0000","last_clean":"2023-11-26T07:18:04.977895+0000","last_became_active":"2023-11-26T07:18:03.127727+0000","last_became_peered":"2023-11-26T07:18:03.127727+0000","last_unstale":"2023-11-26T07:18:04.977895+0000","last_undegraded":"2023-11-26T07:18:04.977895+0000","last_fullsized":"2023-11-26T07:18:04.977895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938927+0000","last_change":"2023-11-26T07:18:03.804397+0000","last_active":"2023-11-26T07:18:04.938927+0000","last_peered":"2023-11-26T07:18:04.938927+0000","last_clean":"2023-11-26T07:18:04.938927+0000","last_became_active":"2023-11-26T07:18:03.804157+0000","last_became_peered":"2023-11-26T07:18:03.804157+0000","last_unstale":"2023-11-26T07:18:04.938927+0000","last_undegraded":"2023-11-26T07:18:04.938927+0000","last_fullsized":"2023-11-26T07:18:04.938927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778691+0000","last_change":"2023-11-26T07:18:03.120821+0000","last_active":"2023-11-26T07:18:04.778691+0000","last_peered":"2023-11-26T07:18:04.778691+0000","last_clean":"2023-11-26T07:18:04.778691+0000","last_became_active":"2023-11-26T07:18:03.120551+0000","last_became_peered":"2023-11-26T07:18:03.120551+0000","last_unstale":"2023-11-26T07:18:04.778691+0000","last_undegraded":"2023-11-26T07:18:04.778691+0000","last_fullsized":"2023-11-26T07:18:04.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778654+0000","last_change":"2023-11-26T07:18:03.783374+0000","last_active":"2023-11-26T07:18:04.778654+0000","last_peered":"2023-11-26T07:18:04.778654+0000","last_clean":"2023-11-26T07:18:04.778654+0000","last_became_active":"2023-11-26T07:18:03.782911+0000","last_became_peered":"2023-11-26T07:18:03.782911+0000","last_unstale":"2023-11-26T07:18:04.778654+0000","last_undegraded":"2023-11-26T07:18:04.778654+0000","last_fullsized":"2023-11-26T07:18:04.778654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938985+0000","last_change":"2023-11-26T07:18:03.120489+0000","last_active":"2023-11-26T07:18:04.938985+0000","last_peered":"2023-11-26T07:18:04.938985+0000","last_clean":"2023-11-26T07:18:04.938985+0000","last_became_active":"2023-11-26T07:18:03.120191+0000","last_became_peered":"2023-11-26T07:18:03.120191+0000","last_unstale":"2023-11-26T07:18:04.938985+0000","last_undegraded":"2023-11-26T07:18:04.938985+0000","last_fullsized":"2023-11-26T07:18:04.938985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3760000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.415}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.726}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1639999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.835}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:12.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:18:12.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71db701640 1 Processor -- start 2023-11-26T07:18:12.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71db701640 1 -- start start 2023-11-26T07:18:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71db701640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71d415d6e0 0x7f71d40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71db701640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d40cf0e0 con 0x7f71d40d1bc0 2023-11-26T07:18:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71db701640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d40ceb20 con 0x7f71d40b2160 2023-11-26T07:18:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71db701640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d415dac0 con 0x7f71d415d6e0 2023-11-26T07:18:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71d949d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71d415d6e0 0x7f71d40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71d9c9e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f71d40d1bc0 0x7f71d40b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34450/0 (socket says 172.21.15.70:34450) 2023-11-26T07:18:12.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71d9c9e640 1 -- 172.21.15.70:0/4159754601 learned_addr learned my addr 172.21.15.70:0/4159754601 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:12.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71d949d640 1 -- 172.21.15.70:0/4159754601 >> v1:172.21.15.120:6789/0 conn(0x7f71d40b2160 legacy=0x7f71d40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:12.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71d949d640 1 -- 172.21.15.70:0/4159754601 >> v1:172.21.15.70:6789/0 conn(0x7f71d40d1bc0 legacy=0x7f71d40b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71d949d640 1 -- 172.21.15.70:0/4159754601 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40cee00 con 0x7f71d415d6e0 2023-11-26T07:18:12.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.903+0000 7f71cbfff640 1 -- 172.21.15.70:0/4159754601 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214104924 0 0) 0x7f71d40cf0e0 con 0x7f71d40d1bc0 2023-11-26T07:18:12.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71d949d640 1 --2- 172.21.15.70:0/4159754601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40d0df0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f71d00097c0 tx=0x7f71d001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f74d8f802ce53aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71cbfff640 1 -- 172.21.15.70:0/4159754601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00ab600 con 0x7f71d415d6e0 2023-11-26T07:18:12.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71cbfff640 1 -- 172.21.15.70:0/4159754601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d00a7050 con 0x7f71d415d6e0 2023-11-26T07:18:12.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71cbfff640 1 -- 172.21.15.70:0/4159754601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00ab980 con 0x7f71d415d6e0 2023-11-26T07:18:12.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71db701640 1 -- 172.21.15.70:0/4159754601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 msgr2=0x7f71d40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71db701640 1 --2- 172.21.15.70:0/4159754601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40d0df0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f71d00097c0 tx=0x7f71d001c440 comp rx=0 tx=0).stop 2023-11-26T07:18:12.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71db701640 1 -- 172.21.15.70:0/4159754601 shutdown_connections 2023-11-26T07:18:12.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71db701640 1 --2- 172.21.15.70:0/4159754601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40d0df0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71db701640 1 -- 172.21.15.70:0/4159754601 >> 172.21.15.70:0/4159754601 conn(0x7f71d409c550 msgr2=0x7f71d40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:12.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71db701640 1 -- 172.21.15.70:0/4159754601 shutdown_connections 2023-11-26T07:18:12.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.907+0000 7f71db701640 1 -- 172.21.15.70:0/4159754601 wait complete. 2023-11-26T07:18:12.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 Processor -- start 2023-11-26T07:18:12.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 -- start start 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d40b2160 0x7f71d40c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d40d1bc0 0x7f71d40c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d40c9cc0 con 0x7f71d415d6e0 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d4154ac0 con 0x7f71d40d1bc0 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d40c89c0 con 0x7f71d40b2160 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60326/0 (socket says 172.21.15.70:60326) 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 -- 172.21.15.70:0/1772087090 learned_addr learned my addr 172.21.15.70:0/1772087090 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d8c9c640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d40d1bc0 0x7f71d40c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d949d640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d40b2160 0x7f71d40c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 -- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d40b2160 msgr2=0x7f71d40c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d40b2160 0x7f71d40c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 -- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d40d1bc0 msgr2=0x7f71d40c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d40d1bc0 0x7f71d40c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 -- 172.21.15.70:0/1772087090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0009420 con 0x7f71d415d6e0 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d8c9c640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d40d1bc0 0x7f71d40c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71d9c9e640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40c7290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c7e0 tx=0x7f71cc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71c9ffb640 1 -- 172.21.15.70:0/1772087090 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00a640 con 0x7f71d415d6e0 2023-11-26T07:18:12.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71c9ffb640 1 -- 172.21.15.70:0/1772087090 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00a7a0 con 0x7f71d415d6e0 2023-11-26T07:18:12.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71c9ffb640 1 -- 172.21.15.70:0/1772087090 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00ab50 con 0x7f71d415d6e0 2023-11-26T07:18:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d40c9420 con 0x7f71d415d6e0 2023-11-26T07:18:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.911+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d40c99e0 con 0x7f71d415d6e0 2023-11-26T07:18:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.915+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d4067680 con 0x7f71d415d6e0 2023-11-26T07:18:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.915+0000 7f71c9ffb640 1 -- 172.21.15.70:0/1772087090 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71cc00acb0 con 0x7f71d415d6e0 2023-11-26T07:18:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.915+0000 7f71c9ffb640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71b80664a0 0x7f71b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:12.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.915+0000 7f71c9ffb640 1 -- 172.21.15.70:0/1772087090 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71cc083330 con 0x7f71d415d6e0 2023-11-26T07:18:12.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.915+0000 7f71d949d640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71b80664a0 0x7f71b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:12.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.915+0000 7f71d949d640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71b80664a0 0x7f71b8068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71d00ad000 tx=0x7f71d00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:12.919+0000 7f71c9ffb640 1 -- 172.21.15.70:0/1772087090 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71cc050850 con 0x7f71d415d6e0 2023-11-26T07:18:13.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.067+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71d40d3470 con 0x7f71b80664a0 2023-11-26T07:18:13.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.071+0000 7f71c9ffb640 1 -- 172.21.15.70:0/1772087090 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264572 (secure 0 0 0) 0x7f71d40d3470 con 0x7f71b80664a0 2023-11-26T07:18:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:13.079 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71b80664a0 msgr2=0x7f71b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71b80664a0 0x7f71b8068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71d00ad000 tx=0x7f71d00a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 msgr2=0x7f71d40c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40c7290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c7e0 tx=0x7f71cc00cca0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 shutdown_connections 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71b80664a0 0x7f71b8068960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d415d6e0 0x7f71d40c7290 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d40d1bc0 0x7f71d40c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 --2- 172.21.15.70:0/1772087090 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d40b2160 0x7f71d40c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 >> 172.21.15.70:0/1772087090 conn(0x7f71d409c550 msgr2=0x7f71d406c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 shutdown_connections 2023-11-26T07:18:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.075+0000 7f71db701640 1 -- 172.21.15.70:0/1772087090 wait complete. 2023-11-26T07:18:13.097 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-26T07:18:11.995779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231596,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743124,"statfs":{"total":773094113280,"available":772856958976,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.226740"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977709+0000","last_change":"2023-11-26T07:18:03.803784+0000","last_active":"2023-11-26T07:18:04.977709+0000","last_peered":"2023-11-26T07:18:04.977709+0000","last_clean":"2023-11-26T07:18:04.977709+0000","last_became_active":"2023-11-26T07:18:03.803443+0000","last_became_peered":"2023-11-26T07:18:03.803443+0000","last_unstale":"2023-11-26T07:18:04.977709+0000","last_undegraded":"2023-11-26T07:18:04.977709+0000","last_fullsized":"2023-11-26T07:18:04.977709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965901+0000","last_change":"2023-11-26T07:18:03.788975+0000","last_active":"2023-11-26T07:18:04.965901+0000","last_peered":"2023-11-26T07:18:04.965901+0000","last_clean":"2023-11-26T07:18:04.965901+0000","last_became_active":"2023-11-26T07:18:03.788417+0000","last_became_peered":"2023-11-26T07:18:03.788417+0000","last_unstale":"2023-11-26T07:18:04.965901+0000","last_undegraded":"2023-11-26T07:18:04.965901+0000","last_fullsized":"2023-11-26T07:18:04.965901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938823+0000","last_change":"2023-11-26T07:18:03.794288+0000","last_active":"2023-11-26T07:18:04.938823+0000","last_peered":"2023-11-26T07:18:04.938823+0000","last_clean":"2023-11-26T07:18:04.938823+0000","last_became_active":"2023-11-26T07:18:03.794001+0000","last_became_peered":"2023-11-26T07:18:03.794001+0000","last_unstale":"2023-11-26T07:18:04.938823+0000","last_undegraded":"2023-11-26T07:18:04.938823+0000","last_fullsized":"2023-11-26T07:18:04.938823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978274+0000","last_change":"2023-11-26T07:18:03.799214+0000","last_active":"2023-11-26T07:18:04.978274+0000","last_peered":"2023-11-26T07:18:04.978274+0000","last_clean":"2023-11-26T07:18:04.978274+0000","last_became_active":"2023-11-26T07:18:03.798914+0000","last_became_peered":"2023-11-26T07:18:03.798914+0000","last_unstale":"2023-11-26T07:18:04.978274+0000","last_undegraded":"2023-11-26T07:18:04.978274+0000","last_fullsized":"2023-11-26T07:18:04.978274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977291+0000","last_change":"2023-11-26T07:18:03.802078+0000","last_active":"2023-11-26T07:18:04.977291+0000","last_peered":"2023-11-26T07:18:04.977291+0000","last_clean":"2023-11-26T07:18:04.977291+0000","last_became_active":"2023-11-26T07:18:03.801400+0000","last_became_peered":"2023-11-26T07:18:03.801400+0000","last_unstale":"2023-11-26T07:18:04.977291+0000","last_undegraded":"2023-11-26T07:18:04.977291+0000","last_fullsized":"2023-11-26T07:18:04.977291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978001+0000","last_change":"2023-11-26T07:18:03.797285+0000","last_active":"2023-11-26T07:18:04.978001+0000","last_peered":"2023-11-26T07:18:04.978001+0000","last_clean":"2023-11-26T07:18:04.978001+0000","last_became_active":"2023-11-26T07:18:03.796973+0000","last_became_peered":"2023-11-26T07:18:03.796973+0000","last_unstale":"2023-11-26T07:18:04.978001+0000","last_undegraded":"2023-11-26T07:18:04.978001+0000","last_fullsized":"2023-11-26T07:18:04.978001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977015+0000","last_change":"2023-11-26T07:18:03.801957+0000","last_active":"2023-11-26T07:18:04.977015+0000","last_peered":"2023-11-26T07:18:04.977015+0000","last_clean":"2023-11-26T07:18:04.977015+0000","last_became_active":"2023-11-26T07:18:03.801666+0000","last_became_peered":"2023-11-26T07:18:03.801666+0000","last_unstale":"2023-11-26T07:18:04.977015+0000","last_undegraded":"2023-11-26T07:18:04.977015+0000","last_fullsized":"2023-11-26T07:18:04.977015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777954+0000","last_change":"2023-11-26T07:18:03.795903+0000","last_active":"2023-11-26T07:18:04.777954+0000","last_peered":"2023-11-26T07:18:04.777954+0000","last_clean":"2023-11-26T07:18:04.777954+0000","last_became_active":"2023-11-26T07:18:03.795634+0000","last_became_peered":"2023-11-26T07:18:03.795634+0000","last_unstale":"2023-11-26T07:18:04.777954+0000","last_undegraded":"2023-11-26T07:18:04.777954+0000","last_fullsized":"2023-11-26T07:18:04.777954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977838+0000","last_change":"2023-11-26T07:18:03.807314+0000","last_active":"2023-11-26T07:18:04.977838+0000","last_peered":"2023-11-26T07:18:04.977838+0000","last_clean":"2023-11-26T07:18:04.977838+0000","last_became_active":"2023-11-26T07:18:03.806735+0000","last_became_peered":"2023-11-26T07:18:03.806735+0000","last_unstale":"2023-11-26T07:18:04.977838+0000","last_undegraded":"2023-11-26T07:18:04.977838+0000","last_fullsized":"2023-11-26T07:18:04.977838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:41:15.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977563+0000","last_change":"2023-11-26T07:18:03.799600+0000","last_active":"2023-11-26T07:18:04.977563+0000","last_peered":"2023-11-26T07:18:04.977563+0000","last_clean":"2023-11-26T07:18:04.977563+0000","last_became_active":"2023-11-26T07:18:03.799261+0000","last_became_peered":"2023-11-26T07:18:03.799261+0000","last_unstale":"2023-11-26T07:18:04.977563+0000","last_undegraded":"2023-11-26T07:18:04.977563+0000","last_fullsized":"2023-11-26T07:18:04.977563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977141+0000","last_change":"2023-11-26T07:18:03.800938+0000","last_active":"2023-11-26T07:18:04.977141+0000","last_peered":"2023-11-26T07:18:04.977141+0000","last_clean":"2023-11-26T07:18:04.977141+0000","last_became_active":"2023-11-26T07:18:03.800617+0000","last_became_peered":"2023-11-26T07:18:03.800617+0000","last_unstale":"2023-11-26T07:18:04.977141+0000","last_undegraded":"2023-11-26T07:18:04.977141+0000","last_fullsized":"2023-11-26T07:18:04.977141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777870+0000","last_change":"2023-11-26T07:18:03.782200+0000","last_active":"2023-11-26T07:18:04.777870+0000","last_peered":"2023-11-26T07:18:04.777870+0000","last_clean":"2023-11-26T07:18:04.777870+0000","last_became_active":"2023-11-26T07:18:03.781899+0000","last_became_peered":"2023-11-26T07:18:03.781899+0000","last_unstale":"2023-11-26T07:18:04.777870+0000","last_undegraded":"2023-11-26T07:18:04.777870+0000","last_fullsized":"2023-11-26T07:18:04.777870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778374+0000","last_change":"2023-11-26T07:18:03.779335+0000","last_active":"2023-11-26T07:18:04.778374+0000","last_peered":"2023-11-26T07:18:04.778374+0000","last_clean":"2023-11-26T07:18:04.778374+0000","last_became_active":"2023-11-26T07:18:03.779062+0000","last_became_peered":"2023-11-26T07:18:03.779062+0000","last_unstale":"2023-11-26T07:18:04.778374+0000","last_undegraded":"2023-11-26T07:18:04.778374+0000","last_fullsized":"2023-11-26T07:18:04.778374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938632+0000","last_change":"2023-11-26T07:18:03.785565+0000","last_active":"2023-11-26T07:18:04.938632+0000","last_peered":"2023-11-26T07:18:04.938632+0000","last_clean":"2023-11-26T07:18:04.938632+0000","last_became_active":"2023-11-26T07:18:03.785185+0000","last_became_peered":"2023-11-26T07:18:03.785185+0000","last_unstale":"2023-11-26T07:18:04.938632+0000","last_undegraded":"2023-11-26T07:18:04.938632+0000","last_fullsized":"2023-11-26T07:18:04.938632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:51.698039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965569+0000","last_change":"2023-11-26T07:18:03.794642+0000","last_active":"2023-11-26T07:18:04.965569+0000","last_peered":"2023-11-26T07:18:04.965569+0000","last_clean":"2023-11-26T07:18:04.965569+0000","last_became_active":"2023-11-26T07:18:03.794199+0000","last_became_peered":"2023-11-26T07:18:03.794199+0000","last_unstale":"2023-11-26T07:18:04.965569+0000","last_undegraded":"2023-11-26T07:18:04.965569+0000","last_fullsized":"2023-11-26T07:18:04.965569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977524+0000","last_change":"2023-11-26T07:18:03.793156+0000","last_active":"2023-11-26T07:18:04.977524+0000","last_peered":"2023-11-26T07:18:04.977524+0000","last_clean":"2023-11-26T07:18:04.977524+0000","last_became_active":"2023-11-26T07:18:03.792834+0000","last_became_peered":"2023-11-26T07:18:03.792834+0000","last_unstale":"2023-11-26T07:18:04.977524+0000","last_undegraded":"2023-11-26T07:18:04.977524+0000","last_fullsized":"2023-11-26T07:18:04.977524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978940+0000","last_change":"2023-11-26T07:18:03.805692+0000","last_active":"2023-11-26T07:18:04.978940+0000","last_peered":"2023-11-26T07:18:04.978940+0000","last_clean":"2023-11-26T07:18:04.978940+0000","last_became_active":"2023-11-26T07:18:03.805350+0000","last_became_peered":"2023-11-26T07:18:03.805350+0000","last_unstale":"2023-11-26T07:18:04.978940+0000","last_undegraded":"2023-11-26T07:18:04.978940+0000","last_fullsized":"2023-11-26T07:18:04.978940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:03:11.683235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777433+0000","last_change":"2023-11-26T07:18:03.786256+0000","last_active":"2023-11-26T07:18:04.777433+0000","last_peered":"2023-11-26T07:18:04.777433+0000","last_clean":"2023-11-26T07:18:04.777433+0000","last_became_active":"2023-11-26T07:18:03.785953+0000","last_became_peered":"2023-11-26T07:18:03.785953+0000","last_unstale":"2023-11-26T07:18:04.777433+0000","last_undegraded":"2023-11-26T07:18:04.777433+0000","last_fullsized":"2023-11-26T07:18:04.777433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978040+0000","last_change":"2023-11-26T07:18:03.803009+0000","last_active":"2023-11-26T07:18:04.978040+0000","last_peered":"2023-11-26T07:18:04.978040+0000","last_clean":"2023-11-26T07:18:04.978040+0000","last_became_active":"2023-11-26T07:18:03.802310+0000","last_became_peered":"2023-11-26T07:18:03.802310+0000","last_unstale":"2023-11-26T07:18:04.978040+0000","last_undegraded":"2023-11-26T07:18:04.978040+0000","last_fullsized":"2023-11-26T07:18:04.978040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:51.419753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977730+0000","last_change":"2023-11-26T07:18:03.785169+0000","last_active":"2023-11-26T07:18:04.977730+0000","last_peered":"2023-11-26T07:18:04.977730+0000","last_clean":"2023-11-26T07:18:04.977730+0000","last_became_active":"2023-11-26T07:18:03.784952+0000","last_became_peered":"2023-11-26T07:18:03.784952+0000","last_unstale":"2023-11-26T07:18:04.977730+0000","last_undegraded":"2023-11-26T07:18:04.977730+0000","last_fullsized":"2023-11-26T07:18:04.977730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938762+0000","last_change":"2023-11-26T07:18:03.788071+0000","last_active":"2023-11-26T07:18:04.938762+0000","last_peered":"2023-11-26T07:18:04.938762+0000","last_clean":"2023-11-26T07:18:04.938762+0000","last_became_active":"2023-11-26T07:18:03.787821+0000","last_became_peered":"2023-11-26T07:18:03.787821+0000","last_unstale":"2023-11-26T07:18:04.938762+0000","last_undegraded":"2023-11-26T07:18:04.938762+0000","last_fullsized":"2023-11-26T07:18:04.938762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978153+0000","last_change":"2023-11-26T07:18:03.804426+0000","last_active":"2023-11-26T07:18:04.978153+0000","last_peered":"2023-11-26T07:18:04.978153+0000","last_clean":"2023-11-26T07:18:04.978153+0000","last_became_active":"2023-11-26T07:18:03.804150+0000","last_became_peered":"2023-11-26T07:18:03.804150+0000","last_unstale":"2023-11-26T07:18:04.978153+0000","last_undegraded":"2023-11-26T07:18:04.978153+0000","last_fullsized":"2023-11-26T07:18:04.978153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778267+0000","last_change":"2023-11-26T07:18:03.787986+0000","last_active":"2023-11-26T07:18:04.778267+0000","last_peered":"2023-11-26T07:18:04.778267+0000","last_clean":"2023-11-26T07:18:04.778267+0000","last_became_active":"2023-11-26T07:18:03.787730+0000","last_became_peered":"2023-11-26T07:18:03.787730+0000","last_unstale":"2023-11-26T07:18:04.778267+0000","last_undegraded":"2023-11-26T07:18:04.778267+0000","last_fullsized":"2023-11-26T07:18:04.778267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978264+0000","last_change":"2023-11-26T07:18:03.792214+0000","last_active":"2023-11-26T07:18:04.978264+0000","last_peered":"2023-11-26T07:18:04.978264+0000","last_clean":"2023-11-26T07:18:04.978264+0000","last_became_active":"2023-11-26T07:18:03.791863+0000","last_became_peered":"2023-11-26T07:18:03.791863+0000","last_unstale":"2023-11-26T07:18:04.978264+0000","last_undegraded":"2023-11-26T07:18:04.978264+0000","last_fullsized":"2023-11-26T07:18:04.978264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778641+0000","last_change":"2023-11-26T07:18:03.788356+0000","last_active":"2023-11-26T07:18:04.778641+0000","last_peered":"2023-11-26T07:18:04.778641+0000","last_clean":"2023-11-26T07:18:04.778641+0000","last_became_active":"2023-11-26T07:18:03.788037+0000","last_became_peered":"2023-11-26T07:18:03.788037+0000","last_unstale":"2023-11-26T07:18:04.778641+0000","last_undegraded":"2023-11-26T07:18:04.778641+0000","last_fullsized":"2023-11-26T07:18:04.778641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:21:53.381469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977702+0000","last_change":"2023-11-26T07:18:03.798506+0000","last_active":"2023-11-26T07:18:04.977702+0000","last_peered":"2023-11-26T07:18:04.977702+0000","last_clean":"2023-11-26T07:18:04.977702+0000","last_became_active":"2023-11-26T07:18:03.798181+0000","last_became_peered":"2023-11-26T07:18:03.798181+0000","last_unstale":"2023-11-26T07:18:04.977702+0000","last_undegraded":"2023-11-26T07:18:04.977702+0000","last_fullsized":"2023-11-26T07:18:04.977702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965715+0000","last_change":"2023-11-26T07:18:03.792464+0000","last_active":"2023-11-26T07:18:04.965715+0000","last_peered":"2023-11-26T07:18:04.965715+0000","last_clean":"2023-11-26T07:18:04.965715+0000","last_became_active":"2023-11-26T07:18:03.792203+0000","last_became_peered":"2023-11-26T07:18:03.792203+0000","last_unstale":"2023-11-26T07:18:04.965715+0000","last_undegraded":"2023-11-26T07:18:04.965715+0000","last_fullsized":"2023-11-26T07:18:04.965715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778594+0000","last_change":"2023-11-26T07:18:03.788844+0000","last_active":"2023-11-26T07:18:04.778594+0000","last_peered":"2023-11-26T07:18:04.778594+0000","last_clean":"2023-11-26T07:18:04.778594+0000","last_became_active":"2023-11-26T07:18:03.786561+0000","last_became_peered":"2023-11-26T07:18:03.786561+0000","last_unstale":"2023-11-26T07:18:04.778594+0000","last_undegraded":"2023-11-26T07:18:04.778594+0000","last_fullsized":"2023-11-26T07:18:04.778594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938878+0000","last_change":"2023-11-26T07:18:03.791815+0000","last_active":"2023-11-26T07:18:04.938878+0000","last_peered":"2023-11-26T07:18:04.938878+0000","last_clean":"2023-11-26T07:18:04.938878+0000","last_became_active":"2023-11-26T07:18:03.790584+0000","last_became_peered":"2023-11-26T07:18:03.790584+0000","last_unstale":"2023-11-26T07:18:04.938878+0000","last_undegraded":"2023-11-26T07:18:04.938878+0000","last_fullsized":"2023-11-26T07:18:04.938878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978434+0000","last_change":"2023-11-26T07:18:03.792243+0000","last_active":"2023-11-26T07:18:04.978434+0000","last_peered":"2023-11-26T07:18:04.978434+0000","last_clean":"2023-11-26T07:18:04.978434+0000","last_became_active":"2023-11-26T07:18:03.791879+0000","last_became_peered":"2023-11-26T07:18:03.791879+0000","last_unstale":"2023-11-26T07:18:04.978434+0000","last_undegraded":"2023-11-26T07:18:04.978434+0000","last_fullsized":"2023-11-26T07:18:04.978434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:38:39.327004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777242+0000","last_change":"2023-11-26T07:18:03.795359+0000","last_active":"2023-11-26T07:18:04.777242+0000","last_peered":"2023-11-26T07:18:04.777242+0000","last_clean":"2023-11-26T07:18:04.777242+0000","last_became_active":"2023-11-26T07:18:03.795059+0000","last_became_peered":"2023-11-26T07:18:03.795059+0000","last_unstale":"2023-11-26T07:18:04.777242+0000","last_undegraded":"2023-11-26T07:18:04.777242+0000","last_fullsized":"2023-11-26T07:18:04.777242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:52.640524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977195+0000","last_change":"2023-11-26T07:18:03.788871+0000","last_active":"2023-11-26T07:18:04.977195+0000","last_peered":"2023-11-26T07:18:04.977195+0000","last_clean":"2023-11-26T07:18:04.977195+0000","last_became_active":"2023-11-26T07:18:03.788343+0000","last_became_peered":"2023-11-26T07:18:03.788343+0000","last_unstale":"2023-11-26T07:18:04.977195+0000","last_undegraded":"2023-11-26T07:18:04.977195+0000","last_fullsized":"2023-11-26T07:18:04.977195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777489+0000","last_change":"2023-11-26T07:18:03.782615+0000","last_active":"2023-11-26T07:18:04.777489+0000","last_peered":"2023-11-26T07:18:04.777489+0000","last_clean":"2023-11-26T07:18:04.777489+0000","last_became_active":"2023-11-26T07:18:03.782335+0000","last_became_peered":"2023-11-26T07:18:03.782335+0000","last_unstale":"2023-11-26T07:18:04.777489+0000","last_undegraded":"2023-11-26T07:18:04.777489+0000","last_fullsized":"2023-11-26T07:18:04.777489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:52:23.941794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778588+0000","last_change":"2023-11-26T07:18:03.122861+0000","last_active":"2023-11-26T07:18:04.778588+0000","last_peered":"2023-11-26T07:18:04.778588+0000","last_clean":"2023-11-26T07:18:04.778588+0000","last_became_active":"2023-11-26T07:18:03.122492+0000","last_became_peered":"2023-11-26T07:18:03.122492+0000","last_unstale":"2023-11-26T07:18:04.778588+0000","last_undegraded":"2023-11-26T07:18:04.778588+0000","last_fullsized":"2023-11-26T07:18:04.778588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938948+0000","last_change":"2023-11-26T07:18:03.798092+0000","last_active":"2023-11-26T07:18:04.938948+0000","last_peered":"2023-11-26T07:18:04.938948+0000","last_clean":"2023-11-26T07:18:04.938948+0000","last_became_active":"2023-11-26T07:18:03.797852+0000","last_became_peered":"2023-11-26T07:18:03.797852+0000","last_unstale":"2023-11-26T07:18:04.938948+0000","last_undegraded":"2023-11-26T07:18:04.938948+0000","last_fullsized":"2023-11-26T07:18:04.938948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977463+0000","last_change":"2023-11-26T07:18:03.119997+0000","last_active":"2023-11-26T07:18:04.977463+0000","last_peered":"2023-11-26T07:18:04.977463+0000","last_clean":"2023-11-26T07:18:04.977463+0000","last_became_active":"2023-11-26T07:18:03.118909+0000","last_became_peered":"2023-11-26T07:18:03.118909+0000","last_unstale":"2023-11-26T07:18:04.977463+0000","last_undegraded":"2023-11-26T07:18:04.977463+0000","last_fullsized":"2023-11-26T07:18:04.977463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:52.437449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778203+0000","last_change":"2023-11-26T07:18:03.122995+0000","last_active":"2023-11-26T07:18:04.778203+0000","last_peered":"2023-11-26T07:18:04.778203+0000","last_clean":"2023-11-26T07:18:04.778203+0000","last_became_active":"2023-11-26T07:18:03.122228+0000","last_became_peered":"2023-11-26T07:18:03.122228+0000","last_unstale":"2023-11-26T07:18:04.778203+0000","last_undegraded":"2023-11-26T07:18:04.778203+0000","last_fullsized":"2023-11-26T07:18:04.778203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777996+0000","last_change":"2023-11-26T07:18:03.782237+0000","last_active":"2023-11-26T07:18:04.777996+0000","last_peered":"2023-11-26T07:18:04.777996+0000","last_clean":"2023-11-26T07:18:04.777996+0000","last_became_active":"2023-11-26T07:18:03.782008+0000","last_became_peered":"2023-11-26T07:18:03.782008+0000","last_unstale":"2023-11-26T07:18:04.777996+0000","last_undegraded":"2023-11-26T07:18:04.777996+0000","last_fullsized":"2023-11-26T07:18:04.777996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:16:49.812944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977820+0000","last_change":"2023-11-26T07:18:03.131480+0000","last_active":"2023-11-26T07:18:04.977820+0000","last_peered":"2023-11-26T07:18:04.977820+0000","last_clean":"2023-11-26T07:18:04.977820+0000","last_became_active":"2023-11-26T07:18:03.131082+0000","last_became_peered":"2023-11-26T07:18:03.131082+0000","last_unstale":"2023-11-26T07:18:04.977820+0000","last_undegraded":"2023-11-26T07:18:04.977820+0000","last_fullsized":"2023-11-26T07:18:04.977820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965576+0000","last_change":"2023-11-26T07:18:03.796258+0000","last_active":"2023-11-26T07:18:04.965576+0000","last_peered":"2023-11-26T07:18:04.965576+0000","last_clean":"2023-11-26T07:18:04.965576+0000","last_became_active":"2023-11-26T07:18:03.795927+0000","last_became_peered":"2023-11-26T07:18:03.795927+0000","last_unstale":"2023-11-26T07:18:04.965576+0000","last_undegraded":"2023-11-26T07:18:04.965576+0000","last_fullsized":"2023-11-26T07:18:04.965576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978098+0000","last_change":"2023-11-26T07:18:03.129331+0000","last_active":"2023-11-26T07:18:04.978098+0000","last_peered":"2023-11-26T07:18:04.978098+0000","last_clean":"2023-11-26T07:18:04.978098+0000","last_became_active":"2023-11-26T07:18:03.129008+0000","last_became_peered":"2023-11-26T07:18:03.129008+0000","last_unstale":"2023-11-26T07:18:04.978098+0000","last_undegraded":"2023-11-26T07:18:04.978098+0000","last_fullsized":"2023-11-26T07:18:04.978098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978607+0000","last_change":"2023-11-26T07:18:03.805685+0000","last_active":"2023-11-26T07:18:04.978607+0000","last_peered":"2023-11-26T07:18:04.978607+0000","last_clean":"2023-11-26T07:18:04.978607+0000","last_became_active":"2023-11-26T07:18:03.805338+0000","last_became_peered":"2023-11-26T07:18:03.805338+0000","last_unstale":"2023-11-26T07:18:04.978607+0000","last_undegraded":"2023-11-26T07:18:04.978607+0000","last_fullsized":"2023-11-26T07:18:04.978607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978665+0000","last_change":"2023-11-26T07:18:03.126035+0000","last_active":"2023-11-26T07:18:04.978665+0000","last_peered":"2023-11-26T07:18:04.978665+0000","last_clean":"2023-11-26T07:18:04.978665+0000","last_became_active":"2023-11-26T07:18:03.125604+0000","last_became_peered":"2023-11-26T07:18:03.125604+0000","last_unstale":"2023-11-26T07:18:04.978665+0000","last_undegraded":"2023-11-26T07:18:04.978665+0000","last_fullsized":"2023-11-26T07:18:04.978665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938971+0000","last_change":"2023-11-26T07:18:03.804355+0000","last_active":"2023-11-26T07:18:04.938971+0000","last_peered":"2023-11-26T07:18:04.938971+0000","last_clean":"2023-11-26T07:18:04.938971+0000","last_became_active":"2023-11-26T07:18:03.804058+0000","last_became_peered":"2023-11-26T07:18:03.804058+0000","last_unstale":"2023-11-26T07:18:04.938971+0000","last_undegraded":"2023-11-26T07:18:04.938971+0000","last_fullsized":"2023-11-26T07:18:04.938971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:57.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965755+0000","last_change":"2023-11-26T07:18:03.126934+0000","last_active":"2023-11-26T07:18:04.965755+0000","last_peered":"2023-11-26T07:18:04.965755+0000","last_clean":"2023-11-26T07:18:04.965755+0000","last_became_active":"2023-11-26T07:18:03.126627+0000","last_became_peered":"2023-11-26T07:18:03.126627+0000","last_unstale":"2023-11-26T07:18:04.965755+0000","last_undegraded":"2023-11-26T07:18:04.965755+0000","last_fullsized":"2023-11-26T07:18:04.965755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777968+0000","last_change":"2023-11-26T07:18:03.800970+0000","last_active":"2023-11-26T07:18:04.777968+0000","last_peered":"2023-11-26T07:18:04.777968+0000","last_clean":"2023-11-26T07:18:04.777968+0000","last_became_active":"2023-11-26T07:18:03.800703+0000","last_became_peered":"2023-11-26T07:18:03.800703+0000","last_unstale":"2023-11-26T07:18:04.777968+0000","last_undegraded":"2023-11-26T07:18:04.777968+0000","last_fullsized":"2023-11-26T07:18:04.777968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:33.918633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977831+0000","last_change":"2023-11-26T07:18:03.121777+0000","last_active":"2023-11-26T07:18:04.977831+0000","last_peered":"2023-11-26T07:18:04.977831+0000","last_clean":"2023-11-26T07:18:04.977831+0000","last_became_active":"2023-11-26T07:18:03.121509+0000","last_became_peered":"2023-11-26T07:18:03.121509+0000","last_unstale":"2023-11-26T07:18:04.977831+0000","last_undegraded":"2023-11-26T07:18:04.977831+0000","last_fullsized":"2023-11-26T07:18:04.977831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977200+0000","last_change":"2023-11-26T07:18:03.802994+0000","last_active":"2023-11-26T07:18:04.977200+0000","last_peered":"2023-11-26T07:18:04.977200+0000","last_clean":"2023-11-26T07:18:04.977200+0000","last_became_active":"2023-11-26T07:18:03.801952+0000","last_became_peered":"2023-11-26T07:18:03.801952+0000","last_unstale":"2023-11-26T07:18:04.977200+0000","last_undegraded":"2023-11-26T07:18:04.977200+0000","last_fullsized":"2023-11-26T07:18:04.977200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.939000+0000","last_change":"2023-11-26T07:18:03.119803+0000","last_active":"2023-11-26T07:18:04.939000+0000","last_peered":"2023-11-26T07:18:04.939000+0000","last_clean":"2023-11-26T07:18:04.939000+0000","last_became_active":"2023-11-26T07:18:03.119500+0000","last_became_peered":"2023-11-26T07:18:03.119500+0000","last_unstale":"2023-11-26T07:18:04.939000+0000","last_undegraded":"2023-11-26T07:18:04.939000+0000","last_fullsized":"2023-11-26T07:18:04.939000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938639+0000","last_change":"2023-11-26T07:18:03.785862+0000","last_active":"2023-11-26T07:18:04.938639+0000","last_peered":"2023-11-26T07:18:04.938639+0000","last_clean":"2023-11-26T07:18:04.938639+0000","last_became_active":"2023-11-26T07:18:03.784616+0000","last_became_peered":"2023-11-26T07:18:03.784616+0000","last_unstale":"2023-11-26T07:18:04.938639+0000","last_undegraded":"2023-11-26T07:18:04.938639+0000","last_fullsized":"2023-11-26T07:18:04.938639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:24.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978559+0000","last_change":"2023-11-26T07:18:03.129914+0000","last_active":"2023-11-26T07:18:04.978559+0000","last_peered":"2023-11-26T07:18:04.978559+0000","last_clean":"2023-11-26T07:18:04.978559+0000","last_became_active":"2023-11-26T07:18:03.127006+0000","last_became_peered":"2023-11-26T07:18:03.127006+0000","last_unstale":"2023-11-26T07:18:04.978559+0000","last_undegraded":"2023-11-26T07:18:04.978559+0000","last_fullsized":"2023-11-26T07:18:04.978559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:54.492600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977454+0000","last_change":"2023-11-26T07:18:03.802395+0000","last_active":"2023-11-26T07:18:04.977454+0000","last_peered":"2023-11-26T07:18:04.977454+0000","last_clean":"2023-11-26T07:18:04.977454+0000","last_became_active":"2023-11-26T07:18:03.801740+0000","last_became_peered":"2023-11-26T07:18:03.801740+0000","last_unstale":"2023-11-26T07:18:04.977454+0000","last_undegraded":"2023-11-26T07:18:04.977454+0000","last_fullsized":"2023-11-26T07:18:04.977454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977360+0000","last_change":"2023-11-26T07:18:03.119783+0000","last_active":"2023-11-26T07:18:04.977360+0000","last_peered":"2023-11-26T07:18:04.977360+0000","last_clean":"2023-11-26T07:18:04.977360+0000","last_became_active":"2023-11-26T07:18:03.119326+0000","last_became_peered":"2023-11-26T07:18:03.119326+0000","last_unstale":"2023-11-26T07:18:04.977360+0000","last_undegraded":"2023-11-26T07:18:04.977360+0000","last_fullsized":"2023-11-26T07:18:04.977360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977326+0000","last_change":"2023-11-26T07:18:03.788692+0000","last_active":"2023-11-26T07:18:04.977326+0000","last_peered":"2023-11-26T07:18:04.977326+0000","last_clean":"2023-11-26T07:18:04.977326+0000","last_became_active":"2023-11-26T07:18:03.787971+0000","last_became_peered":"2023-11-26T07:18:03.787971+0000","last_unstale":"2023-11-26T07:18:04.977326+0000","last_undegraded":"2023-11-26T07:18:04.977326+0000","last_fullsized":"2023-11-26T07:18:04.977326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777168+0000","last_change":"2023-11-26T07:18:03.116346+0000","last_active":"2023-11-26T07:18:04.777168+0000","last_peered":"2023-11-26T07:18:04.777168+0000","last_clean":"2023-11-26T07:18:04.777168+0000","last_became_active":"2023-11-26T07:18:03.115334+0000","last_became_peered":"2023-11-26T07:18:03.115334+0000","last_unstale":"2023-11-26T07:18:04.777168+0000","last_undegraded":"2023-11-26T07:18:04.777168+0000","last_fullsized":"2023-11-26T07:18:04.777168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977145+0000","last_change":"2023-11-26T07:18:03.804750+0000","last_active":"2023-11-26T07:18:04.977145+0000","last_peered":"2023-11-26T07:18:04.977145+0000","last_clean":"2023-11-26T07:18:04.977145+0000","last_became_active":"2023-11-26T07:18:03.804469+0000","last_became_peered":"2023-11-26T07:18:03.804469+0000","last_unstale":"2023-11-26T07:18:04.977145+0000","last_undegraded":"2023-11-26T07:18:04.977145+0000","last_fullsized":"2023-11-26T07:18:04.977145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777925+0000","last_change":"2023-11-26T07:18:03.114861+0000","last_active":"2023-11-26T07:18:04.777925+0000","last_peered":"2023-11-26T07:18:04.777925+0000","last_clean":"2023-11-26T07:18:04.777925+0000","last_became_active":"2023-11-26T07:18:03.114411+0000","last_became_peered":"2023-11-26T07:18:03.114411+0000","last_unstale":"2023-11-26T07:18:04.777925+0000","last_undegraded":"2023-11-26T07:18:04.777925+0000","last_fullsized":"2023-11-26T07:18:04.777925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:41.812402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977491+0000","last_change":"2023-11-26T07:18:03.803915+0000","last_active":"2023-11-26T07:18:04.977491+0000","last_peered":"2023-11-26T07:18:04.977491+0000","last_clean":"2023-11-26T07:18:04.977491+0000","last_became_active":"2023-11-26T07:18:03.803548+0000","last_became_peered":"2023-11-26T07:18:03.803548+0000","last_unstale":"2023-11-26T07:18:04.977491+0000","last_undegraded":"2023-11-26T07:18:04.977491+0000","last_fullsized":"2023-11-26T07:18:04.977491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:09:38.486139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777516+0000","last_change":"2023-11-26T07:18:03.124858+0000","last_active":"2023-11-26T07:18:04.777516+0000","last_peered":"2023-11-26T07:18:04.777516+0000","last_clean":"2023-11-26T07:18:04.777516+0000","last_became_active":"2023-11-26T07:18:03.123588+0000","last_became_peered":"2023-11-26T07:18:03.123588+0000","last_unstale":"2023-11-26T07:18:04.777516+0000","last_undegraded":"2023-11-26T07:18:04.777516+0000","last_fullsized":"2023-11-26T07:18:04.777516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:40.599216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977979+0000","last_change":"2023-11-26T07:18:03.805118+0000","last_active":"2023-11-26T07:18:04.977979+0000","last_peered":"2023-11-26T07:18:04.977979+0000","last_clean":"2023-11-26T07:18:04.977979+0000","last_became_active":"2023-11-26T07:18:03.804832+0000","last_became_peered":"2023-11-26T07:18:03.804832+0000","last_unstale":"2023-11-26T07:18:04.977979+0000","last_undegraded":"2023-11-26T07:18:04.977979+0000","last_fullsized":"2023-11-26T07:18:04.977979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:53:49.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965859+0000","last_change":"2023-11-26T07:18:03.118704+0000","last_active":"2023-11-26T07:18:04.965859+0000","last_peered":"2023-11-26T07:18:04.965859+0000","last_clean":"2023-11-26T07:18:04.965859+0000","last_became_active":"2023-11-26T07:18:03.118402+0000","last_became_peered":"2023-11-26T07:18:03.118402+0000","last_unstale":"2023-11-26T07:18:04.965859+0000","last_undegraded":"2023-11-26T07:18:04.965859+0000","last_fullsized":"2023-11-26T07:18:04.965859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:42:50.691370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978517+0000","last_change":"2023-11-26T07:18:03.798976+0000","last_active":"2023-11-26T07:18:04.978517+0000","last_peered":"2023-11-26T07:18:04.978517+0000","last_clean":"2023-11-26T07:18:04.978517+0000","last_became_active":"2023-11-26T07:18:03.798378+0000","last_became_peered":"2023-11-26T07:18:03.798378+0000","last_unstale":"2023-11-26T07:18:04.978517+0000","last_undegraded":"2023-11-26T07:18:04.978517+0000","last_fullsized":"2023-11-26T07:18:04.978517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:52.399126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777254+0000","last_change":"2023-11-26T07:18:03.127701+0000","last_active":"2023-11-26T07:18:04.777254+0000","last_peered":"2023-11-26T07:18:04.777254+0000","last_clean":"2023-11-26T07:18:04.777254+0000","last_became_active":"2023-11-26T07:18:03.127297+0000","last_became_peered":"2023-11-26T07:18:03.127297+0000","last_unstale":"2023-11-26T07:18:04.777254+0000","last_undegraded":"2023-11-26T07:18:04.777254+0000","last_fullsized":"2023-11-26T07:18:04.777254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:07.033733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978097+0000","last_change":"2023-11-26T07:18:03.805806+0000","last_active":"2023-11-26T07:18:04.978097+0000","last_peered":"2023-11-26T07:18:04.978097+0000","last_clean":"2023-11-26T07:18:04.978097+0000","last_became_active":"2023-11-26T07:18:03.805531+0000","last_became_peered":"2023-11-26T07:18:03.805531+0000","last_unstale":"2023-11-26T07:18:04.978097+0000","last_undegraded":"2023-11-26T07:18:04.978097+0000","last_fullsized":"2023-11-26T07:18:04.978097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:20:20.912837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-26T07:18:03.786995+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:18:03.786995+0000","last_peered":"2023-11-26T07:18:03.786995+0000","last_clean":"2023-11-26T07:18:03.786995+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:18:03.786995+0000","last_undegraded":"2023-11-26T07:18:03.786995+0000","last_fullsized":"2023-11-26T07:18:03.786995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977910+0000","last_change":"2023-11-26T07:18:03.116264+0000","last_active":"2023-11-26T07:18:04.977910+0000","last_peered":"2023-11-26T07:18:04.977910+0000","last_clean":"2023-11-26T07:18:04.977910+0000","last_became_active":"2023-11-26T07:18:03.113528+0000","last_became_peered":"2023-11-26T07:18:03.113528+0000","last_unstale":"2023-11-26T07:18:04.977910+0000","last_undegraded":"2023-11-26T07:18:04.977910+0000","last_fullsized":"2023-11-26T07:18:04.977910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778371+0000","last_change":"2023-11-26T07:18:03.799200+0000","last_active":"2023-11-26T07:18:04.778371+0000","last_peered":"2023-11-26T07:18:04.778371+0000","last_clean":"2023-11-26T07:18:04.778371+0000","last_became_active":"2023-11-26T07:18:03.798900+0000","last_became_peered":"2023-11-26T07:18:03.798900+0000","last_unstale":"2023-11-26T07:18:04.778371+0000","last_undegraded":"2023-11-26T07:18:04.778371+0000","last_fullsized":"2023-11-26T07:18:04.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977542+0000","last_change":"2023-11-26T07:18:03.118573+0000","last_active":"2023-11-26T07:18:04.977542+0000","last_peered":"2023-11-26T07:18:04.977542+0000","last_clean":"2023-11-26T07:18:04.977542+0000","last_became_active":"2023-11-26T07:18:03.118279+0000","last_became_peered":"2023-11-26T07:18:03.118279+0000","last_unstale":"2023-11-26T07:18:04.977542+0000","last_undegraded":"2023-11-26T07:18:04.977542+0000","last_fullsized":"2023-11-26T07:18:04.977542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:38:32.911964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938502+0000","last_change":"2023-11-26T07:18:03.787057+0000","last_active":"2023-11-26T07:18:04.938502+0000","last_peered":"2023-11-26T07:18:04.938502+0000","last_clean":"2023-11-26T07:18:04.938502+0000","last_became_active":"2023-11-26T07:18:03.786791+0000","last_became_peered":"2023-11-26T07:18:03.786791+0000","last_unstale":"2023-11-26T07:18:04.938502+0000","last_undegraded":"2023-11-26T07:18:04.938502+0000","last_fullsized":"2023-11-26T07:18:04.938502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:47.452914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777253+0000","last_change":"2023-11-26T07:18:03.124374+0000","last_active":"2023-11-26T07:18:04.777253+0000","last_peered":"2023-11-26T07:18:04.777253+0000","last_clean":"2023-11-26T07:18:04.777253+0000","last_became_active":"2023-11-26T07:18:03.123071+0000","last_became_peered":"2023-11-26T07:18:03.123071+0000","last_unstale":"2023-11-26T07:18:04.777253+0000","last_undegraded":"2023-11-26T07:18:04.777253+0000","last_fullsized":"2023-11-26T07:18:04.777253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:02:12.811700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965635+0000","last_change":"2023-11-26T07:18:03.787012+0000","last_active":"2023-11-26T07:18:04.965635+0000","last_peered":"2023-11-26T07:18:04.965635+0000","last_clean":"2023-11-26T07:18:04.965635+0000","last_became_active":"2023-11-26T07:18:03.786759+0000","last_became_peered":"2023-11-26T07:18:03.786759+0000","last_unstale":"2023-11-26T07:18:04.965635+0000","last_undegraded":"2023-11-26T07:18:04.965635+0000","last_fullsized":"2023-11-26T07:18:04.965635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978667+0000","last_change":"2023-11-26T07:18:03.125780+0000","last_active":"2023-11-26T07:18:04.978667+0000","last_peered":"2023-11-26T07:18:04.978667+0000","last_clean":"2023-11-26T07:18:04.978667+0000","last_became_active":"2023-11-26T07:18:03.114090+0000","last_became_peered":"2023-11-26T07:18:03.114090+0000","last_unstale":"2023-11-26T07:18:04.978667+0000","last_undegraded":"2023-11-26T07:18:04.978667+0000","last_fullsized":"2023-11-26T07:18:04.978667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:31.621076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777652+0000","last_change":"2023-11-26T07:18:03.793309+0000","last_active":"2023-11-26T07:18:04.777652+0000","last_peered":"2023-11-26T07:18:04.777652+0000","last_clean":"2023-11-26T07:18:04.777652+0000","last_became_active":"2023-11-26T07:18:03.792978+0000","last_became_peered":"2023-11-26T07:18:03.792978+0000","last_unstale":"2023-11-26T07:18:04.777652+0000","last_undegraded":"2023-11-26T07:18:04.777652+0000","last_fullsized":"2023-11-26T07:18:04.777652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:27:53.444118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965659+0000","last_change":"2023-11-26T07:18:03.108277+0000","last_active":"2023-11-26T07:18:04.965659+0000","last_peered":"2023-11-26T07:18:04.965659+0000","last_clean":"2023-11-26T07:18:04.965659+0000","last_became_active":"2023-11-26T07:18:03.107849+0000","last_became_peered":"2023-11-26T07:18:03.107849+0000","last_unstale":"2023-11-26T07:18:04.965659+0000","last_undegraded":"2023-11-26T07:18:04.965659+0000","last_fullsized":"2023-11-26T07:18:04.965659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978391+0000","last_change":"2023-11-26T07:18:03.799853+0000","last_active":"2023-11-26T07:18:04.978391+0000","last_peered":"2023-11-26T07:18:04.978391+0000","last_clean":"2023-11-26T07:18:04.978391+0000","last_became_active":"2023-11-26T07:18:03.799496+0000","last_became_peered":"2023-11-26T07:18:03.799496+0000","last_unstale":"2023-11-26T07:18:04.978391+0000","last_undegraded":"2023-11-26T07:18:04.978391+0000","last_fullsized":"2023-11-26T07:18:04.978391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:50:00.137732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978123+0000","last_change":"2023-11-26T07:18:03.119202+0000","last_active":"2023-11-26T07:18:04.978123+0000","last_peered":"2023-11-26T07:18:04.978123+0000","last_clean":"2023-11-26T07:18:04.978123+0000","last_became_active":"2023-11-26T07:18:03.118804+0000","last_became_peered":"2023-11-26T07:18:03.118804+0000","last_unstale":"2023-11-26T07:18:04.978123+0000","last_undegraded":"2023-11-26T07:18:04.978123+0000","last_fullsized":"2023-11-26T07:18:04.978123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:26.724451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965884+0000","last_change":"2023-11-26T07:18:03.795950+0000","last_active":"2023-11-26T07:18:04.965884+0000","last_peered":"2023-11-26T07:18:04.965884+0000","last_clean":"2023-11-26T07:18:04.965884+0000","last_became_active":"2023-11-26T07:18:03.795701+0000","last_became_peered":"2023-11-26T07:18:03.795701+0000","last_unstale":"2023-11-26T07:18:04.965884+0000","last_undegraded":"2023-11-26T07:18:04.965884+0000","last_fullsized":"2023-11-26T07:18:04.965884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:05.790378+0000","last_change":"2023-11-26T07:18:03.123835+0000","last_active":"2023-11-26T07:18:05.790378+0000","last_peered":"2023-11-26T07:18:05.790378+0000","last_clean":"2023-11-26T07:18:05.790378+0000","last_became_active":"2023-11-26T07:18:03.123563+0000","last_became_peered":"2023-11-26T07:18:03.123563+0000","last_unstale":"2023-11-26T07:18:05.790378+0000","last_undegraded":"2023-11-26T07:18:05.790378+0000","last_fullsized":"2023-11-26T07:18:05.790378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:26:23.116371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778740+0000","last_change":"2023-11-26T07:18:03.798789+0000","last_active":"2023-11-26T07:18:04.778740+0000","last_peered":"2023-11-26T07:18:04.778740+0000","last_clean":"2023-11-26T07:18:04.778740+0000","last_became_active":"2023-11-26T07:18:03.798536+0000","last_became_peered":"2023-11-26T07:18:03.798536+0000","last_unstale":"2023-11-26T07:18:04.778740+0000","last_undegraded":"2023-11-26T07:18:04.778740+0000","last_fullsized":"2023-11-26T07:18:04.778740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978222+0000","last_change":"2023-11-26T07:18:03.121938+0000","last_active":"2023-11-26T07:18:04.978222+0000","last_peered":"2023-11-26T07:18:04.978222+0000","last_clean":"2023-11-26T07:18:04.978222+0000","last_became_active":"2023-11-26T07:18:03.120860+0000","last_became_peered":"2023-11-26T07:18:03.120860+0000","last_unstale":"2023-11-26T07:18:04.978222+0000","last_undegraded":"2023-11-26T07:18:04.978222+0000","last_fullsized":"2023-11-26T07:18:04.978222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:22:46.446245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938909+0000","last_change":"2023-11-26T07:18:03.784898+0000","last_active":"2023-11-26T07:18:04.938909+0000","last_peered":"2023-11-26T07:18:04.938909+0000","last_clean":"2023-11-26T07:18:04.938909+0000","last_became_active":"2023-11-26T07:18:03.784582+0000","last_became_peered":"2023-11-26T07:18:03.784582+0000","last_unstale":"2023-11-26T07:18:04.938909+0000","last_undegraded":"2023-11-26T07:18:04.938909+0000","last_fullsized":"2023-11-26T07:18:04.938909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:37:32.627745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977094+0000","last_change":"2023-11-26T07:18:03.116934+0000","last_active":"2023-11-26T07:18:04.977094+0000","last_peered":"2023-11-26T07:18:04.977094+0000","last_clean":"2023-11-26T07:18:04.977094+0000","last_became_active":"2023-11-26T07:18:03.116587+0000","last_became_peered":"2023-11-26T07:18:03.116587+0000","last_unstale":"2023-11-26T07:18:04.977094+0000","last_undegraded":"2023-11-26T07:18:04.977094+0000","last_fullsized":"2023-11-26T07:18:04.977094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:37:51.633855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.777610+0000","last_change":"2023-11-26T07:18:03.779690+0000","last_active":"2023-11-26T07:18:04.777610+0000","last_peered":"2023-11-26T07:18:04.777610+0000","last_clean":"2023-11-26T07:18:04.777610+0000","last_became_active":"2023-11-26T07:18:03.778339+0000","last_became_peered":"2023-11-26T07:18:03.778339+0000","last_unstale":"2023-11-26T07:18:04.777610+0000","last_undegraded":"2023-11-26T07:18:04.777610+0000","last_fullsized":"2023-11-26T07:18:04.777610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:11:41.605885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965725+0000","last_change":"2023-11-26T07:18:03.119668+0000","last_active":"2023-11-26T07:18:04.965725+0000","last_peered":"2023-11-26T07:18:04.965725+0000","last_clean":"2023-11-26T07:18:04.965725+0000","last_became_active":"2023-11-26T07:18:03.119332+0000","last_became_peered":"2023-11-26T07:18:03.119332+0000","last_unstale":"2023-11-26T07:18:04.965725+0000","last_undegraded":"2023-11-26T07:18:04.965725+0000","last_fullsized":"2023-11-26T07:18:04.965725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778026+0000","last_change":"2023-11-26T07:18:03.782878+0000","last_active":"2023-11-26T07:18:04.778026+0000","last_peered":"2023-11-26T07:18:04.778026+0000","last_clean":"2023-11-26T07:18:04.778026+0000","last_became_active":"2023-11-26T07:18:03.782504+0000","last_became_peered":"2023-11-26T07:18:03.782504+0000","last_unstale":"2023-11-26T07:18:04.778026+0000","last_undegraded":"2023-11-26T07:18:04.778026+0000","last_fullsized":"2023-11-26T07:18:04.778026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:36.658638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.965870+0000","last_change":"2023-11-26T07:18:03.121787+0000","last_active":"2023-11-26T07:18:04.965870+0000","last_peered":"2023-11-26T07:18:04.965870+0000","last_clean":"2023-11-26T07:18:04.965870+0000","last_became_active":"2023-11-26T07:18:03.121345+0000","last_became_peered":"2023-11-26T07:18:03.121345+0000","last_unstale":"2023-11-26T07:18:04.965870+0000","last_undegraded":"2023-11-26T07:18:04.965870+0000","last_fullsized":"2023-11-26T07:18:04.965870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778470+0000","last_change":"2023-11-26T07:18:03.793669+0000","last_active":"2023-11-26T07:18:04.778470+0000","last_peered":"2023-11-26T07:18:04.778470+0000","last_clean":"2023-11-26T07:18:04.778470+0000","last_became_active":"2023-11-26T07:18:03.793355+0000","last_became_peered":"2023-11-26T07:18:03.793355+0000","last_unstale":"2023-11-26T07:18:04.778470+0000","last_undegraded":"2023-11-26T07:18:04.778470+0000","last_fullsized":"2023-11-26T07:18:04.778470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:27.731120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.124539+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.124258+0000","last_became_peered":"2023-11-26T07:18:03.124258+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977547+0000","last_change":"2023-11-26T07:18:03.784788+0000","last_active":"2023-11-26T07:18:04.977547+0000","last_peered":"2023-11-26T07:18:04.977547+0000","last_clean":"2023-11-26T07:18:04.977547+0000","last_became_active":"2023-11-26T07:18:03.784298+0000","last_became_peered":"2023-11-26T07:18:03.784298+0000","last_unstale":"2023-11-26T07:18:04.977547+0000","last_undegraded":"2023-11-26T07:18:04.977547+0000","last_fullsized":"2023-11-26T07:18:04.977547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:55.499269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978292+0000","last_change":"2023-11-26T07:18:03.799951+0000","last_active":"2023-11-26T07:18:04.978292+0000","last_peered":"2023-11-26T07:18:04.978292+0000","last_clean":"2023-11-26T07:18:04.978292+0000","last_became_active":"2023-11-26T07:18:03.799683+0000","last_became_peered":"2023-11-26T07:18:03.799683+0000","last_unstale":"2023-11-26T07:18:04.978292+0000","last_undegraded":"2023-11-26T07:18:04.978292+0000","last_fullsized":"2023-11-26T07:18:04.978292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:07:51.362335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977125+0000","last_change":"2023-11-26T07:18:03.127894+0000","last_active":"2023-11-26T07:18:04.977125+0000","last_peered":"2023-11-26T07:18:04.977125+0000","last_clean":"2023-11-26T07:18:04.977125+0000","last_became_active":"2023-11-26T07:18:03.127553+0000","last_became_peered":"2023-11-26T07:18:03.127553+0000","last_unstale":"2023-11-26T07:18:04.977125+0000","last_undegraded":"2023-11-26T07:18:04.977125+0000","last_fullsized":"2023-11-26T07:18:04.977125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:34.036241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.978401+0000","last_change":"2023-11-26T07:18:03.798787+0000","last_active":"2023-11-26T07:18:04.978401+0000","last_peered":"2023-11-26T07:18:04.978401+0000","last_clean":"2023-11-26T07:18:04.978401+0000","last_became_active":"2023-11-26T07:18:03.797918+0000","last_became_peered":"2023-11-26T07:18:03.797918+0000","last_unstale":"2023-11-26T07:18:04.978401+0000","last_undegraded":"2023-11-26T07:18:04.978401+0000","last_fullsized":"2023-11-26T07:18:04.978401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:09:11.803842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.977895+0000","last_change":"2023-11-26T07:18:03.128111+0000","last_active":"2023-11-26T07:18:04.977895+0000","last_peered":"2023-11-26T07:18:04.977895+0000","last_clean":"2023-11-26T07:18:04.977895+0000","last_became_active":"2023-11-26T07:18:03.127727+0000","last_became_peered":"2023-11-26T07:18:03.127727+0000","last_unstale":"2023-11-26T07:18:04.977895+0000","last_undegraded":"2023-11-26T07:18:04.977895+0000","last_fullsized":"2023-11-26T07:18:04.977895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:01:35.651968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938927+0000","last_change":"2023-11-26T07:18:03.804397+0000","last_active":"2023-11-26T07:18:04.938927+0000","last_peered":"2023-11-26T07:18:04.938927+0000","last_clean":"2023-11-26T07:18:04.938927+0000","last_became_active":"2023-11-26T07:18:03.804157+0000","last_became_peered":"2023-11-26T07:18:03.804157+0000","last_unstale":"2023-11-26T07:18:04.938927+0000","last_undegraded":"2023-11-26T07:18:04.938927+0000","last_fullsized":"2023-11-26T07:18:04.938927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:31.080893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778691+0000","last_change":"2023-11-26T07:18:03.120821+0000","last_active":"2023-11-26T07:18:04.778691+0000","last_peered":"2023-11-26T07:18:04.778691+0000","last_clean":"2023-11-26T07:18:04.778691+0000","last_became_active":"2023-11-26T07:18:03.120551+0000","last_became_peered":"2023-11-26T07:18:03.120551+0000","last_unstale":"2023-11-26T07:18:04.778691+0000","last_undegraded":"2023-11-26T07:18:04.778691+0000","last_fullsized":"2023-11-26T07:18:04.778691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:51:18.820348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.778654+0000","last_change":"2023-11-26T07:18:03.783374+0000","last_active":"2023-11-26T07:18:04.778654+0000","last_peered":"2023-11-26T07:18:04.778654+0000","last_clean":"2023-11-26T07:18:04.778654+0000","last_became_active":"2023-11-26T07:18:03.782911+0000","last_became_peered":"2023-11-26T07:18:03.782911+0000","last_unstale":"2023-11-26T07:18:04.778654+0000","last_undegraded":"2023-11-26T07:18:04.778654+0000","last_fullsized":"2023-11-26T07:18:04.778654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:03.082552+0000","last_clean_scrub_stamp":"2023-11-26T07:18:03.082552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:06:53.712780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-26T07:18:04.938985+0000","last_change":"2023-11-26T07:18:03.120489+0000","last_active":"2023-11-26T07:18:04.938985+0000","last_peered":"2023-11-26T07:18:04.938985+0000","last_clean":"2023-11-26T07:18:04.938985+0000","last_became_active":"2023-11-26T07:18:03.120191+0000","last_became_peered":"2023-11-26T07:18:03.120191+0000","last_unstale":"2023-11-26T07:18:04.938985+0000","last_undegraded":"2023-11-26T07:18:04.938985+0000","last_fullsized":"2023-11-26T07:18:04.938985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:18:02.075883+0000","last_clean_scrub_stamp":"2023-11-26T07:18:02.075883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:27:47.112194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3760000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.415}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.726}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1639999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.835}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:18:13.102 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-26T07:18:13.102 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-26T07:18:13.102 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-26T07:18:13.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-26T07:18:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.271+0000 7fdea1ead640 1 Processor -- start 2023-11-26T07:18:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.271+0000 7fdea1ead640 1 -- start start 2023-11-26T07:18:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fdea1ead640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0d1bc0 0x7fde9c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fdea1ead640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fde9c0b2160 0x7fde9c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fdea1ead640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c0cf0e0 con 0x7fde9c15d6e0 2023-11-26T07:18:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fdea1ead640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c15dac0 con 0x7fde9c0b2160 2023-11-26T07:18:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fdea1ead640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c0ceb20 con 0x7fde9c0d1bc0 2023-11-26T07:18:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9b7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fde9c15d6e0 0x7fde9c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34466/0 (socket says 172.21.15.70:34466) 2023-11-26T07:18:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9b7fe640 1 -- 172.21.15.70:0/471629546 learned_addr learned my addr 172.21.15.70:0/471629546 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9bfff640 1 --2- 172.21.15.70:0/471629546 >> v2:172.21.15.70:3300/0 conn(0x7fde9c0b2160 0x7fde9c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9affd640 1 --2- 172.21.15.70:0/471629546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0d1bc0 0x7fde9c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9bfff640 1 -- 172.21.15.70:0/471629546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0d1bc0 msgr2=0x7fde9c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:13.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9bfff640 1 --2- 172.21.15.70:0/471629546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0d1bc0 0x7fde9c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9bfff640 1 -- 172.21.15.70:0/471629546 >> v1:172.21.15.70:6789/0 conn(0x7fde9c15d6e0 legacy=0x7fde9c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.275+0000 7fde9bfff640 1 -- 172.21.15.70:0/471629546 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c0cee00 con 0x7fde9c0b2160 2023-11-26T07:18:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fde9bfff640 1 --2- 172.21.15.70:0/471629546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c0b2160 0x7fde9c0b0750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c148f857b62fe68b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fde9a7fc640 1 -- 172.21.15.70:0/471629546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940a5900 con 0x7fde9c0b2160 2023-11-26T07:18:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fde9a7fc640 1 -- 172.21.15.70:0/471629546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde940a5a60 con 0x7fde9c0b2160 2023-11-26T07:18:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fde9a7fc640 1 -- 172.21.15.70:0/471629546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940a5df0 con 0x7fde9c0b2160 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 -- 172.21.15.70:0/471629546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c0b2160 msgr2=0x7fde9c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 --2- 172.21.15.70:0/471629546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c0b2160 0x7fde9c0b0750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9401c950 comp rx=0 tx=0).stop 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 -- 172.21.15.70:0/471629546 shutdown_connections 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 --2- 172.21.15.70:0/471629546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c0b2160 0x7fde9c0b0750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 --2- 172.21.15.70:0/471629546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0d1bc0 0x7fde9c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 -- 172.21.15.70:0/471629546 >> 172.21.15.70:0/471629546 conn(0x7fde9c09c550 msgr2=0x7fde9c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 -- 172.21.15.70:0/471629546 shutdown_connections 2023-11-26T07:18:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 -- 172.21.15.70:0/471629546 wait complete. 2023-11-26T07:18:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 Processor -- start 2023-11-26T07:18:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.279+0000 7fdea1ead640 1 -- start start 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0b2160 0x7fde9c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde9c0d1bc0 0x7fde9c0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c15d6e0 0x7fde9c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c154250 con 0x7fde9c15d6e0 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c160600 con 0x7fde9c0d1bc0 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c1608e0 con 0x7fde9c0b2160 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c15d6e0 0x7fde9c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c15d6e0 0x7fde9c15fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60338/0 (socket says 172.21.15.70:60338) 2023-11-26T07:18:13.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 -- 172.21.15.70:0/3234054598 learned_addr learned my addr 172.21.15.70:0/3234054598 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9affd640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde9c0d1bc0 0x7fde9c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9b7fe640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0b2160 0x7fde9c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 -- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0b2160 msgr2=0x7fde9c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0b2160 0x7fde9c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 -- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde9c0d1bc0 msgr2=0x7fde9c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde9c0d1bc0 0x7fde9c0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 -- 172.21.15.70:0/3234054598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94009a70 con 0x7fde9c15d6e0 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9affd640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde9c0d1bc0 0x7fde9c0ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde9bfff640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c15d6e0 0x7fde9c15fb10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde940b0040 tx=0x7fde940196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde83fff640 1 -- 172.21.15.70:0/3234054598 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940b9860 con 0x7fde9c15d6e0 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde83fff640 1 -- 172.21.15.70:0/3234054598 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde940a58f0 con 0x7fde9c15d6e0 2023-11-26T07:18:13.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c154430 con 0x7fde9c15d6e0 2023-11-26T07:18:13.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde83fff640 1 -- 172.21.15.70:0/3234054598 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940b9c00 con 0x7fde9c15d6e0 2023-11-26T07:18:13.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c0cc740 con 0x7fde9c15d6e0 2023-11-26T07:18:13.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c067680 con 0x7fde9c15d6e0 2023-11-26T07:18:13.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.283+0000 7fde83fff640 1 -- 172.21.15.70:0/3234054598 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fde940ad440 con 0x7fde9c15d6e0 2023-11-26T07:18:13.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.287+0000 7fde83fff640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde88066470 0x7fde88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.287+0000 7fde83fff640 1 -- 172.21.15.70:0/3234054598 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde9411f250 con 0x7fde9c15d6e0 2023-11-26T07:18:13.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.287+0000 7fde9b7fe640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde88066470 0x7fde88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.287+0000 7fde9b7fe640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde88066470 0x7fde88068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde8c005890 tx=0x7fde8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.291+0000 7fde83fff640 1 -- 172.21.15.70:0/3234054598 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde940ec6c0 con 0x7fde9c15d6e0 2023-11-26T07:18:13.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.471+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fde9c1548e0 con 0x7fde9c15d6e0 2023-11-26T07:18:13.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.471+0000 7fde83fff640 1 -- 172.21.15.70:0/3234054598 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fde940efce0 con 0x7fde9c15d6e0 2023-11-26T07:18:13.474 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:13.474 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-26T07:18:13.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde88066470 msgr2=0x7fde88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde88066470 0x7fde88068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde8c005890 tx=0x7fde8c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:13.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c15d6e0 msgr2=0x7fde9c15fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c15d6e0 0x7fde9c15fb10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde940b0040 tx=0x7fde940196f0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 shutdown_connections 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde88066470 0x7fde88068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde9c15d6e0 0x7fde9c15fb10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde9c0d1bc0 0x7fde9c0ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 --2- 172.21.15.70:0/3234054598 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde9c0b2160 0x7fde9c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 >> 172.21.15.70:0/3234054598 conn(0x7fde9c09c550 msgr2=0x7fde9c159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 shutdown_connections 2023-11-26T07:18:13.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.475+0000 7fdea1ead640 1 -- 172.21.15.70:0/3234054598 wait complete. 2023-11-26T07:18:13.495 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-26T07:18:13.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31ab3b5640 1 Processor -- start 2023-11-26T07:18:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31ab3b5640 1 -- start start 2023-11-26T07:18:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31ab3b5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a4143810 0x7f31a4072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31ab3b5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a415e860 con 0x7f31a40b1e10 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31ab3b5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a40cdba0 con 0x7f31a415e0f0 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31ab3b5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a4143bf0 con 0x7f31a4143810 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31a9bb2640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f31a40b1e10 0x7f31a415d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57610/0 (socket says 172.21.15.70:57610) 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31a9bb2640 1 -- 172.21.15.70:0/2849152714 learned_addr learned my addr 172.21.15.70:0/2849152714 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31aa3b3640 1 --2- 172.21.15.70:0/2849152714 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a4143810 0x7f31a4072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31a93b1640 1 -- 172.21.15.70:0/2849152714 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855518554 0 0) 0x7f31a415e860 con 0x7f31a40b1e10 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31a93b1640 1 -- 172.21.15.70:0/2849152714 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3190003530 con 0x7f31a40b1e10 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31a93b1640 1 -- 172.21.15.70:0/2849152714 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198764373 0 0) 0x7f31a40cdba0 con 0x7f31a415e0f0 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31a93b1640 1 -- 172.21.15.70:0/2849152714 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a415e860 con 0x7f31a415e0f0 2023-11-26T07:18:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31aa3b3640 1 -- 172.21.15.70:0/2849152714 >> v1:172.21.15.120:6789/0 conn(0x7f31a415e0f0 legacy=0x7f31a40ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31aa3b3640 1 -- 172.21.15.70:0/2849152714 >> v1:172.21.15.70:6789/0 conn(0x7f31a40b1e10 legacy=0x7f31a415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.631+0000 7f31aa3b3640 1 -- 172.21.15.70:0/2849152714 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a40714f0 con 0x7f31a4143810 2023-11-26T07:18:13.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31aa3b3640 1 --2- 172.21.15.70:0/2849152714 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a4143810 0x7f31a4072140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31a00097f0 tx=0x7f31a001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22231f69573a75aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31a93b1640 1 -- 172.21.15.70:0/2849152714 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00a8050 con 0x7f31a4143810 2023-11-26T07:18:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31a93b1640 1 -- 172.21.15.70:0/2849152714 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00ac5f0 con 0x7f31a4143810 2023-11-26T07:18:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31a93b1640 1 -- 172.21.15.70:0/2849152714 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00ac980 con 0x7f31a4143810 2023-11-26T07:18:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2849152714 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a4143810 msgr2=0x7f31a4072140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2849152714 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a4143810 0x7f31a4072140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31a00097f0 tx=0x7f31a001c490 comp rx=0 tx=0).stop 2023-11-26T07:18:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2849152714 shutdown_connections 2023-11-26T07:18:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2849152714 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a4143810 0x7f31a4072140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2849152714 >> 172.21.15.70:0/2849152714 conn(0x7f31a406a890 msgr2=0x7f31a406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2849152714 shutdown_connections 2023-11-26T07:18:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.635+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2849152714 wait complete. 2023-11-26T07:18:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 Processor -- start 2023-11-26T07:18:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 -- start start 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a40b1e10 0x7f31a413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31a4143810 0x7f31a4159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31a415e0f0 0x7f31a41f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a413ad50 con 0x7f31a415e0f0 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a413b310 con 0x7f31a4143810 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a41f7090 con 0x7f31a40b1e10 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31a415e0f0 0x7f31a41f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31a415e0f0 0x7f31a41f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40170/0 (socket says 172.21.15.70:40170) 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 -- 172.21.15.70:0/2481602257 learned_addr learned my addr 172.21.15.70:0/2481602257 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aa3b3640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a40b1e10 0x7f31a413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31a9bb2640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31a4143810 0x7f31a4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 -- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a40b1e10 msgr2=0x7f31a413b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a40b1e10 0x7f31a413b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 -- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31a4143810 msgr2=0x7f31a4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31a4143810 0x7f31a4159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 -- 172.21.15.70:0/2481602257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0009420 con 0x7f31a415e0f0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31aabb4640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31a415e0f0 0x7f31a41f6590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f319c00c7c0 tx=0x7f319c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f319affd640 1 -- 172.21.15.70:0/2481602257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c003b80 con 0x7f31a415e0f0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f319affd640 1 -- 172.21.15.70:0/2481602257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c003ce0 con 0x7f31a415e0f0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a41f7370 con 0x7f31a415e0f0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f319affd640 1 -- 172.21.15.70:0/2481602257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00aa50 con 0x7f31a415e0f0 2023-11-26T07:18:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a4135f20 con 0x7f31a415e0f0 2023-11-26T07:18:13.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.639+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a40cc350 con 0x7f31a415e0f0 2023-11-26T07:18:13.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.643+0000 7f319affd640 1 -- 172.21.15.70:0/2481602257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f319c00abb0 con 0x7f31a415e0f0 2023-11-26T07:18:13.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.643+0000 7f319affd640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3188066470 0x7f3188068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.643+0000 7f319affd640 1 -- 172.21.15.70:0/2481602257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f319c083c20 con 0x7f31a415e0f0 2023-11-26T07:18:13.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.643+0000 7f31aa3b3640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3188066470 0x7f3188068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.643+0000 7f31aa3b3640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3188066470 0x7f3188068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ae000 tx=0x7f31a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.647+0000 7f319affd640 1 -- 172.21.15.70:0/2481602257 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f319c051140 con 0x7f31a415e0f0 2023-11-26T07:18:13.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31a4072660 con 0x7f31a415e0f0 2023-11-26T07:18:13.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f319affd640 1 -- 172.21.15.70:0/2481602257 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f31a4072660 con 0x7f31a415e0f0 2023-11-26T07:18:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:13.801 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3188066470 msgr2=0x7f3188068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3188066470 0x7f3188068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ae000 tx=0x7f31a0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31a415e0f0 msgr2=0x7f31a41f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31a415e0f0 0x7f31a41f6590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f319c00c7c0 tx=0x7f319c00cc80 comp rx=0 tx=0).stop 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 shutdown_connections 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3188066470 0x7f3188068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31a415e0f0 0x7f31a41f6590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31a4143810 0x7f31a4159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 --2- 172.21.15.70:0/2481602257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31a40b1e10 0x7f31a413b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 >> 172.21.15.70:0/2481602257 conn(0x7f31a406a890 msgr2=0x7f31a406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 shutdown_connections 2023-11-26T07:18:13.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.799+0000 7f31ab3b5640 1 -- 172.21.15.70:0/2481602257 wait complete. 2023-11-26T07:18:13.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:13.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:13.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.959+0000 7f686186b640 1 Processor -- start 2023-11-26T07:18:13.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.959+0000 7f686186b640 1 -- start start 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f686186b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f685c15d580 0x7f685c0d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f686186b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f685c0d1f00 0x7f685c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f686186b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0d0bc0 con 0x7f685c0d3e60 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f686186b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c0d0320 con 0x7f685c0d1f00 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f686186b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c0d0600 con 0x7f685c15d580 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f685c0d1f00 0x7f685c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f685c0d1f00 0x7f685c0b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40184/0 (socket says 172.21.15.70:40184) 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 -- 172.21.15.70:0/3632582044 learned_addr learned my addr 172.21.15.70:0/3632582044 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:13.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685affd640 1 --2- 172.21.15.70:0/3632582044 >> v2:172.21.15.120:3300/0 conn(0x7f685c15d580 0x7f685c0d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 -- 172.21.15.70:0/3632582044 >> v2:172.21.15.120:3300/0 conn(0x7f685c15d580 msgr2=0x7f685c0d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:13.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 --2- 172.21.15.70:0/3632582044 >> v2:172.21.15.120:3300/0 conn(0x7f685c15d580 0x7f685c0d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 -- 172.21.15.70:0/3632582044 >> v1:172.21.15.120:6789/0 conn(0x7f685c0d3e60 legacy=0x7f685c0d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:13.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 -- 172.21.15.70:0/3632582044 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0d08e0 con 0x7f685c0d1f00 2023-11-26T07:18:13.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685b7fe640 1 --2- 172.21.15.70:0/3632582044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c0b0490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f685c08bab0 tx=0x7f685401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7c2e539b9c2a45 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.963+0000 7f685a7fc640 1 -- 172.21.15.70:0/3632582044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68540a5790 con 0x7f685c0d1f00 2023-11-26T07:18:13.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f685a7fc640 1 -- 172.21.15.70:0/3632582044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68540a58f0 con 0x7f685c0d1f00 2023-11-26T07:18:13.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f685a7fc640 1 -- 172.21.15.70:0/3632582044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68540a5c80 con 0x7f685c0d1f00 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- 172.21.15.70:0/3632582044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 msgr2=0x7f685c0b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 --2- 172.21.15.70:0/3632582044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c0b0490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f685c08bab0 tx=0x7f685401c9a0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- 172.21.15.70:0/3632582044 shutdown_connections 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 --2- 172.21.15.70:0/3632582044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c0b0490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 --2- 172.21.15.70:0/3632582044 >> v2:172.21.15.120:3300/0 conn(0x7f685c15d580 0x7f685c0d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- 172.21.15.70:0/3632582044 >> 172.21.15.70:0/3632582044 conn(0x7f685c09c550 msgr2=0x7f685c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- 172.21.15.70:0/3632582044 shutdown_connections 2023-11-26T07:18:13.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- 172.21.15.70:0/3632582044 wait complete. 2023-11-26T07:18:13.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 Processor -- start 2023-11-26T07:18:13.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- start start 2023-11-26T07:18:13.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f685c0d3e60 0x7f685c0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f685c15d580 0x7f685c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c1f8a10 con 0x7f685c0d1f00 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c15c990 con 0x7f685c15d580 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f686186b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0cb350 con 0x7f685c0d3e60 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f685affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f685affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40198/0 (socket says 172.21.15.70:40198) 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f685affd640 1 -- 172.21.15.70:0/3102799964 learned_addr learned my addr 172.21.15.70:0/3102799964 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f685b7fe640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f685c15d580 0x7f685c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.967+0000 7f68527fc640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f685c0d3e60 0x7f685c0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f685affd640 1 -- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f685c0d3e60 msgr2=0x7f685c0ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f685affd640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f685c0d3e60 0x7f685c0ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f685affd640 1 -- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f685c15d580 msgr2=0x7f685c0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f685affd640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f685c15d580 0x7f685c0caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f685affd640 1 -- 172.21.15.70:0/3102799964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009b30 con 0x7f685c0d1f00 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f685b7fe640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f685c15d580 0x7f685c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f685affd640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c156280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f684400d620 tx=0x7f684400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f6858ff9640 1 -- 172.21.15.70:0/3102799964 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400b620 con 0x7f685c0d1f00 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f6858ff9640 1 -- 172.21.15.70:0/3102799964 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684400b780 con 0x7f685c0d1f00 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f6858ff9640 1 -- 172.21.15.70:0/3102799964 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400bb10 con 0x7f685c0d1f00 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c15bd80 con 0x7f685c0d1f00 2023-11-26T07:18:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c15c340 con 0x7f685c0d1f00 2023-11-26T07:18:13.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c067680 con 0x7f685c0d1f00 2023-11-26T07:18:13.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f6858ff9640 1 -- 172.21.15.70:0/3102799964 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f684400bc70 con 0x7f685c0d1f00 2023-11-26T07:18:13.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f6858ff9640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f683c066470 0x7f683c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f6858ff9640 1 -- 172.21.15.70:0/3102799964 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6844084360 con 0x7f685c0d1f00 2023-11-26T07:18:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.971+0000 7f68527fc640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f683c066470 0x7f683c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.975+0000 7f68527fc640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f683c066470 0x7f683c068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f685c0cd400 tx=0x7f684c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:13.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:13.975+0000 7f6858ff9640 1 -- 172.21.15.70:0/3102799964 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68440517d0 con 0x7f685c0d1f00 2023-11-26T07:18:14.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.131+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f685c06cdc0 con 0x7f685c0d1f00 2023-11-26T07:18:14.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.131+0000 7f6858ff9640 1 -- 172.21.15.70:0/3102799964 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6844007380 con 0x7f685c0d1f00 2023-11-26T07:18:14.133 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:14.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.131+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f683c066470 msgr2=0x7f683c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.131+0000 7f686186b640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f683c066470 0x7f683c068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f685c0cd400 tx=0x7f684c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:14.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.131+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 msgr2=0x7f685c156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.131+0000 7f686186b640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c156280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f684400d620 tx=0x7f684400dae0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.131+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 shutdown_connections 2023-11-26T07:18:14.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.135+0000 7f686186b640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f685c15d580 0x7f685c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.135+0000 7f686186b640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f685c0d3e60 0x7f685c0ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.135+0000 7f686186b640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f683c066470 0x7f683c068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.135+0000 7f686186b640 1 --2- 172.21.15.70:0/3102799964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f685c0d1f00 0x7f685c156280 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.135+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 >> 172.21.15.70:0/3102799964 conn(0x7f685c09c550 msgr2=0x7f685c15eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.135+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 shutdown_connections 2023-11-26T07:18:14.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.135+0000 7f686186b640 1 -- 172.21.15.70:0/3102799964 wait complete. 2023-11-26T07:18:14.154 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:14.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.291+0000 7fa29ead6640 1 Processor -- start 2023-11-26T07:18:14.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.291+0000 7fa29ead6640 1 -- start start 2023-11-26T07:18:14.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.291+0000 7fa29ead6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 0x7fa298146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.291+0000 7fa29ead6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa298146380 con 0x7fa298145fa0 2023-11-26T07:18:14.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.291+0000 7fa29ead6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa298071660 con 0x7fa29806a490 2023-11-26T07:18:14.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.291+0000 7fa29ead6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa298071480 con 0x7fa29806b190 2023-11-26T07:18:14.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa29c872640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa298145fa0 0x7fa298072420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57624/0 (socket says 172.21.15.70:57624) 2023-11-26T07:18:14.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa29c872640 1 -- 172.21.15.70:0/2937804101 learned_addr learned my addr 172.21.15.70:0/2937804101 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:14.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 0x7fa298146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734807888 0 0) 0x7fa298146380 con 0x7fa298145fa0 2023-11-26T07:18:14.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa280003530 con 0x7fa298145fa0 2023-11-26T07:18:14.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667032423 0 0) 0x7fa298071660 con 0x7fa29806a490 2023-11-26T07:18:14.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa298146380 con 0x7fa29806a490 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3511164969 0 0) 0x7fa280003530 con 0x7fa298145fa0 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 msgr2=0x7fa298146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 0x7fa298146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 >> v1:172.21.15.120:6789/0 conn(0x7fa29806a490 legacy=0x7fa29806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298071940 con 0x7fa298145fa0 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fa294001680 con 0x7fa298145fa0 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 >> v1:172.21.15.70:6789/0 conn(0x7fa298145fa0 legacy=0x7fa298072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa280003b40 0x7fa280003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa280004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 0x7fa280005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298071480 con 0x7fa2800047d0 2023-11-26T07:18:14.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28000ba40 con 0x7fa280003b40 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28000bc00 con 0x7fa29806b190 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa280004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa29c872640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa280003b40 0x7fa280003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa29d073640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 0x7fa280005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28ffff640 1 -- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 msgr2=0x7fa280005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa29806b190 0x7fa280005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28ffff640 1 -- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa280003b40 msgr2=0x7fa280003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa280003b40 0x7fa280003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.295+0000 7fa28ffff640 1 -- 172.21.15.70:0/2937804101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280003530 con 0x7fa2800047d0 2023-11-26T07:18:14.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa280004c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa288009ab0 tx=0x7fa28801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30cd16af0e160d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2880a5620 con 0x7fa2800047d0 2023-11-26T07:18:14.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2880a5780 con 0x7fa2800047d0 2023-11-26T07:18:14.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa28f7fe640 1 -- 172.21.15.70:0/2937804101 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2880a5b30 con 0x7fa2800047d0 2023-11-26T07:18:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 -- 172.21.15.70:0/2937804101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 msgr2=0x7fa280004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 --2- 172.21.15.70:0/2937804101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa280004c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa288009ab0 tx=0x7fa28801ca30 comp rx=0 tx=0).stop 2023-11-26T07:18:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29d073640 1 -- 172.21.15.70:0/2937804101 reap_dead start 2023-11-26T07:18:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 -- 172.21.15.70:0/2937804101 shutdown_connections 2023-11-26T07:18:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 -- 172.21.15.70:0/2937804101 >> 172.21.15.70:0/2937804101 conn(0x7fa2980cff00 msgr2=0x7fa2980d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 -- 172.21.15.70:0/2937804101 shutdown_connections 2023-11-26T07:18:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 -- 172.21.15.70:0/2937804101 wait complete. 2023-11-26T07:18:14.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 Processor -- start 2023-11-26T07:18:14.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.299+0000 7fa29ead6640 1 -- start start 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa29814f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2980cd4a0 0x7fa2980cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa298141260 0x7fa2981416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298072000 con 0x7fa2800047d0 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298141c20 con 0x7fa2980cd4a0 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980ce010 con 0x7fa298141260 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa29814f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa29814f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40210/0 (socket says 172.21.15.70:40210) 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 -- 172.21.15.70:0/2035632190 learned_addr learned my addr 172.21.15.70:0/2035632190 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29d073640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa298141260 0x7fa2981416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2980cd4a0 0x7fa2980cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 -- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa298141260 msgr2=0x7fa2981416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa298141260 0x7fa2981416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 -- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2980cd4a0 msgr2=0x7fa2980cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2980cd4a0 0x7fa2980cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 -- 172.21.15.70:0/2035632190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2980ce2f0 con 0x7fa2800047d0 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29c872640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa29814f6c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa294007290 tx=0x7fa294007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa28d7fa640 1 -- 172.21.15.70:0/2035632190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400f940 con 0x7fa2800047d0 2023-11-26T07:18:14.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa28d7fa640 1 -- 172.21.15.70:0/2035632190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29400fac0 con 0x7fa2800047d0 2023-11-26T07:18:14.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa28d7fa640 1 -- 172.21.15.70:0/2035632190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400fe70 con 0x7fa2800047d0 2023-11-26T07:18:14.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2980ce5d0 con 0x7fa2800047d0 2023-11-26T07:18:14.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29815cb00 con 0x7fa2800047d0 2023-11-26T07:18:14.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2980cef00 con 0x7fa2800047d0 2023-11-26T07:18:14.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.303+0000 7fa28d7fa640 1 -- 172.21.15.70:0/2035632190 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa29401d460 con 0x7fa2800047d0 2023-11-26T07:18:14.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.307+0000 7fa28d7fa640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066470 0x7fa284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.307+0000 7fa28d7fa640 1 -- 172.21.15.70:0/2035632190 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa294084130 con 0x7fa2800047d0 2023-11-26T07:18:14.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.307+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066470 0x7fa284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.307+0000 7fa28ffff640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066470 0x7fa284068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa2880af000 tx=0x7fa2880046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.311+0000 7fa28d7fa640 1 -- 172.21.15.70:0/2035632190 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa294051510 con 0x7fa2800047d0 2023-11-26T07:18:14.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.459+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2980cea80 con 0x7fa2800047d0 2023-11-26T07:18:14.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.459+0000 7fa28d7fa640 1 -- 172.21.15.70:0/2035632190 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2980cea80 con 0x7fa2800047d0 2023-11-26T07:18:14.461 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.459+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066470 msgr2=0x7fa284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.459+0000 7fa29ead6640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066470 0x7fa284068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa2880af000 tx=0x7fa2880046d0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.459+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 msgr2=0x7fa29814f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.459+0000 7fa29ead6640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa29814f6c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa294007290 tx=0x7fa294007750 comp rx=0 tx=0).stop 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 shutdown_connections 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa298141260 0x7fa2981416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2980cd4a0 0x7fa2980cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066470 0x7fa284068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 --2- 172.21.15.70:0/2035632190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2800047d0 0x7fa29814f6c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 >> 172.21.15.70:0/2035632190 conn(0x7fa2980cff00 msgr2=0x7fa29806f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 shutdown_connections 2023-11-26T07:18:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.463+0000 7fa29ead6640 1 -- 172.21.15.70:0/2035632190 wait complete. 2023-11-26T07:18:14.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:14.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32f05a640 1 Processor -- start 2023-11-26T07:18:14.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32f05a640 1 -- start start 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32f05a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa328143ac0 0x7fa328070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32f05a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa3280708b0 0x7fa3280cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32f05a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280cc730 con 0x7fa3280cf7c0 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32f05a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa328143ea0 con 0x7fa328143ac0 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32f05a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280cfbd0 con 0x7fa3280708b0 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32cdf6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa328143ac0 0x7fa328070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32d5f7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa3280cf7c0 0x7fa3280b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57628/0 (socket says 172.21.15.70:57628) 2023-11-26T07:18:14.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32d5f7640 1 -- 172.21.15.70:0/3695512135 learned_addr learned my addr 172.21.15.70:0/3695512135 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32cdf6640 1 -- 172.21.15.70:0/3695512135 >> v2:172.21.15.120:3300/0 conn(0x7fa3280708b0 msgr2=0x7fa3280cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32cdf6640 1 --2- 172.21.15.70:0/3695512135 >> v2:172.21.15.120:3300/0 conn(0x7fa3280708b0 0x7fa3280cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32cdf6640 1 -- 172.21.15.70:0/3695512135 >> v1:172.21.15.70:6789/0 conn(0x7fa3280cf7c0 legacy=0x7fa3280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa32cdf6640 1 -- 172.21.15.70:0/3695512135 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328070ee0 con 0x7fa328143ac0 2023-11-26T07:18:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.623+0000 7fa3277fe640 1 -- 172.21.15.70:0/3695512135 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261456326 0 0) 0x7fa3280cc730 con 0x7fa3280cf7c0 2023-11-26T07:18:14.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32cdf6640 1 --2- 172.21.15.70:0/3695512135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa328143ac0 0x7fa328070370 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3280aeb10 tx=0x7fa31c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad137ac2ff86f0f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa3277fe640 1 -- 172.21.15.70:0/3695512135 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0ab680 con 0x7fa328143ac0 2023-11-26T07:18:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa3277fe640 1 -- 172.21.15.70:0/3695512135 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c0ab7e0 con 0x7fa328143ac0 2023-11-26T07:18:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa3277fe640 1 -- 172.21.15.70:0/3695512135 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0abb70 con 0x7fa328143ac0 2023-11-26T07:18:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 -- 172.21.15.70:0/3695512135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa328143ac0 msgr2=0x7fa328070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3695512135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa328143ac0 0x7fa328070370 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3280aeb10 tx=0x7fa31c01c460 comp rx=0 tx=0).stop 2023-11-26T07:18:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 -- 172.21.15.70:0/3695512135 shutdown_connections 2023-11-26T07:18:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3695512135 >> v2:172.21.15.120:3300/0 conn(0x7fa3280708b0 0x7fa3280cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3695512135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa328143ac0 0x7fa328070370 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 -- 172.21.15.70:0/3695512135 >> 172.21.15.70:0/3695512135 conn(0x7fa32806a890 msgr2=0x7fa32806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 -- 172.21.15.70:0/3695512135 shutdown_connections 2023-11-26T07:18:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 -- 172.21.15.70:0/3695512135 wait complete. 2023-11-26T07:18:14.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.627+0000 7fa32f05a640 1 Processor -- start 2023-11-26T07:18:14.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 -- start start 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3280708b0 0x7fa3280aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3280cf7c0 0x7fa32813ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa328143ac0 0x7fa32813b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa328136e30 con 0x7fa3280cf7c0 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281370d0 con 0x7fa328143ac0 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281373b0 con 0x7fa3280708b0 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3280cf7c0 0x7fa32813ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3280cf7c0 0x7fa32813ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40216/0 (socket says 172.21.15.70:40216) 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 -- 172.21.15.70:0/3049231023 learned_addr learned my addr 172.21.15.70:0/3049231023 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32cdf6640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3280708b0 0x7fa3280aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32d5f7640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa328143ac0 0x7fa32813b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 -- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3280708b0 msgr2=0x7fa3280aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3280708b0 0x7fa3280aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 -- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa328143ac0 msgr2=0x7fa32813b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa328143ac0 0x7fa32813b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 -- 172.21.15.70:0/3049231023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c009420 con 0x7fa3280cf7c0 2023-11-26T07:18:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa327fff640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3280cf7c0 0x7fa32813ad50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b550 tx=0x7fa31400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa3257fa640 1 -- 172.21.15.70:0/3049231023 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314010870 con 0x7fa3280cf7c0 2023-11-26T07:18:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa3257fa640 1 -- 172.21.15.70:0/3049231023 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3140109f0 con 0x7fa3280cf7c0 2023-11-26T07:18:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa328137690 con 0x7fa3280cf7c0 2023-11-26T07:18:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa3257fa640 1 -- 172.21.15.70:0/3049231023 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314010da0 con 0x7fa3280cf7c0 2023-11-26T07:18:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa328137bb0 con 0x7fa3280cf7c0 2023-11-26T07:18:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.631+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3280cb840 con 0x7fa3280cf7c0 2023-11-26T07:18:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.635+0000 7fa3257fa640 1 -- 172.21.15.70:0/3049231023 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa31400f3c0 con 0x7fa3280cf7c0 2023-11-26T07:18:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.635+0000 7fa3257fa640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa30c066470 0x7fa30c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.635+0000 7fa3257fa640 1 -- 172.21.15.70:0/3049231023 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa314083f10 con 0x7fa3280cf7c0 2023-11-26T07:18:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.635+0000 7fa32cdf6640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa30c066470 0x7fa30c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.635+0000 7fa32cdf6640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa30c066470 0x7fa30c068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0af000 tx=0x7fa31c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.639+0000 7fa3257fa640 1 -- 172.21.15.70:0/3049231023 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa314051390 con 0x7fa3280cf7c0 2023-11-26T07:18:14.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.787+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa328067680 con 0x7fa3280cf7c0 2023-11-26T07:18:14.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.787+0000 7fa3257fa640 1 -- 172.21.15.70:0/3049231023 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3140549b0 con 0x7fa3280cf7c0 2023-11-26T07:18:14.790 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa30c066470 msgr2=0x7fa30c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa30c066470 0x7fa30c068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0af000 tx=0x7fa31c0a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3280cf7c0 msgr2=0x7fa32813ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3280cf7c0 0x7fa32813ad50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b550 tx=0x7fa31400ba10 comp rx=0 tx=0).stop 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 shutdown_connections 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa30c066470 0x7fa30c068930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3280cf7c0 0x7fa32813ad50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa328143ac0 0x7fa32813b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 --2- 172.21.15.70:0/3049231023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3280708b0 0x7fa3280aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 >> 172.21.15.70:0/3049231023 conn(0x7fa32806a890 msgr2=0x7fa32806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 shutdown_connections 2023-11-26T07:18:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.791+0000 7fa32f05a640 1 -- 172.21.15.70:0/3049231023 wait complete. 2023-11-26T07:18:14.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:14.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.943+0000 7fe6c2ac8640 1 Processor -- start 2023-11-26T07:18:14.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c2ac8640 1 -- start start 2023-11-26T07:18:14.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c2ac8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe6bc15f150 0x7fe6bc06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c2ac8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe6bc06cdc0 0x7fe6bc1650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c2ac8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6bc15f530 con 0x7fe6bc165620 2023-11-26T07:18:14.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c2ac8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc06e050 con 0x7fe6bc15f150 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c2ac8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc165a90 con 0x7fe6bc06cdc0 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c22c7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe6bc165620 0x7fe6bc161a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57640/0 (socket says 172.21.15.70:57640) 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c22c7640 1 -- 172.21.15.70:0/1089214219 learned_addr learned my addr 172.21.15.70:0/1089214219 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c1ac6640 1 --2- 172.21.15.70:0/1089214219 >> v2:172.21.15.70:3300/0 conn(0x7fe6bc15f150 0x7fe6bc06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c12c5640 1 --2- 172.21.15.70:0/1089214219 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc06cdc0 0x7fe6bc1650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c1ac6640 1 -- 172.21.15.70:0/1089214219 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc06cdc0 msgr2=0x7fe6bc1650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c1ac6640 1 --2- 172.21.15.70:0/1089214219 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc06cdc0 0x7fe6bc1650e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c1ac6640 1 -- 172.21.15.70:0/1089214219 >> v1:172.21.15.70:6789/0 conn(0x7fe6bc165620 legacy=0x7fe6bc161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c0ac4640 1 -- 172.21.15.70:0/1089214219 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372539003 0 0) 0x7fe6bc15f530 con 0x7fe6bc165620 2023-11-26T07:18:14.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.947+0000 7fe6c1ac6640 1 -- 172.21.15.70:0/1089214219 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc165ec0 con 0x7fe6bc15f150 2023-11-26T07:18:14.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c1ac6640 1 --2- 172.21.15.70:0/1089214219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc15f150 0x7fe6bc06c880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0b1bd0 tx=0x7fe6b801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a5e064a1c6f78b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c0ac4640 1 -- 172.21.15.70:0/1089214219 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80ab600 con 0x7fe6bc15f150 2023-11-26T07:18:14.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c0ac4640 1 -- 172.21.15.70:0/1089214219 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b80a7050 con 0x7fe6bc15f150 2023-11-26T07:18:14.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c0ac4640 1 -- 172.21.15.70:0/1089214219 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80ab980 con 0x7fe6bc15f150 2023-11-26T07:18:14.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/1089214219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc15f150 msgr2=0x7fe6bc06c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/1089214219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc15f150 0x7fe6bc06c880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0b1bd0 tx=0x7fe6b801c430 comp rx=0 tx=0).stop 2023-11-26T07:18:14.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/1089214219 shutdown_connections 2023-11-26T07:18:14.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/1089214219 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc06cdc0 0x7fe6bc1650e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/1089214219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc15f150 0x7fe6bc06c880 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/1089214219 >> 172.21.15.70:0/1089214219 conn(0x7fe6bc06a890 msgr2=0x7fe6bc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:14.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/1089214219 shutdown_connections 2023-11-26T07:18:14.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/1089214219 wait complete. 2023-11-26T07:18:14.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 Processor -- start 2023-11-26T07:18:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.951+0000 7fe6c2ac8640 1 -- start start 2023-11-26T07:18:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc06cdc0 0x7fe6bc160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc15f150 0x7fe6bc0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc165620 0x7fe6bc15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc155190 con 0x7fe6bc165620 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cce70 con 0x7fe6bc15f150 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cd150 con 0x7fe6bc06cdc0 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc165620 0x7fe6bc15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc165620 0x7fe6bc15dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40232/0 (socket says 172.21.15.70:40232) 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 -- 172.21.15.70:0/3430968546 learned_addr learned my addr 172.21.15.70:0/3430968546 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c12c5640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc15f150 0x7fe6bc0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c1ac6640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc06cdc0 0x7fe6bc160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 -- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc06cdc0 msgr2=0x7fe6bc160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc06cdc0 0x7fe6bc160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 -- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc15f150 msgr2=0x7fe6bc0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:14.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc15f150 0x7fe6bc0b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:14.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 -- 172.21.15.70:0/3430968546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009420 con 0x7fe6bc165620 2023-11-26T07:18:14.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c1ac6640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc06cdc0 0x7fe6bc160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:14.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c22c7640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc165620 0x7fe6bc15dad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c700 tx=0x7fe6b400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6b27fc640 1 -- 172.21.15.70:0/3430968546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400ce10 con 0x7fe6bc165620 2023-11-26T07:18:14.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6b27fc640 1 -- 172.21.15.70:0/3430968546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400a640 con 0x7fe6bc165620 2023-11-26T07:18:14.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6b27fc640 1 -- 172.21.15.70:0/3430968546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400aa70 con 0x7fe6bc165620 2023-11-26T07:18:14.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc0cd430 con 0x7fe6bc165620 2023-11-26T07:18:14.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc1610c0 con 0x7fe6bc165620 2023-11-26T07:18:14.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc0cd820 con 0x7fe6bc165620 2023-11-26T07:18:14.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.955+0000 7fe6b27fc640 1 -- 172.21.15.70:0/3430968546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6b400abd0 con 0x7fe6bc165620 2023-11-26T07:18:14.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.959+0000 7fe6b27fc640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:14.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.959+0000 7fe6b27fc640 1 -- 172.21.15.70:0/3430968546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6b4083360 con 0x7fe6bc165620 2023-11-26T07:18:14.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.959+0000 7fe6c1ac6640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:14.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.959+0000 7fe6c1ac6640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc162c00 tx=0x7fe6b80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:14.963+0000 7fe6b27fc640 1 -- 172.21.15.70:0/3430968546 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6b40507f0 con 0x7fe6bc165620 2023-11-26T07:18:15.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.143+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6bc0cd620 con 0x7fe6bc165620 2023-11-26T07:18:15.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.143+0000 7fe6b27fc640 1 -- 172.21.15.70:0/3430968546 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fe6b4018090 con 0x7fe6bc165620 2023-11-26T07:18:15.146 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:15.146 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:15.147 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:15.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 msgr2=0x7fe6a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc162c00 tx=0x7fe6b80a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:15.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc165620 msgr2=0x7fe6bc15dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc165620 0x7fe6bc15dad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c700 tx=0x7fe6b400cbc0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 shutdown_connections 2023-11-26T07:18:15.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc165620 0x7fe6bc15dad0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc15f150 0x7fe6bc0b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 --2- 172.21.15.70:0/3430968546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc06cdc0 0x7fe6bc160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 >> 172.21.15.70:0/3430968546 conn(0x7fe6bc06a890 msgr2=0x7fe6bc156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:15.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 shutdown_connections 2023-11-26T07:18:15.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.147+0000 7fe6c2ac8640 1 -- 172.21.15.70:0/3430968546 wait complete. 2023-11-26T07:18:15.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:15.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c09a16640 1 Processor -- start 2023-11-26T07:18:15.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c09a16640 1 -- start start 2023-11-26T07:18:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c09a16640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c04143ac0 0x7f1c04070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c09a16640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c040708b0 0x7f1c040cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c09a16640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c040cfbf0 con 0x7f1c040cf7c0 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c09a16640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c04143ea0 con 0x7f1c040708b0 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c09a16640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040cc730 con 0x7f1c04143ac0 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1bfa7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c040708b0 0x7f1c040cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c02ffd640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c04143ac0 0x7f1c04070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c02ffd640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c04143ac0 0x7f1c04070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:50190/0 (socket says 172.21.15.70:50190) 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c037fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1c040cf7c0 0x7f1c040b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:47030/0 (socket says 172.21.15.70:47030) 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1bfa7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c040708b0 0x7f1c040cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:33078/0 (socket says 172.21.15.70:33078) 2023-11-26T07:18:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c02ffd640 1 -- 172.21.15.70:0/539607770 learned_addr learned my addr 172.21.15.70:0/539607770 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:15.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c02ffd640 1 -- 172.21.15.70:0/539607770 >> v2:172.21.15.120:3300/0 conn(0x7f1c040708b0 msgr2=0x7f1c040cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:15.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c02ffd640 1 --2- 172.21.15.70:0/539607770 >> v2:172.21.15.120:3300/0 conn(0x7f1c040708b0 0x7f1c040cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c02ffd640 1 -- 172.21.15.70:0/539607770 >> v1:172.21.15.120:6789/0 conn(0x7f1c040cf7c0 legacy=0x7f1c040b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.303+0000 7f1c02ffd640 1 -- 172.21.15.70:0/539607770 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04070ee0 con 0x7f1c04143ac0 2023-11-26T07:18:15.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c02ffd640 1 --2- 172.21.15.70:0/539607770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c04143ac0 0x7f1c04070370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009870 tx=0x7f1bf401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b8f989a32d3e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c027fc640 1 -- 172.21.15.70:0/539607770 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40ab650 con 0x7f1c04143ac0 2023-11-26T07:18:15.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c027fc640 1 -- 172.21.15.70:0/539607770 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf40ab7b0 con 0x7f1c04143ac0 2023-11-26T07:18:15.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c027fc640 1 -- 172.21.15.70:0/539607770 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40abb40 con 0x7f1c04143ac0 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 -- 172.21.15.70:0/539607770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c04143ac0 msgr2=0x7f1c04070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 --2- 172.21.15.70:0/539607770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c04143ac0 0x7f1c04070370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009870 tx=0x7f1bf401c540 comp rx=0 tx=0).stop 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 -- 172.21.15.70:0/539607770 shutdown_connections 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 --2- 172.21.15.70:0/539607770 >> v2:172.21.15.120:3300/0 conn(0x7f1c040708b0 0x7f1c040cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 --2- 172.21.15.70:0/539607770 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c04143ac0 0x7f1c04070370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 -- 172.21.15.70:0/539607770 >> 172.21.15.70:0/539607770 conn(0x7f1c0406a890 msgr2=0x7f1c0406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 -- 172.21.15.70:0/539607770 shutdown_connections 2023-11-26T07:18:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.307+0000 7f1c09a16640 1 -- 172.21.15.70:0/539607770 wait complete. 2023-11-26T07:18:15.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 Processor -- start 2023-11-26T07:18:15.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 -- start start 2023-11-26T07:18:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c040708b0 0x7f1c0413d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c040cf7c0 0x7f1c04158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c04143ac0 0x7f1c04158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04159d70 con 0x7f1c04143ac0 2023-11-26T07:18:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0413ade0 con 0x7f1c040708b0 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415a190 con 0x7f1c040cf7c0 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c04143ac0 0x7f1c04158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c04143ac0 0x7f1c04158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40242/0 (socket says 172.21.15.70:40242) 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 -- 172.21.15.70:0/2334151943 learned_addr learned my addr 172.21.15.70:0/2334151943 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1bfa7fc640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c040cf7c0 0x7f1c04158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c02ffd640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c040708b0 0x7f1c0413d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 -- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c040cf7c0 msgr2=0x7f1c04158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c040cf7c0 0x7f1c04158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 -- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c040708b0 msgr2=0x7f1c0413d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c040708b0 0x7f1c0413d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 -- 172.21.15.70:0/2334151943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf40094d0 con 0x7f1c04143ac0 2023-11-26T07:18:15.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c037fe640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c04143ac0 0x7f1c04158ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00c3e0 tx=0x7f1bfc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c00ff9640 1 -- 172.21.15.70:0/2334151943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0074e0 con 0x7f1c04143ac0 2023-11-26T07:18:15.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c00ff9640 1 -- 172.21.15.70:0/2334151943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc007640 con 0x7f1c04143ac0 2023-11-26T07:18:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c041590f0 con 0x7f1c04143ac0 2023-11-26T07:18:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c00ff9640 1 -- 172.21.15.70:0/2334151943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc004a30 con 0x7f1c04143ac0 2023-11-26T07:18:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.311+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c041596b0 con 0x7f1c04143ac0 2023-11-26T07:18:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.315+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c04067680 con 0x7f1c04143ac0 2023-11-26T07:18:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.315+0000 7f1c00ff9640 1 -- 172.21.15.70:0/2334151943 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1bfc004b90 con 0x7f1c04143ac0 2023-11-26T07:18:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.315+0000 7f1c00ff9640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1be4066470 0x7f1be4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.315+0000 7f1c00ff9640 1 -- 172.21.15.70:0/2334151943 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bfc083760 con 0x7f1c04143ac0 2023-11-26T07:18:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.315+0000 7f1c02ffd640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1be4066470 0x7f1be4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.315+0000 7f1c02ffd640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1be4066470 0x7f1be4068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40af000 tx=0x7f1bf40b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.319+0000 7f1c00ff9640 1 -- 172.21.15.70:0/2334151943 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1bfc050c80 con 0x7f1c04143ac0 2023-11-26T07:18:15.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.471+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c040b2110 con 0x7f1c04143ac0 2023-11-26T07:18:15.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.471+0000 7f1c00ff9640 1 -- 172.21.15.70:0/2334151943 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f1bfc0542a0 con 0x7f1c04143ac0 2023-11-26T07:18:15.474 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:15.474 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1be4066470 msgr2=0x7f1be4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1be4066470 0x7f1be4068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40af000 tx=0x7f1bf40b6040 comp rx=0 tx=0).stop 2023-11-26T07:18:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c04143ac0 msgr2=0x7f1c04158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c04143ac0 0x7f1c04158ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00c3e0 tx=0x7f1bfc00c8a0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 shutdown_connections 2023-11-26T07:18:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1be4066470 0x7f1be4068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c04143ac0 0x7f1c04158ac0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c040cf7c0 0x7f1c04158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 --2- 172.21.15.70:0/2334151943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c040708b0 0x7f1c0413d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 >> 172.21.15.70:0/2334151943 conn(0x7f1c0406a890 msgr2=0x7f1c04071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 shutdown_connections 2023-11-26T07:18:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.475+0000 7f1c09a16640 1 -- 172.21.15.70:0/2334151943 wait complete. 2023-11-26T07:18:15.495 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:15.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.631+0000 7fe4d0a9a640 1 Processor -- start 2023-11-26T07:18:15.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.631+0000 7fe4d0a9a640 1 -- start start 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4d0a9a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc1596d0 0x7fe4cc071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4d0a9a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe4cc0ce680 0x7fe4cc0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4d0a9a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc06c750 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4d0a9a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0b3240 con 0x7fe4cc0ce680 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4d0a9a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0cbe00 con 0x7fe4cc1596d0 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4c1d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe4cc0ce680 0x7fe4cc0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4cad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe4cc0b2db0 0x7fe4cc15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57656/0 (socket says 172.21.15.70:57656) 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4cad9d640 1 -- 172.21.15.70:0/1037065383 learned_addr learned my addr 172.21.15.70:0/1037065383 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:15.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4ca59c640 1 --2- 172.21.15.70:0/1037065383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc1596d0 0x7fe4cc071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4c1d9b640 1 -- 172.21.15.70:0/1037065383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc1596d0 msgr2=0x7fe4cc071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:15.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4c1d9b640 1 --2- 172.21.15.70:0/1037065383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc1596d0 0x7fe4cc071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4c1d9b640 1 -- 172.21.15.70:0/1037065383 >> v1:172.21.15.70:6789/0 conn(0x7fe4cc0b2db0 legacy=0x7fe4cc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4c1d9b640 1 -- 172.21.15.70:0/1037065383 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0b3550 con 0x7fe4cc0ce680 2023-11-26T07:18:15.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.635+0000 7fe4c9d9b640 1 -- 172.21.15.70:0/1037065383 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118893994 0 0) 0x7fe4cc06c750 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4c1d9b640 1 --2- 172.21.15.70:0/1037065383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0ce680 0x7fe4cc0b2870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40097c0 tx=0x7fe4b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42e76f8bc534986 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4c9d9b640 1 -- 172.21.15.70:0/1037065383 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40ab600 con 0x7fe4cc0ce680 2023-11-26T07:18:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4c9d9b640 1 -- 172.21.15.70:0/1037065383 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b40a7050 con 0x7fe4cc0ce680 2023-11-26T07:18:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4c9d9b640 1 -- 172.21.15.70:0/1037065383 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40ab980 con 0x7fe4cc0ce680 2023-11-26T07:18:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/1037065383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0ce680 msgr2=0x7fe4cc0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/1037065383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0ce680 0x7fe4cc0b2870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40097c0 tx=0x7fe4b401c480 comp rx=0 tx=0).stop 2023-11-26T07:18:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/1037065383 shutdown_connections 2023-11-26T07:18:15.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/1037065383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0ce680 0x7fe4cc0b2870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/1037065383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc1596d0 0x7fe4cc071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/1037065383 >> 172.21.15.70:0/1037065383 conn(0x7fe4cc06a890 msgr2=0x7fe4cc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:15.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/1037065383 shutdown_connections 2023-11-26T07:18:15.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/1037065383 wait complete. 2023-11-26T07:18:15.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.639+0000 7fe4d0a9a640 1 Processor -- start 2023-11-26T07:18:15.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 -- start start 2023-11-26T07:18:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0b2db0 0x7fe4cc14cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc0ce680 0x7fe4cc14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc1596d0 0x7fe4cc15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0ae2c0 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc15a7b0 con 0x7fe4cc1596d0 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc145220 con 0x7fe4cc0ce680 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0b2db0 0x7fe4cc14cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0b2db0 0x7fe4cc14cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40254/0 (socket says 172.21.15.70:40254) 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 -- 172.21.15.70:0/268853449 learned_addr learned my addr 172.21.15.70:0/268853449 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4cad9d640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc1596d0 0x7fe4cc15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4c1d9b640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc0ce680 0x7fe4cc14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 -- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc0ce680 msgr2=0x7fe4cc14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc0ce680 0x7fe4cc14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 -- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc1596d0 msgr2=0x7fe4cc15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc1596d0 0x7fe4cc15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 -- 172.21.15.70:0/268853449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009420 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4cad9d640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc1596d0 0x7fe4cc15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4c1d9b640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc0ce680 0x7fe4cc14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4ca59c640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0b2db0 0x7fe4cc14cc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00efc0 tx=0x7fe4bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4c37fe640 1 -- 172.21.15.70:0/268853449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc009b80 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4c37fe640 1 -- 172.21.15.70:0/268853449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00f040 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc0ad6b0 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4c37fe640 1 -- 172.21.15.70:0/268853449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0146a0 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc0adc70 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.643+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc067680 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.647+0000 7fe4c37fe640 1 -- 172.21.15.70:0/268853449 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4bc014800 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.647+0000 7fe4c37fe640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066470 0x7fe4ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.647+0000 7fe4c37fe640 1 -- 172.21.15.70:0/268853449 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4bc084c40 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.647+0000 7fe4c1d9b640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066470 0x7fe4ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.647+0000 7fe4c1d9b640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066470 0x7fe4ac068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40ad000 tx=0x7fe4b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.651+0000 7fe4c37fe640 1 -- 172.21.15.70:0/268853449 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4bc052130 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.803+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4cc0709f0 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.803+0000 7fe4c37fe640 1 -- 172.21.15.70:0/268853449 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4bc055750 con 0x7fe4cc0b2db0 2023-11-26T07:18:15.806 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066470 msgr2=0x7fe4ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066470 0x7fe4ac068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40ad000 tx=0x7fe4b4008040 comp rx=0 tx=0).stop 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0b2db0 msgr2=0x7fe4cc14cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0b2db0 0x7fe4cc14cc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00efc0 tx=0x7fe4bc00c490 comp rx=0 tx=0).stop 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 shutdown_connections 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc1596d0 0x7fe4cc15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc0ce680 0x7fe4cc14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066470 0x7fe4ac068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 --2- 172.21.15.70:0/268853449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0b2db0 0x7fe4cc14cc00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 >> 172.21.15.70:0/268853449 conn(0x7fe4cc06a890 msgr2=0x7fe4cc0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:15.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 shutdown_connections 2023-11-26T07:18:15.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.807+0000 7fe4d0a9a640 1 -- 172.21.15.70:0/268853449 wait complete. 2023-11-26T07:18:15.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:15.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98f1a1640 1 Processor -- start 2023-11-26T07:18:15.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98f1a1640 1 -- start start 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98f1a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9880d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98f1a1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd9880b2160 0x7fd9880d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98f1a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9880cf0e0 con 0x7fd9880d19f0 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98f1a1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98815dac0 con 0x7fd9880b2160 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98f1a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880d1e80 con 0x7fd98815d6e0 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd97ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd9880b2160 0x7fd9880d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd97ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd9880b2160 0x7fd9880d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40268/0 (socket says 172.21.15.70:40268) 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd97ffff640 1 -- 172.21.15.70:0/3180996932 learned_addr learned my addr 172.21.15.70:0/3180996932 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:15.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd98cf3d640 1 --2- 172.21.15.70:0/3180996932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9880d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd97ffff640 1 -- 172.21.15.70:0/3180996932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 msgr2=0x7fd9880d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:15.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd97ffff640 1 --2- 172.21.15.70:0/3180996932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9880d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd97ffff640 1 -- 172.21.15.70:0/3180996932 >> v1:172.21.15.120:6789/0 conn(0x7fd9880d19f0 legacy=0x7fd9880cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.967+0000 7fd97ffff640 1 -- 172.21.15.70:0/3180996932 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9880ceb20 con 0x7fd9880b2160 2023-11-26T07:18:15.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd97ffff640 1 --2- 172.21.15.70:0/3180996932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd9880d14b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd978009870 tx=0x7fd97801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f92d79d24e537f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd97f7fe640 1 -- 172.21.15.70:0/3180996932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780a7070 con 0x7fd9880b2160 2023-11-26T07:18:15.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd97f7fe640 1 -- 172.21.15.70:0/3180996932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9780ab430 con 0x7fd9880b2160 2023-11-26T07:18:15.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd97f7fe640 1 -- 172.21.15.70:0/3180996932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780ab7c0 con 0x7fd9880b2160 2023-11-26T07:18:15.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3180996932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 msgr2=0x7fd9880d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3180996932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd9880d14b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd978009870 tx=0x7fd97801c540 comp rx=0 tx=0).stop 2023-11-26T07:18:15.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3180996932 shutdown_connections 2023-11-26T07:18:15.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3180996932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd9880d14b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3180996932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9880d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3180996932 >> 172.21.15.70:0/3180996932 conn(0x7fd98809c550 msgr2=0x7fd9880d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:15.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3180996932 shutdown_connections 2023-11-26T07:18:15.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3180996932 wait complete. 2023-11-26T07:18:15.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.971+0000 7fd98f1a1640 1 Processor -- start 2023-11-26T07:18:15.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 -- start start 2023-11-26T07:18:15.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd988157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9880d19f0 0x7fd98815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9881590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd988156330 con 0x7fd9880b2160 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9881595e0 con 0x7fd9880d19f0 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd988156b90 con 0x7fd98815d6e0 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd988157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd988157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40280/0 (socket says 172.21.15.70:40280) 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 -- 172.21.15.70:0/3613894823 learned_addr learned my addr 172.21.15.70:0/3613894823 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98d73e640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9881590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd97ffff640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9880d19f0 0x7fd98815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 -- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 msgr2=0x7fd9881590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9881590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 -- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9880d19f0 msgr2=0x7fd98815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9880d19f0 0x7fd98815a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 -- 172.21.15.70:0/3613894823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780094d0 con 0x7fd9880b2160 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98cf3d640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd988157020 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd98400e8a0 tx=0x7fd98400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd97d7fa640 1 -- 172.21.15.70:0/3613894823 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984009510 con 0x7fd9880b2160 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd97d7fa640 1 -- 172.21.15.70:0/3613894823 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400c8e0 con 0x7fd9880b2160 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98815a750 con 0x7fd9880b2160 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd97d7fa640 1 -- 172.21.15.70:0/3613894823 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400cc50 con 0x7fd9880b2160 2023-11-26T07:18:15.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd988156820 con 0x7fd9880b2160 2023-11-26T07:18:15.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.975+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd988067680 con 0x7fd9880b2160 2023-11-26T07:18:15.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.979+0000 7fd97d7fa640 1 -- 172.21.15.70:0/3613894823 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd984013470 con 0x7fd9880b2160 2023-11-26T07:18:15.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.979+0000 7fd97d7fa640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd974066470 0x7fd974068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:15.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.979+0000 7fd97d7fa640 1 -- 172.21.15.70:0/3613894823 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd984083fd0 con 0x7fd9880b2160 2023-11-26T07:18:15.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.979+0000 7fd97ffff640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd974066470 0x7fd974068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:15.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.979+0000 7fd97ffff640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd974066470 0x7fd974068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9780af000 tx=0x7fd978008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:15.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:15.983+0000 7fd97d7fa640 1 -- 172.21.15.70:0/3613894823 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9840513b0 con 0x7fd9880b2160 2023-11-26T07:18:16.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.135+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd988066780 con 0x7fd9880b2160 2023-11-26T07:18:16.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd97d7fa640 1 -- 172.21.15.70:0/3613894823 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9840549d0 con 0x7fd9880b2160 2023-11-26T07:18:16.140 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:16.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd974066470 msgr2=0x7fd974068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd974066470 0x7fd974068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9780af000 tx=0x7fd978008040 comp rx=0 tx=0).stop 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 msgr2=0x7fd988157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd988157020 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd98400e8a0 tx=0x7fd98400eca0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 shutdown_connections 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98815d6e0 0x7fd9881590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9880d19f0 0x7fd98815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd974066470 0x7fd974068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 --2- 172.21.15.70:0/3613894823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9880b2160 0x7fd988157020 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 >> 172.21.15.70:0/3613894823 conn(0x7fd98809c550 msgr2=0x7fd9881605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 shutdown_connections 2023-11-26T07:18:16.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.139+0000 7fd98f1a1640 1 -- 172.21.15.70:0/3613894823 wait complete. 2023-11-26T07:18:16.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:16.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b3980640 1 Processor -- start 2023-11-26T07:18:16.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b3980640 1 -- start start 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b3980640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac066320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b3980640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f16ac06a490 0x7f16ac06a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b3980640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac0cd610 con 0x7f16ac1575c0 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b3980640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac06ae60 con 0x7f16ac06a490 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b3980640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac15a6d0 con 0x7f16ac06bac0 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b1f1d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f16ac06a490 0x7f16ac06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b171c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f16ac1575c0 0x7f16ac159e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57666/0 (socket says 172.21.15.70:57666) 2023-11-26T07:18:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b171c640 1 -- 172.21.15.70:0/142182052 learned_addr learned my addr 172.21.15.70:0/142182052 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b0f1b640 1 --2- 172.21.15.70:0/142182052 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac066320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b1f1d640 1 -- 172.21.15.70:0/142182052 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 msgr2=0x7f16ac066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b1f1d640 1 --2- 172.21.15.70:0/142182052 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac066320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b1f1d640 1 -- 172.21.15.70:0/142182052 >> v1:172.21.15.70:6789/0 conn(0x7f16ac1575c0 legacy=0x7f16ac159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16b1f1d640 1 -- 172.21.15.70:0/142182052 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac15a9b0 con 0x7f16ac06a490 2023-11-26T07:18:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.299+0000 7f16a3fff640 1 -- 172.21.15.70:0/142182052 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283413717 0 0) 0x7f16ac0cd610 con 0x7f16ac1575c0 2023-11-26T07:18:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b1f1d640 1 --2- 172.21.15.70:0/142182052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac06a920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009d90 tx=0x7f16a401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f137c37bc32abf69 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16a3fff640 1 -- 172.21.15.70:0/142182052 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40a5780 con 0x7f16ac06a490 2023-11-26T07:18:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16a3fff640 1 -- 172.21.15.70:0/142182052 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a40a58e0 con 0x7f16ac06a490 2023-11-26T07:18:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16a3fff640 1 -- 172.21.15.70:0/142182052 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40a5c70 con 0x7f16ac06a490 2023-11-26T07:18:16.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 -- 172.21.15.70:0/142182052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 msgr2=0x7f16ac06a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 --2- 172.21.15.70:0/142182052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac06a920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f16a4009d90 tx=0x7f16a401c8c0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 -- 172.21.15.70:0/142182052 shutdown_connections 2023-11-26T07:18:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 --2- 172.21.15.70:0/142182052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac06a920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 --2- 172.21.15.70:0/142182052 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac066320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 -- 172.21.15.70:0/142182052 >> 172.21.15.70:0/142182052 conn(0x7f16ac0cf710 msgr2=0x7f16ac0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 -- 172.21.15.70:0/142182052 shutdown_connections 2023-11-26T07:18:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.303+0000 7f16b3980640 1 -- 172.21.15.70:0/142182052 wait complete. 2023-11-26T07:18:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 Processor -- start 2023-11-26T07:18:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 -- start start 2023-11-26T07:18:16.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16ac1575c0 0x7f16ac1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac0cbf60 con 0x7f16ac06a490 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14c950 con 0x7f16ac1575c0 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac145260 con 0x7f16ac06bac0 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac0cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40302/0 (socket says 172.21.15.70:40302) 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 -- 172.21.15.70:0/2982729771 learned_addr learned my addr 172.21.15.70:0/2982729771 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:16.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b0f1b640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b1f1d640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16ac1575c0 0x7f16ac1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 -- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 msgr2=0x7f16ac1441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac1441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 -- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16ac1575c0 msgr2=0x7f16ac1580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16ac1575c0 0x7f16ac1580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 -- 172.21.15.70:0/2982729771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a4009a70 con 0x7f16ac06a490 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b0f1b640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b171c640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac0cba20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c4b0 tx=0x7f16a800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16a1ffb640 1 -- 172.21.15.70:0/2982729771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80074e0 con 0x7f16ac06a490 2023-11-26T07:18:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16a1ffb640 1 -- 172.21.15.70:0/2982729771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8007660 con 0x7f16ac06a490 2023-11-26T07:18:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16a1ffb640 1 -- 172.21.15.70:0/2982729771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8004a30 con 0x7f16ac06a490 2023-11-26T07:18:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac154ce0 con 0x7f16ac06a490 2023-11-26T07:18:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.307+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac14c5e0 con 0x7f16ac06a490 2023-11-26T07:18:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.311+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac067680 con 0x7f16ac06a490 2023-11-26T07:18:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.311+0000 7f16a1ffb640 1 -- 172.21.15.70:0/2982729771 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16a8004b90 con 0x7f16ac06a490 2023-11-26T07:18:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.311+0000 7f16a1ffb640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1690066470 0x7f1690068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.311+0000 7f16a1ffb640 1 -- 172.21.15.70:0/2982729771 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16a80830a0 con 0x7f16ac06a490 2023-11-26T07:18:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.311+0000 7f16b0f1b640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1690066470 0x7f1690068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.311+0000 7f16b0f1b640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1690066470 0x7f1690068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16ac1f6fd0 tx=0x7f169c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.315+0000 7f16a1ffb640 1 -- 172.21.15.70:0/2982729771 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16a8053f10 con 0x7f16ac06a490 2023-11-26T07:18:16.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16ac06b310 con 0x7f16ac06a490 2023-11-26T07:18:16.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16a1ffb640 1 -- 172.21.15.70:0/2982729771 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f16a8018020 con 0x7f16ac06a490 2023-11-26T07:18:16.469 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1690066470 msgr2=0x7f1690068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1690066470 0x7f1690068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16ac1f6fd0 tx=0x7f169c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 msgr2=0x7f16ac0cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac0cba20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c4b0 tx=0x7f16a800c970 comp rx=0 tx=0).stop 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 shutdown_connections 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16ac1575c0 0x7f16ac1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f16ac06bac0 0x7f16ac1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1690066470 0x7f1690068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 --2- 172.21.15.70:0/2982729771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16ac06a490 0x7f16ac0cba20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 >> 172.21.15.70:0/2982729771 conn(0x7f16ac0cf710 msgr2=0x7f16ac151d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 shutdown_connections 2023-11-26T07:18:16.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.467+0000 7f16b3980640 1 -- 172.21.15.70:0/2982729771 wait complete. 2023-11-26T07:18:16.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.623+0000 7ff2201c1640 1 Processor -- start 2023-11-26T07:18:16.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff2201c1640 1 -- start start 2023-11-26T07:18:16.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff2201c1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff218143ac0 0x7ff218070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff2201c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180cf990 0x7ff2180cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff2201c1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180cc730 con 0x7ff2180708b0 2023-11-26T07:18:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff2201c1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff218143ea0 con 0x7ff218143ac0 2023-11-26T07:18:16.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff2201c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff218070ee0 con 0x7ff2180cf990 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21e75e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180cf990 0x7ff2180cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21df5d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff218143ac0 0x7ff218070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21e75e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180cf990 0x7ff2180cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:50256/0 (socket says 172.21.15.70:50256) 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21d75c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff2180708b0 0x7ff2180cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:47040/0 (socket says 172.21.15.70:47040) 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21e75e640 1 -- 172.21.15.70:0/1891027436 learned_addr learned my addr 172.21.15.70:0/1891027436 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21df5d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff218143ac0 0x7ff218070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:33122/0 (socket says 172.21.15.70:33122) 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21df5d640 1 -- 172.21.15.70:0/1891027436 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180cf990 msgr2=0x7ff2180cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21df5d640 1 --2- 172.21.15.70:0/1891027436 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180cf990 0x7ff2180cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21df5d640 1 -- 172.21.15.70:0/1891027436 >> v1:172.21.15.120:6789/0 conn(0x7ff2180708b0 legacy=0x7ff2180cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.627+0000 7ff21df5d640 1 -- 172.21.15.70:0/1891027436 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180711c0 con 0x7ff218143ac0 2023-11-26T07:18:16.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff21df5d640 1 --2- 172.21.15.70:0/1891027436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 0x7ff218070370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097c0 tx=0x7ff21401e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb974c9ca5f2c6c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff21cf5b640 1 -- 172.21.15.70:0/1891027436 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140ab670 con 0x7ff218143ac0 2023-11-26T07:18:16.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff21cf5b640 1 -- 172.21.15.70:0/1891027436 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2140ab7d0 con 0x7ff218143ac0 2023-11-26T07:18:16.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff21cf5b640 1 -- 172.21.15.70:0/1891027436 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140abb60 con 0x7ff218143ac0 2023-11-26T07:18:16.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 -- 172.21.15.70:0/1891027436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 msgr2=0x7ff218070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 --2- 172.21.15.70:0/1891027436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 0x7ff218070370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2140097c0 tx=0x7ff21401e690 comp rx=0 tx=0).stop 2023-11-26T07:18:16.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 -- 172.21.15.70:0/1891027436 shutdown_connections 2023-11-26T07:18:16.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 --2- 172.21.15.70:0/1891027436 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180cf990 0x7ff2180cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 --2- 172.21.15.70:0/1891027436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 0x7ff218070370 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 -- 172.21.15.70:0/1891027436 >> 172.21.15.70:0/1891027436 conn(0x7ff21806a890 msgr2=0x7ff21806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 -- 172.21.15.70:0/1891027436 shutdown_connections 2023-11-26T07:18:16.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 -- 172.21.15.70:0/1891027436 wait complete. 2023-11-26T07:18:16.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.631+0000 7ff2201c1640 1 Processor -- start 2023-11-26T07:18:16.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 -- start start 2023-11-26T07:18:16.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180708b0 0x7ff21813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2180cf990 0x7ff2180afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 0x7ff2180a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180af540 con 0x7ff2180cf990 2023-11-26T07:18:16.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180b19e0 con 0x7ff218143ac0 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180b0d90 con 0x7ff2180708b0 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2180cf990 0x7ff2180afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2180cf990 0x7ff2180afca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40314/0 (socket says 172.21.15.70:40314) 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 -- 172.21.15.70:0/3703008589 learned_addr learned my addr 172.21.15.70:0/3703008589 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21e75e640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 0x7ff2180a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21df5d640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180708b0 0x7ff21813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 -- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180708b0 msgr2=0x7ff21813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180708b0 0x7ff21813c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 -- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 msgr2=0x7ff2180a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 0x7ff2180a9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 -- 172.21.15.70:0/3703008589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214009420 con 0x7ff2180cf990 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff21d75c640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2180cf990 0x7ff2180afca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c460 tx=0x7ff20800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff20e7fc640 1 -- 172.21.15.70:0/3703008589 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208007480 con 0x7ff2180cf990 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff20e7fc640 1 -- 172.21.15.70:0/3703008589 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208007600 con 0x7ff2180cf990 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180b1070 con 0x7ff2180cf990 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff20e7fc640 1 -- 172.21.15.70:0/3703008589 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208004a30 con 0x7ff2180cf990 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2180af780 con 0x7ff2180cf990 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.635+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180af9a0 con 0x7ff2180cf990 2023-11-26T07:18:16.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.639+0000 7ff20e7fc640 1 -- 172.21.15.70:0/3703008589 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff208004b90 con 0x7ff2180cf990 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.639+0000 7ff20e7fc640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff1fc0664a0 0x7ff1fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.639+0000 7ff20e7fc640 1 -- 172.21.15.70:0/3703008589 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff208082fa0 con 0x7ff2180cf990 2023-11-26T07:18:16.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.639+0000 7ff21df5d640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff1fc0664a0 0x7ff1fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.639+0000 7ff21df5d640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff1fc0664a0 0x7ff1fc068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2140b0000 tx=0x7ff2140a9000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.643+0000 7ff20e7fc640 1 -- 172.21.15.70:0/3703008589 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2080b4280 con 0x7ff2180cf990 2023-11-26T07:18:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.819+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff218067680 con 0x7ff2180cf990 2023-11-26T07:18:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff20e7fc640 1 -- 172.21.15.70:0/3703008589 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff208050450 con 0x7ff2180cf990 2023-11-26T07:18:16.824 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:16.824 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff1fc0664a0 msgr2=0x7ff1fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff1fc0664a0 0x7ff1fc068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2140b0000 tx=0x7ff2140a9000 comp rx=0 tx=0).stop 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2180cf990 msgr2=0x7ff2180afca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2180cf990 0x7ff2180afca0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c460 tx=0x7ff20800c920 comp rx=0 tx=0).stop 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 shutdown_connections 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff1fc0664a0 0x7ff1fc068960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2180cf990 0x7ff2180afca0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff218143ac0 0x7ff2180a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 --2- 172.21.15.70:0/3703008589 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff2180708b0 0x7ff21813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 >> 172.21.15.70:0/3703008589 conn(0x7ff21806a890 msgr2=0x7ff218140ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 shutdown_connections 2023-11-26T07:18:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.823+0000 7ff2201c1640 1 -- 172.21.15.70:0/3703008589 wait complete. 2023-11-26T07:18:16.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:16.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02c0e06640 1 Processor -- start 2023-11-26T07:18:16.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02c0e06640 1 -- start start 2023-11-26T07:18:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02c0e06640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f02bc0cf280 0x7f02bc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02c0e06640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc0cc730 con 0x7f02bc0cd1b0 2023-11-26T07:18:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02c0e06640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc070ee0 con 0x7f02bc143ac0 2023-11-26T07:18:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02c0e06640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc143ea0 con 0x7f02bc0cf280 2023-11-26T07:18:16.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02bad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f02bc0cd1b0 0x7f02bc0cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57682/0 (socket says 172.21.15.70:57682) 2023-11-26T07:18:16.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02bad9d640 1 -- 172.21.15.70:0/1183441450 learned_addr learned my addr 172.21.15.70:0/1183441450 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899271547 0 0) 0x7f02bc0cc730 con 0x7f02bc0cd1b0 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/1183441450 >> v2:172.21.15.120:3300/0 conn(0x7f02bc0cf280 0x7f02bc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a8003530 con 0x7f02bc0cd1b0 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967065774 0 0) 0x7f02a8003530 con 0x7f02bc0cd1b0 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 >> v2:172.21.15.120:3300/0 conn(0x7f02bc0cf280 msgr2=0x7f02bc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 --2- 172.21.15.70:0/1183441450 >> v2:172.21.15.120:3300/0 conn(0x7f02bc0cf280 0x7f02bc0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 >> v1:172.21.15.120:6789/0 conn(0x7f02bc143ac0 legacy=0x7f02bc070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0711c0 con 0x7f02bc0cd1b0 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.979+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f02b4001a00 con 0x7f02bc0cd1b0 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 >> v1:172.21.15.70:6789/0 conn(0x7f02bc0cd1b0 legacy=0x7f02bc0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02a8003980 0x7f02a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02a80047d0 0x7f02a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a8005190 0x7f02a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800c0b0 con 0x7f02a80047d0 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800c220 con 0x7f02a8005190 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800c3e0 con 0x7f02a8003980 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/1183441450 >> v2:172.21.15.120:3300/0 conn(0x7f02bc0cf280 0x7f02bc0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02ba59c640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02a8003980 0x7f02a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02a80047d0 0x7f02a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02bad9d640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a8005190 0x7f02a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 -- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02a8003980 msgr2=0x7f02a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02a8003980 0x7f02a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 -- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a8005190 msgr2=0x7f02a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:16.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a8005190 0x7f02a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 -- 172.21.15.70:0/1183441450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8003530 con 0x7f02a80047d0 2023-11-26T07:18:16.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02bad9d640 1 -- 172.21.15.70:0/1183441450 reap_dead start 2023-11-26T07:18:16.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02ba59c640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02a8003980 0x7f02a8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:16.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02a80047d0 0x7f02a8004c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0098b0 tx=0x7f02ac01c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5be4ad8295426b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.983+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0af070 con 0x7f02a80047d0 2023-11-26T07:18:16.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac004020 con 0x7f02a80047d0 2023-11-26T07:18:16.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02b9d9b640 1 -- 172.21.15.70:0/1183441450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0043b0 con 0x7f02a80047d0 2023-11-26T07:18:16.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- 172.21.15.70:0/1183441450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02a80047d0 msgr2=0x7f02a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02a80047d0 0x7f02a8004c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0098b0 tx=0x7f02ac01c550 comp rx=0 tx=0).stop 2023-11-26T07:18:16.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- 172.21.15.70:0/1183441450 shutdown_connections 2023-11-26T07:18:16.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 --2- 172.21.15.70:0/1183441450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02a80047d0 0x7f02a8004c50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- 172.21.15.70:0/1183441450 >> 172.21.15.70:0/1183441450 conn(0x7f02bc06a890 msgr2=0x7f02bc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:16.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- 172.21.15.70:0/1183441450 shutdown_connections 2023-11-26T07:18:16.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- 172.21.15.70:0/1183441450 wait complete. 2023-11-26T07:18:16.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 Processor -- start 2023-11-26T07:18:16.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- start start 2023-11-26T07:18:16.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a80047d0 0x7f02bc13bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc13cc50 0x7f02bc1f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02bc159660 0x7f02bc13e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc13c830 con 0x7f02bc13cc50 2023-11-26T07:18:16.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0cab10 con 0x7f02a80047d0 2023-11-26T07:18:16.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.987+0000 7f02c0e06640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0cad60 con 0x7f02bc159660 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc13cc50 0x7f02bc1f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc13cc50 0x7f02bc1f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40336/0 (socket says 172.21.15.70:40336) 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 -- 172.21.15.70:0/3371880223 learned_addr learned my addr 172.21.15.70:0/3371880223 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02ba59c640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a80047d0 0x7f02bc13bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02bad9d640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02bc159660 0x7f02bc13e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 -- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02bc159660 msgr2=0x7f02bc13e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02bc159660 0x7f02bc13e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 -- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a80047d0 msgr2=0x7f02bc13bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a80047d0 0x7f02bc13bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 -- 172.21.15.70:0/3371880223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc15b4c0 con 0x7f02bc13cc50 2023-11-26T07:18:16.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b1d9b640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc13cc50 0x7f02bc1f2ba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01c380 tx=0x7f02a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b37fe640 1 -- 172.21.15.70:0/3371880223 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0af040 con 0x7f02bc13cc50 2023-11-26T07:18:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b37fe640 1 -- 172.21.15.70:0/3371880223 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0be460 con 0x7f02bc13cc50 2023-11-26T07:18:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc15b7a0 con 0x7f02bc13cc50 2023-11-26T07:18:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b37fe640 1 -- 172.21.15.70:0/3371880223 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0be7d0 con 0x7f02bc13cc50 2023-11-26T07:18:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc13e910 con 0x7f02bc13cc50 2023-11-26T07:18:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc15b320 con 0x7f02bc13cc50 2023-11-26T07:18:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b37fe640 1 -- 172.21.15.70:0/3371880223 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02ac0ab450 con 0x7f02bc13cc50 2023-11-26T07:18:16.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.991+0000 7f02b37fe640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f029c066470 0x7f029c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:16.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.995+0000 7f02b37fe640 1 -- 172.21.15.70:0/3371880223 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02ac11e8d0 con 0x7f02bc13cc50 2023-11-26T07:18:16.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.995+0000 7f02ba59c640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f029c066470 0x7f029c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.995+0000 7f02ba59c640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f029c066470 0x7f029c068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f02a4001370 tx=0x7f02a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:16.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:16.999+0000 7f02b37fe640 1 -- 172.21.15.70:0/3371880223 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02bc15b320 con 0x7f02bc13cc50 2023-11-26T07:18:17.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.147+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02bc15b320 con 0x7f02bc13cc50 2023-11-26T07:18:17.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02b37fe640 1 -- 172.21.15.70:0/3371880223 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f02bc15b320 con 0x7f02bc13cc50 2023-11-26T07:18:17.152 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:17.152 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f029c066470 msgr2=0x7f029c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f029c066470 0x7f029c068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f02a4001370 tx=0x7f02a4009040 comp rx=0 tx=0).stop 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc13cc50 msgr2=0x7f02bc1f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc13cc50 0x7f02bc1f2ba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01c380 tx=0x7f02a8005800 comp rx=0 tx=0).stop 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 shutdown_connections 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f029c066470 0x7f029c068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc13cc50 0x7f02bc1f2ba0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f02bc159660 0x7f02bc13e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 --2- 172.21.15.70:0/3371880223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a80047d0 0x7f02bc13bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 >> 172.21.15.70:0/3371880223 conn(0x7f02bc06a890 msgr2=0x7f02bc06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:17.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 shutdown_connections 2023-11-26T07:18:17.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.151+0000 7f02c0e06640 1 -- 172.21.15.70:0/3371880223 wait complete. 2023-11-26T07:18:17.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.307+0000 7f01b4a79640 1 Processor -- start 2023-11-26T07:18:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.307+0000 7f01b4a79640 1 -- start start 2023-11-26T07:18:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01b4a79640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f01b0161cf0 0x7f01b006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01b4a79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b00cdd10 0x7f01b006d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01b4a79640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b00cd610 con 0x7f01b0070ba0 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01b4a79640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b00cd8f0 con 0x7f01b0161cf0 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01b4a79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b0161210 con 0x7f01b00cdd10 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01a5d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f01b0161cf0 0x7f01b006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01a5d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f01b0161cf0 0x7f01b006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40346/0 (socket says 172.21.15.70:40346) 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01a5d9b640 1 -- 172.21.15.70:0/991869 learned_addr learned my addr 172.21.15.70:0/991869 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01aed9d640 1 --2- 172.21.15.70:0/991869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b00cdd10 0x7f01b006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01a5d9b640 1 -- 172.21.15.70:0/991869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b00cdd10 msgr2=0x7f01b006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:17.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01a5d9b640 1 --2- 172.21.15.70:0/991869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b00cdd10 0x7f01b006d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01a5d9b640 1 -- 172.21.15.70:0/991869 >> v1:172.21.15.120:6789/0 conn(0x7f01b0070ba0 legacy=0x7f01b0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.311+0000 7f01a5d9b640 1 -- 172.21.15.70:0/991869 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b01614f0 con 0x7f01b0161cf0 2023-11-26T07:18:17.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01a5d9b640 1 --2- 172.21.15.70:0/991869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b0161cf0 0x7f01b006bae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0198009870 tx=0x7f019801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a08292f93a51ac server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01add9b640 1 -- 172.21.15.70:0/991869 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980a9620 con 0x7f01b0161cf0 2023-11-26T07:18:17.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01add9b640 1 -- 172.21.15.70:0/991869 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980a9780 con 0x7f01b0161cf0 2023-11-26T07:18:17.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01add9b640 1 -- 172.21.15.70:0/991869 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980a9b10 con 0x7f01b0161cf0 2023-11-26T07:18:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 -- 172.21.15.70:0/991869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b0161cf0 msgr2=0x7f01b006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 --2- 172.21.15.70:0/991869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b0161cf0 0x7f01b006bae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0198009870 tx=0x7f019801c540 comp rx=0 tx=0).stop 2023-11-26T07:18:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 -- 172.21.15.70:0/991869 shutdown_connections 2023-11-26T07:18:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 --2- 172.21.15.70:0/991869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b00cdd10 0x7f01b006d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 --2- 172.21.15.70:0/991869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b0161cf0 0x7f01b006bae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 -- 172.21.15.70:0/991869 >> 172.21.15.70:0/991869 conn(0x7f01b00cf710 msgr2=0x7f01b00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 -- 172.21.15.70:0/991869 shutdown_connections 2023-11-26T07:18:17.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 -- 172.21.15.70:0/991869 wait complete. 2023-11-26T07:18:17.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.315+0000 7f01b4a79640 1 Processor -- start 2023-11-26T07:18:17.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 -- start start 2023-11-26T07:18:17.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b0070ba0 0x7f01b0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b00cdd10 0x7f01b0160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b0161cf0 0x7f01b01503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b0150900 con 0x7f01b00cdd10 2023-11-26T07:18:17.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b015be40 con 0x7f01b0161cf0 2023-11-26T07:18:17.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b015b230 con 0x7f01b0070ba0 2023-11-26T07:18:17.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b00cdd10 0x7f01b0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b00cdd10 0x7f01b0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40360/0 (socket says 172.21.15.70:40360) 2023-11-26T07:18:17.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 -- 172.21.15.70:0/1968911275 learned_addr learned my addr 172.21.15.70:0/1968911275 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:17.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01aed9d640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b0161cf0 0x7f01b01503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01ae59c640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b0070ba0 0x7f01b0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 -- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b0070ba0 msgr2=0x7f01b0150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b0070ba0 0x7f01b0150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 -- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b0161cf0 msgr2=0x7f01b01503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b0161cf0 0x7f01b01503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 -- 172.21.15.70:0/1968911275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980094d0 con 0x7f01b00cdd10 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01ae59c640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b0070ba0 0x7f01b0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a5d9b640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b00cdd10 0x7f01b0160630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f019801abf0 tx=0x7f01980192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a77fe640 1 -- 172.21.15.70:0/1968911275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980a9e00 con 0x7f01b00cdd10 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a77fe640 1 -- 172.21.15.70:0/1968911275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980bb440 con 0x7f01b00cdd10 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01a77fe640 1 -- 172.21.15.70:0/1968911275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980bb7f0 con 0x7f01b00cdd10 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b015b510 con 0x7f01b00cdd10 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b015bad0 con 0x7f01b00cdd10 2023-11-26T07:18:17.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.319+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b0067680 con 0x7f01b00cdd10 2023-11-26T07:18:17.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.323+0000 7f01a77fe640 1 -- 172.21.15.70:0/1968911275 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01980bb950 con 0x7f01b00cdd10 2023-11-26T07:18:17.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.323+0000 7f01a77fe640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:17.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.323+0000 7f01a77fe640 1 -- 172.21.15.70:0/1968911275 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f019811dd70 con 0x7f01b00cdd10 2023-11-26T07:18:17.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.323+0000 7f01ae59c640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:17.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.323+0000 7f01ae59c640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0190066470 0x7f0190068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f01b00cd0f0 tx=0x7f01a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.327+0000 7f01a77fe640 1 -- 172.21.15.70:0/1968911275 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01980eb3a0 con 0x7f01b00cdd10 2023-11-26T07:18:17.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.507+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01b00ce260 con 0x7f01b00cdd10 2023-11-26T07:18:17.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.507+0000 7f01a77fe640 1 -- 172.21.15.70:0/1968911275 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f01980ee9c0 con 0x7f01b00cdd10 2023-11-26T07:18:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:17.510 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:17.510 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:17.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0190066470 msgr2=0x7f0190068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0190066470 0x7f0190068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f01b00cd0f0 tx=0x7f01a0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b00cdd10 msgr2=0x7f01b0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b00cdd10 0x7f01b0160630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f019801abf0 tx=0x7f01980192e0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 shutdown_connections 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01b00cdd10 0x7f01b0160630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b0161cf0 0x7f01b01503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 --2- 172.21.15.70:0/1968911275 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01b0070ba0 0x7f01b0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 >> 172.21.15.70:0/1968911275 conn(0x7f01b00cf710 msgr2=0x7f01b0153520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:17.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 shutdown_connections 2023-11-26T07:18:17.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:17.511+0000 7f01b4a79640 1 -- 172.21.15.70:0/1968911275 wait complete. 2023-11-26T07:18:17.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:18:03.482099+0000', 'modified': '2023-11-26T07:18:06.487816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6833/559747401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 559747401}, {'type': 'v1', 'addr': '172.21.15.120:6833', 'nonce': 559747401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:18:17.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:18:17.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-26T07:18:18.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.066+0000 7f6def279640 1 Processor -- start 2023-11-26T07:18:18.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6def279640 1 -- start start 2023-11-26T07:18:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6def279640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6de80cf280 0x7f6de80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6def279640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6de80cd1b0 0x7f6de80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6def279640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80cc730 con 0x7f6de8143ac0 2023-11-26T07:18:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6def279640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de8143ea0 con 0x7f6de80cd1b0 2023-11-26T07:18:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6def279640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80cfc50 con 0x7f6de80cf280 2023-11-26T07:18:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ded816640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6de80cd1b0 0x7f6de80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ded015640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6de8143ac0 0x7f6de8070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57696/0 (socket says 172.21.15.70:57696) 2023-11-26T07:18:18.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ded015640 1 -- 172.21.15.70:0/773949496 learned_addr learned my addr 172.21.15.70:0/773949496 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ded816640 1 -- 172.21.15.70:0/773949496 >> v2:172.21.15.120:3300/0 conn(0x7f6de80cf280 msgr2=0x7f6de80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6dec814640 1 --2- 172.21.15.70:0/773949496 >> v2:172.21.15.120:3300/0 conn(0x7f6de80cf280 0x7f6de80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ded816640 1 --2- 172.21.15.70:0/773949496 >> v2:172.21.15.120:3300/0 conn(0x7f6de80cf280 0x7f6de80cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ddffff640 1 -- 172.21.15.70:0/773949496 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115407117 0 0) 0x7f6de80cc730 con 0x7f6de8143ac0 2023-11-26T07:18:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ded816640 1 -- 172.21.15.70:0/773949496 >> v1:172.21.15.70:6789/0 conn(0x7f6de8143ac0 legacy=0x7f6de8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6ded816640 1 -- 172.21.15.70:0/773949496 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8070ee0 con 0x7f6de80cd1b0 2023-11-26T07:18:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.070+0000 7f6dec814640 1 --2- 172.21.15.70:0/773949496 >> v2:172.21.15.120:3300/0 conn(0x7f6de80cf280 0x7f6de80cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6ded816640 1 --2- 172.21.15.70:0/773949496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de80cd5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6de80aeb10 tx=0x7f6de001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf69eaa127c82be server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6ddffff640 1 -- 172.21.15.70:0/773949496 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00a59d0 con 0x7f6de80cd1b0 2023-11-26T07:18:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6ddffff640 1 -- 172.21.15.70:0/773949496 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00a5b30 con 0x7f6de80cd1b0 2023-11-26T07:18:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6ddffff640 1 -- 172.21.15.70:0/773949496 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00ad440 con 0x7f6de80cd1b0 2023-11-26T07:18:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 -- 172.21.15.70:0/773949496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 msgr2=0x7f6de80cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 --2- 172.21.15.70:0/773949496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de80cd5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6de80aeb10 tx=0x7f6de001c910 comp rx=0 tx=0).stop 2023-11-26T07:18:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 -- 172.21.15.70:0/773949496 shutdown_connections 2023-11-26T07:18:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 --2- 172.21.15.70:0/773949496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de80cd5c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 --2- 172.21.15.70:0/773949496 >> v2:172.21.15.120:3300/0 conn(0x7f6de80cf280 0x7f6de80cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 -- 172.21.15.70:0/773949496 >> 172.21.15.70:0/773949496 conn(0x7f6de806a890 msgr2=0x7f6de806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 -- 172.21.15.70:0/773949496 shutdown_connections 2023-11-26T07:18:18.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 -- 172.21.15.70:0/773949496 wait complete. 2023-11-26T07:18:18.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 Processor -- start 2023-11-26T07:18:18.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.074+0000 7f6def279640 1 -- start start 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de8136980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6de80cf280 0x7f6de815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6de8143ac0 0x7f6de81411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8136ec0 con 0x7f6de80cd1b0 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de813e690 con 0x7f6de8143ac0 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de813e970 con 0x7f6de80cf280 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de8136980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de8136980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40382/0 (socket says 172.21.15.70:40382) 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 -- 172.21.15.70:0/1571336031 learned_addr learned my addr 172.21.15.70:0/1571336031 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded816640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6de8143ac0 0x7f6de81411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6dec814640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6de80cf280 0x7f6de815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 -- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6de80cf280 msgr2=0x7f6de815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6de80cf280 0x7f6de815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 -- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6de8143ac0 msgr2=0x7f6de81411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6de8143ac0 0x7f6de81411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 -- 172.21.15.70:0/1571336031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de0009a70 con 0x7f6de80cd1b0 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded816640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6de8143ac0 0x7f6de81411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6ded015640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de8136980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6de40011f0 tx=0x7f6de400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6dddffb640 1 -- 172.21.15.70:0/1571336031 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40074e0 con 0x7f6de80cd1b0 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6dddffb640 1 -- 172.21.15.70:0/1571336031 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de4007640 con 0x7f6de80cd1b0 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de813ec50 con 0x7f6de80cd1b0 2023-11-26T07:18:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6dddffb640 1 -- 172.21.15.70:0/1571336031 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4004a10 con 0x7f6de80cd1b0 2023-11-26T07:18:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de813f210 con 0x7f6de80cd1b0 2023-11-26T07:18:18.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.078+0000 7f6dddffb640 1 -- 172.21.15.70:0/1571336031 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6de4004b70 con 0x7f6de80cd1b0 2023-11-26T07:18:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dddffb640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6dcc066470 0x7f6dcc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dddffb640 1 -- 172.21.15.70:0/1571336031 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6de4083420 con 0x7f6de80cd1b0 2023-11-26T07:18:18.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dec814640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6dcc066470 0x7f6dcc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 Processor -- start 2023-11-26T07:18:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 -- start start 2023-11-26T07:18:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dec814640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6dcc066470 0x7f6dcc068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006fd0 tx=0x7f6dd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e72c90 0x563f71e73070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e735b0 0x563f71e28de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e29700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71c93130 con 0x563f71e29320 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71c809a0 con 0x563f71e735b0 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f71c7ded0 con 0x563f71e72c90 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e29700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e29700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40386/0 (socket says 172.21.15.70:40386) 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 -- 172.21.15.70:0/4129560439 learned_addr learned my addr 172.21.15.70:0/4129560439 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded015640 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e72c90 0x563f71e73070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dec814640 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e735b0 0x563f71e28de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 -- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e72c90 msgr2=0x563f71e73070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e72c90 0x563f71e73070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 -- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e735b0 msgr2=0x563f71e28de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e735b0 0x563f71e28de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 -- 172.21.15.70:0/4129560439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f71971890 con 0x563f71e29320 2023-11-26T07:18:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dec814640 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e735b0 0x563f71e28de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6ded816640 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e29700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6de00b0040 tx=0x7f6de0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e30c8ea10ec2f09 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dd2ffd640 1 -- 172.21.15.70:0/4129560439 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00b8650 con 0x563f71e29320 2023-11-26T07:18:18.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dd2ffd640 1 -- 172.21.15.70:0/4129560439 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00b87b0 con 0x563f71e29320 2023-11-26T07:18:18.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.082+0000 7f6dd2ffd640 1 -- 172.21.15.70:0/4129560439 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00b8b60 con 0x563f71e29320 2023-11-26T07:18:18.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- 172.21.15.70:0/4129560439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 msgr2=0x563f71e29700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e29700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6de00b0040 tx=0x7f6de0004ac0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- 172.21.15.70:0/4129560439 shutdown_connections 2023-11-26T07:18:18.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e29700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e735b0 0x563f71e28de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4129560439 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e72c90 0x563f71e73070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- 172.21.15.70:0/4129560439 >> 172.21.15.70:0/4129560439 conn(0x563f71e252d0 msgr2=0x563f71e276c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- 172.21.15.70:0/4129560439 shutdown_connections 2023-11-26T07:18:18.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- 172.21.15.70:0/4129560439 wait complete. 2023-11-26T07:18:18.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- start start 2023-11-26T07:18:18.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 Processor -- start 2023-11-26T07:18:18.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e2dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e2e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e735b0 0x563f71e41910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71c797c0 con 0x563f71e29320 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71c31bf0 con 0x563f71e72c90 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f71c37a90 con 0x563f71e735b0 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 10 client.0 _ll_register_callbacks cb 0x563f71e143c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e2dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e2dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40388/0 (socket says 172.21.15.70:40388) 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 -- 172.21.15.70:0/2125182632 learned_addr learned my addr 172.21.15.70:0/2125182632 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6dec814640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e2e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded816640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e735b0 0x563f71e41910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 -- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e735b0 msgr2=0x563f71e41910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e735b0 0x563f71e41910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 -- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 msgr2=0x563f71e2e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e2e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 -- 172.21.15.70:0/2125182632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de8070ee0 con 0x563f71e29320 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded816640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e735b0 0x563f71e41910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6ded015640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e2dd40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6de40544e0 tx=0x7f6de40545a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4074a86654b34f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6dc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6dc7fff640 1 -- 172.21.15.70:0/2125182632 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de405c3c0 con 0x563f71e29320 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6dc7fff640 1 -- 172.21.15.70:0/2125182632 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6de405c520 con 0x563f71e29320 2023-11-26T07:18:18.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f71c3b470 con 0x563f71e29320 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6dc7fff640 1 -- 172.21.15.70:0/2125182632 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6de4058150 con 0x563f71e29320 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 10 client.4623 fetch_fsmap learned FSMap version 8 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.086+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563f71c3a190 con 0x563f71e29320 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dc7fff640 1 -- 172.21.15.70:0/2125182632 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f71c3b470 con 0x563f71e29320 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dc7fff640 1 -- 172.21.15.70:0/2125182632 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6de40582b0 con 0x563f71e29320 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 10 client.4623 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 20 client.4623 populate_metadata read hostname 'smithi070' 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71e42320 0x563f71e84f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 4 client.4623 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 --> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f71c3eb50 con 0x563f71e42320 2023-11-26T07:18:18.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dec814640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71e42320 0x563f71e84f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dec814640 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71e42320 0x563f71e84f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=930f833672a333a5 server_cookie=e66abf283ab0780c in_seq=0 out_seq=0 2023-11-26T07:18:18.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dc7fff640 10 client.4623 ms_handle_connect on v2:172.21.15.120:6832/559747401 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dc7fff640 1 -- 172.21.15.70:0/2125182632 <== mds.0 v2:172.21.15.120:6832/559747401 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f71c3eb50 con 0x563f71e42320 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dc7fff640 10 client.4623 handle_command_reply: tid=0 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 client.4623 shutdown 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 msgr2=0x563f71e2dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e2dd40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6de40544e0 tx=0x7f6de40545a0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 shutdown_connections 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71e42320 0x563f71e84f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e735b0 0x563f71e41910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6dc7fff640 0 client.4623 ms_handle_reset on v2:172.21.15.120:6832/559747401 2023-11-26T07:18:18.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e2e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 --2- 172.21.15.70:0/2125182632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e29320 0x563f71e2dd40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 >> 172.21.15.70:0/2125182632 conn(0x563f71e252d0 msgr2=0x563f71e276c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 shutdown_connections 2023-11-26T07:18:18.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 1 -- 172.21.15.70:0/2125182632 wait complete. 2023-11-26T07:18:18.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.090+0000 7f6df25e8000 20 client.4623 trim_cache size 0 max 16384 2023-11-26T07:18:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 Processor -- start 2023-11-26T07:18:18.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 -- start start 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e71c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e70b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e71070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71932940 con 0x563f71e735b0 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71e30890 con 0x563f71e72c90 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f71c76fd0 con 0x563f71e29320 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e71070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e71070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40400/0 (socket says 172.21.15.70:40400) 2023-11-26T07:18:18.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 -- 172.21.15.70:0/4003850316 learned_addr learned my addr 172.21.15.70:0/4003850316 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded015640 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e71c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6dec814640 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e70b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 -- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 msgr2=0x563f71e71c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e71c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 -- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 msgr2=0x563f71e70b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e70b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 -- 172.21.15.70:0/4003850316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f71c20490 con 0x563f71e735b0 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded015640 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e71c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:18.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.106+0000 7f6ded816640 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e71070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6de00a5b00 tx=0x7f6de00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efea81cb5a386f8e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6dd37fe640 1 -- 172.21.15.70:0/4003850316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00c8070 con 0x563f71e735b0 2023-11-26T07:18:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6dd37fe640 1 -- 172.21.15.70:0/4003850316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00039a0 con 0x563f71e735b0 2023-11-26T07:18:18.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6dd37fe640 1 -- 172.21.15.70:0/4003850316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0003d30 con 0x563f71e735b0 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- 172.21.15.70:0/4003850316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 msgr2=0x563f71e71070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e71070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6de00a5b00 tx=0x7f6de00a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- 172.21.15.70:0/4003850316 shutdown_connections 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e71070 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e70b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 --2- 172.21.15.70:0/4003850316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e71c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- 172.21.15.70:0/4003850316 >> 172.21.15.70:0/4003850316 conn(0x563f71e252d0 msgr2=0x563f71e80280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- 172.21.15.70:0/4003850316 shutdown_connections 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- 172.21.15.70:0/4003850316 wait complete. 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- start start 2023-11-26T07:18:18.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 Processor -- start 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e2aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e85fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71c76bc0 con 0x563f71e735b0 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f71e2efb0 con 0x563f71e72c90 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f71e2e820 con 0x563f71e29320 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6df25e8000 10 client.0 _ll_register_callbacks cb 0x563f71cc7c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e864e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40410/0 (socket says 172.21.15.70:40410) 2023-11-26T07:18:18.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 -- 172.21.15.70:0/995124798 learned_addr learned my addr 172.21.15.70:0/995124798 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded015640 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e2aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6dec814640 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e85fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 -- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 msgr2=0x563f71e2aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e2aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 -- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 msgr2=0x563f71e85fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e85fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.110+0000 7f6ded816640 1 -- 172.21.15.70:0/995124798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f71971890 con 0x563f71e735b0 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6ded816640 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e864e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6de001cdf0 tx=0x7f6de001b150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2f8abb03bd93b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 1 -- 172.21.15.70:0/995124798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00d5070 con 0x563f71e735b0 2023-11-26T07:18:18.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 1 -- 172.21.15.70:0/995124798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6de00b89f0 con 0x563f71e735b0 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f71c78110 con 0x563f71e735b0 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 1 -- 172.21.15.70:0/995124798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6de00c8070 con 0x563f71e735b0 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 10 client.4629 fetch_fsmap learned FSMap version 8 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563f71971cc0 con 0x563f71e735b0 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 1 -- 172.21.15.70:0/995124798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f71c78110 con 0x563f71e735b0 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 1 -- 172.21.15.70:0/995124798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6de00d8020 con 0x563f71e735b0 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 10 client.4629 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 20 client.4629 populate_metadata read hostname 'smithi070' 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71ed3010 0x563f71ed33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 4 client.4629 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:18:18.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 --> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563f71ca79a0 con 0x563f71ed3010 2023-11-26T07:18:18.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6ded015640 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71ed3010 0x563f71ed33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 10 client.4629 ms_handle_connect on v2:172.21.15.120:6832/559747401 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6ded015640 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71ed3010 0x563f71ed33f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8194540fdbe68b70 server_cookie=b08fd2b32267430a in_seq=0 out_seq=0 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 1 -- 172.21.15.70:0/995124798 <== mds.0 v2:172.21.15.120:6832/559747401 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x563f71ca79a0 con 0x563f71ed3010 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 10 client.4629 handle_command_reply: tid=0 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 client.4629 shutdown 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 msgr2=0x563f71e864e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e864e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6de001cdf0 tx=0x7f6de001b150 comp rx=0 tx=0).stop 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 shutdown_connections 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:6832/559747401,v1:172.21.15.120:6833/559747401] conn(0x563f71ed3010 0x563f71ed33f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f71e735b0 0x563f71e864e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563f71e72c90 0x563f71e85fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 --2- 172.21.15.70:0/995124798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x563f71e29320 0x563f71e2aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6dc7fff640 0 client.4629 ms_handle_reset on v2:172.21.15.120:6832/559747401 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 >> 172.21.15.70:0/995124798 conn(0x563f71e252d0 msgr2=0x563f71e276c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 shutdown_connections 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 1 -- 172.21.15.70:0/995124798 wait complete. 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.114+0000 7f6df25e8000 20 client.4629 trim_cache size 0 max 16384 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "35961970-1319-4bbb-b3aa-e783ca1e0d4a", 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-11-26T07:18:18.122 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4288, 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 14.023106507, 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 8, 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 21, 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 21, 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 20.794884771 2023-11-26T07:18:18.123 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:18:18.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6dcc066470 msgr2=0x7f6dcc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6dcc066470 0x7f6dcc068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006fd0 tx=0x7f6dd8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:18.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 msgr2=0x7f6de8136980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de8136980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6de40011f0 tx=0x7f6de400c9b0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 shutdown_connections 2023-11-26T07:18:18.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6de8143ac0 0x7f6de81411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6de80cf280 0x7f6de815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6dcc066470 0x7f6dcc068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 --2- 172.21.15.70:0/1571336031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6de80cd1b0 0x7f6de8136980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 >> 172.21.15.70:0/1571336031 conn(0x7f6de806a890 msgr2=0x7f6de8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 shutdown_connections 2023-11-26T07:18:18.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.118+0000 7f6def279640 1 -- 172.21.15.70:0/1571336031 wait complete. 2023-11-26T07:18:18.138 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-26T07:18:18.161 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-26T07:18:18.161 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-26T07:18:18.162 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-26T07:18:18.162 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:18:18.162 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:18.162 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-26T07:18:18.162 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:18:18.162 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:18.162 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-26T07:18:18.162 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:18:18.162 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:18.163 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-26T07:18:18.163 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-26T07:18:18.163 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:18.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.163 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:18:18.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2023-11-26T07:18:18.237 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2023-11-26T07:18:18.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:18:18.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.239 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:18:18.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2023-11-26T07:18:18.316 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2023-11-26T07:18:18.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:18:18.318 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-26T07:18:18.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:18:18.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.450+0000 7ff1af291640 1 Processor -- start 2023-11-26T07:18:18.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1af291640 1 -- start start 2023-11-26T07:18:18.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1af291640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff1a80b2160 0x7ff1a80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1af291640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80cf0e0 con 0x7ff1a815d6e0 2023-11-26T07:18:18.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1af291640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80ceb20 con 0x7ff1a80d1bc0 2023-11-26T07:18:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1af291640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a815dac0 con 0x7ff1a80b2160 2023-11-26T07:18:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff1a815d6e0 0x7ff1a80d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57704/0 (socket says 172.21.15.70:57704) 2023-11-26T07:18:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 -- 172.21.15.70:0/1792640276 learned_addr learned my addr 172.21.15.70:0/1792640276 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:18.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600560225 0 0) 0x7ff1a80cf0e0 con 0x7ff1a815d6e0 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff194003530 con 0x7ff1a815d6e0 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad82e640 1 --2- 172.21.15.70:0/1792640276 >> v2:172.21.15.120:3300/0 conn(0x7ff1a80b2160 0x7ff1a80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1705944844 0 0) 0x7ff194003530 con 0x7ff1a815d6e0 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 >> v2:172.21.15.120:3300/0 conn(0x7ff1a80b2160 msgr2=0x7ff1a80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 --2- 172.21.15.70:0/1792640276 >> v2:172.21.15.120:3300/0 conn(0x7ff1a80b2160 0x7ff1a80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 >> v1:172.21.15.120:6789/0 conn(0x7ff1a80d1bc0 legacy=0x7ff1a80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80cee00 con 0x7ff1a815d6e0 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7ff1a4001680 con 0x7ff1a815d6e0 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 >> v1:172.21.15.70:6789/0 conn(0x7ff1a815d6e0 legacy=0x7ff1a80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff194003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1940047d0 0x7ff194004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff194005190 0x7ff19400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a815dac0 con 0x7ff194003980 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19400c030 con 0x7ff194005190 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19400c1f0 con 0x7ff1940047d0 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff194003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ac82c640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1940047d0 0x7ff194004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad82e640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff194005190 0x7ff19400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 -- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1940047d0 msgr2=0x7ff194004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1940047d0 0x7ff194004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 -- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff194005190 msgr2=0x7ff19400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff194005190 0x7ff19400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad02d640 1 -- 172.21.15.70:0/1792640276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194003530 con 0x7ff194003980 2023-11-26T07:18:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ad82e640 1 -- 172.21.15.70:0/1792640276 reap_dead start 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.454+0000 7ff1ac82c640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1940047d0 0x7ff194004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1ad02d640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff194003da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c240 tx=0x7ff1a401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b8314c867c2676 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4005ae0 con 0x7ff194003980 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4005c40 con 0x7ff194003980 2023-11-26T07:18:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff19ffff640 1 -- 172.21.15.70:0/1792640276 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40a59d0 con 0x7ff194003980 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1af291640 1 -- 172.21.15.70:0/1792640276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 msgr2=0x7ff194003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1af291640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff194003da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c240 tx=0x7ff1a401cbd0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1af291640 1 -- 172.21.15.70:0/1792640276 shutdown_connections 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1af291640 1 --2- 172.21.15.70:0/1792640276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff194003da0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1af291640 1 -- 172.21.15.70:0/1792640276 >> 172.21.15.70:0/1792640276 conn(0x7ff1a809c550 msgr2=0x7ff1a80d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1af291640 1 -- 172.21.15.70:0/1792640276 shutdown_connections 2023-11-26T07:18:18.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.458+0000 7ff1af291640 1 -- 172.21.15.70:0/1792640276 wait complete. 2023-11-26T07:18:18.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 Processor -- start 2023-11-26T07:18:18.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 -- start start 2023-11-26T07:18:18.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff1a815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1a814f1e0 0x7ff1a814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a80cd190 0x7ff1a80b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8152100 con 0x7ff194003980 2023-11-26T07:18:18.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80cbb90 con 0x7ff1a80cd190 2023-11-26T07:18:18.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a815f820 con 0x7ff1a814f1e0 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff1a815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff1a815f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40432/0 (socket says 172.21.15.70:40432) 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 -- 172.21.15.70:0/3850741756 learned_addr learned my addr 172.21.15.70:0/3850741756 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ac82c640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1a814f1e0 0x7ff1a814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad82e640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a80cd190 0x7ff1a80b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 -- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1a814f1e0 msgr2=0x7ff1a814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1a814f1e0 0x7ff1a814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 -- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a80cd190 msgr2=0x7ff1a80b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a80cd190 0x7ff1a80b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 -- 172.21.15.70:0/3850741756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80cb2a0 con 0x7ff194003980 2023-11-26T07:18:18.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad82e640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a80cd190 0x7ff1a80b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:18.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1ad02d640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff1a815f190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c240 tx=0x7ff194005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff19dffb640 1 -- 172.21.15.70:0/3850741756 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40b4070 con 0x7ff194003980 2023-11-26T07:18:18.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff19dffb640 1 -- 172.21.15.70:0/3850741756 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4005db0 con 0x7ff194003980 2023-11-26T07:18:18.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a80cb540 con 0x7ff194003980 2023-11-26T07:18:18.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff19dffb640 1 -- 172.21.15.70:0/3850741756 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40a5790 con 0x7ff194003980 2023-11-26T07:18:18.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a80cd620 con 0x7ff194003980 2023-11-26T07:18:18.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.462+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a8067680 con 0x7ff194003980 2023-11-26T07:18:18.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.466+0000 7ff19dffb640 1 -- 172.21.15.70:0/3850741756 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1a40a58f0 con 0x7ff194003980 2023-11-26T07:18:18.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.466+0000 7ff19dffb640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff18c0664a0 0x7ff18c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:18.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.466+0000 7ff19dffb640 1 -- 172.21.15.70:0/3850741756 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1a411d850 con 0x7ff194003980 2023-11-26T07:18:18.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.466+0000 7ff1ac82c640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff18c0664a0 0x7ff18c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:18.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.466+0000 7ff1ac82c640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff18c0664a0 0x7ff18c068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1a814f600 tx=0x7ff198009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:18.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.470+0000 7ff19dffb640 1 -- 172.21.15.70:0/3850741756 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1a40ead00 con 0x7ff194003980 2023-11-26T07:18:18.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.650+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff1a80b5840 con 0x7ff194003980 2023-11-26T07:18:18.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff19dffb640 1 -- 172.21.15.70:0/3850741756 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff1a40ee320 con 0x7ff194003980 2023-11-26T07:18:18.657 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff18c0664a0 msgr2=0x7ff18c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff18c0664a0 0x7ff18c068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1a814f600 tx=0x7ff198009040 comp rx=0 tx=0).stop 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 msgr2=0x7ff1a815f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff1a815f190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c240 tx=0x7ff194005800 comp rx=0 tx=0).stop 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 shutdown_connections 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1a80cd190 0x7ff1a80b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff1a814f1e0 0x7ff1a814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff18c0664a0 0x7ff18c068960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 --2- 172.21.15.70:0/3850741756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff194003980 0x7ff1a815f190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 >> 172.21.15.70:0/3850741756 conn(0x7ff1a809c550 msgr2=0x7ff1a80b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 shutdown_connections 2023-11-26T07:18:18.659 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:18.654+0000 7ff1af291640 1 -- 172.21.15.70:0/3850741756 wait complete. 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:18:18.676 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:18:18.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.677 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-11-26T07:18:18.686 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:18.686 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:18:18.687 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 02:42:99:81:d5:52 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:18:18.688 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:18.689 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-26T07:18:18.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.689 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:18.689 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:18.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2023-11-26T07:18:18.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2023-11-26T07:18:18.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2023-11-26T07:18:18.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-26T07:18:18.690 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:18.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.803 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:18.821 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-11-26T07:18:18.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.824 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-11-26T07:18:18.940 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-11-26T07:18:18.940 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:18.940 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:18:18.940 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:18.940 INFO:teuthology.orchestra.run.smithi070.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:18:18.941 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:18.941 INFO:teuthology.orchestra.run.smithi070.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:18.941 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:18.941 INFO:teuthology.orchestra.run.smithi070.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:18.941 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:18.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.941 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:18.942 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:18.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:18.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:18.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:18.942 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:18.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:18.993 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:18:19.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:19.003 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2023-11-26T07:18:19.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:19.052 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:19.052 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:19.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:19.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-26T07:18:19.053 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:19.137 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-26T07:18:19.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-26T07:18:19.138 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:19.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:19.307 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:19.307 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:19.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2023-11-26T07:18:19.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2023-11-26T07:18:19.307 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:19.348 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-26T07:18:19.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:19.349 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:19.399 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:18:19.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:19.400 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:19.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:18:19.515 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:19.568 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:18:19.569 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:18:19.570 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:18:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:18:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:18:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:18:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:18:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:18:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:19.571 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:19.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:19.572 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:18:19.627 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:18:19.627 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-26T07:18:19.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:18:19.695 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:19.748 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:18:19.749 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:18:19.750 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:19.751 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:19.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:19.752 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:18:19.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2023-11-26T07:18:19.802+0000 7f464d709580 -1 init, newargv = 0x55ee71081150 newargc=15 2023-11-26T07:18:19.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[44403]: starting ceph client 2023-11-26T07:18:19.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[44403]: starting fuse 2023-11-26T07:18:20.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:18:20.931 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:20.985 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:18:20.986 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:18:20.987 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:20.988 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:20.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:20.989 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:18:21.039 INFO:teuthology.orchestra.run.smithi070.stdout:43 2023-11-26T07:18:21.039 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> import re 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> import os 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-26T07:18:21.040 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> return f 2023-11-26T07:18:21.041 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:18:21.042 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:21.042 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2023-11-26T07:18:21.042 DEBUG:teuthology.orchestra.run.smithi070:> ' 2023-11-26T07:18:21.171 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.44403.asok 2023-11-26T07:18:21.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:18:21.182 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44403.asok 2023-11-26T07:18:21.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44403.asok status 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "44403", 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4526, 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 4526 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 103946588 2023-11-26T07:18:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 103946588 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.4526 172.21.15.70:0/103946588", 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "172.21.15.70:0/103946588", 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 8, 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 21, 2023-11-26T07:18:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:18:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2023-11-26T07:18:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2023-11-26T07:18:21.360 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:18:21.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:18:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa8832640 1 Processor -- start 2023-11-26T07:18:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa8832640 1 -- start start 2023-11-26T07:18:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa8832640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1aa41596d0 0x7f1aa4071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa8832640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1aa40b2f80 0x7f1aa406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa8832640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa406c750 con 0x7f1aa40ce680 2023-11-26T07:18:21.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa8832640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40cbe00 con 0x7f1aa41596d0 2023-11-26T07:18:21.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa8832640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40b3550 con 0x7f1aa40b2f80 2023-11-26T07:18:21.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1a99d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1aa40ce680 0x7f1aa40b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57708/0 (socket says 172.21.15.70:57708) 2023-11-26T07:18:21.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1a99d9b640 1 -- 172.21.15.70:0/3233910503 learned_addr learned my addr 172.21.15.70:0/3233910503 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:21.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1aa41596d0 0x7f1aa4071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa2d9d640 1 --2- 172.21.15.70:0/3233910503 >> v2:172.21.15.120:3300/0 conn(0x7f1aa40b2f80 0x7f1aa406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa1d9b640 1 -- 172.21.15.70:0/3233910503 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976091936 0 0) 0x7f1aa406c750 con 0x7f1aa40ce680 2023-11-26T07:18:21.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa1d9b640 1 -- 172.21.15.70:0/3233910503 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a90003530 con 0x7f1aa40ce680 2023-11-26T07:18:21.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa259c640 1 -- 172.21.15.70:0/3233910503 >> v2:172.21.15.120:3300/0 conn(0x7f1aa40b2f80 msgr2=0x7f1aa406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:21.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa259c640 1 --2- 172.21.15.70:0/3233910503 >> v2:172.21.15.120:3300/0 conn(0x7f1aa40b2f80 0x7f1aa406cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa259c640 1 -- 172.21.15.70:0/3233910503 >> v1:172.21.15.70:6789/0 conn(0x7f1aa40ce680 legacy=0x7f1aa40b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.506+0000 7f1aa259c640 1 -- 172.21.15.70:0/3233910503 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4071e80 con 0x7f1aa41596d0 2023-11-26T07:18:21.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa259c640 1 --2- 172.21.15.70:0/3233910503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa41596d0 0x7f1aa4071850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1aa406e860 tx=0x7f1a8c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb503a1c12fb673 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:21.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa1d9b640 1 -- 172.21.15.70:0/3233910503 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0ab600 con 0x7f1aa41596d0 2023-11-26T07:18:21.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa1d9b640 1 -- 172.21.15.70:0/3233910503 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c0a7050 con 0x7f1aa41596d0 2023-11-26T07:18:21.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa1d9b640 1 -- 172.21.15.70:0/3233910503 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0ab980 con 0x7f1aa41596d0 2023-11-26T07:18:21.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 -- 172.21.15.70:0/3233910503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa41596d0 msgr2=0x7f1aa4071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 --2- 172.21.15.70:0/3233910503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa41596d0 0x7f1aa4071850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1aa406e860 tx=0x7f1a8c01c460 comp rx=0 tx=0).stop 2023-11-26T07:18:21.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 -- 172.21.15.70:0/3233910503 shutdown_connections 2023-11-26T07:18:21.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 --2- 172.21.15.70:0/3233910503 >> v2:172.21.15.120:3300/0 conn(0x7f1aa40b2f80 0x7f1aa406cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 --2- 172.21.15.70:0/3233910503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa41596d0 0x7f1aa4071850 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 -- 172.21.15.70:0/3233910503 >> 172.21.15.70:0/3233910503 conn(0x7f1aa406a890 msgr2=0x7f1aa406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:21.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 -- 172.21.15.70:0/3233910503 shutdown_connections 2023-11-26T07:18:21.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.510+0000 7f1aa8832640 1 -- 172.21.15.70:0/3233910503 wait complete. 2023-11-26T07:18:21.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 Processor -- start 2023-11-26T07:18:21.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 -- start start 2023-11-26T07:18:21.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40b2f80 0x7f1aa4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40ce680 0x7f1aa415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1aa41596d0 0x7f1aa415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa415cbc0 con 0x7f1aa40ce680 2023-11-26T07:18:21.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa40cc0e0 con 0x7f1aa40b2f80 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa415c8e0 con 0x7f1aa41596d0 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40ce680 0x7f1aa415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40ce680 0x7f1aa415bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40454/0 (socket says 172.21.15.70:40454) 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 -- 172.21.15.70:0/2223901938 learned_addr learned my addr 172.21.15.70:0/2223901938 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa2d9d640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1aa41596d0 0x7f1aa415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa259c640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40b2f80 0x7f1aa4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 -- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1aa41596d0 msgr2=0x7f1aa415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1aa41596d0 0x7f1aa415c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 -- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40b2f80 msgr2=0x7f1aa4159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40b2f80 0x7f1aa4159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 -- 172.21.15.70:0/2223901938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c009420 con 0x7f1aa40ce680 2023-11-26T07:18:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a99d9b640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40ce680 0x7f1aa415bd60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c4d0 tx=0x7f1a9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a9b7fe640 1 -- 172.21.15.70:0/2223901938 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94005cf0 con 0x7f1aa40ce680 2023-11-26T07:18:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a9b7fe640 1 -- 172.21.15.70:0/2223901938 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94005e50 con 0x7f1aa40ce680 2023-11-26T07:18:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1a9b7fe640 1 -- 172.21.15.70:0/2223901938 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94007270 con 0x7f1aa40ce680 2023-11-26T07:18:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa40cc380 con 0x7f1aa40ce680 2023-11-26T07:18:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.514+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4146cd0 con 0x7f1aa40ce680 2023-11-26T07:18:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.518+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa40cbf40 con 0x7f1aa40ce680 2023-11-26T07:18:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.518+0000 7f1a9b7fe640 1 -- 172.21.15.70:0/2223901938 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a940073d0 con 0x7f1aa40ce680 2023-11-26T07:18:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.518+0000 7f1a9b7fe640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a84066470 0x7f1a84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.518+0000 7f1a9b7fe640 1 -- 172.21.15.70:0/2223901938 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a940833c0 con 0x7f1aa40ce680 2023-11-26T07:18:21.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.518+0000 7f1aa259c640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a84066470 0x7f1a84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:21.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.518+0000 7f1aa259c640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a84066470 0x7f1a84068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0ad000 tx=0x7f1a8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:21.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.522+0000 7f1a9b7fe640 1 -- 172.21.15.70:0/2223901938 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1aa40cbf40 con 0x7f1aa40ce680 2023-11-26T07:18:21.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1aa40cbf40 con 0x7f1aa40ce680 2023-11-26T07:18:21.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1a9b7fe640 1 -- 172.21.15.70:0/2223901938 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1aa40cbf40 con 0x7f1aa40ce680 2023-11-26T07:18:21.705 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:18:21.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a84066470 msgr2=0x7f1a84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a84066470 0x7f1a84068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0ad000 tx=0x7f1a8c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:21.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40ce680 msgr2=0x7f1aa415bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:21.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40ce680 0x7f1aa415bd60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c4d0 tx=0x7f1a9400c990 comp rx=0 tx=0).stop 2023-11-26T07:18:21.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 shutdown_connections 2023-11-26T07:18:21.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a84066470 0x7f1a84068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40ce680 0x7f1aa415bd60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1aa41596d0 0x7f1aa415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 --2- 172.21.15.70:0/2223901938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1aa40b2f80 0x7f1aa4159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:21.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 >> 172.21.15.70:0/2223901938 conn(0x7f1aa406a890 msgr2=0x7f1aa40acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:21.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 shutdown_connections 2023-11-26T07:18:21.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:21.702+0000 7f1aa8832640 1 -- 172.21.15.70:0/2223901938 wait complete. 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:18:21.726 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-26T07:18:21.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.727 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:21.736 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-11-26T07:18:21.737 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 02:42:99:81:d5:52 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:18:21.738 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:21.739 INFO:teuthology.orchestra.run.smithi070.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:18:21.739 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:21.739 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:18:21.739 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:21.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.740 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:21.805 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-11-26T07:18:21.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.808 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-11-26T07:18:21.863 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-11-26T07:18:21.863 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:21.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.865 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:21.865 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:21.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:21.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:21.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:21.865 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:21.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.961 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:18:21.971 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:18:21.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:21.971 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2023-11-26T07:18:22.023 INFO:teuthology.orchestra.run.smithi070.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-26T07:18:22.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.024 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:22.024 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:22.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:18:22.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-26T07:18:22.024 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:22.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether c6:d2:2d:fe:d7:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:18:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:18:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c4d2:2dff:fefe:d79f/64 scope link 2023-11-26T07:18:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-26T07:18:22.235 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether c6:d2:2d:fe:d7:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c4d2:2dff:fefe:d79f/64 scope link 2023-11-26T07:18:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:22.237 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-26T07:18:22.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-26T07:18:22.238 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:22.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.377 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:18:22.377 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:18:22.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.1 up 2023-11-26T07:18:22.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.1 master ceph-brx 2023-11-26T07:18:22.378 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:18:22.418 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-26T07:18:22.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:22.418 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:22.472 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-26T07:18:22.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:22.472 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:22.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:18:22.587 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:22.641 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:18:22.642 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:18:22.642 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:18:22.642 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:18:22.642 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:18:22.642 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:18:22.642 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:22.643 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:22.644 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:18:22.645 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:18:22.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.646 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:18:22.695 INFO:teuthology.orchestra.run.smithi070.stdout:43 2023-11-26T07:18:22.695 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-26T07:18:22.695 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-26T07:18:22.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:18:22.768 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:18:22.821 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:22.822 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:18:22.823 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:18:22.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.824 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:18:22.844 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi070.stderr:2023-11-26T07:18:22.842+0000 7f775ea47580 -1 init, newargv = 0x564c98ef7870 newargc=15 2023-11-26T07:18:22.844 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi070.stderr:ceph-fuse[44541]: starting ceph client 2023-11-26T07:18:22.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi070.stderr:ceph-fuse[44541]: starting fuse 2023-11-26T07:18:22.852 INFO:teuthology.orchestra.run.smithi070.stdout:43 2023-11-26T07:18:22.853 INFO:teuthology.orchestra.run.smithi070.stdout:44 2023-11-26T07:18:22.853 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-26T07:18:22.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:18:22.853 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> import re 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> import os 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2023-11-26T07:18:22.854 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> return f 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.2")) 2023-11-26T07:18:22.855 DEBUG:teuthology.orchestra.run.smithi070:> ' 2023-11-26T07:18:22.975 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.2.44541.asok 2023-11-26T07:18:22.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:18:22.986 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44541.asok 2023-11-26T07:18:22.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:22.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44541.asok status 2023-11-26T07:18:23.154 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:18:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2023-11-26T07:18:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:18:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:18:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "2", 2023-11-26T07:18:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2023-11-26T07:18:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "44541", 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 4656, 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2023-11-26T07:18:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 4656 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.2:0", 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1441604826 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.2:0", 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1441604826 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.4656 192.168.0.2:0/1441604826", 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.2:0/1441604826", 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 8, 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 21, 2023-11-26T07:18:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:18:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2023-11-26T07:18:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2023-11-26T07:18:23.159 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:18:23.169 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:18:23.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 Processor -- start 2023-11-26T07:18:23.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 -- start start 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7c3813e290 0x7f7c380cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7c380cf7c0 0x7f7c3815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c381408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c380cfc40 con 0x7f7c380cf7c0 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3806c520 con 0x7f7c3813e290 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.302+0000 7f7c3ee79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3806c800 con 0x7f7c3815f4e0 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7c380cf7c0 0x7f7c3815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7c380cf7c0 0x7f7c3815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40460/0 (socket says 172.21.15.70:40460) 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 -- 172.21.15.70:0/722356848 learned_addr learned my addr 172.21.15.70:0/722356848 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c3cc15640 1 --2- 172.21.15.70:0/722356848 >> v2:172.21.15.120:3300/0 conn(0x7f7c3813e290 0x7f7c380cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c3d416640 1 --2- 172.21.15.70:0/722356848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c381408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 -- 172.21.15.70:0/722356848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 msgr2=0x7f7c381408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:23.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 --2- 172.21.15.70:0/722356848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c381408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 -- 172.21.15.70:0/722356848 >> v2:172.21.15.120:3300/0 conn(0x7f7c3813e290 msgr2=0x7f7c380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:23.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 --2- 172.21.15.70:0/722356848 >> v2:172.21.15.120:3300/0 conn(0x7f7c3813e290 0x7f7c380cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 -- 172.21.15.70:0/722356848 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3806cae0 con 0x7f7c380cf7c0 2023-11-26T07:18:23.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2ffff640 1 --2- 172.21.15.70:0/722356848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c3815efa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c380725a0 tx=0x7f7c2801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c516ccc7a364a2d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2f7fe640 1 -- 172.21.15.70:0/722356848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280ab600 con 0x7f7c380cf7c0 2023-11-26T07:18:23.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2f7fe640 1 -- 172.21.15.70:0/722356848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c280a7050 con 0x7f7c380cf7c0 2023-11-26T07:18:23.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.306+0000 7f7c2f7fe640 1 -- 172.21.15.70:0/722356848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280ab980 con 0x7f7c380cf7c0 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- 172.21.15.70:0/722356848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 msgr2=0x7f7c3815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/722356848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c3815efa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7c380725a0 tx=0x7f7c2801c210 comp rx=0 tx=0).stop 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- 172.21.15.70:0/722356848 shutdown_connections 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/722356848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c381408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/722356848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c3815efa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/722356848 >> v2:172.21.15.120:3300/0 conn(0x7f7c3813e290 0x7f7c380cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- 172.21.15.70:0/722356848 >> 172.21.15.70:0/722356848 conn(0x7f7c3806a890 msgr2=0x7f7c3806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- 172.21.15.70:0/722356848 shutdown_connections 2023-11-26T07:18:23.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- 172.21.15.70:0/722356848 wait complete. 2023-11-26T07:18:23.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 Processor -- start 2023-11-26T07:18:23.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- start start 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c380af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c3813e290 0x7f7c380b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c3815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380af070 con 0x7f7c380cf7c0 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c381551b0 con 0x7f7c3813e290 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3ee79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380b1250 con 0x7f7c3815f4e0 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c380af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c380af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40476/0 (socket says 172.21.15.70:40476) 2023-11-26T07:18:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 -- 172.21.15.70:0/1205103621 learned_addr learned my addr 172.21.15.70:0/1205103621 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c2ffff640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c3813e290 0x7f7c380b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3d416640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c3815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 -- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 msgr2=0x7f7c3815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c3815dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 -- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c3813e290 msgr2=0x7f7c380b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c3813e290 0x7f7c380b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3cc15640 1 -- 172.21.15.70:0/1205103621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280094d0 con 0x7f7c380cf7c0 2023-11-26T07:18:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.310+0000 7f7c3d416640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c3815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:23.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c3cc15640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c380af500 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400d800 tx=0x7f7c3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c2d7fa640 1 -- 172.21.15.70:0/1205103621 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340096a0 con 0x7f7c380cf7c0 2023-11-26T07:18:23.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c2d7fa640 1 -- 172.21.15.70:0/1205103621 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34009800 con 0x7f7c380cf7c0 2023-11-26T07:18:23.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c380b1510 con 0x7f7c380cf7c0 2023-11-26T07:18:23.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c2d7fa640 1 -- 172.21.15.70:0/1205103621 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34009b70 con 0x7f7c380cf7c0 2023-11-26T07:18:23.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c380aed00 con 0x7f7c380cf7c0 2023-11-26T07:18:23.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c380b1a30 con 0x7f7c380cf7c0 2023-11-26T07:18:23.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c2d7fa640 1 -- 172.21.15.70:0/1205103621 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c34009cd0 con 0x7f7c380cf7c0 2023-11-26T07:18:23.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c2d7fa640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c24066470 0x7f7c24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:23.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c2d7fa640 1 -- 172.21.15.70:0/1205103621 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c34084540 con 0x7f7c380cf7c0 2023-11-26T07:18:23.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.314+0000 7f7c2ffff640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c24066470 0x7f7c24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:23.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.318+0000 7f7c2ffff640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c24066470 0x7f7c24068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ad000 tx=0x7f7c28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:23.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.318+0000 7f7c2d7fa640 1 -- 172.21.15.70:0/1205103621 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c380b1a30 con 0x7f7c380cf7c0 2023-11-26T07:18:23.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c380aeb60 con 0x7f7c380cf7c0 2023-11-26T07:18:23.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c2d7fa640 1 -- 172.21.15.70:0/1205103621 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7c380aeb60 con 0x7f7c380cf7c0 2023-11-26T07:18:23.505 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:18:23.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c24066470 msgr2=0x7f7c24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c24066470 0x7f7c24068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ad000 tx=0x7f7c28008040 comp rx=0 tx=0).stop 2023-11-26T07:18:23.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 msgr2=0x7f7c380af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:23.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c380af500 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400d800 tx=0x7f7c3400dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 shutdown_connections 2023-11-26T07:18:23.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c3815f4e0 0x7f7c3815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c3813e290 0x7f7c380b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c24066470 0x7f7c24068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 --2- 172.21.15.70:0/1205103621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c380cf7c0 0x7f7c380af500 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:23.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 >> 172.21.15.70:0/1205103621 conn(0x7f7c3806a890 msgr2=0x7f7c38138b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:23.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 shutdown_connections 2023-11-26T07:18:23.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:23.502+0000 7f7c3ee79640 1 -- 172.21.15.70:0/1205103621 wait complete. 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:18:23.526 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:18:23.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.527 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2023-11-26T07:18:23.537 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:23.538 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:18:23.539 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:29:fb:62:88 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:23.539 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:18:23.539 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:23.539 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-26T07:18:23.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.540 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:23.540 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:23.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2023-11-26T07:18:23.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2023-11-26T07:18:23.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2023-11-26T07:18:23.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-26T07:18:23.540 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:23.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.663 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:23.683 INFO:teuthology.orchestra.run.smithi120.stdout:1 2023-11-26T07:18:23.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.685 DEBUG:teuthology.orchestra.run.smithi120:> route 2023-11-26T07:18:23.760 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2023-11-26T07:18:23.760 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:23.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.761 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:23.762 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:23.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:23.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:23.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:23.762 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:23.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.855 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:18:23.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.908 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2023-11-26T07:18:23.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:23.959 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:23.960 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:23.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:23.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-26T07:18:23.960 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:24.043 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-26T07:18:24.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-26T07:18:24.044 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:24.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:24.203 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:24.204 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:24.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2023-11-26T07:18:24.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2023-11-26T07:18:24.204 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:24.245 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-26T07:18:24.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:24.245 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:24.296 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:18:24.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:24.297 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:24.346 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:18:24.412 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:18:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:18:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:18:24.464 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:24.465 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:18:24.466 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:18:24.467 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:18:24.467 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:18:24.467 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:18:24.467 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:18:24.467 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:18:24.467 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:24.467 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:24.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:24.468 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:18:24.519 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:18:24.520 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-26T07:18:24.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:18:24.591 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:24.648 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:18:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:18:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:18:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:18:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:18:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:18:24.649 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:18:24.650 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:18:24.651 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:18:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:18:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:18:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:24.652 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:24.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:24.653 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:18:24.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:2023-11-26T07:18:24.689+0000 7f33b4308580 -1 init, newargv = 0x5565d3862350 newargc=15 2023-11-26T07:18:24.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[43899]: starting ceph client 2023-11-26T07:18:24.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[43899]: starting fuse 2023-11-26T07:18:24.702 INFO:teuthology.orchestra.run.smithi120.stdout:43 2023-11-26T07:18:24.702 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> import re 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> import os 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2023-11-26T07:18:24.703 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2023-11-26T07:18:24.704 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> return f 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.1")) 2023-11-26T07:18:24.705 DEBUG:teuthology.orchestra.run.smithi120:> ' 2023-11-26T07:18:24.829 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.1.43899.asok 2023-11-26T07:18:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:18:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:18:24.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43899.asok 2023-11-26T07:18:24.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:24.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43899.asok status 2023-11-26T07:18:25.011 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-11-26T07:18:25.011 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2023-11-26T07:18:25.011 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:18:25.011 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "1", 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "43899", 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4547, 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2023-11-26T07:18:25.012 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 4547 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2517391602 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:18:25.013 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2517391602 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.4547 192.168.0.1:0/2517391602", 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/2517391602", 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 8, 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 21, 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2023-11-26T07:18:25.014 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-11-26T07:18:25.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:18:25.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.170+0000 7f630b1a1640 1 Processor -- start 2023-11-26T07:18:25.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.170+0000 7f630b1a1640 1 -- start start 2023-11-26T07:18:25.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f630b1a1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6304143ac0 0x7f6304070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f630b1a1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63040cc730 con 0x7f63040cf990 2023-11-26T07:18:25.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f630b1a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6304070ee0 con 0x7f63040708b0 2023-11-26T07:18:25.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f630b1a1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6304143ea0 con 0x7f6304143ac0 2023-11-26T07:18:25.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f6308f3d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6304143ac0 0x7f6304070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f630973e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f63040cf990 0x7f63040cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53710/0 (socket says 172.21.15.70:53710) 2023-11-26T07:18:25.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f630973e640 1 -- 172.21.15.70:0/331833530 learned_addr learned my addr 172.21.15.70:0/331833530 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:25.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f6308f3d640 1 -- 172.21.15.70:0/331833530 >> v1:172.21.15.120:6789/0 conn(0x7f63040708b0 legacy=0x7f63040cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f6308f3d640 1 -- 172.21.15.70:0/331833530 >> v1:172.21.15.70:6789/0 conn(0x7f63040cf990 legacy=0x7f63040cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f6308f3d640 1 -- 172.21.15.70:0/331833530 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040711c0 con 0x7f6304143ac0 2023-11-26T07:18:25.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.174+0000 7f62fb7fe640 1 -- 172.21.15.70:0/331833530 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794764830 0 0) 0x7f63040cc730 con 0x7f63040cf990 2023-11-26T07:18:25.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f6308f3d640 1 --2- 172.21.15.70:0/331833530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6304143ac0 0x7f6304070370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63000097c0 tx=0x7f630001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f131df2c3dc6ff5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f62fb7fe640 1 -- 172.21.15.70:0/331833530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000a8050 con 0x7f6304143ac0 2023-11-26T07:18:25.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f62fb7fe640 1 -- 172.21.15.70:0/331833530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63000ac5f0 con 0x7f6304143ac0 2023-11-26T07:18:25.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f62fb7fe640 1 -- 172.21.15.70:0/331833530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000ac980 con 0x7f6304143ac0 2023-11-26T07:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 -- 172.21.15.70:0/331833530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6304143ac0 msgr2=0x7f6304070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 --2- 172.21.15.70:0/331833530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6304143ac0 0x7f6304070370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63000097c0 tx=0x7f630001c480 comp rx=0 tx=0).stop 2023-11-26T07:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 -- 172.21.15.70:0/331833530 shutdown_connections 2023-11-26T07:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 --2- 172.21.15.70:0/331833530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6304143ac0 0x7f6304070370 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 -- 172.21.15.70:0/331833530 >> 172.21.15.70:0/331833530 conn(0x7f630406a890 msgr2=0x7f630406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 -- 172.21.15.70:0/331833530 shutdown_connections 2023-11-26T07:18:25.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 -- 172.21.15.70:0/331833530 wait complete. 2023-11-26T07:18:25.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 Processor -- start 2023-11-26T07:18:25.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.178+0000 7f630b1a1640 1 -- start start 2023-11-26T07:18:25.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63040708b0 0x7f630415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63040cf990 0x7f630414c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6304143ac0 0x7f63040b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b00a0 con 0x7f63040cf990 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b0f00 con 0x7f63040708b0 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630415ab40 con 0x7f6304143ac0 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63040cf990 0x7f630414c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63040cf990 0x7f630414c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59134/0 (socket says 172.21.15.70:59134) 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 -- 172.21.15.70:0/1783968555 learned_addr learned my addr 172.21.15.70:0/1783968555 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f6308f3d640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63040708b0 0x7f630415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630973e640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6304143ac0 0x7f63040b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 -- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6304143ac0 msgr2=0x7f63040b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6304143ac0 0x7f63040b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 -- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63040708b0 msgr2=0x7f630415a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63040708b0 0x7f630415a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 -- 172.21.15.70:0/1783968555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6300009420 con 0x7f63040cf990 2023-11-26T07:18:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62fbfff640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63040cf990 0x7f630414c890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c3f0 tx=0x7f62f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62f97fa640 1 -- 172.21.15.70:0/1783968555 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f40052d0 con 0x7f63040cf990 2023-11-26T07:18:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62f97fa640 1 -- 172.21.15.70:0/1783968555 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f4005430 con 0x7f63040cf990 2023-11-26T07:18:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62f97fa640 1 -- 172.21.15.70:0/1783968555 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4003840 con 0x7f63040cf990 2023-11-26T07:18:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630414cdd0 con 0x7f63040cf990 2023-11-26T07:18:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63040b05d0 con 0x7f63040cf990 2023-11-26T07:18:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6304067680 con 0x7f63040cf990 2023-11-26T07:18:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.182+0000 7f62f97fa640 1 -- 172.21.15.70:0/1783968555 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62f40039a0 con 0x7f63040cf990 2023-11-26T07:18:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.186+0000 7f62f97fa640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f00664a0 0x7f62f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.186+0000 7f62f97fa640 1 -- 172.21.15.70:0/1783968555 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62f4083470 con 0x7f63040cf990 2023-11-26T07:18:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.186+0000 7f6308f3d640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f00664a0 0x7f62f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.186+0000 7f6308f3d640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f00664a0 0x7f62f0068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63000ae000 tx=0x7f63000a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:25.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.190+0000 7f62f97fa640 1 -- 172.21.15.70:0/1783968555 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62f4050870 con 0x7f63040cf990 2023-11-26T07:18:25.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.370+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63040adf10 con 0x7f63040cf990 2023-11-26T07:18:25.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.370+0000 7f62f97fa640 1 -- 172.21.15.70:0/1783968555 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f62f4053e90 con 0x7f63040cf990 2023-11-26T07:18:25.375 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f00664a0 msgr2=0x7f62f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f00664a0 0x7f62f0068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63000ae000 tx=0x7f63000a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63040cf990 msgr2=0x7f630414c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63040cf990 0x7f630414c890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c3f0 tx=0x7f62f400c8b0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 shutdown_connections 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f00664a0 0x7f62f0068960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63040cf990 0x7f630414c890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6304143ac0 0x7f63040b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 --2- 172.21.15.70:0/1783968555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f63040708b0 0x7f630415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:25.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 >> 172.21.15.70:0/1783968555 conn(0x7f630406a890 msgr2=0x7f6304142cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:25.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 shutdown_connections 2023-11-26T07:18:25.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:25.374+0000 7f630b1a1640 1 -- 172.21.15.70:0/1783968555 wait complete. 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:18:25.396 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-26T07:18:25.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.397 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2023-11-26T07:18:25.406 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:25.406 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:18:25.407 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42383sec preferred_lft 42383sec 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:29:fb:62:88 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:18:25.408 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.409 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:18:25.409 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.409 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:18:25.409 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:25.409 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-26T07:18:25.409 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.410 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:18:25.469 INFO:teuthology.orchestra.run.smithi120.stdout:1 2023-11-26T07:18:25.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.471 DEBUG:teuthology.orchestra.run.smithi120:> route 2023-11-26T07:18:25.526 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2023-11-26T07:18:25.526 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:18:25.526 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:18:25.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.527 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:25.528 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:25.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:18:25.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:18:25.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:18:25.528 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:25.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.618 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:18:25.627 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:18:25.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.629 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2023-11-26T07:18:25.683 INFO:teuthology.orchestra.run.smithi120.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-26T07:18:25.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.684 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:25.684 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:25.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:18:25.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-26T07:18:25.684 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:25.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether f6:4a:00:f2:97:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:18:25.832 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:18:25.833 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.833 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::f44a:ff:fef2:97e1/64 scope link 2023-11-26T07:18:25.833 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.834 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether f6:4a:00:f2:97:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-26T07:18:25.896 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-26T07:18:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::f44a:ff:fef2:97e1/64 scope link 2023-11-26T07:18:25.897 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:18:25.898 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-26T07:18:25.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:25.898 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:25.898 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:25.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-26T07:18:25.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-26T07:18:25.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-26T07:18:25.899 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-26T07:18:25.899 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-26T07:18:25.899 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:26.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.036 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:18:26.036 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:18:26.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.1 up 2023-11-26T07:18:26.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.1 master ceph-brx 2023-11-26T07:18:26.037 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:18:26.076 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-26T07:18:26.076 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:26.076 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:26.130 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-26T07:18:26.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:18:26.131 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:26.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:18:26.243 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:26.296 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:18:26.296 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:18:26.296 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:18:26.296 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:18:26.297 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:18:26.298 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:18:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:18:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:18:26.299 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:18:26.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.300 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:18:26.355 INFO:teuthology.orchestra.run.smithi120.stdout:43 2023-11-26T07:18:26.355 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-26T07:18:26.355 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-26T07:18:26.401 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:18:26.422 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:18:26.476 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:18:26.476 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:18:26.476 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:18:26.477 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:18:26.478 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:18:26.479 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:18:26.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.480 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:18:26.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi120.stderr:2023-11-26T07:18:26.493+0000 7f8900860580 -1 init, newargv = 0x560890c7d3f0 newargc=15 2023-11-26T07:18:26.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi120.stderr:ceph-fuse[44005]: starting ceph client 2023-11-26T07:18:26.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi120.stderr:ceph-fuse[44005]: starting fuse 2023-11-26T07:18:26.505 INFO:teuthology.orchestra.run.smithi120.stdout:43 2023-11-26T07:18:26.505 INFO:teuthology.orchestra.run.smithi120.stdout:44 2023-11-26T07:18:26.505 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-26T07:18:26.505 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> import re 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> import os 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:26.506 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> return f 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:18:26.507 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:18:26.508 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.3")) 2023-11-26T07:18:26.508 DEBUG:teuthology.orchestra.run.smithi120:> ' 2023-11-26T07:18:26.632 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.3.44005.asok 2023-11-26T07:18:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:18:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:18:26.644 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44005.asok 2023-11-26T07:18:26.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.645 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44005.asok status 2023-11-26T07:18:26.816 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-11-26T07:18:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2023-11-26T07:18:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:18:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:18:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "3", 2023-11-26T07:18:26.816 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "44005", 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4705, 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2023-11-26T07:18:26.817 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 4705 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.2:0", 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 190783184 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.2:0", 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 190783184 2023-11-26T07:18:26.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.4705 192.168.0.2:0/190783184", 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.2:0/190783184", 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 8, 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 21, 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2023-11-26T07:18:26.819 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-11-26T07:18:26.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.831 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2023-11-26T07:18:26.831 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:26.844 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2023-11-26T07:18:26.844 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:26.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:26.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.911 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2023-11-26T07:18:26.911 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:26.962 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2023-11-26T07:18:26.962 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:26.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:26.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:27.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:27.033 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2023-11-26T07:18:27.033 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:27.042 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2023-11-26T07:18:27.043 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:27.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:27.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:27.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:27.111 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2023-11-26T07:18:27.111 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:27.169 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2023-11-26T07:18:27.169 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:27.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:27.170 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:27.230 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-26T07:18:27.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:27.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc1690ea640 1 Processor -- start 2023-11-26T07:18:27.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc1690ea640 1 -- start start 2023-11-26T07:18:27.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc1690ea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc16406f000 0x7fc16406d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc1690ea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1640cf260 con 0x7fc16406f3e0 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc1690ea640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16406c3c0 con 0x7fc164099a70 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc1690ea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16406d570 con 0x7fc16406f000 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc16259c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc16406f3e0 0x7fc16406b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53724/0 (socket says 172.21.15.70:53724) 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc16259c640 1 -- 172.21.15.70:0/701104632 learned_addr learned my addr 172.21.15.70:0/701104632 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc162d9d640 1 --2- 172.21.15.70:0/701104632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc16406f000 0x7fc16406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534671967 0 0) 0x7fc1640cf260 con 0x7fc16406f3e0 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc14c003530 con 0x7fc16406f3e0 2023-11-26T07:18:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862074245 0 0) 0x7fc16406c3c0 con 0x7fc164099a70 2023-11-26T07:18:27.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1640cf260 con 0x7fc164099a70 2023-11-26T07:18:27.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2047099011 0 0) 0x7fc14c003530 con 0x7fc16406f3e0 2023-11-26T07:18:27.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc162d9d640 1 -- 172.21.15.70:0/701104632 >> v1:172.21.15.120:6789/0 conn(0x7fc164099a70 legacy=0x7fc16406bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc162d9d640 1 -- 172.21.15.70:0/701104632 >> v1:172.21.15.70:6789/0 conn(0x7fc16406f3e0 legacy=0x7fc16406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.394+0000 7fc162d9d640 1 -- 172.21.15.70:0/701104632 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16409a010 con 0x7fc16406f000 2023-11-26T07:18:27.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc162d9d640 1 --2- 172.21.15.70:0/701104632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc16406f000 0x7fc16406d030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc1540097f0 tx=0x7fc15401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55a81fafcb06ef server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158001680 con 0x7fc16406f000 2023-11-26T07:18:27.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1540a7050 con 0x7fc16406f000 2023-11-26T07:18:27.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc161d9b640 1 -- 172.21.15.70:0/701104632 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1540ab600 con 0x7fc16406f000 2023-11-26T07:18:27.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc1690ea640 1 -- 172.21.15.70:0/701104632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc16406f000 msgr2=0x7fc16406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc1690ea640 1 --2- 172.21.15.70:0/701104632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc16406f000 0x7fc16406d030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc1540097f0 tx=0x7fc15401c3e0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc1690ea640 1 -- 172.21.15.70:0/701104632 shutdown_connections 2023-11-26T07:18:27.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc1690ea640 1 --2- 172.21.15.70:0/701104632 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc16406f000 0x7fc16406d030 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc1690ea640 1 -- 172.21.15.70:0/701104632 >> 172.21.15.70:0/701104632 conn(0x7fc1640b2d10 msgr2=0x7fc1640b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc1690ea640 1 -- 172.21.15.70:0/701104632 shutdown_connections 2023-11-26T07:18:27.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.398+0000 7fc1690ea640 1 -- 172.21.15.70:0/701104632 wait complete. 2023-11-26T07:18:27.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 Processor -- start 2023-11-26T07:18:27.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 -- start start 2023-11-26T07:18:27.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16406f000 0x7fc164156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc16406f3e0 0x7fc1640ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc164099a70 0x7fc164157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641576b0 con 0x7fc16406f3e0 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640c6f20 con 0x7fc16406f000 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640ce880 con 0x7fc164099a70 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc16406f3e0 0x7fc1640ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc16406f3e0 0x7fc1640ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59136/0 (socket says 172.21.15.70:59136) 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 -- 172.21.15.70:0/3386074036 learned_addr learned my addr 172.21.15.70:0/3386074036 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc162d9d640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16406f000 0x7fc164156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16359e640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc164099a70 0x7fc164157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 -- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc164099a70 msgr2=0x7fc164157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc164099a70 0x7fc164157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 -- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16406f000 msgr2=0x7fc164156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16406f000 0x7fc164156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 -- 172.21.15.70:0/3386074036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc154009420 con 0x7fc16406f3e0 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc16259c640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc16406f3e0 0x7fc1640ca6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc15800c730 tx=0x7fc15800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc14b7fe640 1 -- 172.21.15.70:0/3386074036 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158005ae0 con 0x7fc16406f3e0 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc14b7fe640 1 -- 172.21.15.70:0/3386074036 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc158005c40 con 0x7fc16406f3e0 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc14b7fe640 1 -- 172.21.15.70:0/3386074036 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158007070 con 0x7fc16406f3e0 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1640ce5a0 con 0x7fc16406f3e0 2023-11-26T07:18:27.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.402+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1641572d0 con 0x7fc16406f3e0 2023-11-26T07:18:27.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.406+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc164157920 con 0x7fc16406f3e0 2023-11-26T07:18:27.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.406+0000 7fc14b7fe640 1 -- 172.21.15.70:0/3386074036 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1580071d0 con 0x7fc16406f3e0 2023-11-26T07:18:27.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.406+0000 7fc14b7fe640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc150066470 0x7fc150068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.406+0000 7fc14b7fe640 1 -- 172.21.15.70:0/3386074036 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc158083420 con 0x7fc16406f3e0 2023-11-26T07:18:27.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.406+0000 7fc162d9d640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc150066470 0x7fc150068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.406+0000 7fc162d9d640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc150066470 0x7fc150068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc1540ad000 tx=0x7fc1540a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.410+0000 7fc14b7fe640 1 -- 172.21.15.70:0/3386074036 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc158050940 con 0x7fc16406f3e0 2023-11-26T07:18:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.558+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc164067680 con 0x7fc16406f3e0 2023-11-26T07:18:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc14b7fe640 1 -- 172.21.15.70:0/3386074036 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fc158053f60 con 0x7fc16406f3e0 2023-11-26T07:18:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:27.566 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc150066470 msgr2=0x7fc150068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc150066470 0x7fc150068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc1540ad000 tx=0x7fc1540a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc16406f3e0 msgr2=0x7fc1640ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc16406f3e0 0x7fc1640ca6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc15800c730 tx=0x7fc15800cbf0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 shutdown_connections 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc150066470 0x7fc150068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc16406f3e0 0x7fc1640ca6e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc164099a70 0x7fc164157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 --2- 172.21.15.70:0/3386074036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16406f000 0x7fc164156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 >> 172.21.15.70:0/3386074036 conn(0x7fc1640b2d10 msgr2=0x7fc1640b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 shutdown_connections 2023-11-26T07:18:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.562+0000 7fc1690ea640 1 -- 172.21.15.70:0/3386074036 wait complete. 2023-11-26T07:18:27.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:27.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:27.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 Processor -- start 2023-11-26T07:18:27.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 -- start start 2023-11-26T07:18:27.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd320070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd3200708b0 0x7fd3200cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3200cf7c0 0x7fd3200b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd320143ea0 con 0x7fd3200cf7c0 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200cfbf0 con 0x7fd3200708b0 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.722+0000 7fd324dc1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200cc730 con 0x7fd320143ac0 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3200cf7c0 0x7fd3200b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3200cf7c0 0x7fd3200b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59150/0 (socket says 172.21.15.70:59150) 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 -- 172.21.15.70:0/3611605999 learned_addr learned my addr 172.21.15.70:0/3611605999 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd315d9b640 1 --2- 172.21.15.70:0/3611605999 >> v2:172.21.15.120:3300/0 conn(0x7fd3200708b0 0x7fd3200cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31e59c640 1 --2- 172.21.15.70:0/3611605999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd320070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 -- 172.21.15.70:0/3611605999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 msgr2=0x7fd320070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 --2- 172.21.15.70:0/3611605999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd320070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 -- 172.21.15.70:0/3611605999 >> v2:172.21.15.120:3300/0 conn(0x7fd3200708b0 msgr2=0x7fd3200cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 --2- 172.21.15.70:0/3611605999 >> v2:172.21.15.120:3300/0 conn(0x7fd3200708b0 0x7fd3200cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 -- 172.21.15.70:0/3611605999 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320070ee0 con 0x7fd3200cf7c0 2023-11-26T07:18:27.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31ed9d640 1 --2- 172.21.15.70:0/3611605999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200cf7c0 0x7fd3200b1ef0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3200cfec0 tx=0x7fd31801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c662c29de23971b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31dd9b640 1 -- 172.21.15.70:0/3611605999 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180ab600 con 0x7fd3200cf7c0 2023-11-26T07:18:27.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31dd9b640 1 -- 172.21.15.70:0/3611605999 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3180a7050 con 0x7fd3200cf7c0 2023-11-26T07:18:27.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.726+0000 7fd31dd9b640 1 -- 172.21.15.70:0/3611605999 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180ab980 con 0x7fd3200cf7c0 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- 172.21.15.70:0/3611605999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200cf7c0 msgr2=0x7fd3200b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 --2- 172.21.15.70:0/3611605999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200cf7c0 0x7fd3200b1ef0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3200cfec0 tx=0x7fd31801c240 comp rx=0 tx=0).stop 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- 172.21.15.70:0/3611605999 shutdown_connections 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 --2- 172.21.15.70:0/3611605999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200cf7c0 0x7fd3200b1ef0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 --2- 172.21.15.70:0/3611605999 >> v2:172.21.15.120:3300/0 conn(0x7fd3200708b0 0x7fd3200cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 --2- 172.21.15.70:0/3611605999 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd320070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- 172.21.15.70:0/3611605999 >> 172.21.15.70:0/3611605999 conn(0x7fd32006a890 msgr2=0x7fd32006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- 172.21.15.70:0/3611605999 shutdown_connections 2023-11-26T07:18:27.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- 172.21.15.70:0/3611605999 wait complete. 2023-11-26T07:18:27.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 Processor -- start 2023-11-26T07:18:27.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- start start 2023-11-26T07:18:27.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200708b0 0x7fd320138780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3200cf7c0 0x7fd3200cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd3200cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3201591a0 con 0x7fd3200708b0 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32015cee0 con 0x7fd3200cf7c0 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd324dc1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32015d1c0 con 0x7fd320143ac0 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd31e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200708b0 0x7fd320138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd31e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200708b0 0x7fd320138780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59164/0 (socket says 172.21.15.70:59164) 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd31e59c640 1 -- 172.21.15.70:0/2682408706 learned_addr learned my addr 172.21.15.70:0/2682408706 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd31ed9d640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd3200cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.730+0000 7fd315d9b640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3200cf7c0 0x7fd3200cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd31e59c640 1 -- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 msgr2=0x7fd3200cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd31e59c640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd3200cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd31e59c640 1 -- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3200cf7c0 msgr2=0x7fd3200cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd31e59c640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3200cf7c0 0x7fd3200cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd31e59c640 1 -- 172.21.15.70:0/2682408706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180094d0 con 0x7fd3200708b0 2023-11-26T07:18:27.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd31e59c640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200708b0 0x7fd320138780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd31000efc0 tx=0x7fd31000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd3177fe640 1 -- 172.21.15.70:0/2682408706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310009b80 con 0x7fd3200708b0 2023-11-26T07:18:27.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd3177fe640 1 -- 172.21.15.70:0/2682408706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000f040 con 0x7fd3200708b0 2023-11-26T07:18:27.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd3177fe640 1 -- 172.21.15.70:0/2682408706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3100146a0 con 0x7fd3200708b0 2023-11-26T07:18:27.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32015d4a0 con 0x7fd3200708b0 2023-11-26T07:18:27.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32015b000 con 0x7fd3200708b0 2023-11-26T07:18:27.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd320067680 con 0x7fd3200708b0 2023-11-26T07:18:27.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd3177fe640 1 -- 172.21.15.70:0/2682408706 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd310014800 con 0x7fd3200708b0 2023-11-26T07:18:27.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd3177fe640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd300066470 0x7fd300068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:27.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd3177fe640 1 -- 172.21.15.70:0/2682408706 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd310084bf0 con 0x7fd3200708b0 2023-11-26T07:18:27.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.734+0000 7fd315d9b640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd300066470 0x7fd300068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:27.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.738+0000 7fd315d9b640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd300066470 0x7fd300068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ae0 tx=0x7fd308009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:27.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.738+0000 7fd3177fe640 1 -- 172.21.15.70:0/2682408706 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd310052090 con 0x7fd3200708b0 2023-11-26T07:18:27.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd32013ec40 con 0x7fd3200708b0 2023-11-26T07:18:27.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd3177fe640 1 -- 172.21.15.70:0/2682408706 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3100556b0 con 0x7fd3200708b0 2023-11-26T07:18:27.901 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd300066470 msgr2=0x7fd300068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd300066470 0x7fd300068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ae0 tx=0x7fd308009190 comp rx=0 tx=0).stop 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200708b0 msgr2=0x7fd320138780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200708b0 0x7fd320138780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd31000efc0 tx=0x7fd31000c490 comp rx=0 tx=0).stop 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 shutdown_connections 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd320143ac0 0x7fd3200cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3200cf7c0 0x7fd3200cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd300066470 0x7fd300068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 --2- 172.21.15.70:0/2682408706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3200708b0 0x7fd320138780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:27.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 >> 172.21.15.70:0/2682408706 conn(0x7fd32006a890 msgr2=0x7fd320142420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:27.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 shutdown_connections 2023-11-26T07:18:27.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:27.898+0000 7fd324dc1640 1 -- 172.21.15.70:0/2682408706 wait complete. 2023-11-26T07:18:27.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:28.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.058+0000 7f14cd046640 1 Processor -- start 2023-11-26T07:18:28.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.058+0000 7f14cd046640 1 -- start start 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14cd046640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f14c813e290 0x7f14c80cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14cd046640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c80cf7c0 0x7f14c815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14cd046640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f14c815f4e0 0x7f14c81408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14cd046640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80cfc40 con 0x7f14c813e290 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14cd046640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c806c520 con 0x7f14c815f4e0 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14cd046640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c806c800 con 0x7f14c80cf7c0 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f14c813e290 0x7f14c80cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f14c813e290 0x7f14c80cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59170/0 (socket says 172.21.15.70:59170) 2023-11-26T07:18:28.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 -- 172.21.15.70:0/1182738609 learned_addr learned my addr 172.21.15.70:0/1182738609 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:28.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 -- 172.21.15.70:0/1182738609 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c80cf7c0 msgr2=0x7f14c815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:28.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 --2- 172.21.15.70:0/1182738609 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c80cf7c0 0x7f14c815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 -- 172.21.15.70:0/1182738609 >> v2:172.21.15.120:3300/0 conn(0x7f14c815f4e0 msgr2=0x7f14c81408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:28.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 --2- 172.21.15.70:0/1182738609 >> v2:172.21.15.120:3300/0 conn(0x7f14c815f4e0 0x7f14c81408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.062+0000 7f14c6d9d640 1 -- 172.21.15.70:0/1182738609 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c806cae0 con 0x7f14c813e290 2023-11-26T07:18:28.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14c6d9d640 1 --2- 172.21.15.70:0/1182738609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c813e290 0x7f14c80cf280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14c8072660 tx=0x7f14b801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655b9b2b2ce38ba4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14c5d9b640 1 -- 172.21.15.70:0/1182738609 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b80ab600 con 0x7f14c813e290 2023-11-26T07:18:28.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14c5d9b640 1 -- 172.21.15.70:0/1182738609 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b80a7050 con 0x7f14c813e290 2023-11-26T07:18:28.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14c5d9b640 1 -- 172.21.15.70:0/1182738609 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b80ab980 con 0x7f14c813e290 2023-11-26T07:18:28.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 -- 172.21.15.70:0/1182738609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c813e290 msgr2=0x7f14c80cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 --2- 172.21.15.70:0/1182738609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c813e290 0x7f14c80cf280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14c8072660 tx=0x7f14b801c210 comp rx=0 tx=0).stop 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 -- 172.21.15.70:0/1182738609 shutdown_connections 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 --2- 172.21.15.70:0/1182738609 >> v2:172.21.15.120:3300/0 conn(0x7f14c815f4e0 0x7f14c81408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 --2- 172.21.15.70:0/1182738609 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c80cf7c0 0x7f14c815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 --2- 172.21.15.70:0/1182738609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c813e290 0x7f14c80cf280 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 -- 172.21.15.70:0/1182738609 >> 172.21.15.70:0/1182738609 conn(0x7f14c806a890 msgr2=0x7f14c806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 -- 172.21.15.70:0/1182738609 shutdown_connections 2023-11-26T07:18:28.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 -- 172.21.15.70:0/1182738609 wait complete. 2023-11-26T07:18:28.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 Processor -- start 2023-11-26T07:18:28.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.066+0000 7f14cd046640 1 -- start start 2023-11-26T07:18:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14c80cf7c0 0x7f14c8142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c813e290 0x7f14c815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c815f4e0 0x7f14c8144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8141df0 con 0x7f14c815f4e0 2023-11-26T07:18:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81420d0 con 0x7f14c80cf7c0 2023-11-26T07:18:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81423b0 con 0x7f14c813e290 2023-11-26T07:18:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c815f4e0 0x7f14c8144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c815f4e0 0x7f14c8144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59180/0 (socket says 172.21.15.70:59180) 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 -- 172.21.15.70:0/461150183 learned_addr learned my addr 172.21.15.70:0/461150183 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c6d9d640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14c80cf7c0 0x7f14c8142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c659c640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c813e290 0x7f14c815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 -- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c813e290 msgr2=0x7f14c815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c813e290 0x7f14c815c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 -- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14c80cf7c0 msgr2=0x7f14c8142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14c80cf7c0 0x7f14c8142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 -- 172.21.15.70:0/461150183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80094d0 con 0x7f14c815f4e0 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c6d9d640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14c80cf7c0 0x7f14c8142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14c759e640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c815f4e0 0x7f14c8144010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b970 tx=0x7f14c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14af7fe640 1 -- 172.21.15.70:0/461150183 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000cb40 con 0x7f14c815f4e0 2023-11-26T07:18:28.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14af7fe640 1 -- 172.21.15.70:0/461150183 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c000ccc0 con 0x7f14c815f4e0 2023-11-26T07:18:28.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14af7fe640 1 -- 172.21.15.70:0/461150183 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0014680 con 0x7f14c815f4e0 2023-11-26T07:18:28.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c8142690 con 0x7f14c815f4e0 2023-11-26T07:18:28.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c815cb40 con 0x7f14c815f4e0 2023-11-26T07:18:28.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c8067680 con 0x7f14c815f4e0 2023-11-26T07:18:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.070+0000 7f14af7fe640 1 -- 172.21.15.70:0/461150183 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f14c001d3b0 con 0x7f14c815f4e0 2023-11-26T07:18:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.074+0000 7f14af7fe640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f14b4066470 0x7f14b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.074+0000 7f14af7fe640 1 -- 172.21.15.70:0/461150183 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14c0083ea0 con 0x7f14c815f4e0 2023-11-26T07:18:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.074+0000 7f14c6d9d640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f14b4066470 0x7f14b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.074+0000 7f14c6d9d640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f14b4066470 0x7f14b4068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f14b80ad000 tx=0x7f14b80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.078+0000 7f14af7fe640 1 -- 172.21.15.70:0/461150183 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14c0051280 con 0x7f14c815f4e0 2023-11-26T07:18:28.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14c80cc310 con 0x7f14c815f4e0 2023-11-26T07:18:28.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14af7fe640 1 -- 172.21.15.70:0/461150183 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14c0019020 con 0x7f14c815f4e0 2023-11-26T07:18:28.229 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:28.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f14b4066470 msgr2=0x7f14b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f14b4066470 0x7f14b4068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f14b80ad000 tx=0x7f14b80a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:28.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c815f4e0 msgr2=0x7f14c8144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c815f4e0 0x7f14c8144010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f14c000b970 tx=0x7f14c000be30 comp rx=0 tx=0).stop 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 shutdown_connections 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f14b4066470 0x7f14b4068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14c815f4e0 0x7f14c8144010 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f14c813e290 0x7f14c815c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 --2- 172.21.15.70:0/461150183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14c80cf7c0 0x7f14c8142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 >> 172.21.15.70:0/461150183 conn(0x7f14c806a890 msgr2=0x7f14c80ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.226+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 shutdown_connections 2023-11-26T07:18:28.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.230+0000 7f14cd046640 1 -- 172.21.15.70:0/461150183 wait complete. 2023-11-26T07:18:28.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:28.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.386+0000 7f434b3d1640 1 Processor -- start 2023-11-26T07:18:28.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434b3d1640 1 -- start start 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434b3d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4344143ac0 0x7f4344070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434b3d1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43440cf990 0x7f43440cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434b3d1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440cc730 con 0x7f43440708b0 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434b3d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4344143ea0 con 0x7f4344143ac0 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434b3d1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4344070ee0 con 0x7f43440cf990 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434916d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4344143ac0 0x7f4344070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434916d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4344143ac0 0x7f4344070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59190/0 (socket says 172.21.15.70:59190) 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434916d640 1 -- 172.21.15.70:0/1483954082 learned_addr learned my addr 172.21.15.70:0/1483954082 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434896c640 1 --1- 172.21.15.70:0/1483954082 >> v1:172.21.15.70:6789/0 conn(0x7f43440708b0 0x7f43440cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53730/0 (socket says 172.21.15.70:53730) 2023-11-26T07:18:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434996e640 1 --2- 172.21.15.70:0/1483954082 >> v2:172.21.15.120:3300/0 conn(0x7f43440cf990 0x7f43440cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434916d640 1 -- 172.21.15.70:0/1483954082 >> v2:172.21.15.120:3300/0 conn(0x7f43440cf990 msgr2=0x7f43440cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434916d640 1 --2- 172.21.15.70:0/1483954082 >> v2:172.21.15.120:3300/0 conn(0x7f43440cf990 0x7f43440cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434916d640 1 -- 172.21.15.70:0/1483954082 >> v1:172.21.15.70:6789/0 conn(0x7f43440708b0 legacy=0x7f43440cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434916d640 1 -- 172.21.15.70:0/1483954082 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440711c0 con 0x7f4344143ac0 2023-11-26T07:18:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f433bfff640 1 -- 172.21.15.70:0/1483954082 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920230870 0 0) 0x7f43440cc730 con 0x7f43440708b0 2023-11-26T07:18:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.390+0000 7f434996e640 1 --2- 172.21.15.70:0/1483954082 >> v2:172.21.15.120:3300/0 conn(0x7f43440cf990 0x7f43440cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434916d640 1 --2- 172.21.15.70:0/1483954082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4344143ac0 0x7f4344070370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f434406e570 tx=0x7f434001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8941f4786d661df server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f433bfff640 1 -- 172.21.15.70:0/1483954082 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400ab610 con 0x7f4344143ac0 2023-11-26T07:18:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f433bfff640 1 -- 172.21.15.70:0/1483954082 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43400ab770 con 0x7f4344143ac0 2023-11-26T07:18:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f433bfff640 1 -- 172.21.15.70:0/1483954082 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400abb00 con 0x7f4344143ac0 2023-11-26T07:18:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 -- 172.21.15.70:0/1483954082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4344143ac0 msgr2=0x7f4344070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 --2- 172.21.15.70:0/1483954082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4344143ac0 0x7f4344070370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f434406e570 tx=0x7f434001c500 comp rx=0 tx=0).stop 2023-11-26T07:18:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 -- 172.21.15.70:0/1483954082 shutdown_connections 2023-11-26T07:18:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 --2- 172.21.15.70:0/1483954082 >> v2:172.21.15.120:3300/0 conn(0x7f43440cf990 0x7f43440cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 --2- 172.21.15.70:0/1483954082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4344143ac0 0x7f4344070370 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 -- 172.21.15.70:0/1483954082 >> 172.21.15.70:0/1483954082 conn(0x7f434406a890 msgr2=0x7f434406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 -- 172.21.15.70:0/1483954082 shutdown_connections 2023-11-26T07:18:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 -- 172.21.15.70:0/1483954082 wait complete. 2023-11-26T07:18:28.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 Processor -- start 2023-11-26T07:18:28.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.394+0000 7f434b3d1640 1 -- start start 2023-11-26T07:18:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43440708b0 0x7f434413d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f43440cf990 0x7f4344140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344143ac0 0x7f4344138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440afcb0 con 0x7f43440708b0 2023-11-26T07:18:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4344141770 con 0x7f4344143ac0 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4344141a50 con 0x7f43440cf990 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43440708b0 0x7f434413d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43440708b0 0x7f434413d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59202/0 (socket says 172.21.15.70:59202) 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 -- 172.21.15.70:0/2068042869 learned_addr learned my addr 172.21.15.70:0/2068042869 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434996e640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344143ac0 0x7f4344138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 -- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f43440cf990 msgr2=0x7f4344140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434896c640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f43440cf990 0x7f4344140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f43440cf990 0x7f4344140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 -- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344143ac0 msgr2=0x7f4344138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344143ac0 0x7f4344138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 -- 172.21.15.70:0/2068042869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400094d0 con 0x7f43440708b0 2023-11-26T07:18:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434996e640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344143ac0 0x7f4344138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434896c640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f43440cf990 0x7f4344140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434916d640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43440708b0 0x7f434413d820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4340019110 tx=0x7f434001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f4339ffb640 1 -- 172.21.15.70:0/2068042869 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400b4800 con 0x7f43440708b0 2023-11-26T07:18:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f4339ffb640 1 -- 172.21.15.70:0/2068042869 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43400b4980 con 0x7f43440708b0 2023-11-26T07:18:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4344141d30 con 0x7f43440708b0 2023-11-26T07:18:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f4339ffb640 1 -- 172.21.15.70:0/2068042869 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400b4d30 con 0x7f43440708b0 2023-11-26T07:18:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434413dd60 con 0x7f43440708b0 2023-11-26T07:18:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434413df50 con 0x7f43440708b0 2023-11-26T07:18:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.398+0000 7f4339ffb640 1 -- 172.21.15.70:0/2068042869 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43400c83a0 con 0x7f43440708b0 2023-11-26T07:18:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.402+0000 7f4339ffb640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4328066470 0x7f4328068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.402+0000 7f4339ffb640 1 -- 172.21.15.70:0/2068042869 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f434011e770 con 0x7f43440708b0 2023-11-26T07:18:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.402+0000 7f434896c640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4328066470 0x7f4328068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.402+0000 7f434896c640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4328066470 0x7f4328068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f43440b1bd0 tx=0x7f4334009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.406+0000 7f4339ffb640 1 -- 172.21.15.70:0/2068042869 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43400ebd30 con 0x7f43440708b0 2023-11-26T07:18:28.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4344067680 con 0x7f43440708b0 2023-11-26T07:18:28.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f4339ffb640 1 -- 172.21.15.70:0/2068042869 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43400ef350 con 0x7f43440708b0 2023-11-26T07:18:28.557 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4328066470 msgr2=0x7f4328068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4328066470 0x7f4328068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f43440b1bd0 tx=0x7f4334009040 comp rx=0 tx=0).stop 2023-11-26T07:18:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43440708b0 msgr2=0x7f434413d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43440708b0 0x7f434413d820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4340019110 tx=0x7f434001ad40 comp rx=0 tx=0).stop 2023-11-26T07:18:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 shutdown_connections 2023-11-26T07:18:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344143ac0 0x7f4344138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f43440cf990 0x7f4344140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4328066470 0x7f4328068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 --2- 172.21.15.70:0/2068042869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43440708b0 0x7f434413d820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 >> 172.21.15.70:0/2068042869 conn(0x7f434406a890 msgr2=0x7f4344071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 shutdown_connections 2023-11-26T07:18:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.554+0000 7f434b3d1640 1 -- 172.21.15.70:0/2068042869 wait complete. 2023-11-26T07:18:28.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.710+0000 7f53e6032640 1 Processor -- start 2023-11-26T07:18:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.710+0000 7f53e6032640 1 -- start start 2023-11-26T07:18:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53e6032640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53e00cf280 0x7f53e00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53e6032640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00cc730 con 0x7f53e00cd1b0 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53e6032640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e0070ee0 con 0x7f53e0143ac0 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53e6032640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e0143ea0 con 0x7f53e00cf280 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53deffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53e00cf280 0x7f53e00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53dffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f53e00cd1b0 0x7f53e00cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53738/0 (socket says 172.21.15.70:53738) 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53dffff640 1 -- 172.21.15.70:0/470169032 learned_addr learned my addr 172.21.15.70:0/470169032 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53deffd640 1 -- 172.21.15.70:0/470169032 >> v1:172.21.15.120:6789/0 conn(0x7f53e0143ac0 legacy=0x7f53e0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53deffd640 1 -- 172.21.15.70:0/470169032 >> v1:172.21.15.70:6789/0 conn(0x7f53e00cd1b0 legacy=0x7f53e00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53de7fc640 1 -- 172.21.15.70:0/470169032 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424091402 0 0) 0x7f53e00cc730 con 0x7f53e00cd1b0 2023-11-26T07:18:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.714+0000 7f53deffd640 1 -- 172.21.15.70:0/470169032 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00711c0 con 0x7f53e00cf280 2023-11-26T07:18:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53deffd640 1 --2- 172.21.15.70:0/470169032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e00cf280 0x7f53e00cf710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f53d40097c0 tx=0x7f53d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5923e035201b9200 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53de7fc640 1 -- 172.21.15.70:0/470169032 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40a8050 con 0x7f53e00cf280 2023-11-26T07:18:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53de7fc640 1 -- 172.21.15.70:0/470169032 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d40ac5f0 con 0x7f53e00cf280 2023-11-26T07:18:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53de7fc640 1 -- 172.21.15.70:0/470169032 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40ac980 con 0x7f53e00cf280 2023-11-26T07:18:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 -- 172.21.15.70:0/470169032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e00cf280 msgr2=0x7f53e00cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 --2- 172.21.15.70:0/470169032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e00cf280 0x7f53e00cf710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f53d40097c0 tx=0x7f53d401c480 comp rx=0 tx=0).stop 2023-11-26T07:18:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 -- 172.21.15.70:0/470169032 shutdown_connections 2023-11-26T07:18:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 --2- 172.21.15.70:0/470169032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e00cf280 0x7f53e00cf710 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 -- 172.21.15.70:0/470169032 >> 172.21.15.70:0/470169032 conn(0x7f53e006a890 msgr2=0x7f53e006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 -- 172.21.15.70:0/470169032 shutdown_connections 2023-11-26T07:18:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 -- 172.21.15.70:0/470169032 wait complete. 2023-11-26T07:18:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 Processor -- start 2023-11-26T07:18:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.718+0000 7f53e6032640 1 -- start start 2023-11-26T07:18:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53e00cd1b0 0x7f53e00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53e00cf280 0x7f53e0157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0143ac0 0x7f53e00accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e015b320 con 0x7f53e0143ac0 2023-11-26T07:18:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e015b4b0 con 0x7f53e00cf280 2023-11-26T07:18:28.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01579d0 con 0x7f53e00cd1b0 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0143ac0 0x7f53e00accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0143ac0 0x7f53e00accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59224/0 (socket says 172.21.15.70:59224) 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 -- 172.21.15.70:0/1237824737 learned_addr learned my addr 172.21.15.70:0/1237824737 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53deffd640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53e00cf280 0x7f53e0157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53df7fe640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53e00cd1b0 0x7f53e00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 -- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53e00cd1b0 msgr2=0x7f53e00aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53e00cd1b0 0x7f53e00aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 -- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53e00cf280 msgr2=0x7f53e0157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53e00cf280 0x7f53e0157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 -- 172.21.15.70:0/1237824737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009420 con 0x7f53e0143ac0 2023-11-26T07:18:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53df7fe640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53e00cd1b0 0x7f53e00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53dffff640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0143ac0 0x7f53e00accd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c810 tx=0x7f53d800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53c7fff640 1 -- 172.21.15.70:0/1237824737 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800a640 con 0x7f53e0143ac0 2023-11-26T07:18:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53c7fff640 1 -- 172.21.15.70:0/1237824737 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d800a7c0 con 0x7f53e0143ac0 2023-11-26T07:18:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e0157ee0 con 0x7f53e0143ac0 2023-11-26T07:18:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53c7fff640 1 -- 172.21.15.70:0/1237824737 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d800ab70 con 0x7f53e0143ac0 2023-11-26T07:18:28.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00b0d10 con 0x7f53e0143ac0 2023-11-26T07:18:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e015b660 con 0x7f53e0143ac0 2023-11-26T07:18:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.722+0000 7f53c7fff640 1 -- 172.21.15.70:0/1237824737 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53d800acd0 con 0x7f53e0143ac0 2023-11-26T07:18:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.726+0000 7f53c7fff640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53cc066470 0x7f53cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.726+0000 7f53c7fff640 1 -- 172.21.15.70:0/1237824737 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53d80836d0 con 0x7f53e0143ac0 2023-11-26T07:18:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.726+0000 7f53df7fe640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53cc066470 0x7f53cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:28.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.726+0000 7f53df7fe640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53cc066470 0x7f53cc068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53e00acc00 tx=0x7f53d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:28.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.730+0000 7f53c7fff640 1 -- 172.21.15.70:0/1237824737 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53e015b660 con 0x7f53e0143ac0 2023-11-26T07:18:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.878+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53e015b660 con 0x7f53e0143ac0 2023-11-26T07:18:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53c7fff640 1 -- 172.21.15.70:0/1237824737 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f53e015b660 con 0x7f53e0143ac0 2023-11-26T07:18:28.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:28.885 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53cc066470 msgr2=0x7f53cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53cc066470 0x7f53cc068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53e00acc00 tx=0x7f53d0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0143ac0 msgr2=0x7f53e00accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0143ac0 0x7f53e00accd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c810 tx=0x7f53d800ccd0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 shutdown_connections 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53cc066470 0x7f53cc068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53e0143ac0 0x7f53e00accd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53e00cf280 0x7f53e0157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 --2- 172.21.15.70:0/1237824737 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53e00cd1b0 0x7f53e00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 >> 172.21.15.70:0/1237824737 conn(0x7f53e006a890 msgr2=0x7f53e00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 shutdown_connections 2023-11-26T07:18:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:28.882+0000 7f53e6032640 1 -- 172.21.15.70:0/1237824737 wait complete. 2023-11-26T07:18:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:28.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:28.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:28.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:29.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b53a4640 1 Processor -- start 2023-11-26T07:18:29.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b53a4640 1 -- start start 2023-11-26T07:18:29.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b53a4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b53a4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00ce3b0 con 0x7fc4b00d01b0 2023-11-26T07:18:29.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b53a4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00ce690 con 0x7fc4b015d610 2023-11-26T07:18:29.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b53a4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00ce970 con 0x7fc4b015d230 2023-11-26T07:18:29.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b4ba3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc4b00d01b0 0x7fc4b00b3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53752/0 (socket says 172.21.15.70:53752) 2023-11-26T07:18:29.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4b4ba3640 1 -- 172.21.15.70:0/3500481835 learned_addr learned my addr 172.21.15.70:0/3500481835 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4affff640 1 --2- 172.21.15.70:0/3500481835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042142341 0 0) 0x7fc4b00ce3b0 con 0x7fc4b00d01b0 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.046+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc498003530 con 0x7fc4b00d01b0 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181659928 0 0) 0x7fc4b00ce690 con 0x7fc4b015d610 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b00ce3b0 con 0x7fc4b015d610 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4affff640 1 -- 172.21.15.70:0/3500481835 >> v1:172.21.15.120:6789/0 conn(0x7fc4b015d610 legacy=0x7fc4b00cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4affff640 1 -- 172.21.15.70:0/3500481835 >> v1:172.21.15.70:6789/0 conn(0x7fc4b00d01b0 legacy=0x7fc4b00b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1548238226 0 0) 0x7fc498003530 con 0x7fc4b00d01b0 2023-11-26T07:18:29.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4affff640 1 -- 172.21.15.70:0/3500481835 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00cec50 con 0x7fc4b015d230 2023-11-26T07:18:29.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4affff640 1 --2- 172.21.15.70:0/3500481835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00d3be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097f0 tx=0x7fc4a001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a6deb372338661 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8001a00 con 0x7fc4b015d230 2023-11-26T07:18:29.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a00a7050 con 0x7fc4b015d230 2023-11-26T07:18:29.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.050+0000 7fc4aeffd640 1 -- 172.21.15.70:0/3500481835 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00ab620 con 0x7fc4b015d230 2023-11-26T07:18:29.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- 172.21.15.70:0/3500481835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 msgr2=0x7fc4b00d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/3500481835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00d3be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097f0 tx=0x7fc4a001c350 comp rx=0 tx=0).stop 2023-11-26T07:18:29.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- 172.21.15.70:0/3500481835 shutdown_connections 2023-11-26T07:18:29.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/3500481835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00d3be0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- 172.21.15.70:0/3500481835 >> 172.21.15.70:0/3500481835 conn(0x7fc4b00d30c0 msgr2=0x7fc4b00d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- 172.21.15.70:0/3500481835 shutdown_connections 2023-11-26T07:18:29.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- 172.21.15.70:0/3500481835 wait complete. 2023-11-26T07:18:29.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 Processor -- start 2023-11-26T07:18:29.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- start start 2023-11-26T07:18:29.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b00d01b0 0x7fc4b00caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b015d610 0x7fc4b0153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b015ab80 con 0x7fc4b00d01b0 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b015b9e0 con 0x7fc4b015d610 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b53a4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b015add0 con 0x7fc4b015d230 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4affff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b00d01b0 0x7fc4b00caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4affff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b00d01b0 0x7fc4b00caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59238/0 (socket says 172.21.15.70:59238) 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4affff640 1 -- 172.21.15.70:0/2565301576 learned_addr learned my addr 172.21.15.70:0/2565301576 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4b4ba3640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b015d610 0x7fc4b0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.054+0000 7fc4af7fe640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4affff640 1 -- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 msgr2=0x7fc4b00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4affff640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4affff640 1 -- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b015d610 msgr2=0x7fc4b0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4affff640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b015d610 0x7fc4b0153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4affff640 1 -- 172.21.15.70:0/2565301576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a0009420 con 0x7fc4b00d01b0 2023-11-26T07:18:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4affff640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b00d01b0 0x7fc4b00caae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097f0 tx=0x7fc4a001ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4acff9640 1 -- 172.21.15.70:0/2565301576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00abe60 con 0x7fc4b00d01b0 2023-11-26T07:18:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4acff9640 1 -- 172.21.15.70:0/2565301576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a0004020 con 0x7fc4b00d01b0 2023-11-26T07:18:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4acff9640 1 -- 172.21.15.70:0/2565301576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00043d0 con 0x7fc4b00d01b0 2023-11-26T07:18:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b015b0b0 con 0x7fc4b00d01b0 2023-11-26T07:18:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b015b670 con 0x7fc4b00d01b0 2023-11-26T07:18:29.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b0067c10 con 0x7fc4b00d01b0 2023-11-26T07:18:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4acff9640 1 -- 172.21.15.70:0/2565301576 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4a0003620 con 0x7fc4b00d01b0 2023-11-26T07:18:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.058+0000 7fc4acff9640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc49c0664a0 0x7fc49c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.062+0000 7fc4acff9640 1 -- 172.21.15.70:0/2565301576 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4a011e170 con 0x7fc4b00d01b0 2023-11-26T07:18:29.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.062+0000 7fc4af7fe640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc49c0664a0 0x7fc49c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.062+0000 7fc4af7fe640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc49c0664a0 0x7fc49c068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4b015f800 tx=0x7fc4a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.066+0000 7fc4acff9640 1 -- 172.21.15.70:0/2565301576 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4a00eb550 con 0x7fc4b00d01b0 2023-11-26T07:18:29.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.214+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4b01608b0 con 0x7fc4b00d01b0 2023-11-26T07:18:29.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.214+0000 7fc4acff9640 1 -- 172.21.15.70:0/2565301576 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4a00eeb70 con 0x7fc4b00d01b0 2023-11-26T07:18:29.218 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc49c0664a0 msgr2=0x7fc49c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc49c0664a0 0x7fc49c068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4b015f800 tx=0x7fc4a4009040 comp rx=0 tx=0).stop 2023-11-26T07:18:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b00d01b0 msgr2=0x7fc4b00caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b00d01b0 0x7fc4b00caae0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00097f0 tx=0x7fc4a001ab90 comp rx=0 tx=0).stop 2023-11-26T07:18:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 shutdown_connections 2023-11-26T07:18:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b015d610 0x7fc4b0153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b015d230 0x7fc4b00cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc49c0664a0 0x7fc49c068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 --2- 172.21.15.70:0/2565301576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b00d01b0 0x7fc4b00caae0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 >> 172.21.15.70:0/2565301576 conn(0x7fc4b00d30c0 msgr2=0x7fc4b00b68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 shutdown_connections 2023-11-26T07:18:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.218+0000 7fc4b53a4640 1 -- 172.21.15.70:0/2565301576 wait complete. 2023-11-26T07:18:29.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:29.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29214c9640 1 Processor -- start 2023-11-26T07:18:29.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29214c9640 1 -- start start 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29214c9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f291c0d1bc0 0x7f291c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29214c9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29214c9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291c0cf0e0 con 0x7f291c15d6e0 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29214c9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c15dac0 con 0x7f291c0d1bc0 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29214c9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0ceb20 con 0x7f291c0b2160 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29127fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f291c0d1bc0 0x7f291c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f291b7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f291affd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f291c15d6e0 0x7f291c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:55470/0 (socket says 172.21.15.70:55470) 2023-11-26T07:18:29.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29127fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f291c0d1bc0 0x7f291c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:49350/0 (socket says 172.21.15.70:49350) 2023-11-26T07:18:29.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f291b7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:37990/0 (socket says 172.21.15.70:37990) 2023-11-26T07:18:29.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29127fc640 1 -- 172.21.15.70:0/2101948118 learned_addr learned my addr 172.21.15.70:0/2101948118 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:29.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29127fc640 1 -- 172.21.15.70:0/2101948118 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 msgr2=0x7f291c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:29.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29127fc640 1 --2- 172.21.15.70:0/2101948118 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29127fc640 1 -- 172.21.15.70:0/2101948118 >> v1:172.21.15.120:6789/0 conn(0x7f291c15d6e0 legacy=0x7f291c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.378+0000 7f29127fc640 1 -- 172.21.15.70:0/2101948118 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0cee00 con 0x7f291c0d1bc0 2023-11-26T07:18:29.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29127fc640 1 --2- 172.21.15.70:0/2101948118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 0x7f291c0d0df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f290c009870 tx=0x7f290c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7f46931fe7e6c75 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f291a7fc640 1 -- 172.21.15.70:0/2101948118 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c0a7070 con 0x7f291c0d1bc0 2023-11-26T07:18:29.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f291a7fc640 1 -- 172.21.15.70:0/2101948118 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c0ab430 con 0x7f291c0d1bc0 2023-11-26T07:18:29.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f291a7fc640 1 -- 172.21.15.70:0/2101948118 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c0ab7c0 con 0x7f291c0d1bc0 2023-11-26T07:18:29.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 -- 172.21.15.70:0/2101948118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 msgr2=0x7f291c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 --2- 172.21.15.70:0/2101948118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 0x7f291c0d0df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f290c009870 tx=0x7f290c01c540 comp rx=0 tx=0).stop 2023-11-26T07:18:29.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 -- 172.21.15.70:0/2101948118 shutdown_connections 2023-11-26T07:18:29.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 --2- 172.21.15.70:0/2101948118 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 --2- 172.21.15.70:0/2101948118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 0x7f291c0d0df0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 -- 172.21.15.70:0/2101948118 >> 172.21.15.70:0/2101948118 conn(0x7f291c09c550 msgr2=0x7f291c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 -- 172.21.15.70:0/2101948118 shutdown_connections 2023-11-26T07:18:29.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.382+0000 7f29214c9640 1 -- 172.21.15.70:0/2101948118 wait complete. 2023-11-26T07:18:29.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 Processor -- start 2023-11-26T07:18:29.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 -- start start 2023-11-26T07:18:29.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 0x7f291c0b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f291c15d6e0 0x7f291c0b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c15a9f0 con 0x7f291c15d6e0 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0cd1e0 con 0x7f291c0d1bc0 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0b8bf0 con 0x7f291c0b2160 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f291c15d6e0 0x7f291c0b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f291c15d6e0 0x7f291c0b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59240/0 (socket says 172.21.15.70:59240) 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 -- 172.21.15.70:0/1442717642 learned_addr learned my addr 172.21.15.70:0/1442717642 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29127fc640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 0x7f291c0b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291affd640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 -- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 msgr2=0x7f291c0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 -- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 msgr2=0x7f291c0b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 0x7f291c0b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 -- 172.21.15.70:0/1442717642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c0094d0 con 0x7f291c15d6e0 2023-11-26T07:18:29.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f291b7fe640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f291c15d6e0 0x7f291c0b6100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2914009e30 tx=0x7f291400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f2913fff640 1 -- 172.21.15.70:0/1442717642 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914009ca0 con 0x7f291c15d6e0 2023-11-26T07:18:29.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f2913fff640 1 -- 172.21.15.70:0/1442717642 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291400f040 con 0x7f291c15d6e0 2023-11-26T07:18:29.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c0cc940 con 0x7f291c15d6e0 2023-11-26T07:18:29.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f2913fff640 1 -- 172.21.15.70:0/1442717642 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140146c0 con 0x7f291c15d6e0 2023-11-26T07:18:29.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c0ccf00 con 0x7f291c15d6e0 2023-11-26T07:18:29.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.386+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c15ab60 con 0x7f291c15d6e0 2023-11-26T07:18:29.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.390+0000 7f2913fff640 1 -- 172.21.15.70:0/1442717642 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2914014820 con 0x7f291c15d6e0 2023-11-26T07:18:29.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.390+0000 7f2913fff640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f28fc066470 0x7f28fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.390+0000 7f2913fff640 1 -- 172.21.15.70:0/1442717642 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2914084e90 con 0x7f291c15d6e0 2023-11-26T07:18:29.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.390+0000 7f291affd640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f28fc066470 0x7f28fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.390+0000 7f291affd640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f28fc066470 0x7f28fc068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2904000f70 tx=0x7f2904007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.394+0000 7f2913fff640 1 -- 172.21.15.70:0/1442717642 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2914052270 con 0x7f291c15d6e0 2023-11-26T07:18:29.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.542+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f291c067680 con 0x7f291c15d6e0 2023-11-26T07:18:29.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.542+0000 7f2913fff640 1 -- 172.21.15.70:0/1442717642 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2914018020 con 0x7f291c15d6e0 2023-11-26T07:18:29.547 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:29.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f28fc066470 msgr2=0x7f28fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f28fc066470 0x7f28fc068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2904000f70 tx=0x7f2904007c90 comp rx=0 tx=0).stop 2023-11-26T07:18:29.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f291c15d6e0 msgr2=0x7f291c0b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f291c15d6e0 0x7f291c0b6100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2914009e30 tx=0x7f291400c490 comp rx=0 tx=0).stop 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 shutdown_connections 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f28fc066470 0x7f28fc068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f291c15d6e0 0x7f291c0b6100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f291c0d1bc0 0x7f291c0b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 --2- 172.21.15.70:0/1442717642 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f291c0b2160 0x7f291c0cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 >> 172.21.15.70:0/1442717642 conn(0x7f291c09c550 msgr2=0x7f291c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 shutdown_connections 2023-11-26T07:18:29.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.546+0000 7f29214c9640 1 -- 172.21.15.70:0/1442717642 wait complete. 2023-11-26T07:18:29.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:29.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.702+0000 7f58a8757640 1 Processor -- start 2023-11-26T07:18:29.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.702+0000 7f58a8757640 1 -- start start 2023-11-26T07:18:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a8757640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b950 0x7f58a00ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a8757640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a006bdc0 con 0x7f58a006ec30 2023-11-26T07:18:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a8757640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0161ab0 con 0x7f58a006b4a0 2023-11-26T07:18:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a8757640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0161d90 con 0x7f58a006b950 2023-11-26T07:18:29.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a64f3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f58a006ec30 0x7f58a0161010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53768/0 (socket says 172.21.15.70:53768) 2023-11-26T07:18:29.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a64f3640 1 -- 172.21.15.70:0/3981101055 learned_addr learned my addr 172.21.15.70:0/3981101055 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:29.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a6cf4640 1 --2- 172.21.15.70:0/3981101055 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b950 0x7f58a00ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a54f1640 1 -- 172.21.15.70:0/3981101055 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404105197 0 0) 0x7f58a006bdc0 con 0x7f58a006ec30 2023-11-26T07:18:29.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a54f1640 1 -- 172.21.15.70:0/3981101055 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f588c003530 con 0x7f58a006ec30 2023-11-26T07:18:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a54f1640 1 -- 172.21.15.70:0/3981101055 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329879687 0 0) 0x7f58a0161ab0 con 0x7f58a006b4a0 2023-11-26T07:18:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a6cf4640 1 -- 172.21.15.70:0/3981101055 >> v1:172.21.15.120:6789/0 conn(0x7f58a006b4a0 legacy=0x7f58a00ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a6cf4640 1 -- 172.21.15.70:0/3981101055 >> v1:172.21.15.70:6789/0 conn(0x7f58a006ec30 legacy=0x7f58a0161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.706+0000 7f58a6cf4640 1 -- 172.21.15.70:0/3981101055 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00ad820 con 0x7f58a006b950 2023-11-26T07:18:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a6cf4640 1 --2- 172.21.15.70:0/3981101055 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b950 0x7f58a00ae730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5898009dc0 tx=0x7f589801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d713ac06bcbabc21 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a54f1640 1 -- 172.21.15.70:0/3981101055 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980a5990 con 0x7f58a006b950 2023-11-26T07:18:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a54f1640 1 -- 172.21.15.70:0/3981101055 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58980a5af0 con 0x7f58a006b950 2023-11-26T07:18:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a54f1640 1 -- 172.21.15.70:0/3981101055 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980a5e60 con 0x7f58a006b950 2023-11-26T07:18:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 -- 172.21.15.70:0/3981101055 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b950 msgr2=0x7f58a00ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 --2- 172.21.15.70:0/3981101055 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b950 0x7f58a00ae730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5898009dc0 tx=0x7f589801c8b0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 -- 172.21.15.70:0/3981101055 shutdown_connections 2023-11-26T07:18:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 --2- 172.21.15.70:0/3981101055 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b950 0x7f58a00ae730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 -- 172.21.15.70:0/3981101055 >> 172.21.15.70:0/3981101055 conn(0x7f58a0070db0 msgr2=0x7f58a00711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 -- 172.21.15.70:0/3981101055 shutdown_connections 2023-11-26T07:18:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 -- 172.21.15.70:0/3981101055 wait complete. 2023-11-26T07:18:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 Processor -- start 2023-11-26T07:18:29.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.710+0000 7f58a8757640 1 -- start start 2023-11-26T07:18:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b4a0 0x7f58a0148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a006b950 0x7f58a015fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58a006ec30 0x7f58a0160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0151fd0 con 0x7f58a006b950 2023-11-26T07:18:29.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00b2f10 con 0x7f58a006ec30 2023-11-26T07:18:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01fa1b0 con 0x7f58a006b4a0 2023-11-26T07:18:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a006b950 0x7f58a015fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a006b950 0x7f58a015fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59244/0 (socket says 172.21.15.70:59244) 2023-11-26T07:18:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 -- 172.21.15.70:0/91489583 learned_addr learned my addr 172.21.15.70:0/91489583 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a6cf4640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58a006ec30 0x7f58a0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a64f3640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b4a0 0x7f58a0148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 -- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b4a0 msgr2=0x7f58a0148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b4a0 0x7f58a0148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 -- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58a006ec30 msgr2=0x7f58a0160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58a006ec30 0x7f58a0160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 -- 172.21.15.70:0/91489583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009a70 con 0x7f58a006b950 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a5cf2640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a006b950 0x7f58a015fd20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5890001ec0 tx=0x7f589000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f5896ffd640 1 -- 172.21.15.70:0/91489583 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900054e0 con 0x7f58a006b950 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f5896ffd640 1 -- 172.21.15.70:0/91489583 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890003600 con 0x7f58a006b950 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a01fa490 con 0x7f58a006b950 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f5896ffd640 1 -- 172.21.15.70:0/91489583 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900039b0 con 0x7f58a006b950 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a00b2ba0 con 0x7f58a006b950 2023-11-26T07:18:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a00b3080 con 0x7f58a006b950 2023-11-26T07:18:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.714+0000 7f5896ffd640 1 -- 172.21.15.70:0/91489583 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5890003b10 con 0x7f58a006b950 2023-11-26T07:18:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.718+0000 7f5896ffd640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.718+0000 7f5896ffd640 1 -- 172.21.15.70:0/91489583 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5890083460 con 0x7f58a006b950 2023-11-26T07:18:29.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.718+0000 7f58a64f3640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:29.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.718+0000 7f58a64f3640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f589c001210 tx=0x7f589c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:29.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.722+0000 7f5896ffd640 1 -- 172.21.15.70:0/91489583 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58900508c0 con 0x7f58a006b950 2023-11-26T07:18:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.874+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58a00676f0 con 0x7f58a006b950 2023-11-26T07:18:29.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.874+0000 7f5896ffd640 1 -- 172.21.15.70:0/91489583 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58900170a0 con 0x7f58a006b950 2023-11-26T07:18:29.878 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5884066470 msgr2=0x7f5884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f589c001210 tx=0x7f589c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a006b950 msgr2=0x7f58a015fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a006b950 0x7f58a015fd20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5890001ec0 tx=0x7f589000c8e0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 shutdown_connections 2023-11-26T07:18:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a006b950 0x7f58a015fd20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58a006ec30 0x7f58a0160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 --2- 172.21.15.70:0/91489583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58a006b4a0 0x7f58a0148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 >> 172.21.15.70:0/91489583 conn(0x7f58a0070db0 msgr2=0x7f58a00ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 shutdown_connections 2023-11-26T07:18:29.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:29.878+0000 7f58a8757640 1 -- 172.21.15.70:0/91489583 wait complete. 2023-11-26T07:18:29.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:30.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5bad69c640 1 Processor -- start 2023-11-26T07:18:30.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5bad69c640 1 -- start start 2023-11-26T07:18:30.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5bad69c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ba815d6e0 0x7f5ba80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5bad69c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5ba80b2160 0x7f5ba80d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5bad69c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80cf0e0 con 0x7f5ba80d19f0 2023-11-26T07:18:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5bad69c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba815dac0 con 0x7f5ba80b2160 2023-11-26T07:18:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5bad69c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80d1e80 con 0x7f5ba815d6e0 2023-11-26T07:18:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5b9e7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5ba80b2160 0x7f5ba80d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5b9e7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5ba80b2160 0x7f5ba80d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59246/0 (socket says 172.21.15.70:59246) 2023-11-26T07:18:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.034+0000 7f5b9e7fc640 1 -- 172.21.15.70:0/1533670588 learned_addr learned my addr 172.21.15.70:0/1533670588 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:30.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5ba6ffd640 1 --2- 172.21.15.70:0/1533670588 >> v2:172.21.15.120:3300/0 conn(0x7f5ba815d6e0 0x7f5ba80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5b9e7fc640 1 -- 172.21.15.70:0/1533670588 >> v2:172.21.15.120:3300/0 conn(0x7f5ba815d6e0 msgr2=0x7f5ba80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5b9e7fc640 1 --2- 172.21.15.70:0/1533670588 >> v2:172.21.15.120:3300/0 conn(0x7f5ba815d6e0 0x7f5ba80d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5b9e7fc640 1 -- 172.21.15.70:0/1533670588 >> v1:172.21.15.120:6789/0 conn(0x7f5ba80d19f0 legacy=0x7f5ba80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5b9e7fc640 1 -- 172.21.15.70:0/1533670588 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80ceb20 con 0x7f5ba80b2160 2023-11-26T07:18:30.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5ba6ffd640 1 --2- 172.21.15.70:0/1533670588 >> v2:172.21.15.120:3300/0 conn(0x7f5ba815d6e0 0x7f5ba80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5b9e7fc640 1 --2- 172.21.15.70:0/1533670588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba80b2160 0x7f5ba80d14b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80b5db0 tx=0x7f5b9801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecae6ba72b85582f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5ba67fc640 1 -- 172.21.15.70:0/1533670588 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980ac410 con 0x7f5ba80b2160 2023-11-26T07:18:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5ba67fc640 1 -- 172.21.15.70:0/1533670588 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b980ac570 con 0x7f5ba80b2160 2023-11-26T07:18:30.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.038+0000 7f5ba67fc640 1 -- 172.21.15.70:0/1533670588 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980ac900 con 0x7f5ba80b2160 2023-11-26T07:18:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- 172.21.15.70:0/1533670588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba80b2160 msgr2=0x7f5ba80d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 --2- 172.21.15.70:0/1533670588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba80b2160 0x7f5ba80d14b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80b5db0 tx=0x7f5b9801c4c0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- 172.21.15.70:0/1533670588 shutdown_connections 2023-11-26T07:18:30.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 --2- 172.21.15.70:0/1533670588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba80b2160 0x7f5ba80d14b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 --2- 172.21.15.70:0/1533670588 >> v2:172.21.15.120:3300/0 conn(0x7f5ba815d6e0 0x7f5ba80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- 172.21.15.70:0/1533670588 >> 172.21.15.70:0/1533670588 conn(0x7f5ba809c550 msgr2=0x7f5ba80d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- 172.21.15.70:0/1533670588 shutdown_connections 2023-11-26T07:18:30.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- 172.21.15.70:0/1533670588 wait complete. 2023-11-26T07:18:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 Processor -- start 2023-11-26T07:18:30.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- start start 2023-11-26T07:18:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ba80b2160 0x7f5ba81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ba80d19f0 0x7f5ba8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba815d6e0 0x7f5ba80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8152f00 con 0x7f5ba815d6e0 2023-11-26T07:18:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8154980 con 0x7f5ba80b2160 2023-11-26T07:18:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5bad69c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81569a0 con 0x7f5ba80d19f0 2023-11-26T07:18:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5ba77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba815d6e0 0x7f5ba80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5ba77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba815d6e0 0x7f5ba80b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59250/0 (socket says 172.21.15.70:59250) 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5ba77fe640 1 -- 172.21.15.70:0/2642978660 learned_addr learned my addr 172.21.15.70:0/2642978660 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5ba6ffd640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ba80b2160 0x7f5ba81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.042+0000 7f5b9e7fc640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ba80d19f0 0x7f5ba8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5ba77fe640 1 -- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ba80d19f0 msgr2=0x7f5ba8156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5ba77fe640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ba80d19f0 0x7f5ba8156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5ba77fe640 1 -- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ba80b2160 msgr2=0x7f5ba81529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5ba77fe640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ba80b2160 0x7f5ba81529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5ba77fe640 1 -- 172.21.15.70:0/2642978660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b980094d0 con 0x7f5ba815d6e0 2023-11-26T07:18:30.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5ba77fe640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba815d6e0 0x7f5ba80b3740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c780 tx=0x7f5ba000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5b9ffff640 1 -- 172.21.15.70:0/2642978660 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0004b70 con 0x7f5ba815d6e0 2023-11-26T07:18:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5b9ffff640 1 -- 172.21.15.70:0/2642978660 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba000ce90 con 0x7f5ba815d6e0 2023-11-26T07:18:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5b9ffff640 1 -- 172.21.15.70:0/2642978660 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000a850 con 0x7f5ba815d6e0 2023-11-26T07:18:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba8153640 con 0x7f5ba815d6e0 2023-11-26T07:18:30.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba8153c00 con 0x7f5ba815d6e0 2023-11-26T07:18:30.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba8067680 con 0x7f5ba815d6e0 2023-11-26T07:18:30.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5b9ffff640 1 -- 172.21.15.70:0/2642978660 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ba000a9b0 con 0x7f5ba815d6e0 2023-11-26T07:18:30.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5b9ffff640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5b88066470 0x7f5b88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5b9ffff640 1 -- 172.21.15.70:0/2642978660 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ba0083f40 con 0x7f5ba815d6e0 2023-11-26T07:18:30.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.046+0000 7f5ba6ffd640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5b88066470 0x7f5b88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.050+0000 7f5ba6ffd640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5b88066470 0x7f5b88068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b90006fd0 tx=0x7f5b90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.050+0000 7f5b9ffff640 1 -- 172.21.15.70:0/2642978660 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ba0051460 con 0x7f5ba815d6e0 2023-11-26T07:18:30.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.202+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba806cd30 con 0x7f5ba815d6e0 2023-11-26T07:18:30.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.202+0000 7f5b9ffff640 1 -- 172.21.15.70:0/2642978660 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f5ba0054a80 con 0x7f5ba815d6e0 2023-11-26T07:18:30.207 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:30.207 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5b88066470 msgr2=0x7f5b88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5b88066470 0x7f5b88068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b90006fd0 tx=0x7f5b90008040 comp rx=0 tx=0).stop 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba815d6e0 msgr2=0x7f5ba80b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba815d6e0 0x7f5ba80b3740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c780 tx=0x7f5ba000cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 shutdown_connections 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5b88066470 0x7f5b88068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ba815d6e0 0x7f5ba80b3740 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ba80d19f0 0x7f5ba8156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 --2- 172.21.15.70:0/2642978660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ba80b2160 0x7f5ba81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 >> 172.21.15.70:0/2642978660 conn(0x7f5ba809c550 msgr2=0x7f5ba81605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 shutdown_connections 2023-11-26T07:18:30.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.206+0000 7f5bad69c640 1 -- 172.21.15.70:0/2642978660 wait complete. 2023-11-26T07:18:30.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:30.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:30.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.362+0000 7efec28e4640 1 Processor -- start 2023-11-26T07:18:30.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efec28e4640 1 -- start start 2023-11-26T07:18:30.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efec28e4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 0x7efebc0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efec28e4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0cf0e0 con 0x7efebc0b2160 2023-11-26T07:18:30.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efec28e4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0ceb20 con 0x7efebc0d1bc0 2023-11-26T07:18:30.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efec28e4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc15dac0 con 0x7efebc15d6e0 2023-11-26T07:18:30.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebb7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efebc0b2160 0x7efebc0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53770/0 (socket says 172.21.15.70:53770) 2023-11-26T07:18:30.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebb7fe640 1 -- 172.21.15.70:0/1662990228 learned_addr learned my addr 172.21.15.70:0/1662990228 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebbfff640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 0x7efebc0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226683927 0 0) 0x7efebc0cf0e0 con 0x7efebc0b2160 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea4003530 con 0x7efebc0b2160 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298468249 0 0) 0x7efebc0ceb20 con 0x7efebc0d1bc0 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efebc0cf0e0 con 0x7efebc0d1bc0 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2164301399 0 0) 0x7efea4003530 con 0x7efebc0b2160 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 msgr2=0x7efebc0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 0x7efebc0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 >> v1:172.21.15.120:6789/0 conn(0x7efebc0d1bc0 legacy=0x7efebc0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0cee00 con 0x7efebc0b2160 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7efeb0001680 con 0x7efebc0b2160 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 >> v1:172.21.15.70:6789/0 conn(0x7efebc0b2160 legacy=0x7efebc0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efea4003b40 0x7efea4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 0x7efea40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efea4004d10 0x7efea4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc15dac0 con 0x7efea4003b40 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea400ba40 con 0x7efea4004d10 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea400bbb0 con 0x7efebc15d6e0 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebbfff640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efea4003b40 0x7efea4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efec0e81640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efea4004d10 0x7efea4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebb7fe640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 0x7efea40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebbfff640 1 -- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 msgr2=0x7efea40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebbfff640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 0x7efea40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebbfff640 1 -- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efea4004d10 msgr2=0x7efea4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebbfff640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efea4004d10 0x7efea4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebbfff640 1 -- 172.21.15.70:0/1662990228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4003530 con 0x7efea4003b40 2023-11-26T07:18:30.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.366+0000 7efebb7fe640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efebc15d6e0 0x7efea40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efebbfff640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efea4003b40 0x7efea4003f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efeac009ae0 tx=0x7efeac01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d60fa63de2a4f2a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0a55f0 con 0x7efea4003b40 2023-11-26T07:18:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac0a5750 con 0x7efea4003b40 2023-11-26T07:18:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efebaffd640 1 -- 172.21.15.70:0/1662990228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0a5b00 con 0x7efea4003b40 2023-11-26T07:18:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efec28e4640 1 -- 172.21.15.70:0/1662990228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efea4003b40 msgr2=0x7efea4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efec28e4640 1 --2- 172.21.15.70:0/1662990228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efea4003b40 0x7efea4003f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efeac009ae0 tx=0x7efeac01ca20 comp rx=0 tx=0).stop 2023-11-26T07:18:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efec0e81640 1 -- 172.21.15.70:0/1662990228 reap_dead start 2023-11-26T07:18:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efec28e4640 1 -- 172.21.15.70:0/1662990228 shutdown_connections 2023-11-26T07:18:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efec28e4640 1 -- 172.21.15.70:0/1662990228 >> 172.21.15.70:0/1662990228 conn(0x7efebc09c550 msgr2=0x7efebc0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efec28e4640 1 -- 172.21.15.70:0/1662990228 shutdown_connections 2023-11-26T07:18:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.370+0000 7efec28e4640 1 -- 172.21.15.70:0/1662990228 wait complete. 2023-11-26T07:18:30.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 Processor -- start 2023-11-26T07:18:30.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 -- start start 2023-11-26T07:18:30.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efea4003b40 0x7efebc15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efebc1fa0e0 0x7efebc0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efebc0b2ba0 0x7efebc0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0b5e10 con 0x7efebc1fa0e0 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0b60f0 con 0x7efebc0b2ba0 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0b63d0 con 0x7efea4003b40 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efebc1fa0e0 0x7efebc0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efebc1fa0e0 0x7efebc0c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59268/0 (socket says 172.21.15.70:59268) 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 -- 172.21.15.70:0/1505497567 learned_addr learned my addr 172.21.15.70:0/1505497567 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec0e81640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efebc0b2ba0 0x7efebc0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebbfff640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efea4003b40 0x7efebc15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 -- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efea4003b40 msgr2=0x7efebc15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efea4003b40 0x7efebc15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 -- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efebc0b2ba0 msgr2=0x7efebc0b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efebc0b2ba0 0x7efebc0b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 -- 172.21.15.70:0/1505497567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0b66b0 con 0x7efebc1fa0e0 2023-11-26T07:18:30.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efebb7fe640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efebc1fa0e0 0x7efebc0c8be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efeb000e8c0 tx=0x7efeb000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efeb8ff9640 1 -- 172.21.15.70:0/1505497567 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000c8d0 con 0x7efebc1fa0e0 2023-11-26T07:18:30.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efeb8ff9640 1 -- 172.21.15.70:0/1505497567 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb000ca30 con 0x7efebc1fa0e0 2023-11-26T07:18:30.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efeb8ff9640 1 -- 172.21.15.70:0/1505497567 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000cda0 con 0x7efebc1fa0e0 2023-11-26T07:18:30.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0b6990 con 0x7efebc1fa0e0 2023-11-26T07:18:30.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.374+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0c92f0 con 0x7efebc1fa0e0 2023-11-26T07:18:30.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.378+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0b6b80 con 0x7efebc1fa0e0 2023-11-26T07:18:30.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.378+0000 7efeb8ff9640 1 -- 172.21.15.70:0/1505497567 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efeb001d460 con 0x7efebc1fa0e0 2023-11-26T07:18:30.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.378+0000 7efeb8ff9640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efea80664a0 0x7efea8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.378+0000 7efeb8ff9640 1 -- 172.21.15.70:0/1505497567 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efeb0083da0 con 0x7efebc1fa0e0 2023-11-26T07:18:30.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.378+0000 7efebbfff640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efea80664a0 0x7efea8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.378+0000 7efebbfff640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efea80664a0 0x7efea8068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efeac0af000 tx=0x7efeac0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.382+0000 7efeb8ff9640 1 -- 172.21.15.70:0/1505497567 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efeb00512b0 con 0x7efebc1fa0e0 2023-11-26T07:18:30.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.530+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efebc067680 con 0x7efebc1fa0e0 2023-11-26T07:18:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.530+0000 7efeb8ff9640 1 -- 172.21.15.70:0/1505497567 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7efeb00548d0 con 0x7efebc1fa0e0 2023-11-26T07:18:30.535 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efea80664a0 msgr2=0x7efea8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efea80664a0 0x7efea8068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efeac0af000 tx=0x7efeac0046d0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efebc1fa0e0 msgr2=0x7efebc0c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efebc1fa0e0 0x7efebc0c8be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efeb000e8c0 tx=0x7efeb000ed80 comp rx=0 tx=0).stop 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 shutdown_connections 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efea80664a0 0x7efea8068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efebc1fa0e0 0x7efebc0c8be0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efebc0b2ba0 0x7efebc0b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 --2- 172.21.15.70:0/1505497567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efea4003b40 0x7efebc15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 >> 172.21.15.70:0/1505497567 conn(0x7efebc09c550 msgr2=0x7efebc15c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 shutdown_connections 2023-11-26T07:18:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.534+0000 7efec28e4640 1 -- 172.21.15.70:0/1505497567 wait complete. 2023-11-26T07:18:30.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:30.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 Processor -- start 2023-11-26T07:18:30.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 -- start start 2023-11-26T07:18:30.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f15c81596d0 0x7f15c8071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c80ce680 0x7f15c80b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f15c80b2db0 0x7f15c815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c80b3240 con 0x7f15c81596d0 2023-11-26T07:18:30.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c80cbe00 con 0x7f15c80b2db0 2023-11-26T07:18:30.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ce5df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c806c750 con 0x7f15c80ce680 2023-11-26T07:18:30.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f15c81596d0 0x7f15c8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f15c81596d0 0x7f15c8071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59280/0 (socket says 172.21.15.70:59280) 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 -- 172.21.15.70:0/3553911231 learned_addr learned my addr 172.21.15.70:0/3553911231 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15ccb7c640 1 --2- 172.21.15.70:0/3553911231 >> v2:172.21.15.120:3300/0 conn(0x7f15c80b2db0 0x7f15c815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15bffff640 1 --2- 172.21.15.70:0/3553911231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c80ce680 0x7f15c80b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 -- 172.21.15.70:0/3553911231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c80ce680 msgr2=0x7f15c80b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 --2- 172.21.15.70:0/3553911231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c80ce680 0x7f15c80b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 -- 172.21.15.70:0/3553911231 >> v2:172.21.15.120:3300/0 conn(0x7f15c80b2db0 msgr2=0x7f15c815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 --2- 172.21.15.70:0/3553911231 >> v2:172.21.15.120:3300/0 conn(0x7f15c80b2db0 0x7f15c815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15c7fff640 1 -- 172.21.15.70:0/3553911231 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c80b3550 con 0x7f15c81596d0 2023-11-26T07:18:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.694+0000 7f15bffff640 1 --2- 172.21.15.70:0/3553911231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c80ce680 0x7f15c80b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15c7fff640 1 --2- 172.21.15.70:0/3553911231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c81596d0 0x7f15c8071850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15c8071d90 tx=0x7f15b801e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9a0b5304542286 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15c77fe640 1 -- 172.21.15.70:0/3553911231 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80a7830 con 0x7f15c81596d0 2023-11-26T07:18:30.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15c77fe640 1 -- 172.21.15.70:0/3553911231 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b80a7990 con 0x7f15c81596d0 2023-11-26T07:18:30.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15c77fe640 1 -- 172.21.15.70:0/3553911231 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80a7d20 con 0x7f15c81596d0 2023-11-26T07:18:30.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 -- 172.21.15.70:0/3553911231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c81596d0 msgr2=0x7f15c8071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 --2- 172.21.15.70:0/3553911231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c81596d0 0x7f15c8071850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15c8071d90 tx=0x7f15b801e930 comp rx=0 tx=0).stop 2023-11-26T07:18:30.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 -- 172.21.15.70:0/3553911231 shutdown_connections 2023-11-26T07:18:30.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 --2- 172.21.15.70:0/3553911231 >> v2:172.21.15.120:3300/0 conn(0x7f15c80b2db0 0x7f15c815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 --2- 172.21.15.70:0/3553911231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c80ce680 0x7f15c80b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 --2- 172.21.15.70:0/3553911231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c81596d0 0x7f15c8071850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 -- 172.21.15.70:0/3553911231 >> 172.21.15.70:0/3553911231 conn(0x7f15c806a890 msgr2=0x7f15c806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 -- 172.21.15.70:0/3553911231 shutdown_connections 2023-11-26T07:18:30.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 -- 172.21.15.70:0/3553911231 wait complete. 2023-11-26T07:18:30.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.698+0000 7f15ce5df640 1 Processor -- start 2023-11-26T07:18:30.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 -- start start 2023-11-26T07:18:30.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c80b2db0 0x7f15c815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15c80ce680 0x7f15c81489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c81596d0 0x7f15c8147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8148f20 con 0x7f15c80b2db0 2023-11-26T07:18:30.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8149150 con 0x7f15c80ce680 2023-11-26T07:18:30.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c814b390 con 0x7f15c81596d0 2023-11-26T07:18:30.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c80b2db0 0x7f15c815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c80b2db0 0x7f15c815a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59290/0 (socket says 172.21.15.70:59290) 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 -- 172.21.15.70:0/994424310 learned_addr learned my addr 172.21.15.70:0/994424310 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15bffff640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15c80ce680 0x7f15c81489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ccb7c640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c81596d0 0x7f15c8147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 -- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c81596d0 msgr2=0x7f15c8147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c81596d0 0x7f15c8147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 -- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15c80ce680 msgr2=0x7f15c81489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15c80ce680 0x7f15c81489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 -- 172.21.15.70:0/994424310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80094d0 con 0x7f15c80b2db0 2023-11-26T07:18:30.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c7fff640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c80b2db0 0x7f15c815a170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f15b80b2040 tx=0x7f15b801b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c57fa640 1 -- 172.21.15.70:0/994424310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80af850 con 0x7f15c80b2db0 2023-11-26T07:18:30.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c57fa640 1 -- 172.21.15.70:0/994424310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b80af9b0 con 0x7f15c80b2db0 2023-11-26T07:18:30.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c814b670 con 0x7f15c80b2db0 2023-11-26T07:18:30.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15c57fa640 1 -- 172.21.15.70:0/994424310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80afd60 con 0x7f15c80b2db0 2023-11-26T07:18:30.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c81481e0 con 0x7f15c80b2db0 2023-11-26T07:18:30.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.702+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c8067680 con 0x7f15c80b2db0 2023-11-26T07:18:30.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.706+0000 7f15c57fa640 1 -- 172.21.15.70:0/994424310 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15b80ba480 con 0x7f15c80b2db0 2023-11-26T07:18:30.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.706+0000 7f15c57fa640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f15a8066470 0x7f15a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:30.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.706+0000 7f15c57fa640 1 -- 172.21.15.70:0/994424310 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15b8120fb0 con 0x7f15c80b2db0 2023-11-26T07:18:30.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.706+0000 7f15bffff640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f15a8066470 0x7f15a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:30.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.706+0000 7f15bffff640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f15a8066470 0x7f15a8068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f15c81f4c20 tx=0x7f15b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:30.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.710+0000 7f15c57fa640 1 -- 172.21.15.70:0/994424310 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15b80ee4b0 con 0x7f15c80b2db0 2023-11-26T07:18:30.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15c8071ba0 con 0x7f15c80b2db0 2023-11-26T07:18:30.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15c57fa640 1 -- 172.21.15.70:0/994424310 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15b80f1ad0 con 0x7f15c80b2db0 2023-11-26T07:18:30.865 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f15a8066470 msgr2=0x7f15a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f15a8066470 0x7f15a8068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f15c81f4c20 tx=0x7f15b0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:30.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c80b2db0 msgr2=0x7f15c815a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c80b2db0 0x7f15c815a170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f15b80b2040 tx=0x7f15b801b6d0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 shutdown_connections 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f15c81596d0 0x7f15c8147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15c80ce680 0x7f15c81489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f15a8066470 0x7f15a8068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 --2- 172.21.15.70:0/994424310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15c80b2db0 0x7f15c815a170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 >> 172.21.15.70:0/994424310 conn(0x7f15c806a890 msgr2=0x7f15c806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 shutdown_connections 2023-11-26T07:18:30.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:30.862+0000 7f15ce5df640 1 -- 172.21.15.70:0/994424310 wait complete. 2023-11-26T07:18:30.885 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:31.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f696beea640 1 Processor -- start 2023-11-26T07:18:31.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f696beea640 1 -- start start 2023-11-26T07:18:31.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f696beea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f69640cf990 0x7f69640708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f696beea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6964162080 con 0x7f696414b1e0 2023-11-26T07:18:31.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f696beea640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6964161d70 con 0x7f6964070e00 2023-11-26T07:18:31.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f696beea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696414b5c0 con 0x7f69640cf990 2023-11-26T07:18:31.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f6969485640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f69640cf990 0x7f69640708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f6969c86640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f696414b1e0 0x7f69640cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53776/0 (socket says 172.21.15.70:53776) 2023-11-26T07:18:31.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f6969c86640 1 -- 172.21.15.70:0/1787332749 learned_addr learned my addr 172.21.15.70:0/1787332749 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:31.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f6969485640 1 -- 172.21.15.70:0/1787332749 >> v1:172.21.15.120:6789/0 conn(0x7f6964070e00 legacy=0x7f6964162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:31.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f6969485640 1 -- 172.21.15.70:0/1787332749 >> v1:172.21.15.70:6789/0 conn(0x7f696414b1e0 legacy=0x7f69640cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.022+0000 7f6969485640 1 -- 172.21.15.70:0/1787332749 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964071580 con 0x7f69640cf990 2023-11-26T07:18:31.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f6969485640 1 --2- 172.21.15.70:0/1787332749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69640cf990 0x7f69640708c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69540097c0 tx=0x7f695401c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10a14afd583d442 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f6968c84640 1 -- 172.21.15.70:0/1787332749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540ab600 con 0x7f69640cf990 2023-11-26T07:18:31.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f6968c84640 1 -- 172.21.15.70:0/1787332749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69540a7050 con 0x7f69640cf990 2023-11-26T07:18:31.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f6968c84640 1 -- 172.21.15.70:0/1787332749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69540ab980 con 0x7f69640cf990 2023-11-26T07:18:31.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f696beea640 1 -- 172.21.15.70:0/1787332749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69640cf990 msgr2=0x7f69640708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f696beea640 1 --2- 172.21.15.70:0/1787332749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69640cf990 0x7f69640708c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69540097c0 tx=0x7f695401c2a0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f696beea640 1 -- 172.21.15.70:0/1787332749 shutdown_connections 2023-11-26T07:18:31.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f696beea640 1 --2- 172.21.15.70:0/1787332749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f69640cf990 0x7f69640708c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f696beea640 1 -- 172.21.15.70:0/1787332749 >> 172.21.15.70:0/1787332749 conn(0x7f696406a890 msgr2=0x7f696406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f696beea640 1 -- 172.21.15.70:0/1787332749 shutdown_connections 2023-11-26T07:18:31.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.026+0000 7f696beea640 1 -- 172.21.15.70:0/1787332749 wait complete. 2023-11-26T07:18:31.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 Processor -- start 2023-11-26T07:18:31.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 -- start start 2023-11-26T07:18:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6964070e00 0x7f6964141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69640cf990 0x7f696413e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f696414b1e0 0x7f696413ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6964148890 con 0x7f6964070e00 2023-11-26T07:18:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69641419f0 con 0x7f69640cf990 2023-11-26T07:18:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640af800 con 0x7f696414b1e0 2023-11-26T07:18:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6964070e00 0x7f6964141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6964070e00 0x7f6964141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59306/0 (socket says 172.21.15.70:59306) 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 -- 172.21.15.70:0/1207501571 learned_addr learned my addr 172.21.15.70:0/1207501571 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969485640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69640cf990 0x7f696413e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696a487640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f696414b1e0 0x7f696413ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 -- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f696414b1e0 msgr2=0x7f696413ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f696414b1e0 0x7f696413ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 -- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69640cf990 msgr2=0x7f696413e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69640cf990 0x7f696413e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 -- 172.21.15.70:0/1207501571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954009420 con 0x7f6964070e00 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969485640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69640cf990 0x7f696413e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696a487640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f696414b1e0 0x7f696413ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f6969c86640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6964070e00 0x7f6964141310 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f696000c780 tx=0x7f696000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f695a7fc640 1 -- 172.21.15.70:0/1207501571 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69600074e0 con 0x7f6964070e00 2023-11-26T07:18:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f695a7fc640 1 -- 172.21.15.70:0/1207501571 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6960007640 con 0x7f6964070e00 2023-11-26T07:18:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69640af240 con 0x7f6964070e00 2023-11-26T07:18:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f695a7fc640 1 -- 172.21.15.70:0/1207501571 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960004a30 con 0x7f6964070e00 2023-11-26T07:18:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.030+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69640b0db0 con 0x7f6964070e00 2023-11-26T07:18:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.034+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696413f160 con 0x7f6964070e00 2023-11-26T07:18:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.034+0000 7f695a7fc640 1 -- 172.21.15.70:0/1207501571 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6960004b90 con 0x7f6964070e00 2023-11-26T07:18:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.034+0000 7f695a7fc640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6948066470 0x7f6948068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.034+0000 7f695a7fc640 1 -- 172.21.15.70:0/1207501571 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69600833c0 con 0x7f6964070e00 2023-11-26T07:18:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.034+0000 7f6969485640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6948066470 0x7f6948068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.034+0000 7f6969485640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6948066470 0x7f6948068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69540ad000 tx=0x7f6954008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.038+0000 7f695a7fc640 1 -- 172.21.15.70:0/1207501571 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69600507b0 con 0x7f6964070e00 2023-11-26T07:18:31.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6964067680 con 0x7f6964070e00 2023-11-26T07:18:31.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f695a7fc640 1 -- 172.21.15.70:0/1207501571 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6960018020 con 0x7f6964070e00 2023-11-26T07:18:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6948066470 msgr2=0x7f6948068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6948066470 0x7f6948068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69540ad000 tx=0x7f6954008040 comp rx=0 tx=0).stop 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6964070e00 msgr2=0x7f6964141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6964070e00 0x7f6964141310 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f696000c780 tx=0x7f696000cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 shutdown_connections 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f696414b1e0 0x7f696413ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69640cf990 0x7f696413e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6948066470 0x7f6948068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 --2- 172.21.15.70:0/1207501571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6964070e00 0x7f6964141310 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 >> 172.21.15.70:0/1207501571 conn(0x7f696406a890 msgr2=0x7f69640cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 shutdown_connections 2023-11-26T07:18:31.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.190+0000 7f696beea640 1 -- 172.21.15.70:0/1207501571 wait complete. 2023-11-26T07:18:31.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:31.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9390ec9640 1 Processor -- start 2023-11-26T07:18:31.506 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9390ec9640 1 -- start start 2023-11-26T07:18:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9390ec9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f938c0cf990 0x7f938c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9390ec9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c06c520 con 0x7f938c15f4e0 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9390ec9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c06c800 con 0x7f938c13e290 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9390ec9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c06cae0 con 0x7f938c0cf990 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f938ad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f938c15f4e0 0x7f938c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53786/0 (socket says 172.21.15.70:53786) 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f938ad9d640 1 -- 172.21.15.70:0/1044860856 learned_addr learned my addr 172.21.15.70:0/1044860856 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9381d9b640 1 --2- 172.21.15.70:0/1044860856 >> v2:172.21.15.120:3300/0 conn(0x7f938c0cf990 0x7f938c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9389d9b640 1 -- 172.21.15.70:0/1044860856 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739631381 0 0) 0x7f938c06c520 con 0x7f938c15f4e0 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.346+0000 7f9389d9b640 1 -- 172.21.15.70:0/1044860856 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9378003530 con 0x7f938c15f4e0 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9381d9b640 1 -- 172.21.15.70:0/1044860856 >> v1:172.21.15.120:6789/0 conn(0x7f938c13e290 legacy=0x7f938c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9381d9b640 1 -- 172.21.15.70:0/1044860856 >> v1:172.21.15.70:6789/0 conn(0x7f938c15f4e0 legacy=0x7f938c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9381d9b640 1 -- 172.21.15.70:0/1044860856 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c06cdc0 con 0x7f938c0cf990 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9381d9b640 1 --2- 172.21.15.70:0/1044860856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0cf990 0x7f938c15efa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93740097c0 tx=0x7f937401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc0db0f95d87a2b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9389d9b640 1 -- 172.21.15.70:0/1044860856 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93740ab670 con 0x7f938c0cf990 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9389d9b640 1 -- 172.21.15.70:0/1044860856 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93740ab7d0 con 0x7f938c0cf990 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9389d9b640 1 -- 172.21.15.70:0/1044860856 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93740abb60 con 0x7f938c0cf990 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9390ec9640 1 -- 172.21.15.70:0/1044860856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0cf990 msgr2=0x7f938c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9390ec9640 1 --2- 172.21.15.70:0/1044860856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0cf990 0x7f938c15efa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93740097c0 tx=0x7f937401c450 comp rx=0 tx=0).stop 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9390ec9640 1 -- 172.21.15.70:0/1044860856 shutdown_connections 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9390ec9640 1 --2- 172.21.15.70:0/1044860856 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c0cf990 0x7f938c15efa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.350+0000 7f9390ec9640 1 -- 172.21.15.70:0/1044860856 >> 172.21.15.70:0/1044860856 conn(0x7f938c06a890 msgr2=0x7f938c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 -- 172.21.15.70:0/1044860856 shutdown_connections 2023-11-26T07:18:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 -- 172.21.15.70:0/1044860856 wait complete. 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 Processor -- start 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 -- start start 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c0cf990 0x7f938c1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f938c13e290 0x7f938c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c15f4e0 0x7f938c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c131650 con 0x7f938c0cf990 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c15b510 con 0x7f938c15f4e0 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9390ec9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c130ad0 con 0x7f938c13e290 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c0cf990 0x7f938c1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c0cf990 0x7f938c1514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59312/0 (socket says 172.21.15.70:59312) 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 -- 172.21.15.70:0/866642759 learned_addr learned my addr 172.21.15.70:0/866642759 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f9381d9b640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f938c13e290 0x7f938c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938ad9d640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c15f4e0 0x7f938c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 -- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f938c13e290 msgr2=0x7f938c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f938c13e290 0x7f938c15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 -- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c15f4e0 msgr2=0x7f938c15a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c15f4e0 0x7f938c15a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.354+0000 7f938a59c640 1 -- 172.21.15.70:0/866642759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374009420 con 0x7f938c0cf990 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f938a59c640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c0cf990 0x7f938c1514b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f937c00c7f0 tx=0x7f937c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f93837fe640 1 -- 172.21.15.70:0/866642759 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c003b80 con 0x7f938c0cf990 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f93837fe640 1 -- 172.21.15.70:0/866642759 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c003ce0 con 0x7f938c0cf990 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f93837fe640 1 -- 172.21.15.70:0/866642759 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00aa90 con 0x7f938c0cf990 2023-11-26T07:18:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c130db0 con 0x7f938c0cf990 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c131370 con 0x7f938c0cf990 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c067680 con 0x7f938c0cf990 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f93837fe640 1 -- 172.21.15.70:0/866642759 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f937c00abf0 con 0x7f938c0cf990 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f93837fe640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f936c066470 0x7f936c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f93837fe640 1 -- 172.21.15.70:0/866642759 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f937c083c10 con 0x7f938c0cf990 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.358+0000 7f9381d9b640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f936c066470 0x7f936c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.362+0000 7f9381d9b640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f936c066470 0x7f936c068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93740af000 tx=0x7f93740a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.362+0000 7f93837fe640 1 -- 172.21.15.70:0/866642759 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f937c051130 con 0x7f938c0cf990 2023-11-26T07:18:31.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.514+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f938c06df50 con 0x7f938c0cf990 2023-11-26T07:18:31.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.514+0000 7f93837fe640 1 -- 172.21.15.70:0/866642759 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f937c054750 con 0x7f938c0cf990 2023-11-26T07:18:31.518 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:31.518 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f936c066470 msgr2=0x7f936c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f936c066470 0x7f936c068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93740af000 tx=0x7f93740a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c0cf990 msgr2=0x7f938c1514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c0cf990 0x7f938c1514b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f937c00c7f0 tx=0x7f937c00ccb0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 shutdown_connections 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f938c15f4e0 0x7f938c15a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f938c13e290 0x7f938c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f936c066470 0x7f936c068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 --2- 172.21.15.70:0/866642759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c0cf990 0x7f938c1514b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 >> 172.21.15.70:0/866642759 conn(0x7f938c06a890 msgr2=0x7f938c139b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 shutdown_connections 2023-11-26T07:18:31.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.518+0000 7f9390ec9640 1 -- 172.21.15.70:0/866642759 wait complete. 2023-11-26T07:18:31.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:31.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:31.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd0a21a1640 1 Processor -- start 2023-11-26T07:18:31.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd0a21a1640 1 -- start start 2023-11-26T07:18:31.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd0a21a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd09c0cd610 0x7fd09c071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd0a21a1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c071eb0 con 0x7fd09c070ba0 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd0a21a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c15d970 con 0x7fd09c1614b0 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd0a21a1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c15dc30 con 0x7fd09c0cd610 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd09bfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd09c070ba0 0x7fd09c070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53788/0 (socket says 172.21.15.70:53788) 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd09bfff640 1 -- 172.21.15.70:0/3182570267 learned_addr learned my addr 172.21.15.70:0/3182570267 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd093fff640 1 --2- 172.21.15.70:0/3182570267 >> v2:172.21.15.120:3300/0 conn(0x7fd09c0cd610 0x7fd09c071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd09affd640 1 -- 172.21.15.70:0/3182570267 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922036245 0 0) 0x7fd09c071eb0 con 0x7fd09c070ba0 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd09affd640 1 -- 172.21.15.70:0/3182570267 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd088003530 con 0x7fd09c070ba0 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd093fff640 1 -- 172.21.15.70:0/3182570267 >> v1:172.21.15.120:6789/0 conn(0x7fd09c1614b0 legacy=0x7fd09c161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd093fff640 1 -- 172.21.15.70:0/3182570267 >> v1:172.21.15.70:6789/0 conn(0x7fd09c070ba0 legacy=0x7fd09c070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.678+0000 7fd093fff640 1 -- 172.21.15.70:0/3182570267 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c15df10 con 0x7fd09c0cd610 2023-11-26T07:18:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd093fff640 1 --2- 172.21.15.70:0/3182570267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 0x7fd09c071970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0840097c0 tx=0x7fd08401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb33b054104fd63 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd09affd640 1 -- 172.21.15.70:0/3182570267 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840ab650 con 0x7fd09c0cd610 2023-11-26T07:18:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd09affd640 1 -- 172.21.15.70:0/3182570267 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0840ab7b0 con 0x7fd09c0cd610 2023-11-26T07:18:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd09affd640 1 -- 172.21.15.70:0/3182570267 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840abb40 con 0x7fd09c0cd610 2023-11-26T07:18:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3182570267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 msgr2=0x7fd09c071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3182570267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 0x7fd09c071970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0840097c0 tx=0x7fd08401c450 comp rx=0 tx=0).stop 2023-11-26T07:18:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3182570267 shutdown_connections 2023-11-26T07:18:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3182570267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 0x7fd09c071970 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3182570267 >> 172.21.15.70:0/3182570267 conn(0x7fd09c0cf710 msgr2=0x7fd09c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3182570267 shutdown_connections 2023-11-26T07:18:31.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.682+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3182570267 wait complete. 2023-11-26T07:18:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 Processor -- start 2023-11-26T07:18:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 -- start start 2023-11-26T07:18:31.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd09c070ba0 0x7fd09c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 0x7fd09c15d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd09c1614b0 0x7fd09c14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c150800 con 0x7fd09c070ba0 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c15c040 con 0x7fd09c0cd610 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c14dc90 con 0x7fd09c1614b0 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd09c070ba0 0x7fd09c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd09c070ba0 0x7fd09c155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59326/0 (socket says 172.21.15.70:59326) 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 -- 172.21.15.70:0/3684288809 learned_addr learned my addr 172.21.15.70:0/3684288809 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd093fff640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 0x7fd09c15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09bfff640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd09c1614b0 0x7fd09c14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 -- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd09c1614b0 msgr2=0x7fd09c14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd09c1614b0 0x7fd09c14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 -- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 msgr2=0x7fd09c15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 0x7fd09c15d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 -- 172.21.15.70:0/3684288809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084009420 con 0x7fd09c070ba0 2023-11-26T07:18:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09bfff640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd09c1614b0 0x7fd09c14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd09b7fe640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd09c070ba0 0x7fd09c155ba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00c500 tx=0x7fd08c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd098ff9640 1 -- 172.21.15.70:0/3684288809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c005220 con 0x7fd09c070ba0 2023-11-26T07:18:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd098ff9640 1 -- 172.21.15.70:0/3684288809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c005380 con 0x7fd09c070ba0 2023-11-26T07:18:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd098ff9640 1 -- 172.21.15.70:0/3684288809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c007270 con 0x7fd09c070ba0 2023-11-26T07:18:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c15c2e0 con 0x7fd09c070ba0 2023-11-26T07:18:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c15c8a0 con 0x7fd09c070ba0 2023-11-26T07:18:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.686+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c067680 con 0x7fd09c070ba0 2023-11-26T07:18:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.690+0000 7fd098ff9640 1 -- 172.21.15.70:0/3684288809 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd08c0073d0 con 0x7fd09c070ba0 2023-11-26T07:18:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.690+0000 7fd098ff9640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd07c066470 0x7fd07c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.690+0000 7fd098ff9640 1 -- 172.21.15.70:0/3684288809 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd08c083800 con 0x7fd09c070ba0 2023-11-26T07:18:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.690+0000 7fd093fff640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd07c066470 0x7fd07c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.690+0000 7fd093fff640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd07c066470 0x7fd07c068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0840af000 tx=0x7fd0840a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.694+0000 7fd098ff9640 1 -- 172.21.15.70:0/3684288809 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd08c050c70 con 0x7fd09c070ba0 2023-11-26T07:18:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.846+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd09c067ef0 con 0x7fd09c070ba0 2023-11-26T07:18:31.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.846+0000 7fd098ff9640 1 -- 172.21.15.70:0/3684288809 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd08c054290 con 0x7fd09c070ba0 2023-11-26T07:18:31.851 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:31.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd07c066470 msgr2=0x7fd07c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd07c066470 0x7fd07c068930 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0840af000 tx=0x7fd0840a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd09c070ba0 msgr2=0x7fd09c155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd09c070ba0 0x7fd09c155ba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00c500 tx=0x7fd08c00c9c0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 shutdown_connections 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd09c1614b0 0x7fd09c14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd09c0cd610 0x7fd09c15d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd07c066470 0x7fd07c068930 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 --2- 172.21.15.70:0/3684288809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd09c070ba0 0x7fd09c155ba0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 >> 172.21.15.70:0/3684288809 conn(0x7fd09c0cf710 msgr2=0x7fd09c15f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:31.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 shutdown_connections 2023-11-26T07:18:31.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:31.850+0000 7fd0a21a1640 1 -- 172.21.15.70:0/3684288809 wait complete. 2023-11-26T07:18:31.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:32.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff781ff5640 1 Processor -- start 2023-11-26T07:18:32.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff781ff5640 1 -- start start 2023-11-26T07:18:32.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff781ff5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c0cd610 0x7ff77c071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff781ff5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff77c070ba0 0x7ff77c071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff781ff5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c071eb0 con 0x7ff77c1614b0 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff781ff5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c071550 con 0x7ff77c070ba0 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff781ff5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c15d970 con 0x7ff77c0cd610 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff77bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff77c070ba0 0x7ff77c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff77bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff77c070ba0 0x7ff77c071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59336/0 (socket says 172.21.15.70:59336) 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff77bfff640 1 -- 172.21.15.70:0/1594726866 learned_addr learned my addr 172.21.15.70:0/1594726866 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff773fff640 1 --2- 172.21.15.70:0/1594726866 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c0cd610 0x7ff77c071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff77bfff640 1 -- 172.21.15.70:0/1594726866 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c0cd610 msgr2=0x7ff77c071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff77bfff640 1 --2- 172.21.15.70:0/1594726866 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c0cd610 0x7ff77c071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff77bfff640 1 -- 172.21.15.70:0/1594726866 >> v1:172.21.15.120:6789/0 conn(0x7ff77c1614b0 legacy=0x7ff77c161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff77bfff640 1 -- 172.21.15.70:0/1594726866 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c15dc30 con 0x7ff77c070ba0 2023-11-26T07:18:32.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.010+0000 7ff773fff640 1 --2- 172.21.15.70:0/1594726866 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c0cd610 0x7ff77c071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:32.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff77bfff640 1 --2- 172.21.15.70:0/1594726866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c070ba0 0x7ff77c071010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e50 tx=0x7ff77401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb812c8dcd275f2a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff77affd640 1 -- 172.21.15.70:0/1594726866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740a58e0 con 0x7ff77c070ba0 2023-11-26T07:18:32.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff77affd640 1 -- 172.21.15.70:0/1594726866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7740a5a40 con 0x7ff77c070ba0 2023-11-26T07:18:32.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff77affd640 1 -- 172.21.15.70:0/1594726866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740a5dd0 con 0x7ff77c070ba0 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 -- 172.21.15.70:0/1594726866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c070ba0 msgr2=0x7ff77c071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1594726866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c070ba0 0x7ff77c071010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff774009e50 tx=0x7ff77401ca10 comp rx=0 tx=0).stop 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 -- 172.21.15.70:0/1594726866 shutdown_connections 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1594726866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c070ba0 0x7ff77c071010 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1594726866 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c0cd610 0x7ff77c071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 -- 172.21.15.70:0/1594726866 >> 172.21.15.70:0/1594726866 conn(0x7ff77c0cf710 msgr2=0x7ff77c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 -- 172.21.15.70:0/1594726866 shutdown_connections 2023-11-26T07:18:32.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 -- 172.21.15.70:0/1594726866 wait complete. 2023-11-26T07:18:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.014+0000 7ff781ff5640 1 Processor -- start 2023-11-26T07:18:32.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 -- start start 2023-11-26T07:18:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c070ba0 0x7ff77c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c0cd610 0x7ff77c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77c1614b0 0x7ff77c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c1535a0 con 0x7ff77c0cd610 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c14f960 con 0x7ff77c1614b0 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c153200 con 0x7ff77c070ba0 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c0cd610 0x7ff77c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c0cd610 0x7ff77c14f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59348/0 (socket says 172.21.15.70:59348) 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 -- 172.21.15.70:0/1351160530 learned_addr learned my addr 172.21.15.70:0/1351160530 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff77bfff640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77c1614b0 0x7ff77c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff77b7fe640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c070ba0 0x7ff77c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 -- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c070ba0 msgr2=0x7ff77c0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c070ba0 0x7ff77c0b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 -- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77c1614b0 msgr2=0x7ff77c156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77c1614b0 0x7ff77c156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 -- 172.21.15.70:0/1351160530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774009b30 con 0x7ff77c0cd610 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff773fff640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c0cd610 0x7ff77c14f420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff76400e810 tx=0x7ff76400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff778ff9640 1 -- 172.21.15.70:0/1351160530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400c8d0 con 0x7ff77c0cd610 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff778ff9640 1 -- 172.21.15.70:0/1351160530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400ca30 con 0x7ff77c0cd610 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c150d00 con 0x7ff77c0cd610 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff778ff9640 1 -- 172.21.15.70:0/1351160530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400cde0 con 0x7ff77c0cd610 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c1512c0 con 0x7ff77c0cd610 2023-11-26T07:18:32.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.018+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c153810 con 0x7ff77c0cd610 2023-11-26T07:18:32.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.022+0000 7ff778ff9640 1 -- 172.21.15.70:0/1351160530 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff764013410 con 0x7ff77c0cd610 2023-11-26T07:18:32.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.022+0000 7ff778ff9640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff75c066470 0x7ff75c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.022+0000 7ff778ff9640 1 -- 172.21.15.70:0/1351160530 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff764083be0 con 0x7ff77c0cd610 2023-11-26T07:18:32.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.022+0000 7ff77b7fe640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff75c066470 0x7ff75c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.022+0000 7ff77b7fe640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff75c066470 0x7ff75c068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff77c155cc0 tx=0x7ff76c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.026+0000 7ff778ff9640 1 -- 172.21.15.70:0/1351160530 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff764051100 con 0x7ff77c0cd610 2023-11-26T07:18:32.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff77c067680 con 0x7ff77c0cd610 2023-11-26T07:18:32.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff778ff9640 1 -- 172.21.15.70:0/1351160530 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff764054720 con 0x7ff77c0cd610 2023-11-26T07:18:32.177 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:32.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff75c066470 msgr2=0x7ff75c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff75c066470 0x7ff75c068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff77c155cc0 tx=0x7ff76c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:32.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c0cd610 msgr2=0x7ff77c14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c0cd610 0x7ff77c14f420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff76400e810 tx=0x7ff76400ecd0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 shutdown_connections 2023-11-26T07:18:32.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff75c066470 0x7ff75c068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff77c0cd610 0x7ff77c14f420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77c1614b0 0x7ff77c156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 --2- 172.21.15.70:0/1351160530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff77c070ba0 0x7ff77c0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 >> 172.21.15.70:0/1351160530 conn(0x7ff77c0cf710 msgr2=0x7ff77c1679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 shutdown_connections 2023-11-26T07:18:32.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.174+0000 7ff781ff5640 1 -- 172.21.15.70:0/1351160530 wait complete. 2023-11-26T07:18:32.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:32.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.334+0000 7f131305a640 1 Processor -- start 2023-11-26T07:18:32.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.334+0000 7f131305a640 1 -- start start 2023-11-26T07:18:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f131305a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f130c070ba0 0x7f130c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f131305a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f131305a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c0cd610 con 0x7f130c161cf0 2023-11-26T07:18:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f131305a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0cd8f0 con 0x7f130c070ba0 2023-11-26T07:18:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f131305a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c161210 con 0x7f130c0cdd10 2023-11-26T07:18:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1310df6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f130c070ba0 0x7f130c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f13115f7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1303fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f130c161cf0 0x7f130c070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:55532/0 (socket says 172.21.15.70:55532) 2023-11-26T07:18:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1303fff640 1 -- 172.21.15.70:0/2989039979 learned_addr learned my addr 172.21.15.70:0/2989039979 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1310df6640 1 -- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 msgr2=0x7f130c06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1310df6640 1 --2- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1310df6640 1 -- 172.21.15.70:0/2989039979 >> v1:172.21.15.120:6789/0 conn(0x7f130c161cf0 legacy=0x7f130c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1310df6640 1 -- 172.21.15.70:0/2989039979 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c1614f0 con 0x7f130c070ba0 2023-11-26T07:18:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f13115f7640 1 --2- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.338+0000 7f1310df6640 1 --2- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c06bae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13080097c0 tx=0x7f130801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91c7556224523567 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f13037fe640 1 -- 172.21.15.70:0/2989039979 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080a6040 con 0x7f130c070ba0 2023-11-26T07:18:32.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f13037fe640 1 -- 172.21.15.70:0/2989039979 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080aa600 con 0x7f130c070ba0 2023-11-26T07:18:32.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f13037fe640 1 -- 172.21.15.70:0/2989039979 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080aa990 con 0x7f130c070ba0 2023-11-26T07:18:32.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 msgr2=0x7f130c06bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 --2- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c06bae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13080097c0 tx=0x7f130801c480 comp rx=0 tx=0).stop 2023-11-26T07:18:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- 172.21.15.70:0/2989039979 shutdown_connections 2023-11-26T07:18:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 --2- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 --2- 172.21.15.70:0/2989039979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c06bae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- 172.21.15.70:0/2989039979 >> 172.21.15.70:0/2989039979 conn(0x7f130c0cf710 msgr2=0x7f130c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- 172.21.15.70:0/2989039979 shutdown_connections 2023-11-26T07:18:32.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- 172.21.15.70:0/2989039979 wait complete. 2023-11-26T07:18:32.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 Processor -- start 2023-11-26T07:18:32.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- start start 2023-11-26T07:18:32.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f130c161cf0 0x7f130c14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1556d0 con 0x7f130c161cf0 2023-11-26T07:18:32.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1f6300 con 0x7f130c070ba0 2023-11-26T07:18:32.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.342+0000 7f131305a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1f65e0 con 0x7f130c0cdd10 2023-11-26T07:18:32.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f130c161cf0 0x7f130c14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f130c161cf0 0x7f130c14ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59362/0 (socket says 172.21.15.70:59362) 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 -- 172.21.15.70:0/2928542913 learned_addr learned my addr 172.21.15.70:0/2928542913 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f1310df6640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f1303fff640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 -- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 msgr2=0x7f130c14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c14e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 -- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 msgr2=0x7f130c14a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c14a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 -- 172.21.15.70:0/2928542913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009a70 con 0x7f130c161cf0 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f1310df6640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:32.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13115f7640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f130c161cf0 0x7f130c14ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f130400efc0 tx=0x7f1304009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13017fa640 1 -- 172.21.15.70:0/2928542913 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304009d70 con 0x7f130c161cf0 2023-11-26T07:18:32.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13017fa640 1 -- 172.21.15.70:0/2928542913 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130400f040 con 0x7f130c161cf0 2023-11-26T07:18:32.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13017fa640 1 -- 172.21.15.70:0/2928542913 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040039a0 con 0x7f130c161cf0 2023-11-26T07:18:32.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1308009420 con 0x7f130c161cf0 2023-11-26T07:18:32.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c1f6ba0 con 0x7f130c161cf0 2023-11-26T07:18:32.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c067680 con 0x7f130c161cf0 2023-11-26T07:18:32.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.346+0000 7f13017fa640 1 -- 172.21.15.70:0/2928542913 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13040144a0 con 0x7f130c161cf0 2023-11-26T07:18:32.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.350+0000 7f13017fa640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f12f80664a0 0x7f12f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.350+0000 7f13017fa640 1 -- 172.21.15.70:0/2928542913 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13040848f0 con 0x7f130c161cf0 2023-11-26T07:18:32.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.350+0000 7f1310df6640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f12f80664a0 0x7f12f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.350+0000 7f1310df6640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f12f80664a0 0x7f12f8068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13080ae000 tx=0x7f13080b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.354+0000 7f13017fa640 1 -- 172.21.15.70:0/2928542913 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1304051eb0 con 0x7f130c161cf0 2023-11-26T07:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f130c0ce260 con 0x7f130c161cf0 2023-11-26T07:18:32.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f13017fa640 1 -- 172.21.15.70:0/2928542913 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13040180a0 con 0x7f130c161cf0 2023-11-26T07:18:32.506 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:32.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f12f80664a0 msgr2=0x7f12f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f12f80664a0 0x7f12f8068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13080ae000 tx=0x7f13080b5040 comp rx=0 tx=0).stop 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f130c161cf0 msgr2=0x7f130c14ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f130c161cf0 0x7f130c14ec40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f130400efc0 tx=0x7f1304009f90 comp rx=0 tx=0).stop 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 shutdown_connections 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f12f80664a0 0x7f12f8068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f130c161cf0 0x7f130c14ec40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f130c0cdd10 0x7f130c14e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 --2- 172.21.15.70:0/2928542913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c070ba0 0x7f130c14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.502+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 >> 172.21.15.70:0/2928542913 conn(0x7f130c0cf710 msgr2=0x7f130c160450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.506+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 shutdown_connections 2023-11-26T07:18:32.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.506+0000 7f131305a640 1 -- 172.21.15.70:0/2928542913 wait complete. 2023-11-26T07:18:32.591 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is in failed state and validate the reason 2023-11-26T07:18:32.591 INFO:tasks.cephfs_test_runner:test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:18:32.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:32.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f8526f80640 1 Processor -- start 2023-11-26T07:18:32.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f8526f80640 1 -- start start 2023-11-26T07:18:32.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f8526f80640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85200cf710 0x7f85200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f8526f80640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85200cc730 con 0x7f85200cf280 2023-11-26T07:18:32.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f8526f80640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8520070ee0 con 0x7f8520143ac0 2023-11-26T07:18:32.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f8526f80640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8520143ea0 con 0x7f85200cf710 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f851ffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f85200cf280 0x7f85200cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53796/0 (socket says 172.21.15.70:53796) 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f851ffff640 1 -- 172.21.15.70:0/258057451 learned_addr learned my addr 172.21.15.70:0/258057451 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f852551d640 1 --2- 172.21.15.70:0/258057451 >> v2:172.21.15.120:3300/0 conn(0x7f85200cf710 0x7f85200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f851f7fe640 1 -- 172.21.15.70:0/258057451 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088505525 0 0) 0x7f85200cc730 con 0x7f85200cf280 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f851f7fe640 1 -- 172.21.15.70:0/258057451 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510005740 con 0x7f85200cf280 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f852551d640 1 -- 172.21.15.70:0/258057451 >> v1:172.21.15.120:6789/0 conn(0x7f8520143ac0 legacy=0x7f8520070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f852551d640 1 -- 172.21.15.70:0/258057451 >> v1:172.21.15.70:6789/0 conn(0x7f85200cf280 legacy=0x7f85200cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.726+0000 7f852551d640 1 -- 172.21.15.70:0/258057451 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85200711c0 con 0x7f85200cf710 2023-11-26T07:18:32.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f852551d640 1 --2- 172.21.15.70:0/258057451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 0x7f85200cd8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8518009d90 tx=0x7f851801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b429a42d630f83a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f851f7fe640 1 -- 172.21.15.70:0/258057451 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180a5a10 con 0x7f85200cf710 2023-11-26T07:18:32.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f851f7fe640 1 -- 172.21.15.70:0/258057451 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85180a5b70 con 0x7f85200cf710 2023-11-26T07:18:32.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f851f7fe640 1 -- 172.21.15.70:0/258057451 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180ad440 con 0x7f85200cf710 2023-11-26T07:18:32.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f8526f80640 1 -- 172.21.15.70:0/258057451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 msgr2=0x7f85200cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f8526f80640 1 --2- 172.21.15.70:0/258057451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 0x7f85200cd8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8518009d90 tx=0x7f851801c950 comp rx=0 tx=0).stop 2023-11-26T07:18:32.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f8526f80640 1 -- 172.21.15.70:0/258057451 shutdown_connections 2023-11-26T07:18:32.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f8526f80640 1 --2- 172.21.15.70:0/258057451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 0x7f85200cd8c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f8526f80640 1 -- 172.21.15.70:0/258057451 >> 172.21.15.70:0/258057451 conn(0x7f852006a890 msgr2=0x7f852006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f8526f80640 1 -- 172.21.15.70:0/258057451 shutdown_connections 2023-11-26T07:18:32.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.730+0000 7f8526f80640 1 -- 172.21.15.70:0/258057451 wait complete. 2023-11-26T07:18:32.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 Processor -- start 2023-11-26T07:18:32.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 -- start start 2023-11-26T07:18:32.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85200cf280 0x7f8520156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 0x7f852015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8520143ac0 0x7f852015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85201f51d0 con 0x7f85200cf280 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85201f54b0 con 0x7f85200cf710 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85201f5790 con 0x7f8520143ac0 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85200cf280 0x7f8520156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85200cf280 0x7f8520156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59370/0 (socket says 172.21.15.70:59370) 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 -- 172.21.15.70:0/423831146 learned_addr learned my addr 172.21.15.70:0/423831146 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f851ffff640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 0x7f852015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f852551d640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8520143ac0 0x7f852015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 -- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8520143ac0 msgr2=0x7f852015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8520143ac0 0x7f852015adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 -- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 msgr2=0x7f852015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 0x7f852015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 -- 172.21.15.70:0/423831146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518009a70 con 0x7f85200cf280 2023-11-26T07:18:32.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8524d1c640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85200cf280 0x7f8520156250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f851400c500 tx=0x7f851400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f851d7fa640 1 -- 172.21.15.70:0/423831146 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514005220 con 0x7f85200cf280 2023-11-26T07:18:32.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f851d7fa640 1 -- 172.21.15.70:0/423831146 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514005380 con 0x7f85200cf280 2023-11-26T07:18:32.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f851d7fa640 1 -- 172.21.15.70:0/423831146 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514007270 con 0x7f85200cf280 2023-11-26T07:18:32.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85201f5a70 con 0x7f85200cf280 2023-11-26T07:18:32.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85201385b0 con 0x7f85200cf280 2023-11-26T07:18:32.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.734+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8520067680 con 0x7f85200cf280 2023-11-26T07:18:32.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.738+0000 7f851d7fa640 1 -- 172.21.15.70:0/423831146 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85140073d0 con 0x7f85200cf280 2023-11-26T07:18:32.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.738+0000 7f851d7fa640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8504066470 0x7f8504068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:32.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.738+0000 7f851d7fa640 1 -- 172.21.15.70:0/423831146 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8514083800 con 0x7f85200cf280 2023-11-26T07:18:32.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.738+0000 7f851ffff640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8504066470 0x7f8504068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:32.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.738+0000 7f851ffff640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8504066470 0x7f8504068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f852015b6a0 tx=0x7f850c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:32.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.742+0000 7f851d7fa640 1 -- 172.21.15.70:0/423831146 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8514050bf0 con 0x7f85200cf280 2023-11-26T07:18:32.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.894+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8520130370 con 0x7f85200cf280 2023-11-26T07:18:32.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f851d7fa640 1 -- 172.21.15.70:0/423831146 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f8514054210 con 0x7f85200cf280 2023-11-26T07:18:32.901 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:32.901 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8504066470 msgr2=0x7f8504068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8504066470 0x7f8504068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f852015b6a0 tx=0x7f850c009040 comp rx=0 tx=0).stop 2023-11-26T07:18:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85200cf280 msgr2=0x7f8520156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85200cf280 0x7f8520156250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f851400c500 tx=0x7f851400c9c0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 shutdown_connections 2023-11-26T07:18:32.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8520143ac0 0x7f852015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85200cf710 0x7f852015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8504066470 0x7f8504068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 --2- 172.21.15.70:0/423831146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85200cf280 0x7f8520156250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:32.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 >> 172.21.15.70:0/423831146 conn(0x7f852006a890 msgr2=0x7f8520142420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:32.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 shutdown_connections 2023-11-26T07:18:32.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:32.898+0000 7f8526f80640 1 -- 172.21.15.70:0/423831146 wait complete. 2023-11-26T07:18:32.921 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:32.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:33.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.058+0000 7fcfc2491640 1 Processor -- start 2023-11-26T07:18:33.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.058+0000 7fcfc2491640 1 -- start start 2023-11-26T07:18:33.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.058+0000 7fcfc2491640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcfbc13e290 0x7fcfbc0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.058+0000 7fcfc2491640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfbc15f6b0 0x7fcfbc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.058+0000 7fcfc2491640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc15fb20 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc2491640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0cfc40 con 0x7fcfbc15f6b0 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc2491640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc06c520 con 0x7fcfbc13e290 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfbc15f6b0 0x7fcfbc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcfbc15f6b0 0x7fcfbc0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59384/0 (socket says 172.21.15.70:59384) 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfbb7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcfbc0cf7c0 0x7fcfbc15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53810/0 (socket says 172.21.15.70:53810) 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 -- 172.21.15.70:0/627941923 learned_addr learned my addr 172.21.15.70:0/627941923 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfbbfff640 1 --2- 172.21.15.70:0/627941923 >> v2:172.21.15.120:3300/0 conn(0x7fcfbc13e290 0x7fcfbc0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 -- 172.21.15.70:0/627941923 >> v2:172.21.15.120:3300/0 conn(0x7fcfbc13e290 msgr2=0x7fcfbc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 --2- 172.21.15.70:0/627941923 >> v2:172.21.15.120:3300/0 conn(0x7fcfbc13e290 0x7fcfbc0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 -- 172.21.15.70:0/627941923 >> v1:172.21.15.70:6789/0 conn(0x7fcfbc0cf7c0 legacy=0x7fcfbc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 -- 172.21.15.70:0/627941923 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc06c800 con 0x7fcfbc15f6b0 2023-11-26T07:18:33.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfbbfff640 1 --2- 172.21.15.70:0/627941923 >> v2:172.21.15.120:3300/0 conn(0x7fcfbc13e290 0x7fcfbc0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfc0a2e640 1 --2- 172.21.15.70:0/627941923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc15f6b0 0x7fcfbc0cd7b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0725a0 tx=0x7fcfb401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358ab241f350074c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfbaffd640 1 -- 172.21.15.70:0/627941923 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40a5860 con 0x7fcfbc15f6b0 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfbaffd640 1 -- 172.21.15.70:0/627941923 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb40a59c0 con 0x7fcfbc15f6b0 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.062+0000 7fcfbaffd640 1 -- 172.21.15.70:0/627941923 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40a5d50 con 0x7fcfbc15f6b0 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- 172.21.15.70:0/627941923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc15f6b0 msgr2=0x7fcfbc0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 --2- 172.21.15.70:0/627941923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc15f6b0 0x7fcfbc0cd7b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0725a0 tx=0x7fcfb401c9a0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- 172.21.15.70:0/627941923 shutdown_connections 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 --2- 172.21.15.70:0/627941923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc15f6b0 0x7fcfbc0cd7b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 --2- 172.21.15.70:0/627941923 >> v2:172.21.15.120:3300/0 conn(0x7fcfbc13e290 0x7fcfbc0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- 172.21.15.70:0/627941923 >> 172.21.15.70:0/627941923 conn(0x7fcfbc06a890 msgr2=0x7fcfbc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- 172.21.15.70:0/627941923 shutdown_connections 2023-11-26T07:18:33.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- 172.21.15.70:0/627941923 wait complete. 2023-11-26T07:18:33.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 Processor -- start 2023-11-26T07:18:33.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- start start 2023-11-26T07:18:33.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc0cf7c0 0x7fcfbc154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcfbc13e290 0x7fcfbc0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfbc15f6b0 0x7fcfbc0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc15e3f0 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0b0320 con 0x7fcfbc15f6b0 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc2491640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0b0cf0 con 0x7fcfbc13e290 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc0cf7c0 0x7fcfbc154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc0cf7c0 0x7fcfbc154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59390/0 (socket says 172.21.15.70:59390) 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfbbfff640 1 -- 172.21.15.70:0/3675537392 learned_addr learned my addr 172.21.15.70:0/3675537392 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfbb7fe640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcfbc13e290 0x7fcfbc0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.066+0000 7fcfc0a2e640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfbc15f6b0 0x7fcfbc0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfbbfff640 1 -- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcfbc13e290 msgr2=0x7fcfbc0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfbbfff640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcfbc13e290 0x7fcfbc0b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfbbfff640 1 -- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfbc15f6b0 msgr2=0x7fcfbc0b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfbbfff640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfbc15f6b0 0x7fcfbc0b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfbbfff640 1 -- 172.21.15.70:0/3675537392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009b30 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfbbfff640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc0cf7c0 0x7fcfbc154600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c7c0 tx=0x7fcfac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfb8ff9640 1 -- 172.21.15.70:0/3675537392 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac007a30 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfb8ff9640 1 -- 172.21.15.70:0/3675537392 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac007b90 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfb8ff9640 1 -- 172.21.15.70:0/3675537392 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00ce70 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc0af710 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc0afcd0 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc067680 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfb8ff9640 1 -- 172.21.15.70:0/3675537392 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfac0113f0 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfb8ff9640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcfa8066470 0x7fcfa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfb8ff9640 1 -- 172.21.15.70:0/3675537392 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfac0842d0 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.070+0000 7fcfbb7fe640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcfa8066470 0x7fcfa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.074+0000 7fcfbb7fe640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcfa8066470 0x7fcfa8068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc134490 tx=0x7fcfb0007e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.074+0000 7fcfb8ff9640 1 -- 172.21.15.70:0/3675537392 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfac051760 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfbc06df50 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfb8ff9640 1 -- 172.21.15.70:0/3675537392 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfac054d80 con 0x7fcfbc0cf7c0 2023-11-26T07:18:33.229 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:33.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcfa8066470 msgr2=0x7fcfa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcfa8066470 0x7fcfa8068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc134490 tx=0x7fcfb0007e10 comp rx=0 tx=0).stop 2023-11-26T07:18:33.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc0cf7c0 msgr2=0x7fcfbc154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc0cf7c0 0x7fcfbc154600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c7c0 tx=0x7fcfac00cc80 comp rx=0 tx=0).stop 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 shutdown_connections 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfbc15f6b0 0x7fcfbc0b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcfbc13e290 0x7fcfbc0b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcfa8066470 0x7fcfa8068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 --2- 172.21.15.70:0/3675537392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfbc0cf7c0 0x7fcfbc154600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.226+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 >> 172.21.15.70:0/3675537392 conn(0x7fcfbc06a890 msgr2=0x7fcfbc15a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.230+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 shutdown_connections 2023-11-26T07:18:33.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.230+0000 7fcfc2491640 1 -- 172.21.15.70:0/3675537392 wait complete. 2023-11-26T07:18:33.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:33.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.386+0000 7ff3eb57d640 1 Processor -- start 2023-11-26T07:18:33.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.386+0000 7ff3eb57d640 1 -- start start 2023-11-26T07:18:33.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3eb57d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff3e40b1e10 0x7ff3e415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3eb57d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff3e415df20 0x7ff3e40ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3eb57d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e415e860 con 0x7ff3e4143810 2023-11-26T07:18:33.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3eb57d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e415e3b0 con 0x7ff3e40b1e10 2023-11-26T07:18:33.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3eb57d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e40cdba0 con 0x7ff3e415df20 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3e9d7a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff3e40b1e10 0x7ff3e415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3ead7c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff3e415df20 0x7ff3e40ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3ea57b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff3e4143810 0x7ff3e4072140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:55556/0 (socket says 172.21.15.70:55556) 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3ea57b640 1 -- 172.21.15.70:0/2036464882 learned_addr learned my addr 172.21.15.70:0/2036464882 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3ead7c640 1 -- 172.21.15.70:0/2036464882 >> v2:172.21.15.70:3300/0 conn(0x7ff3e40b1e10 msgr2=0x7ff3e415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3ead7c640 1 --2- 172.21.15.70:0/2036464882 >> v2:172.21.15.70:3300/0 conn(0x7ff3e40b1e10 0x7ff3e415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3ead7c640 1 -- 172.21.15.70:0/2036464882 >> v1:172.21.15.120:6789/0 conn(0x7ff3e4143810 legacy=0x7ff3e4072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3ead7c640 1 -- 172.21.15.70:0/2036464882 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e4143bf0 con 0x7ff3e415df20 2023-11-26T07:18:33.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3e9579640 1 -- 172.21.15.70:0/2036464882 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539391579 0 0) 0x7ff3e415e860 con 0x7ff3e4143810 2023-11-26T07:18:33.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.390+0000 7ff3e9d7a640 1 --2- 172.21.15.70:0/2036464882 >> v2:172.21.15.70:3300/0 conn(0x7ff3e40b1e10 0x7ff3e415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:33.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3ead7c640 1 --2- 172.21.15.70:0/2036464882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 0x7ff3e40ce030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3e406d020 tx=0x7ff3dc01eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f47f69c3e007503 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3e9579640 1 -- 172.21.15.70:0/2036464882 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0a7ae0 con 0x7ff3e415df20 2023-11-26T07:18:33.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3e9579640 1 -- 172.21.15.70:0/2036464882 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0a7c40 con 0x7ff3e415df20 2023-11-26T07:18:33.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3e9579640 1 -- 172.21.15.70:0/2036464882 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0af440 con 0x7ff3e415df20 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 -- 172.21.15.70:0/2036464882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 msgr2=0x7ff3e40ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/2036464882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 0x7ff3e40ce030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3e406d020 tx=0x7ff3dc01eaf0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 -- 172.21.15.70:0/2036464882 shutdown_connections 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/2036464882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 0x7ff3e40ce030 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/2036464882 >> v2:172.21.15.70:3300/0 conn(0x7ff3e40b1e10 0x7ff3e415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 -- 172.21.15.70:0/2036464882 >> 172.21.15.70:0/2036464882 conn(0x7ff3e406a890 msgr2=0x7ff3e406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 -- 172.21.15.70:0/2036464882 shutdown_connections 2023-11-26T07:18:33.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 -- 172.21.15.70:0/2036464882 wait complete. 2023-11-26T07:18:33.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 Processor -- start 2023-11-26T07:18:33.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.394+0000 7ff3eb57d640 1 -- start start 2023-11-26T07:18:33.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3e40b1e10 0x7ff3e413d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3e4143810 0x7ff3e40b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 0x7ff3e40b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e41512d0 con 0x7ff3e4143810 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e4152bb0 con 0x7ff3e415df20 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e4152e90 con 0x7ff3e40b1e10 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3e4143810 0x7ff3e40b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3e4143810 0x7ff3e40b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59404/0 (socket says 172.21.15.70:59404) 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 -- 172.21.15.70:0/1161076798 learned_addr learned my addr 172.21.15.70:0/1161076798 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3ea57b640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3e40b1e10 0x7ff3e413d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3ead7c640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 0x7ff3e40b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 -- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3e40b1e10 msgr2=0x7ff3e413d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3e40b1e10 0x7ff3e413d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 -- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 msgr2=0x7ff3e40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 0x7ff3e40b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 -- 172.21.15.70:0/1161076798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4009420 con 0x7ff3e4143810 2023-11-26T07:18:33.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3e9d7a640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3e4143810 0x7ff3e40b2830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400ebe0 tx=0x7ff3d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3daffd640 1 -- 172.21.15.70:0/1161076798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400eee0 con 0x7ff3e4143810 2023-11-26T07:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3daffd640 1 -- 172.21.15.70:0/1161076798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400cc30 con 0x7ff3e4143810 2023-11-26T07:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3daffd640 1 -- 172.21.15.70:0/1161076798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4013470 con 0x7ff3e4143810 2023-11-26T07:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc009a70 con 0x7ff3e4143810 2023-11-26T07:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e4153450 con 0x7ff3e4143810 2023-11-26T07:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e4067500 con 0x7ff3e4143810 2023-11-26T07:18:33.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.398+0000 7ff3daffd640 1 -- 172.21.15.70:0/1161076798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3d40135d0 con 0x7ff3e4143810 2023-11-26T07:18:33.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.402+0000 7ff3daffd640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff3c8066470 0x7ff3c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.402+0000 7ff3daffd640 1 -- 172.21.15.70:0/1161076798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3d40841a0 con 0x7ff3e4143810 2023-11-26T07:18:33.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.402+0000 7ff3ea57b640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff3c8066470 0x7ff3c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.402+0000 7ff3ea57b640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff3c8066470 0x7ff3c8068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0007fd0 tx=0x7ff3e0007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.406+0000 7ff3daffd640 1 -- 172.21.15.70:0/1161076798 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3d40515a0 con 0x7ff3e4143810 2023-11-26T07:18:33.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.554+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3e40b4010 con 0x7ff3e4143810 2023-11-26T07:18:33.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.554+0000 7ff3daffd640 1 -- 172.21.15.70:0/1161076798 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3d4054bc0 con 0x7ff3e4143810 2023-11-26T07:18:33.558 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff3c8066470 msgr2=0x7ff3c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff3c8066470 0x7ff3c8068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0007fd0 tx=0x7ff3e0007d60 comp rx=0 tx=0).stop 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3e4143810 msgr2=0x7ff3e40b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3e4143810 0x7ff3e40b2830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400ebe0 tx=0x7ff3d400c520 comp rx=0 tx=0).stop 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 shutdown_connections 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff3c8066470 0x7ff3c8068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3e4143810 0x7ff3e40b2830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3e415df20 0x7ff3e40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 --2- 172.21.15.70:0/1161076798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3e40b1e10 0x7ff3e413d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 >> 172.21.15.70:0/1161076798 conn(0x7ff3e406a890 msgr2=0x7ff3e406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 shutdown_connections 2023-11-26T07:18:33.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.558+0000 7ff3eb57d640 1 -- 172.21.15.70:0/1161076798 wait complete. 2023-11-26T07:18:33.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f449d4d6640 1 Processor -- start 2023-11-26T07:18:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f449d4d6640 1 -- start start 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f449d4d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f449815d6e0 0x7f44980d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f449d4d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f44980d1bc0 0x7f44980b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f449d4d6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44980cf0e0 con 0x7f44980b2160 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f449d4d6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449815dac0 con 0x7f44980d1bc0 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f449d4d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44980ceb20 con 0x7f449815d6e0 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f44967fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f44980b2160 0x7f44980d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60716/0 (socket says 172.21.15.70:60716) 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f44967fc640 1 -- 172.21.15.70:0/3184219086 learned_addr learned my addr 172.21.15.70:0/3184219086 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f4496ffd640 1 --2- 172.21.15.70:0/3184219086 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f449815d6e0 0x7f44980d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f44977fe640 1 --2- 172.21.15.70:0/3184219086 >> v2:172.21.15.120:3300/0 conn(0x7f44980d1bc0 0x7f44980b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f4495ffb640 1 -- 172.21.15.70:0/3184219086 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085990930 0 0) 0x7f44980cf0e0 con 0x7f44980b2160 2023-11-26T07:18:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f4495ffb640 1 -- 172.21.15.70:0/3184219086 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4480003530 con 0x7f44980b2160 2023-11-26T07:18:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f4496ffd640 1 -- 172.21.15.70:0/3184219086 >> v2:172.21.15.120:3300/0 conn(0x7f44980d1bc0 msgr2=0x7f44980b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.714+0000 7f4496ffd640 1 --2- 172.21.15.70:0/3184219086 >> v2:172.21.15.120:3300/0 conn(0x7f44980d1bc0 0x7f44980b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.718+0000 7f4496ffd640 1 -- 172.21.15.70:0/3184219086 >> v1:172.21.15.70:6789/0 conn(0x7f44980b2160 legacy=0x7f44980d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.718+0000 7f4496ffd640 1 -- 172.21.15.70:0/3184219086 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980cee00 con 0x7f449815d6e0 2023-11-26T07:18:33.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.718+0000 7f4496ffd640 1 --2- 172.21.15.70:0/3184219086 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f449815d6e0 0x7f44980d0df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44880097c0 tx=0x7f448801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2b4095e48f380c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.718+0000 7f4495ffb640 1 -- 172.21.15.70:0/3184219086 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880ab600 con 0x7f449815d6e0 2023-11-26T07:18:33.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.718+0000 7f4495ffb640 1 -- 172.21.15.70:0/3184219086 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44880a7050 con 0x7f449815d6e0 2023-11-26T07:18:33.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.718+0000 7f4495ffb640 1 -- 172.21.15.70:0/3184219086 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880ab980 con 0x7f449815d6e0 2023-11-26T07:18:33.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- 172.21.15.70:0/3184219086 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f449815d6e0 msgr2=0x7f44980d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 --2- 172.21.15.70:0/3184219086 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f449815d6e0 0x7f44980d0df0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44880097c0 tx=0x7f448801c480 comp rx=0 tx=0).stop 2023-11-26T07:18:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- 172.21.15.70:0/3184219086 shutdown_connections 2023-11-26T07:18:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 --2- 172.21.15.70:0/3184219086 >> v2:172.21.15.120:3300/0 conn(0x7f44980d1bc0 0x7f44980b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 --2- 172.21.15.70:0/3184219086 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f449815d6e0 0x7f44980d0df0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- 172.21.15.70:0/3184219086 >> 172.21.15.70:0/3184219086 conn(0x7f449809c550 msgr2=0x7f44980d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- 172.21.15.70:0/3184219086 shutdown_connections 2023-11-26T07:18:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- 172.21.15.70:0/3184219086 wait complete. 2023-11-26T07:18:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 Processor -- start 2023-11-26T07:18:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- start start 2023-11-26T07:18:33.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44980b2160 0x7f44981550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44980d1bc0 0x7f4498154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449815d6e0 0x7f449815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44981563b0 con 0x7f449815d6e0 2023-11-26T07:18:33.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449815e590 con 0x7f44980b2160 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f449d4d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4498154e70 con 0x7f44980d1bc0 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449815d6e0 0x7f449815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449815d6e0 0x7f449815e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40416/0 (socket says 172.21.15.70:40416) 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 -- 172.21.15.70:0/2421002123 learned_addr learned my addr 172.21.15.70:0/2421002123 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f4496ffd640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44980b2160 0x7f44981550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44967fc640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44980d1bc0 0x7f4498154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 -- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44980d1bc0 msgr2=0x7f4498154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44980d1bc0 0x7f4498154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 -- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44980b2160 msgr2=0x7f44981550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44980b2160 0x7f44981550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.722+0000 7f44977fe640 1 -- 172.21.15.70:0/2421002123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488009420 con 0x7f449815d6e0 2023-11-26T07:18:33.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f44977fe640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449815d6e0 0x7f449815e7b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f449000efc0 tx=0x7f449000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f447f7fe640 1 -- 172.21.15.70:0/2421002123 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490014480 con 0x7f449815d6e0 2023-11-26T07:18:33.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f447f7fe640 1 -- 172.21.15.70:0/2421002123 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449000f040 con 0x7f449815d6e0 2023-11-26T07:18:33.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44981557a0 con 0x7f449815d6e0 2023-11-26T07:18:33.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f447f7fe640 1 -- 172.21.15.70:0/2421002123 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490014820 con 0x7f449815d6e0 2023-11-26T07:18:33.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4498155d60 con 0x7f449815d6e0 2023-11-26T07:18:33.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44980b7000 con 0x7f449815d6e0 2023-11-26T07:18:33.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f447f7fe640 1 -- 172.21.15.70:0/2421002123 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4490014980 con 0x7f449815d6e0 2023-11-26T07:18:33.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f447f7fe640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f44840664a0 0x7f4484068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:33.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f447f7fe640 1 -- 172.21.15.70:0/2421002123 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4490084860 con 0x7f449815d6e0 2023-11-26T07:18:33.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.726+0000 7f4496ffd640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f44840664a0 0x7f4484068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:33.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.730+0000 7f4496ffd640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f44840664a0 0x7f4484068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f44880ad000 tx=0x7f4488008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:33.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.730+0000 7f447f7fe640 1 -- 172.21.15.70:0/2421002123 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44980b7000 con 0x7f449815d6e0 2023-11-26T07:18:33.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.882+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44980b7000 con 0x7f449815d6e0 2023-11-26T07:18:33.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.882+0000 7f447f7fe640 1 -- 172.21.15.70:0/2421002123 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44980b7000 con 0x7f449815d6e0 2023-11-26T07:18:33.886 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f44840664a0 msgr2=0x7f4484068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f44840664a0 0x7f4484068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f44880ad000 tx=0x7f4488008040 comp rx=0 tx=0).stop 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449815d6e0 msgr2=0x7f449815e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449815d6e0 0x7f449815e7b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f449000efc0 tx=0x7f449000c490 comp rx=0 tx=0).stop 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 shutdown_connections 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f44840664a0 0x7f4484068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f449815d6e0 0x7f449815e7b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44980d1bc0 0x7f4498154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 --2- 172.21.15.70:0/2421002123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44980b2160 0x7f44981550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:33.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 >> 172.21.15.70:0/2421002123 conn(0x7f449809c550 msgr2=0x7f44980b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:33.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 shutdown_connections 2023-11-26T07:18:33.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:33.886+0000 7f449d4d6640 1 -- 172.21.15.70:0/2421002123 wait complete. 2023-11-26T07:18:33.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-11-26T07:18:34.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.042+0000 7f0252216640 1 Processor -- start 2023-11-26T07:18:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.042+0000 7f0252216640 1 -- start start 2023-11-26T07:18:34.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f0252216640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f024c15d6e0 0x7f024c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f0252216640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c0d1bc0 0x7f024c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f0252216640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024c0cf0e0 con 0x7f024c0b2160 2023-11-26T07:18:34.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f0252216640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024c15dac0 con 0x7f024c15d6e0 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f0252216640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0ceb20 con 0x7f024c0d1bc0 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f024c15d6e0 0x7f024c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f024c15d6e0 0x7f024c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40420/0 (socket says 172.21.15.70:40420) 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 -- 172.21.15.70:0/3616241467 learned_addr learned my addr 172.21.15.70:0/3616241467 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024bfff640 1 --2- 172.21.15.70:0/3616241467 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c0d1bc0 0x7f024c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 -- 172.21.15.70:0/3616241467 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c0d1bc0 msgr2=0x7f024c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 --2- 172.21.15.70:0/3616241467 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c0d1bc0 0x7f024c0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 -- 172.21.15.70:0/3616241467 >> v1:172.21.15.120:6789/0 conn(0x7f024c0b2160 legacy=0x7f024c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 -- 172.21.15.70:0/3616241467 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0cee00 con 0x7f024c15d6e0 2023-11-26T07:18:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024bfff640 1 --2- 172.21.15.70:0/3616241467 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c0d1bc0 0x7f024c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.046+0000 7f024b7fe640 1 --2- 172.21.15.70:0/3616241467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c15d6e0 0x7f024c0d0df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f023c009870 tx=0x7f023c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5947048129995f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f024a7fc640 1 -- 172.21.15.70:0/3616241467 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c0ac410 con 0x7f024c15d6e0 2023-11-26T07:18:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f024a7fc640 1 -- 172.21.15.70:0/3616241467 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c0ac570 con 0x7f024c15d6e0 2023-11-26T07:18:34.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f024a7fc640 1 -- 172.21.15.70:0/3616241467 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c0ac900 con 0x7f024c15d6e0 2023-11-26T07:18:34.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- 172.21.15.70:0/3616241467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c15d6e0 msgr2=0x7f024c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 --2- 172.21.15.70:0/3616241467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c15d6e0 0x7f024c0d0df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f023c009870 tx=0x7f023c01c500 comp rx=0 tx=0).stop 2023-11-26T07:18:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- 172.21.15.70:0/3616241467 shutdown_connections 2023-11-26T07:18:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 --2- 172.21.15.70:0/3616241467 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c0d1bc0 0x7f024c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 --2- 172.21.15.70:0/3616241467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c15d6e0 0x7f024c0d0df0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- 172.21.15.70:0/3616241467 >> 172.21.15.70:0/3616241467 conn(0x7f024c09c550 msgr2=0x7f024c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- 172.21.15.70:0/3616241467 shutdown_connections 2023-11-26T07:18:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- 172.21.15.70:0/3616241467 wait complete. 2023-11-26T07:18:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 Processor -- start 2023-11-26T07:18:34.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- start start 2023-11-26T07:18:34.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c0b2160 0x7f024c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f024c0d1bc0 0x7f024c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c15d6e0 0x7f024c141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c15cdb0 con 0x7f024c0b2160 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c15dda0 con 0x7f024c0d1bc0 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f0252216640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c15e080 con 0x7f024c15d6e0 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f024b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c0b2160 0x7f024c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f024b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c0b2160 0x7f024c0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40426/0 (socket says 172.21.15.70:40426) 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f024b7fe640 1 -- 172.21.15.70:0/3715530647 learned_addr learned my addr 172.21.15.70:0/3715530647 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.050+0000 7f024affd640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f024c0d1bc0 0x7f024c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f024bfff640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c15d6e0 0x7f024c141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f024b7fe640 1 -- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c15d6e0 msgr2=0x7f024c141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f024b7fe640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c15d6e0 0x7f024c141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f024b7fe640 1 -- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f024c0d1bc0 msgr2=0x7f024c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f024b7fe640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f024c0d1bc0 0x7f024c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f024b7fe640 1 -- 172.21.15.70:0/3715530647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0094d0 con 0x7f024c0b2160 2023-11-26T07:18:34.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f024b7fe640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c0b2160 0x7f024c0ccd70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f023c0af040 tx=0x7f023c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0233fff640 1 -- 172.21.15.70:0/3715530647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c0ac410 con 0x7f024c0b2160 2023-11-26T07:18:34.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0233fff640 1 -- 172.21.15.70:0/3715530647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c0b5630 con 0x7f024c0b2160 2023-11-26T07:18:34.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0233fff640 1 -- 172.21.15.70:0/3715530647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c0b59e0 con 0x7f024c0b2160 2023-11-26T07:18:34.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024c1548a0 con 0x7f024c0b2160 2023-11-26T07:18:34.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024c1550a0 con 0x7f024c0b2160 2023-11-26T07:18:34.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024c067680 con 0x7f024c0b2160 2023-11-26T07:18:34.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0233fff640 1 -- 172.21.15.70:0/3715530647 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f023c0b3070 con 0x7f024c0b2160 2023-11-26T07:18:34.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0233fff640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0238066470 0x7f0238068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.054+0000 7f0233fff640 1 -- 172.21.15.70:0/3715530647 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f023c11e350 con 0x7f024c0b2160 2023-11-26T07:18:34.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.058+0000 7f024affd640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0238066470 0x7f0238068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.058+0000 7f024affd640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0238066470 0x7f0238068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f024c067f60 tx=0x7f0240007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.062+0000 7f0233fff640 1 -- 172.21.15.70:0/3715530647 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f023c0eb880 con 0x7f024c0b2160 2023-11-26T07:18:34.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.262+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7f024c0cd650 con 0x7f024c0b2160 2023-11-26T07:18:34.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.814+0000 7f0233fff640 1 -- 172.21.15.70:0/3715530647 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v55) v1 ==== 168+0+0 (secure 0 0 0) 0x7f023c0eeea0 con 0x7f024c0b2160 2023-11-26T07:18:34.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0238066470 msgr2=0x7f0238068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0238066470 0x7f0238068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f024c067f60 tx=0x7f0240007e40 comp rx=0 tx=0).stop 2023-11-26T07:18:34.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c0b2160 msgr2=0x7f024c0ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c0b2160 0x7f024c0ccd70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f023c0af040 tx=0x7f023c0192a0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 shutdown_connections 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f024c15d6e0 0x7f024c141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f024c0d1bc0 0x7f024c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0238066470 0x7f0238068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 --2- 172.21.15.70:0/3715530647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f024c0b2160 0x7f024c0ccd70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 >> 172.21.15.70:0/3715530647 conn(0x7f024c09c550 msgr2=0x7f024c06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 shutdown_connections 2023-11-26T07:18:34.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.818+0000 7f0252216640 1 -- 172.21.15.70:0/3715530647 wait complete. 2023-11-26T07:18:34.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:18:34.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.978+0000 7efcb9f57640 1 Processor -- start 2023-11-26T07:18:34.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.978+0000 7efcb9f57640 1 -- start start 2023-11-26T07:18:34.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb9f57640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efcb4143ac0 0x7efcb4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb9f57640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efcb40708b0 0x7efcb40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb9f57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40cf7c0 0x7efcb40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb9f57640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb4143ea0 con 0x7efcb40708b0 2023-11-26T07:18:34.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb9f57640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40cc730 con 0x7efcb4143ac0 2023-11-26T07:18:34.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb9f57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40cfbd0 con 0x7efcb40cf7c0 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efcb40708b0 0x7efcb40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efcb40708b0 0x7efcb40cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40430/0 (socket says 172.21.15.70:40430) 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 -- 172.21.15.70:0/3118905940 learned_addr learned my addr 172.21.15.70:0/3118905940 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb37fe640 1 --2- 172.21.15.70:0/3118905940 >> v2:172.21.15.120:3300/0 conn(0x7efcb4143ac0 0x7efcb4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb3fff640 1 --2- 172.21.15.70:0/3118905940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40cf7c0 0x7efcb40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 -- 172.21.15.70:0/3118905940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40cf7c0 msgr2=0x7efcb40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 --2- 172.21.15.70:0/3118905940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40cf7c0 0x7efcb40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 -- 172.21.15.70:0/3118905940 >> v2:172.21.15.120:3300/0 conn(0x7efcb4143ac0 msgr2=0x7efcb4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 --2- 172.21.15.70:0/3118905940 >> v2:172.21.15.120:3300/0 conn(0x7efcb4143ac0 0x7efcb4070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.982+0000 7efcb2ffd640 1 -- 172.21.15.70:0/3118905940 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4070ee0 con 0x7efcb40708b0 2023-11-26T07:18:34.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb2ffd640 1 --2- 172.21.15.70:0/3118905940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb40708b0 0x7efcb40cf280 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efcb406dca0 tx=0x7efca801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c21065887cb7d96 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb27fc640 1 -- 172.21.15.70:0/3118905940 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80ab600 con 0x7efcb40708b0 2023-11-26T07:18:34.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb27fc640 1 -- 172.21.15.70:0/3118905940 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca80a7050 con 0x7efcb40708b0 2023-11-26T07:18:34.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb27fc640 1 -- 172.21.15.70:0/3118905940 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80ab980 con 0x7efcb40708b0 2023-11-26T07:18:34.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 -- 172.21.15.70:0/3118905940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb40708b0 msgr2=0x7efcb40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 --2- 172.21.15.70:0/3118905940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb40708b0 0x7efcb40cf280 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efcb406dca0 tx=0x7efca801c240 comp rx=0 tx=0).stop 2023-11-26T07:18:34.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 -- 172.21.15.70:0/3118905940 shutdown_connections 2023-11-26T07:18:34.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 --2- 172.21.15.70:0/3118905940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40cf7c0 0x7efcb40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 --2- 172.21.15.70:0/3118905940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb40708b0 0x7efcb40cf280 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 --2- 172.21.15.70:0/3118905940 >> v2:172.21.15.120:3300/0 conn(0x7efcb4143ac0 0x7efcb4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 -- 172.21.15.70:0/3118905940 >> 172.21.15.70:0/3118905940 conn(0x7efcb406a890 msgr2=0x7efcb406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:34.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 -- 172.21.15.70:0/3118905940 shutdown_connections 2023-11-26T07:18:34.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 -- 172.21.15.70:0/3118905940 wait complete. 2023-11-26T07:18:34.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 Processor -- start 2023-11-26T07:18:34.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.986+0000 7efcb9f57640 1 -- start start 2023-11-26T07:18:34.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40708b0 0x7efcb4136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb40cf7c0 0x7efcb4133a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb4143ac0 0x7efcb4133f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41344d0 con 0x7efcb4143ac0 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41346c0 con 0x7efcb40cf7c0 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41349a0 con 0x7efcb40708b0 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb4143ac0 0x7efcb4133f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb4143ac0 0x7efcb4133f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40436/0 (socket says 172.21.15.70:40436) 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 -- 172.21.15.70:0/2386344953 learned_addr learned my addr 172.21.15.70:0/2386344953 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb37fe640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40708b0 0x7efcb4136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb2ffd640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb40cf7c0 0x7efcb4133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 -- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40708b0 msgr2=0x7efcb4136540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40708b0 0x7efcb4136540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 -- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb40cf7c0 msgr2=0x7efcb4133a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:34.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb40cf7c0 0x7efcb4133a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:34.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 -- 172.21.15.70:0/2386344953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80094d0 con 0x7efcb4143ac0 2023-11-26T07:18:34.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb3fff640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb4143ac0 0x7efcb4133f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efcac00eed0 tx=0x7efcac00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efc9bfff640 1 -- 172.21.15.70:0/2386344953 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac010040 con 0x7efcb4143ac0 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efc9bfff640 1 -- 172.21.15.70:0/2386344953 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac014400 con 0x7efcb4143ac0 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb4134c80 con 0x7efcb4143ac0 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efc9bfff640 1 -- 172.21.15.70:0/2386344953 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac009ea0 con 0x7efcb4143ac0 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb4136a80 con 0x7efcb4143ac0 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb4067680 con 0x7efcb4143ac0 2023-11-26T07:18:34.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.990+0000 7efc9bfff640 1 -- 172.21.15.70:0/2386344953 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efcac0147b0 con 0x7efcb4143ac0 2023-11-26T07:18:34.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.994+0000 7efc9bfff640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efca0066470 0x7efca0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:34.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.994+0000 7efc9bfff640 1 -- 172.21.15.70:0/2386344953 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcac0844e0 con 0x7efcb4143ac0 2023-11-26T07:18:34.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.994+0000 7efcb37fe640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efca0066470 0x7efca0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:34.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.994+0000 7efcb37fe640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efca0066470 0x7efca0068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efca4009ac0 tx=0x7efca4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:34.998+0000 7efc9bfff640 1 -- 172.21.15.70:0/2386344953 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efcac051970 con 0x7efcb4143ac0 2023-11-26T07:18:35.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.146+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efcb406cf20 con 0x7efcb4143ac0 2023-11-26T07:18:35.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.150+0000 7efc9bfff640 1 -- 172.21.15.70:0/2386344953 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7efcac054f90 con 0x7efcb4143ac0 2023-11-26T07:18:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efca0066470 msgr2=0x7efca0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efca0066470 0x7efca0068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efca4009ac0 tx=0x7efca4009190 comp rx=0 tx=0).stop 2023-11-26T07:18:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb4143ac0 msgr2=0x7efcb4133f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb4143ac0 0x7efcb4133f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efcac00eed0 tx=0x7efcac00b480 comp rx=0 tx=0).stop 2023-11-26T07:18:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 shutdown_connections 2023-11-26T07:18:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efca0066470 0x7efca0068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcb4143ac0 0x7efcb4133f90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb40cf7c0 0x7efcb4133a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 --2- 172.21.15.70:0/2386344953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcb40708b0 0x7efcb4136540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 >> 172.21.15.70:0/2386344953 conn(0x7efcb406a890 msgr2=0x7efcb415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 shutdown_connections 2023-11-26T07:18:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.154+0000 7efcb9f57640 1 -- 172.21.15.70:0/2386344953 wait complete. 2023-11-26T07:18:35.177 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:18:35.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:18:35.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:18:35.294 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:18:35.295 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:18:35.295 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:35.304 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:18:35.305 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:35.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:35.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f949a640 1 Processor -- start 2023-11-26T07:18:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f949a640 1 -- start start 2023-11-26T07:18:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f949a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f75f40b2160 0x7f75f40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f949a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f40cf0e0 con 0x7f75f415d6e0 2023-11-26T07:18:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f949a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f40ceb20 con 0x7f75f40d1bc0 2023-11-26T07:18:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f949a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f415dac0 con 0x7f75f40b2160 2023-11-26T07:18:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f2ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f75f415d6e0 0x7f75f40d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60718/0 (socket says 172.21.15.70:60718) 2023-11-26T07:18:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f2ffd640 1 -- 172.21.15.70:0/1471315132 learned_addr learned my addr 172.21.15.70:0/1471315132 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:35.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f37fe640 1 --2- 172.21.15.70:0/1471315132 >> v2:172.21.15.120:3300/0 conn(0x7f75f40b2160 0x7f75f40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632013449 0 0) 0x7f75f40cf0e0 con 0x7f75f415d6e0 2023-11-26T07:18:35.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e0003530 con 0x7f75f415d6e0 2023-11-26T07:18:35.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 749698387 0 0) 0x7f75e0003530 con 0x7f75f415d6e0 2023-11-26T07:18:35.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 >> v2:172.21.15.120:3300/0 conn(0x7f75f40b2160 msgr2=0x7f75f40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 --2- 172.21.15.70:0/1471315132 >> v2:172.21.15.120:3300/0 conn(0x7f75f40b2160 0x7f75f40d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 >> v1:172.21.15.120:6789/0 conn(0x7f75f40d1bc0 legacy=0x7f75f40b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40cee00 con 0x7f75f415d6e0 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f75e4001680 con 0x7f75f415d6e0 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 >> v1:172.21.15.70:6789/0 conn(0x7f75f415d6e0 legacy=0x7f75f40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75e0003980 0x7f75e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e00047d0 0x7f75e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75e0005190 0x7f75e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f415dac0 con 0x7f75e0005190 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e000c030 con 0x7f75e00047d0 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e000c1f0 con 0x7f75e0003980 2023-11-26T07:18:35.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f37fe640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75e0005190 0x7f75e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75f2ffd640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75e0003980 0x7f75e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.534+0000 7f75ea7fc640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e00047d0 0x7f75e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f37fe640 1 -- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75e0003980 msgr2=0x7f75e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f37fe640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75e0003980 0x7f75e0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f37fe640 1 -- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e00047d0 msgr2=0x7f75e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f37fe640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e00047d0 0x7f75e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f37fe640 1 -- 172.21.15.70:0/1471315132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e0003530 con 0x7f75e0005190 2023-11-26T07:18:35.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75ea7fc640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e00047d0 0x7f75e0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:35.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f37fe640 1 -- 172.21.15.70:0/1471315132 reap_dead start 2023-11-26T07:18:35.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f37fe640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75e0005190 0x7f75e000b990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009ab0 tx=0x7f75ec01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d2a526c367bfdf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0a5660 con 0x7f75e0005190 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec0a57c0 con 0x7f75e0005190 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f27fc640 1 -- 172.21.15.70:0/1471315132 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0a5b50 con 0x7f75e0005190 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f949a640 1 -- 172.21.15.70:0/1471315132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75e0005190 msgr2=0x7f75e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f949a640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75e0005190 0x7f75e000b990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009ab0 tx=0x7f75ec01ca70 comp rx=0 tx=0).stop 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f949a640 1 -- 172.21.15.70:0/1471315132 shutdown_connections 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f949a640 1 --2- 172.21.15.70:0/1471315132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75e0005190 0x7f75e000b990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f949a640 1 -- 172.21.15.70:0/1471315132 >> 172.21.15.70:0/1471315132 conn(0x7f75f409c550 msgr2=0x7f75f40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f949a640 1 -- 172.21.15.70:0/1471315132 shutdown_connections 2023-11-26T07:18:35.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.538+0000 7f75f949a640 1 -- 172.21.15.70:0/1471315132 wait complete. 2023-11-26T07:18:35.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 Processor -- start 2023-11-26T07:18:35.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 -- start start 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e0005190 0x7f75f40b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f4155da0 0x7f75f41550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f40b8660 0x7f75f4152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4155610 con 0x7f75f40b8660 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f415dc00 con 0x7f75e0005190 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f949a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4160ae0 con 0x7f75f4155da0 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f40b8660 0x7f75f4152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f40b8660 0x7f75f4152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40452/0 (socket says 172.21.15.70:40452) 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 -- 172.21.15.70:0/3933451128 learned_addr learned my addr 172.21.15.70:0/3933451128 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f2ffd640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e0005190 0x7f75f40b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75ea7fc640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f4155da0 0x7f75f41550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 -- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f4155da0 msgr2=0x7f75f41550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f4155da0 0x7f75f41550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 -- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e0005190 msgr2=0x7f75f40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e0005190 0x7f75f40b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 -- 172.21.15.70:0/3933451128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40ce990 con 0x7f75f40b8660 2023-11-26T07:18:35.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75f37fe640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f40b8660 0x7f75f4152540 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75ec01d310 tx=0x7f75e0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75ebfff640 1 -- 172.21.15.70:0/3933451128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0a5660 con 0x7f75f40b8660 2023-11-26T07:18:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.542+0000 7f75ebfff640 1 -- 172.21.15.70:0/3933451128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec0ad850 con 0x7f75f40b8660 2023-11-26T07:18:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75ebfff640 1 -- 172.21.15.70:0/3933451128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0adbe0 con 0x7f75f40b8660 2023-11-26T07:18:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f4155840 con 0x7f75f40b8660 2023-11-26T07:18:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f415e130 con 0x7f75f40b8660 2023-11-26T07:18:35.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f415cf40 con 0x7f75f40b8660 2023-11-26T07:18:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75ebfff640 1 -- 172.21.15.70:0/3933451128 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75ec0add40 con 0x7f75f40b8660 2023-11-26T07:18:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75ebfff640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75d4066470 0x7f75d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75ebfff640 1 -- 172.21.15.70:0/3933451128 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75ec11d360 con 0x7f75f40b8660 2023-11-26T07:18:35.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75f2ffd640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75d4066470 0x7f75d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.546+0000 7f75f2ffd640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75d4066470 0x7f75d4068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c10 tx=0x7f75e4000f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.550+0000 7f75ebfff640 1 -- 172.21.15.70:0/3933451128 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75ec0ea950 con 0x7f75f40b8660 2023-11-26T07:18:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75f4067680 con 0x7f75f40b8660 2023-11-26T07:18:35.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75ebfff640 1 -- 172.21.15.70:0/3933451128 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f75ec0bd090 con 0x7f75f40b8660 2023-11-26T07:18:35.705 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:35.705 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:35.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75d4066470 msgr2=0x7f75d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75d4066470 0x7f75d4068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c10 tx=0x7f75e4000f00 comp rx=0 tx=0).stop 2023-11-26T07:18:35.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f40b8660 msgr2=0x7f75f4152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f40b8660 0x7f75f4152540 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75ec01d310 tx=0x7f75e0005800 comp rx=0 tx=0).stop 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 shutdown_connections 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f75d4066470 0x7f75d4068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75f40b8660 0x7f75f4152540 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f75f4155da0 0x7f75f41550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 --2- 172.21.15.70:0/3933451128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75e0005190 0x7f75f40b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.702+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 >> 172.21.15.70:0/3933451128 conn(0x7f75f409c550 msgr2=0x7f75f406b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.706+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 shutdown_connections 2023-11-26T07:18:35.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.706+0000 7f75f949a640 1 -- 172.21.15.70:0/3933451128 wait complete. 2023-11-26T07:18:35.726 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:35.727 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:35.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e2bdf640 1 Processor -- start 2023-11-26T07:18:35.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e2bdf640 1 -- start start 2023-11-26T07:18:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e2bdf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f58dc143ac0 0x7f58dc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e2bdf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f58dc0cf990 0x7f58dc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e2bdf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc0cc730 con 0x7f58dc0708b0 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e2bdf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58dc143ea0 con 0x7f58dc143ac0 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e2bdf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58dc070ee0 con 0x7f58dc0cf990 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e097b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f58dc143ac0 0x7f58dc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58d3fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f58dc0708b0 0x7f58dc0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60732/0 (socket says 172.21.15.70:60732) 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e097b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f58dc143ac0 0x7f58dc070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40466/0 (socket says 172.21.15.70:40466) 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58d3fff640 1 -- 172.21.15.70:0/299724617 learned_addr learned my addr 172.21.15.70:0/299724617 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e117c640 1 --2- 172.21.15.70:0/299724617 >> v2:172.21.15.120:3300/0 conn(0x7f58dc0cf990 0x7f58dc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e097b640 1 -- 172.21.15.70:0/299724617 >> v2:172.21.15.120:3300/0 conn(0x7f58dc0cf990 msgr2=0x7f58dc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:35.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e097b640 1 --2- 172.21.15.70:0/299724617 >> v2:172.21.15.120:3300/0 conn(0x7f58dc0cf990 0x7f58dc0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e097b640 1 -- 172.21.15.70:0/299724617 >> v1:172.21.15.70:6789/0 conn(0x7f58dc0708b0 legacy=0x7f58dc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.870+0000 7f58e097b640 1 -- 172.21.15.70:0/299724617 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0711c0 con 0x7f58dc143ac0 2023-11-26T07:18:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e097b640 1 --2- 172.21.15.70:0/299724617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc143ac0 0x7f58dc070370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58dc06e570 tx=0x7f58d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0130ed6261d9440 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58d37fe640 1 -- 172.21.15.70:0/299724617 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80ab600 con 0x7f58dc143ac0 2023-11-26T07:18:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58d37fe640 1 -- 172.21.15.70:0/299724617 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d80a7050 con 0x7f58dc143ac0 2023-11-26T07:18:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58d37fe640 1 -- 172.21.15.70:0/299724617 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80ab980 con 0x7f58dc143ac0 2023-11-26T07:18:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 -- 172.21.15.70:0/299724617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc143ac0 msgr2=0x7f58dc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/299724617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc143ac0 0x7f58dc070370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58dc06e570 tx=0x7f58d801c460 comp rx=0 tx=0).stop 2023-11-26T07:18:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 -- 172.21.15.70:0/299724617 shutdown_connections 2023-11-26T07:18:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/299724617 >> v2:172.21.15.120:3300/0 conn(0x7f58dc0cf990 0x7f58dc0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/299724617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc143ac0 0x7f58dc070370 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 -- 172.21.15.70:0/299724617 >> 172.21.15.70:0/299724617 conn(0x7f58dc06a890 msgr2=0x7f58dc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:35.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 -- 172.21.15.70:0/299724617 shutdown_connections 2023-11-26T07:18:35.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.874+0000 7f58e2bdf640 1 -- 172.21.15.70:0/299724617 wait complete. 2023-11-26T07:18:35.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 Processor -- start 2023-11-26T07:18:35.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 -- start start 2023-11-26T07:18:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc0708b0 0x7f58dc137800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58dc0cf990 0x7f58dc138450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58dc143ac0 0x7f58dc138990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc138fd0 con 0x7f58dc0708b0 2023-11-26T07:18:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc1392b0 con 0x7f58dc143ac0 2023-11-26T07:18:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc139590 con 0x7f58dc0cf990 2023-11-26T07:18:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc0708b0 0x7f58dc137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc0708b0 0x7f58dc137800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40480/0 (socket says 172.21.15.70:40480) 2023-11-26T07:18:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 -- 172.21.15.70:0/2238671420 learned_addr learned my addr 172.21.15.70:0/2238671420 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:35.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 -- 172.21.15.70:0/2238671420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58dc0cf990 msgr2=0x7f58dc138450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58dc0cf990 0x7f58dc138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 -- 172.21.15.70:0/2238671420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58dc143ac0 msgr2=0x7f58dc138990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58dc143ac0 0x7f58dc138990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 -- 172.21.15.70:0/2238671420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d8009420 con 0x7f58dc0708b0 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e097b640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc0708b0 0x7f58dc137800 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58d80ae040 tx=0x7f58d8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58d17fa640 1 -- 172.21.15.70:0/2238671420 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80b4610 con 0x7f58dc0708b0 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58d17fa640 1 -- 172.21.15.70:0/2238671420 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d80b4770 con 0x7f58dc0708b0 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58d17fa640 1 -- 172.21.15.70:0/2238671420 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80b4b00 con 0x7f58dc0708b0 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc139870 con 0x7f58dc0708b0 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.878+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc153510 con 0x7f58dc0708b0 2023-11-26T07:18:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.882+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc067680 con 0x7f58dc0708b0 2023-11-26T07:18:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.882+0000 7f58d17fa640 1 -- 172.21.15.70:0/2238671420 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58d80b2040 con 0x7f58dc0708b0 2023-11-26T07:18:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.882+0000 7f58d17fa640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58c8066470 0x7f58c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.882+0000 7f58d17fa640 1 -- 172.21.15.70:0/2238671420 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58d811de10 con 0x7f58dc0708b0 2023-11-26T07:18:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.882+0000 7f58d3fff640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58c8066470 0x7f58c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:35.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.882+0000 7f58d3fff640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58c8066470 0x7f58c8068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f70 tx=0x7f58cc007a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:35.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:35.886+0000 7f58d17fa640 1 -- 172.21.15.70:0/2238671420 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58d8121030 con 0x7f58dc0708b0 2023-11-26T07:18:36.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58dc139d20 con 0x7f58dc0708b0 2023-11-26T07:18:36.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58d17fa640 1 -- 172.21.15.70:0/2238671420 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58d80b0020 con 0x7f58dc0708b0 2023-11-26T07:18:36.040 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:36.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58c8066470 msgr2=0x7f58c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58c8066470 0x7f58c8068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f70 tx=0x7f58cc007a90 comp rx=0 tx=0).stop 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc0708b0 msgr2=0x7f58dc137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc0708b0 0x7f58dc137800 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58d80ae040 tx=0x7f58d8019200 comp rx=0 tx=0).stop 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 shutdown_connections 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58dc143ac0 0x7f58dc138990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58dc0cf990 0x7f58dc138450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58c8066470 0x7f58c8068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 --2- 172.21.15.70:0/2238671420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58dc0708b0 0x7f58dc137800 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 >> 172.21.15.70:0/2238671420 conn(0x7f58dc06a890 msgr2=0x7f58dc06c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 shutdown_connections 2023-11-26T07:18:36.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.038+0000 7f58e2bdf640 1 -- 172.21.15.70:0/2238671420 wait complete. 2023-11-26T07:18:36.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.198+0000 7f7b11e32640 1 Processor -- start 2023-11-26T07:18:36.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.198+0000 7f7b11e32640 1 -- start start 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.198+0000 7f7b11e32640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b0c0cf280 0x7f7b0c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.198+0000 7f7b11e32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.198+0000 7f7b11e32640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0c0cc730 con 0x7f7b0c143ac0 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.198+0000 7f7b11e32640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0c143ea0 con 0x7f7b0c0cf280 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.198+0000 7f7b11e32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0cfc50 con 0x7f7b0c0cd1b0 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0affd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b0c0cf280 0x7f7b0c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c0cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:58284/0 (socket says 172.21.15.70:58284) 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 -- 172.21.15.70:0/1831911381 learned_addr learned my addr 172.21.15.70:0/1831911381 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 -- 172.21.15.70:0/1831911381 >> v2:172.21.15.120:3300/0 conn(0x7f7b0c0cf280 msgr2=0x7f7b0c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:36.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 --2- 172.21.15.70:0/1831911381 >> v2:172.21.15.120:3300/0 conn(0x7f7b0c0cf280 0x7f7b0c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 -- 172.21.15.70:0/1831911381 >> v1:172.21.15.120:6789/0 conn(0x7f7b0c143ac0 legacy=0x7f7b0c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 -- 172.21.15.70:0/1831911381 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c070ee0 con 0x7f7b0c0cd1b0 2023-11-26T07:18:36.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0bfff640 1 --2- 172.21.15.70:0/1831911381 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c0cd5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009e50 tx=0x7f7b0401ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a02e6e500ff501f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0a7fc640 1 -- 172.21.15.70:0/1831911381 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b040a7af0 con 0x7f7b0c0cd1b0 2023-11-26T07:18:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0a7fc640 1 -- 172.21.15.70:0/1831911381 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b040a7c50 con 0x7f7b0c0cd1b0 2023-11-26T07:18:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.202+0000 7f7b0a7fc640 1 -- 172.21.15.70:0/1831911381 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b040af3f0 con 0x7f7b0c0cd1b0 2023-11-26T07:18:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- 172.21.15.70:0/1831911381 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 msgr2=0x7f7b0c0cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1831911381 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c0cd5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009e50 tx=0x7f7b0401ec20 comp rx=0 tx=0).stop 2023-11-26T07:18:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- 172.21.15.70:0/1831911381 shutdown_connections 2023-11-26T07:18:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1831911381 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c0cd5c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1831911381 >> v2:172.21.15.120:3300/0 conn(0x7f7b0c0cf280 0x7f7b0c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- 172.21.15.70:0/1831911381 >> 172.21.15.70:0/1831911381 conn(0x7f7b0c06a890 msgr2=0x7f7b0c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- 172.21.15.70:0/1831911381 shutdown_connections 2023-11-26T07:18:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- 172.21.15.70:0/1831911381 wait complete. 2023-11-26T07:18:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 Processor -- start 2023-11-26T07:18:36.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- start start 2023-11-26T07:18:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b0c0cf280 0x7f7b0c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b0c143ac0 0x7f7b0c13b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0b0190 con 0x7f7b0c0cf280 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0b03e0 con 0x7f7b0c143ac0 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b11e32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0c0b06c0 con 0x7f7b0c0cd1b0 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b0affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b0c0cf280 0x7f7b0c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b0affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b0c0cf280 0x7f7b0c0b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40486/0 (socket says 172.21.15.70:40486) 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b0affd640 1 -- 172.21.15.70:0/1540175387 learned_addr learned my addr 172.21.15.70:0/1540175387 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b0bfff640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b0c143ac0 0x7f7b0c13b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.206+0000 7f7b0b7fe640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b0affd640 1 -- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 msgr2=0x7f7b0c1596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b0affd640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c1596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b0affd640 1 -- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b0c143ac0 msgr2=0x7f7b0c13b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b0affd640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b0c143ac0 0x7f7b0c13b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b0affd640 1 -- 172.21.15.70:0/1540175387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04009b30 con 0x7f7b0c0cf280 2023-11-26T07:18:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b0bfff640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b0c143ac0 0x7f7b0c13b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b0affd640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b0c0cf280 0x7f7b0c0b11a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000e870 tx=0x7f7b0000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7af3fff640 1 -- 172.21.15.70:0/1540175387 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00009510 con 0x7f7b0c0cf280 2023-11-26T07:18:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7af3fff640 1 -- 172.21.15.70:0/1540175387 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000eec0 con 0x7f7b0c0cf280 2023-11-26T07:18:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7af3fff640 1 -- 172.21.15.70:0/1540175387 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000cb40 con 0x7f7b0c0cf280 2023-11-26T07:18:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c0b09a0 con 0x7f7b0c0cf280 2023-11-26T07:18:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0c13d940 con 0x7f7b0c0cf280 2023-11-26T07:18:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0c0ada60 con 0x7f7b0c0cf280 2023-11-26T07:18:36.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7af3fff640 1 -- 172.21.15.70:0/1540175387 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b0000cca0 con 0x7f7b0c0cf280 2023-11-26T07:18:36.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7af3fff640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7af80664a0 0x7f7af8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.210+0000 7f7af3fff640 1 -- 172.21.15.70:0/1540175387 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b00083f00 con 0x7f7b0c0cf280 2023-11-26T07:18:36.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.214+0000 7f7b0b7fe640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7af80664a0 0x7f7af8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.214+0000 7f7b0b7fe640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7af80664a0 0x7f7af8068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7afc007fd0 tx=0x7f7afc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.214+0000 7f7af3fff640 1 -- 172.21.15.70:0/1540175387 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b00051420 con 0x7f7b0c0cf280 2023-11-26T07:18:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.362+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b0c067680 con 0x7f7b0c0cf280 2023-11-26T07:18:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7af3fff640 1 -- 172.21.15.70:0/1540175387 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b00054a40 con 0x7f7b0c0cf280 2023-11-26T07:18:36.368 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7af80664a0 msgr2=0x7f7af8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7af80664a0 0x7f7af8068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7afc007fd0 tx=0x7f7afc009040 comp rx=0 tx=0).stop 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b0c0cf280 msgr2=0x7f7b0c0b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b0c0cf280 0x7f7b0c0b11a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000e870 tx=0x7f7b0000ec70 comp rx=0 tx=0).stop 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 shutdown_connections 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7af80664a0 0x7f7af8068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b0c0cf280 0x7f7b0c0b11a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b0c143ac0 0x7f7b0c13b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 --2- 172.21.15.70:0/1540175387 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7b0c0cd1b0 0x7f7b0c1596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 >> 172.21.15.70:0/1540175387 conn(0x7f7b0c06a890 msgr2=0x7f7b0c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 shutdown_connections 2023-11-26T07:18:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.366+0000 7f7b11e32640 1 -- 172.21.15.70:0/1540175387 wait complete. 2023-11-26T07:18:36.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:36.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c9b2a640 1 Processor -- start 2023-11-26T07:18:36.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c9b2a640 1 -- start start 2023-11-26T07:18:36.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c9b2a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3c40d1bc0 0x7fd3c40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c9b2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40b2160 0x7fd3c40b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c9b2a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40cf0e0 con 0x7fd3c415d6e0 2023-11-26T07:18:36.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c9b2a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c415dac0 con 0x7fd3c40d1bc0 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c9b2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40ceb20 con 0x7fd3c40b2160 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3c40d1bc0 0x7fd3c40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3c40d1bc0 0x7fd3c40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40502/0 (socket says 172.21.15.70:40502) 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c2ffd640 1 -- 172.21.15.70:0/1354834280 learned_addr learned my addr 172.21.15.70:0/1354834280 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c3fff640 1 --2- 172.21.15.70:0/1354834280 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40b2160 0x7fd3c40b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c2ffd640 1 -- 172.21.15.70:0/1354834280 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40b2160 msgr2=0x7fd3c40b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c2ffd640 1 --2- 172.21.15.70:0/1354834280 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40b2160 0x7fd3c40b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c2ffd640 1 -- 172.21.15.70:0/1354834280 >> v1:172.21.15.120:6789/0 conn(0x7fd3c415d6e0 legacy=0x7fd3c40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.526+0000 7fd3c2ffd640 1 -- 172.21.15.70:0/1354834280 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40cee00 con 0x7fd3c40d1bc0 2023-11-26T07:18:36.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c2ffd640 1 --2- 172.21.15.70:0/1354834280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c40d1bc0 0x7fd3c40d0df0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009870 tx=0x7fd3b801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7365ea418256fa0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c27fc640 1 -- 172.21.15.70:0/1354834280 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80a7070 con 0x7fd3c40d1bc0 2023-11-26T07:18:36.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c27fc640 1 -- 172.21.15.70:0/1354834280 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b80ab430 con 0x7fd3c40d1bc0 2023-11-26T07:18:36.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c27fc640 1 -- 172.21.15.70:0/1354834280 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80ab7c0 con 0x7fd3c40d1bc0 2023-11-26T07:18:36.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/1354834280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c40d1bc0 msgr2=0x7fd3c40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/1354834280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c40d1bc0 0x7fd3c40d0df0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009870 tx=0x7fd3b801c540 comp rx=0 tx=0).stop 2023-11-26T07:18:36.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/1354834280 shutdown_connections 2023-11-26T07:18:36.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/1354834280 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40b2160 0x7fd3c40b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/1354834280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c40d1bc0 0x7fd3c40d0df0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/1354834280 >> 172.21.15.70:0/1354834280 conn(0x7fd3c409c550 msgr2=0x7fd3c40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/1354834280 shutdown_connections 2023-11-26T07:18:36.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.530+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/1354834280 wait complete. 2023-11-26T07:18:36.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 Processor -- start 2023-11-26T07:18:36.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 -- start start 2023-11-26T07:18:36.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3c40b2160 0x7fd3c40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40d1bc0 0x7fd3c40b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c415d6e0 0x7fd3c40b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c415a9f0 con 0x7fd3c415d6e0 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40cd1e0 con 0x7fd3c40b2160 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40b8bf0 con 0x7fd3c40d1bc0 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c415d6e0 0x7fd3c40b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c415d6e0 0x7fd3c40b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40508/0 (socket says 172.21.15.70:40508) 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 -- 172.21.15.70:0/844948705 learned_addr learned my addr 172.21.15.70:0/844948705 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c37fe640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3c40b2160 0x7fd3c40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c2ffd640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40d1bc0 0x7fd3c40b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 -- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40d1bc0 msgr2=0x7fd3c40b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40d1bc0 0x7fd3c40b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 -- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3c40b2160 msgr2=0x7fd3c40cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3c40b2160 0x7fd3c40cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 -- 172.21.15.70:0/844948705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80094d0 con 0x7fd3c415d6e0 2023-11-26T07:18:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c3fff640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c415d6e0 0x7fd3c40b6100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009e30 tx=0x7fd3bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3abfff640 1 -- 172.21.15.70:0/844948705 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc009ca0 con 0x7fd3c415d6e0 2023-11-26T07:18:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3abfff640 1 -- 172.21.15.70:0/844948705 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00f040 con 0x7fd3c415d6e0 2023-11-26T07:18:36.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3abfff640 1 -- 172.21.15.70:0/844948705 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0146c0 con 0x7fd3c415d6e0 2023-11-26T07:18:36.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c40cc940 con 0x7fd3c415d6e0 2023-11-26T07:18:36.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.534+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c40ccf00 con 0x7fd3c415d6e0 2023-11-26T07:18:36.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.538+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c415ab60 con 0x7fd3c415d6e0 2023-11-26T07:18:36.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.538+0000 7fd3abfff640 1 -- 172.21.15.70:0/844948705 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3bc014820 con 0x7fd3c415d6e0 2023-11-26T07:18:36.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.538+0000 7fd3abfff640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd3b0066470 0x7fd3b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.538+0000 7fd3abfff640 1 -- 172.21.15.70:0/844948705 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3bc084d00 con 0x7fd3c415d6e0 2023-11-26T07:18:36.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.538+0000 7fd3c37fe640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd3b0066470 0x7fd3b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.538+0000 7fd3c37fe640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd3b0066470 0x7fd3b0068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4007fd0 tx=0x7fd3b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.542+0000 7fd3abfff640 1 -- 172.21.15.70:0/844948705 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3bc052190 con 0x7fd3c415d6e0 2023-11-26T07:18:36.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.690+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3c4067680 con 0x7fd3c415d6e0 2023-11-26T07:18:36.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.690+0000 7fd3abfff640 1 -- 172.21.15.70:0/844948705 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd3bc0180a0 con 0x7fd3c415d6e0 2023-11-26T07:18:36.695 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:36.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd3b0066470 msgr2=0x7fd3b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd3b0066470 0x7fd3b0068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4007fd0 tx=0x7fd3b4009040 comp rx=0 tx=0).stop 2023-11-26T07:18:36.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c415d6e0 msgr2=0x7fd3c40b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c415d6e0 0x7fd3c40b6100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009e30 tx=0x7fd3bc00c490 comp rx=0 tx=0).stop 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 shutdown_connections 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd3b0066470 0x7fd3b0068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3c415d6e0 0x7fd3c40b6100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd3c40d1bc0 0x7fd3c40b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 --2- 172.21.15.70:0/844948705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd3c40b2160 0x7fd3c40cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 >> 172.21.15.70:0/844948705 conn(0x7fd3c409c550 msgr2=0x7fd3c40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 shutdown_connections 2023-11-26T07:18:36.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.694+0000 7fd3c9b2a640 1 -- 172.21.15.70:0/844948705 wait complete. 2023-11-26T07:18:36.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:36.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f5844b3e640 1 Processor -- start 2023-11-26T07:18:36.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f5844b3e640 1 -- start start 2023-11-26T07:18:36.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f5844b3e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f58400d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f5844b3e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400cf0e0 con 0x7f58400d1bc0 2023-11-26T07:18:36.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f5844b3e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58400ceb20 con 0x7f584015d6e0 2023-11-26T07:18:36.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f5844b3e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584015dac0 con 0x7f58400b2160 2023-11-26T07:18:36.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583dd9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f58400d1bc0 0x7f58400b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60744/0 (socket says 172.21.15.70:60744) 2023-11-26T07:18:36.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583dd9b640 1 -- 172.21.15.70:0/2833166140 learned_addr learned my addr 172.21.15.70:0/2833166140 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:36.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583ed9d640 1 --2- 172.21.15.70:0/2833166140 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f58400d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287169744 0 0) 0x7f58400cf0e0 con 0x7f58400d1bc0 2023-11-26T07:18:36.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5828003530 con 0x7f58400d1bc0 2023-11-26T07:18:36.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130183599 0 0) 0x7f58400ceb20 con 0x7f584015d6e0 2023-11-26T07:18:36.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58400cf0e0 con 0x7f584015d6e0 2023-11-26T07:18:36.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806576073 0 0) 0x7f5828003530 con 0x7f58400d1bc0 2023-11-26T07:18:36.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583ed9d640 1 -- 172.21.15.70:0/2833166140 >> v1:172.21.15.120:6789/0 conn(0x7f584015d6e0 legacy=0x7f58400d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583ed9d640 1 -- 172.21.15.70:0/2833166140 >> v1:172.21.15.70:6789/0 conn(0x7f58400d1bc0 legacy=0x7f58400b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.862+0000 7f583ed9d640 1 -- 172.21.15.70:0/2833166140 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400cee00 con 0x7f58400b2160 2023-11-26T07:18:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f583ed9d640 1 --2- 172.21.15.70:0/2833166140 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f58400d0df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5838009dc0 tx=0x7f583801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722ac2e0e2173564 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834001680 con 0x7f58400b2160 2023-11-26T07:18:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58380a55c0 con 0x7f58400b2160 2023-11-26T07:18:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f583d59a640 1 -- 172.21.15.70:0/2833166140 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380a5950 con 0x7f58400b2160 2023-11-26T07:18:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f5844b3e640 1 -- 172.21.15.70:0/2833166140 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 msgr2=0x7f58400d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f5844b3e640 1 --2- 172.21.15.70:0/2833166140 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f58400d0df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5838009dc0 tx=0x7f583801c890 comp rx=0 tx=0).stop 2023-11-26T07:18:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f5844b3e640 1 -- 172.21.15.70:0/2833166140 shutdown_connections 2023-11-26T07:18:36.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f5844b3e640 1 --2- 172.21.15.70:0/2833166140 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f58400d0df0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f5844b3e640 1 -- 172.21.15.70:0/2833166140 >> 172.21.15.70:0/2833166140 conn(0x7f584009c550 msgr2=0x7f58400d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:36.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f5844b3e640 1 -- 172.21.15.70:0/2833166140 shutdown_connections 2023-11-26T07:18:36.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.866+0000 7f5844b3e640 1 -- 172.21.15.70:0/2833166140 wait complete. 2023-11-26T07:18:36.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 Processor -- start 2023-11-26T07:18:36.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 -- start start 2023-11-26T07:18:36.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f584015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58400d1bc0 0x7f5840151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584015d6e0 0x7f584015f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5840151d60 con 0x7f58400d1bc0 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584015e610 con 0x7f584015d6e0 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58401606d0 con 0x7f58400b2160 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58400d1bc0 0x7f5840151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58400d1bc0 0x7f5840151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40512/0 (socket says 172.21.15.70:40512) 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 -- 172.21.15.70:0/872802021 learned_addr learned my addr 172.21.15.70:0/872802021 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583e59c640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f584015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583ed9d640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584015d6e0 0x7f584015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 -- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 msgr2=0x7f584015c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f584015c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 -- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584015d6e0 msgr2=0x7f584015f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:36.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584015d6e0 0x7f584015f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:36.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 -- 172.21.15.70:0/872802021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838009a70 con 0x7f58400d1bc0 2023-11-26T07:18:36.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583ed9d640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584015d6e0 0x7f584015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f583dd9b640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58400d1bc0 0x7f5840151820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f583400c780 tx=0x7f583400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f582effd640 1 -- 172.21.15.70:0/872802021 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834005cf0 con 0x7f58400d1bc0 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f582effd640 1 -- 172.21.15.70:0/872802021 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834005e50 con 0x7f58400d1bc0 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58401609b0 con 0x7f58400d1bc0 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.870+0000 7f582effd640 1 -- 172.21.15.70:0/872802021 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340072b0 con 0x7f58400d1bc0 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.874+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584015eb40 con 0x7f58400d1bc0 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.874+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5840067680 con 0x7f58400d1bc0 2023-11-26T07:18:36.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.874+0000 7f582effd640 1 -- 172.21.15.70:0/872802021 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5834007410 con 0x7f58400d1bc0 2023-11-26T07:18:36.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.874+0000 7f582effd640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5820066470 0x7f5820068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:36.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.874+0000 7f582effd640 1 -- 172.21.15.70:0/872802021 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5834083600 con 0x7f58400d1bc0 2023-11-26T07:18:36.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.874+0000 7f583e59c640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5820066470 0x7f5820068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:36.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.874+0000 7f583e59c640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5820066470 0x7f5820068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58300011f0 tx=0x7f5830009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:36.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:36.878+0000 7f582effd640 1 -- 172.21.15.70:0/872802021 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5834054510 con 0x7f58400d1bc0 2023-11-26T07:18:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f58401591f0 con 0x7f58400d1bc0 2023-11-26T07:18:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f582effd640 1 -- 172.21.15.70:0/872802021 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f58340540a0 con 0x7f58400d1bc0 2023-11-26T07:18:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:37.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5820066470 msgr2=0x7f5820068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5820066470 0x7f5820068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58300011f0 tx=0x7f5830009040 comp rx=0 tx=0).stop 2023-11-26T07:18:37.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58400d1bc0 msgr2=0x7f5840151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58400d1bc0 0x7f5840151820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f583400c780 tx=0x7f583400cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 shutdown_connections 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5820066470 0x7f5820068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58400d1bc0 0x7f5840151820 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f584015d6e0 0x7f584015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 --2- 172.21.15.70:0/872802021 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58400b2160 0x7f584015c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 >> 172.21.15.70:0/872802021 conn(0x7f584009c550 msgr2=0x7f58400b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 shutdown_connections 2023-11-26T07:18:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.042+0000 7f5844b3e640 1 -- 172.21.15.70:0/872802021 wait complete. 2023-11-26T07:18:37.066 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:18:37.066 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:37.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f339af1c640 1 Processor -- start 2023-11-26T07:18:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f339af1c640 1 -- start start 2023-11-26T07:18:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f339af1c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3394143ac0 0x7f3394070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f339af1c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33940708b0 0x7f33940cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f339af1c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940cfbf0 con 0x7f33940cf7c0 2023-11-26T07:18:37.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f339af1c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3394143ea0 con 0x7f3394143ac0 2023-11-26T07:18:37.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f339af1c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33940cc730 con 0x7f33940708b0 2023-11-26T07:18:37.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f3398cb8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3394143ac0 0x7f3394070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f338bfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33940708b0 0x7f33940cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f3398cb8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3394143ac0 0x7f3394070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:59532/0 (socket says 172.21.15.70:59532) 2023-11-26T07:18:37.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f3398cb8640 1 -- 172.21.15.70:0/2242446105 learned_addr learned my addr 172.21.15.70:0/2242446105 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:37.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f33994b9640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f33940cf7c0 0x7f33940b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:51026/0 (socket says 172.21.15.70:51026) 2023-11-26T07:18:37.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f3398cb8640 1 -- 172.21.15.70:0/2242446105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33940708b0 msgr2=0x7f33940cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:37.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f3398cb8640 1 --2- 172.21.15.70:0/2242446105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33940708b0 0x7f33940cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f3398cb8640 1 -- 172.21.15.70:0/2242446105 >> v1:172.21.15.120:6789/0 conn(0x7f33940cf7c0 legacy=0x7f33940b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.278+0000 7f3398cb8640 1 -- 172.21.15.70:0/2242446105 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394070ee0 con 0x7f3394143ac0 2023-11-26T07:18:37.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f3398cb8640 1 --2- 172.21.15.70:0/2242446105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3394143ac0 0x7f3394070370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f339000bb10 tx=0x7f339001ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e481aef86a093836 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f338b7fe640 1 -- 172.21.15.70:0/2242446105 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900a7bf0 con 0x7f3394143ac0 2023-11-26T07:18:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f338b7fe640 1 -- 172.21.15.70:0/2242446105 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900a7d50 con 0x7f3394143ac0 2023-11-26T07:18:37.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f338b7fe640 1 -- 172.21.15.70:0/2242446105 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900af660 con 0x7f3394143ac0 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 -- 172.21.15.70:0/2242446105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3394143ac0 msgr2=0x7f3394070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 --2- 172.21.15.70:0/2242446105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3394143ac0 0x7f3394070370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f339000bb10 tx=0x7f339001ec10 comp rx=0 tx=0).stop 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 -- 172.21.15.70:0/2242446105 shutdown_connections 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 --2- 172.21.15.70:0/2242446105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33940708b0 0x7f33940cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 --2- 172.21.15.70:0/2242446105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3394143ac0 0x7f3394070370 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 -- 172.21.15.70:0/2242446105 >> 172.21.15.70:0/2242446105 conn(0x7f339406a890 msgr2=0x7f339406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 -- 172.21.15.70:0/2242446105 shutdown_connections 2023-11-26T07:18:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.282+0000 7f339af1c640 1 -- 172.21.15.70:0/2242446105 wait complete. 2023-11-26T07:18:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 Processor -- start 2023-11-26T07:18:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 -- start start 2023-11-26T07:18:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33940708b0 0x7f3394138450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33940cf7c0 0x7f3394141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3394143ac0 0x7f33940aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339415ac80 con 0x7f33940cf7c0 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339415af60 con 0x7f33940708b0 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339415b240 con 0x7f3394143ac0 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33940cf7c0 0x7f3394141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33940cf7c0 0x7f3394141280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40518/0 (socket says 172.21.15.70:40518) 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 -- 172.21.15.70:0/2876430824 learned_addr learned my addr 172.21.15.70:0/2876430824 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f3398cb8640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33940708b0 0x7f3394138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f33994b9640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3394143ac0 0x7f33940aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 -- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3394143ac0 msgr2=0x7f33940aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3394143ac0 0x7f33940aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 -- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33940708b0 msgr2=0x7f3394138450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33940708b0 0x7f3394138450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 -- 172.21.15.70:0/2876430824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339000b770 con 0x7f33940cf7c0 2023-11-26T07:18:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f338bfff640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33940cf7c0 0x7f3394141280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f338400e9b0 tx=0x7f338400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f33897fa640 1 -- 172.21.15.70:0/2876430824 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840096b0 con 0x7f33940cf7c0 2023-11-26T07:18:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f33897fa640 1 -- 172.21.15.70:0/2876430824 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338400c9a0 con 0x7f33940cf7c0 2023-11-26T07:18:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f33897fa640 1 -- 172.21.15.70:0/2876430824 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400cd30 con 0x7f33940cf7c0 2023-11-26T07:18:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339415b520 con 0x7f33940cf7c0 2023-11-26T07:18:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.286+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394138990 con 0x7f33940cf7c0 2023-11-26T07:18:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.290+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3394073ce0 con 0x7f33940cf7c0 2023-11-26T07:18:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.290+0000 7f33897fa640 1 -- 172.21.15.70:0/2876430824 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3384013470 con 0x7f33940cf7c0 2023-11-26T07:18:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.290+0000 7f33897fa640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3380066470 0x7f3380068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.290+0000 7f33897fa640 1 -- 172.21.15.70:0/2876430824 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3384084200 con 0x7f33940cf7c0 2023-11-26T07:18:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.290+0000 7f3398cb8640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3380066470 0x7f3380068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.290+0000 7f3398cb8640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3380066470 0x7f3380068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33900b1000 tx=0x7f33900a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.294+0000 7f33897fa640 1 -- 172.21.15.70:0/2876430824 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3394073ce0 con 0x7f33940cf7c0 2023-11-26T07:18:37.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3394073ce0 con 0x7f33940cf7c0 2023-11-26T07:18:37.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f33897fa640 1 -- 172.21.15.70:0/2876430824 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f3394073ce0 con 0x7f33940cf7c0 2023-11-26T07:18:37.449 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:37.449 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3380066470 msgr2=0x7f3380068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3380066470 0x7f3380068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33900b1000 tx=0x7f33900a9070 comp rx=0 tx=0).stop 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33940cf7c0 msgr2=0x7f3394141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33940cf7c0 0x7f3394141280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f338400e9b0 tx=0x7f338400ee70 comp rx=0 tx=0).stop 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 shutdown_connections 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3380066470 0x7f3380068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33940cf7c0 0x7f3394141280 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3394143ac0 0x7f33940aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 --2- 172.21.15.70:0/2876430824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33940708b0 0x7f3394138450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 >> 172.21.15.70:0/2876430824 conn(0x7f339406a890 msgr2=0x7f339406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 shutdown_connections 2023-11-26T07:18:37.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.446+0000 7f339af1c640 1 -- 172.21.15.70:0/2876430824 wait complete. 2023-11-26T07:18:37.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:37.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd989dc4640 1 Processor -- start 2023-11-26T07:18:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd989dc4640 1 -- start start 2023-11-26T07:18:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd989dc4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd98413e290 0x7fd9840cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd989dc4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd98415f6b0 0x7fd9840cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd989dc4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98415fb20 con 0x7fd9840cf7c0 2023-11-26T07:18:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd989dc4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9840cfc40 con 0x7fd98415f6b0 2023-11-26T07:18:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd989dc4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98406c520 con 0x7fd98413e290 2023-11-26T07:18:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd983fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd98415f6b0 0x7fd9840cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd982ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd9840cf7c0 0x7fd98415efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60752/0 (socket says 172.21.15.70:60752) 2023-11-26T07:18:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.610+0000 7fd982ffd640 1 -- 172.21.15.70:0/250663619 learned_addr learned my addr 172.21.15.70:0/250663619 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd9837fe640 1 --2- 172.21.15.70:0/250663619 >> v2:172.21.15.120:3300/0 conn(0x7fd98413e290 0x7fd9840cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd983fff640 1 -- 172.21.15.70:0/250663619 >> v2:172.21.15.120:3300/0 conn(0x7fd98413e290 msgr2=0x7fd9840cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd983fff640 1 --2- 172.21.15.70:0/250663619 >> v2:172.21.15.120:3300/0 conn(0x7fd98413e290 0x7fd9840cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd983fff640 1 -- 172.21.15.70:0/250663619 >> v1:172.21.15.70:6789/0 conn(0x7fd9840cf7c0 legacy=0x7fd98415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd983fff640 1 -- 172.21.15.70:0/250663619 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98406c800 con 0x7fd98415f6b0 2023-11-26T07:18:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd9827fc640 1 -- 172.21.15.70:0/250663619 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499030051 0 0) 0x7fd978001120 con 0x7fd9840cf7c0 2023-11-26T07:18:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd983fff640 1 --2- 172.21.15.70:0/250663619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd98415f6b0 0x7fd9840cd7b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd9840725a0 tx=0x7fd97c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aeb24b01bd4510 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd9827fc640 1 -- 172.21.15.70:0/250663619 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a59a0 con 0x7fd98415f6b0 2023-11-26T07:18:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd9827fc640 1 -- 172.21.15.70:0/250663619 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c0a5b00 con 0x7fd98415f6b0 2023-11-26T07:18:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.614+0000 7fd9827fc640 1 -- 172.21.15.70:0/250663619 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a5e90 con 0x7fd98415f6b0 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- 172.21.15.70:0/250663619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd98415f6b0 msgr2=0x7fd9840cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 --2- 172.21.15.70:0/250663619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd98415f6b0 0x7fd9840cd7b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd9840725a0 tx=0x7fd97c01c8e0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- 172.21.15.70:0/250663619 shutdown_connections 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 --2- 172.21.15.70:0/250663619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd98415f6b0 0x7fd9840cd7b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 --2- 172.21.15.70:0/250663619 >> v2:172.21.15.120:3300/0 conn(0x7fd98413e290 0x7fd9840cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- 172.21.15.70:0/250663619 >> 172.21.15.70:0/250663619 conn(0x7fd98406a890 msgr2=0x7fd98406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- 172.21.15.70:0/250663619 shutdown_connections 2023-11-26T07:18:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- 172.21.15.70:0/250663619 wait complete. 2023-11-26T07:18:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 Processor -- start 2023-11-26T07:18:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- start start 2023-11-26T07:18:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9840cf7c0 0x7fd9841543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd98413e290 0x7fd984133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98415f6b0 0x7fd984133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840aec90 con 0x7fd9840cf7c0 2023-11-26T07:18:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840aef70 con 0x7fd98413e290 2023-11-26T07:18:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd989dc4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840b2760 con 0x7fd98415f6b0 2023-11-26T07:18:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9840cf7c0 0x7fd9841543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9840cf7c0 0x7fd9841543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40534/0 (socket says 172.21.15.70:40534) 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 -- 172.21.15.70:0/3906361752 learned_addr learned my addr 172.21.15.70:0/3906361752 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 -- 172.21.15.70:0/3906361752 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98415f6b0 msgr2=0x7fd984133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98415f6b0 0x7fd984133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 -- 172.21.15.70:0/3906361752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd98413e290 msgr2=0x7fd984133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd98413e290 0x7fd984133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 -- 172.21.15.70:0/3906361752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c009a70 con 0x7fd9840cf7c0 2023-11-26T07:18:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.618+0000 7fd9837fe640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9840cf7c0 0x7fd9841543a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd97400e930 tx=0x7fd97400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd96bfff640 1 -- 172.21.15.70:0/3906361752 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974009690 con 0x7fd9840cf7c0 2023-11-26T07:18:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd96bfff640 1 -- 172.21.15.70:0/3906361752 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97400ca00 con 0x7fd9840cf7c0 2023-11-26T07:18:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9840b2a40 con 0x7fd9840cf7c0 2023-11-26T07:18:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd96bfff640 1 -- 172.21.15.70:0/3906361752 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97400cd70 con 0x7fd9840cf7c0 2023-11-26T07:18:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd984154a20 con 0x7fd9840cf7c0 2023-11-26T07:18:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd984154d00 con 0x7fd9840cf7c0 2023-11-26T07:18:37.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd96bfff640 1 -- 172.21.15.70:0/3906361752 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd974013470 con 0x7fd9840cf7c0 2023-11-26T07:18:37.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd96bfff640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd970066470 0x7fd970068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd96bfff640 1 -- 172.21.15.70:0/3906361752 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9740844d0 con 0x7fd9840cf7c0 2023-11-26T07:18:37.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd982ffd640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd970066470 0x7fd970068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.622+0000 7fd982ffd640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd970066470 0x7fd970068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd978005890 tx=0x7fd978001270 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.626+0000 7fd96bfff640 1 -- 172.21.15.70:0/3906361752 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd974051a00 con 0x7fd9840cf7c0 2023-11-26T07:18:37.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.778+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9840b2bd0 con 0x7fd9840cf7c0 2023-11-26T07:18:37.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd96bfff640 1 -- 172.21.15.70:0/3906361752 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd974055020 con 0x7fd9840cf7c0 2023-11-26T07:18:37.784 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd970066470 msgr2=0x7fd970068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd970066470 0x7fd970068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd978005890 tx=0x7fd978001270 comp rx=0 tx=0).stop 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9840cf7c0 msgr2=0x7fd9841543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9840cf7c0 0x7fd9841543a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd97400e930 tx=0x7fd97400edf0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 shutdown_connections 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd98415f6b0 0x7fd984133ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd98413e290 0x7fd984133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd970066470 0x7fd970068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 --2- 172.21.15.70:0/3906361752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9840cf7c0 0x7fd9841543a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 >> 172.21.15.70:0/3906361752 conn(0x7fd98406a890 msgr2=0x7fd98413c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 shutdown_connections 2023-11-26T07:18:37.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.782+0000 7fd989dc4640 1 -- 172.21.15.70:0/3906361752 wait complete. 2023-11-26T07:18:37.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.942+0000 7f7445b2a640 1 Processor -- start 2023-11-26T07:18:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.942+0000 7f7445b2a640 1 -- start start 2023-11-26T07:18:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f7445b2a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f744013e290 0x7f74400cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f7445b2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74400cf7c0 0x7f744015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f7445b2a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744006c520 con 0x7f744015f4e0 2023-11-26T07:18:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f7445b2a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74400cfc40 con 0x7f744013e290 2023-11-26T07:18:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f7445b2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744006c800 con 0x7f74400cf7c0 2023-11-26T07:18:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f744013e290 0x7f74400cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743ffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f744015f4e0 0x7f74401408e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60762/0 (socket says 172.21.15.70:60762) 2023-11-26T07:18:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f744013e290 0x7f74400cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40550/0 (socket says 172.21.15.70:40550) 2023-11-26T07:18:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743ffff640 1 -- 172.21.15.70:0/3820496332 learned_addr learned my addr 172.21.15.70:0/3820496332 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743effd640 1 --2- 172.21.15.70:0/3820496332 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74400cf7c0 0x7f744015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743f7fe640 1 -- 172.21.15.70:0/3820496332 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74400cf7c0 msgr2=0x7f744015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743f7fe640 1 --2- 172.21.15.70:0/3820496332 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74400cf7c0 0x7f744015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743f7fe640 1 -- 172.21.15.70:0/3820496332 >> v1:172.21.15.70:6789/0 conn(0x7f744015f4e0 legacy=0x7f74401408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743f7fe640 1 -- 172.21.15.70:0/3820496332 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744006cae0 con 0x7f744013e290 2023-11-26T07:18:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743e7fc640 1 -- 172.21.15.70:0/3820496332 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442932004 0 0) 0x7f744006c520 con 0x7f744015f4e0 2023-11-26T07:18:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.946+0000 7f743effd640 1 --2- 172.21.15.70:0/3820496332 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74400cf7c0 0x7f744015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f743f7fe640 1 --2- 172.21.15.70:0/3820496332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744013e290 0x7f74400cf280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1b6e6eb57439b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f743e7fc640 1 -- 172.21.15.70:0/3820496332 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300ab650 con 0x7f744013e290 2023-11-26T07:18:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f743e7fc640 1 -- 172.21.15.70:0/3820496332 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300ab7b0 con 0x7f744013e290 2023-11-26T07:18:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f743e7fc640 1 -- 172.21.15.70:0/3820496332 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300abb40 con 0x7f744013e290 2023-11-26T07:18:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 -- 172.21.15.70:0/3820496332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744013e290 msgr2=0x7f74400cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 --2- 172.21.15.70:0/3820496332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744013e290 0x7f74400cf280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001c450 comp rx=0 tx=0).stop 2023-11-26T07:18:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 -- 172.21.15.70:0/3820496332 shutdown_connections 2023-11-26T07:18:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 --2- 172.21.15.70:0/3820496332 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74400cf7c0 0x7f744015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 --2- 172.21.15.70:0/3820496332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744013e290 0x7f74400cf280 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 -- 172.21.15.70:0/3820496332 >> 172.21.15.70:0/3820496332 conn(0x7f744006a890 msgr2=0x7f744006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 -- 172.21.15.70:0/3820496332 shutdown_connections 2023-11-26T07:18:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 -- 172.21.15.70:0/3820496332 wait complete. 2023-11-26T07:18:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 Processor -- start 2023-11-26T07:18:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.950+0000 7f7445b2a640 1 -- start start 2023-11-26T07:18:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cf7c0 0x7f744015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f744013e290 0x7f74400affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744015f4e0 0x7f74400b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440156550 con 0x7f744015f4e0 2023-11-26T07:18:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400b19c0 con 0x7f74400cf7c0 2023-11-26T07:18:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7440155d40 con 0x7f744013e290 2023-11-26T07:18:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744015f4e0 0x7f74400b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744015f4e0 0x7f74400b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40560/0 (socket says 172.21.15.70:40560) 2023-11-26T07:18:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 -- 172.21.15.70:0/754748420 learned_addr learned my addr 172.21.15.70:0/754748420 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743effd640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f744013e290 0x7f74400affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 -- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f744013e290 msgr2=0x7f74400affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743f7fe640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cf7c0 0x7f744015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f744013e290 0x7f74400affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 -- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cf7c0 msgr2=0x7f744015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cf7c0 0x7f744015e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 -- 172.21.15.70:0/754748420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009420 con 0x7f744015f4e0 2023-11-26T07:18:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743effd640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f744013e290 0x7f74400affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743f7fe640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cf7c0 0x7f744015e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f743ffff640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744015f4e0 0x7f74400b04e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f743800c7b0 tx=0x7f743800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7427fff640 1 -- 172.21.15.70:0/754748420 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800a640 con 0x7f744015f4e0 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7427fff640 1 -- 172.21.15.70:0/754748420 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800a7c0 con 0x7f744015f4e0 2023-11-26T07:18:37.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7427fff640 1 -- 172.21.15.70:0/754748420 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800ab70 con 0x7f744015f4e0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7440155f90 con 0x7f744015f4e0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74400b11c0 con 0x7f744015f4e0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.954+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7440067680 con 0x7f744015f4e0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.958+0000 7f7427fff640 1 -- 172.21.15.70:0/754748420 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f743800acd0 con 0x7f744015f4e0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.958+0000 7f7427fff640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f742c066470 0x7f742c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.958+0000 7f7427fff640 1 -- 172.21.15.70:0/754748420 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74380832c0 con 0x7f744015f4e0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.958+0000 7f743f7fe640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f742c066470 0x7f742c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:37.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.958+0000 7f743f7fe640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f742c066470 0x7f742c068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74300af000 tx=0x7f7430008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:37.962+0000 7f7427fff640 1 -- 172.21.15.70:0/754748420 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7438050730 con 0x7f744015f4e0 2023-11-26T07:18:38.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.110+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f744006df50 con 0x7f744015f4e0 2023-11-26T07:18:38.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.110+0000 7f7427fff640 1 -- 172.21.15.70:0/754748420 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7438053d50 con 0x7f744015f4e0 2023-11-26T07:18:38.115 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f742c066470 msgr2=0x7f742c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f742c066470 0x7f742c068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74300af000 tx=0x7f7430008040 comp rx=0 tx=0).stop 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744015f4e0 msgr2=0x7f74400b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744015f4e0 0x7f74400b04e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f743800c7b0 tx=0x7f743800cc70 comp rx=0 tx=0).stop 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 shutdown_connections 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f742c066470 0x7f742c068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f744015f4e0 0x7f74400b04e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f744013e290 0x7f74400affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 --2- 172.21.15.70:0/754748420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74400cf7c0 0x7f744015e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 >> 172.21.15.70:0/754748420 conn(0x7f744006a890 msgr2=0x7f74400af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 shutdown_connections 2023-11-26T07:18:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.114+0000 7f7445b2a640 1 -- 172.21.15.70:0/754748420 wait complete. 2023-11-26T07:18:38.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:38.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.270+0000 7f9979fd1640 1 Processor -- start 2023-11-26T07:18:38.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.270+0000 7f9979fd1640 1 -- start start 2023-11-26T07:18:38.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9979fd1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f99740cf990 0x7f997415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9979fd1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f997415f4e0 0x7f99740cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9979fd1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997406c520 con 0x7f997413e290 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9979fd1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997406c800 con 0x7f997415f4e0 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9979fd1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997406cae0 con 0x7f99740cf990 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9973fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f997415f4e0 0x7f99740cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f99737fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f997413e290 0x7f99740cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60770/0 (socket says 172.21.15.70:60770) 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f99737fe640 1 -- 172.21.15.70:0/2042982605 learned_addr learned my addr 172.21.15.70:0/2042982605 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f996bfff640 1 --2- 172.21.15.70:0/2042982605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f99740cf990 0x7f997415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9973fff640 1 -- 172.21.15.70:0/2042982605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f99740cf990 msgr2=0x7f997415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9973fff640 1 --2- 172.21.15.70:0/2042982605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f99740cf990 0x7f997415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9973fff640 1 -- 172.21.15.70:0/2042982605 >> v1:172.21.15.70:6789/0 conn(0x7f997413e290 legacy=0x7f99740cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9973fff640 1 -- 172.21.15.70:0/2042982605 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997406cdc0 con 0x7f997415f4e0 2023-11-26T07:18:38.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.274+0000 7f9972ffd640 1 -- 172.21.15.70:0/2042982605 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471705916 0 0) 0x7f997406c520 con 0x7f997413e290 2023-11-26T07:18:38.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9973fff640 1 --2- 172.21.15.70:0/2042982605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997415f4e0 0x7f99740cd7b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f996c009d90 tx=0x7f996c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab5c30c9b5d2788 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9972ffd640 1 -- 172.21.15.70:0/2042982605 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0a5a00 con 0x7f997415f4e0 2023-11-26T07:18:38.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9972ffd640 1 -- 172.21.15.70:0/2042982605 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c0a5b60 con 0x7f997415f4e0 2023-11-26T07:18:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9972ffd640 1 -- 172.21.15.70:0/2042982605 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0ad440 con 0x7f997415f4e0 2023-11-26T07:18:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 -- 172.21.15.70:0/2042982605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997415f4e0 msgr2=0x7f99740cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2042982605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997415f4e0 0x7f99740cd7b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f996c009d90 tx=0x7f996c01c920 comp rx=0 tx=0).stop 2023-11-26T07:18:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 -- 172.21.15.70:0/2042982605 shutdown_connections 2023-11-26T07:18:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2042982605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997415f4e0 0x7f99740cd7b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2042982605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f99740cf990 0x7f997415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 -- 172.21.15.70:0/2042982605 >> 172.21.15.70:0/2042982605 conn(0x7f997406a890 msgr2=0x7f997406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 -- 172.21.15.70:0/2042982605 shutdown_connections 2023-11-26T07:18:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 -- 172.21.15.70:0/2042982605 wait complete. 2023-11-26T07:18:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 Processor -- start 2023-11-26T07:18:38.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.278+0000 7f9979fd1640 1 -- start start 2023-11-26T07:18:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740cf990 0x7f9974135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997413e290 0x7f9974135ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f997415f4e0 0x7f9974136530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99741507a0 con 0x7f997413e290 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997414fcb0 con 0x7f99740cf990 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997414ff00 con 0x7f997415f4e0 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997413e290 0x7f9974135ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997413e290 0x7f9974135ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40590/0 (socket says 172.21.15.70:40590) 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 -- 172.21.15.70:0/2578346288 learned_addr learned my addr 172.21.15.70:0/2578346288 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f99737fe640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740cf990 0x7f9974135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9973fff640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f997415f4e0 0x7f9974136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 -- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f997415f4e0 msgr2=0x7f9974136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f997415f4e0 0x7f9974136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 -- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740cf990 msgr2=0x7f9974135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740cf990 0x7f9974135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 -- 172.21.15.70:0/2578346288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c009a70 con 0x7f997413e290 2023-11-26T07:18:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f996bfff640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997413e290 0x7f9974135ff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f995c00d800 tx=0x7f995c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9970ff9640 1 -- 172.21.15.70:0/2578346288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00b6c0 con 0x7f997413e290 2023-11-26T07:18:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9970ff9640 1 -- 172.21.15.70:0/2578346288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c00b820 con 0x7f997413e290 2023-11-26T07:18:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9970ff9640 1 -- 172.21.15.70:0/2578346288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00bb90 con 0x7f997413e290 2023-11-26T07:18:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99741501e0 con 0x7f997413e290 2023-11-26T07:18:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99740afb20 con 0x7f997413e290 2023-11-26T07:18:38.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.282+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9974067680 con 0x7f997413e290 2023-11-26T07:18:38.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.286+0000 7f9970ff9640 1 -- 172.21.15.70:0/2578346288 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f995c00bcf0 con 0x7f997413e290 2023-11-26T07:18:38.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.286+0000 7f9970ff9640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9954066470 0x7f9954068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.286+0000 7f9970ff9640 1 -- 172.21.15.70:0/2578346288 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f995c084290 con 0x7f997413e290 2023-11-26T07:18:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.286+0000 7f99737fe640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9954066470 0x7f9954068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.286+0000 7f99737fe640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9954066470 0x7f9954068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9964007fd0 tx=0x7f9964007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.290+0000 7f9970ff9640 1 -- 172.21.15.70:0/2578346288 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f995c0517b0 con 0x7f997413e290 2023-11-26T07:18:38.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.438+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99740cc310 con 0x7f997413e290 2023-11-26T07:18:38.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9970ff9640 1 -- 172.21.15.70:0/2578346288 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f995c054dd0 con 0x7f997413e290 2023-11-26T07:18:38.443 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:38.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9954066470 msgr2=0x7f9954068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9954066470 0x7f9954068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9964007fd0 tx=0x7f9964007d60 comp rx=0 tx=0).stop 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997413e290 msgr2=0x7f9974135ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997413e290 0x7f9974135ff0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f995c00d800 tx=0x7f995c00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 shutdown_connections 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9954066470 0x7f9954068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f997413e290 0x7f9974135ff0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f997415f4e0 0x7f9974136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 --2- 172.21.15.70:0/2578346288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99740cf990 0x7f9974135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 >> 172.21.15.70:0/2578346288 conn(0x7f997406a890 msgr2=0x7f997413aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 shutdown_connections 2023-11-26T07:18:38.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.442+0000 7f9979fd1640 1 -- 172.21.15.70:0/2578346288 wait complete. 2023-11-26T07:18:38.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:38.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.598+0000 7ff0cb9df640 1 Processor -- start 2023-11-26T07:18:38.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.598+0000 7ff0cb9df640 1 -- start start 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0cb9df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff0c4143ac0 0x7ff0c4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0cb9df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff0c40708b0 0x7ff0c40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0cb9df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40cf7c0 0x7ff0c40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0cb9df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c4143ea0 con 0x7ff0c40708b0 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0cb9df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c40cc730 con 0x7ff0c4143ac0 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0cb9df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40cfbd0 con 0x7ff0c40cf7c0 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff0c40708b0 0x7ff0c40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff0c40708b0 0x7ff0c40cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40604/0 (socket says 172.21.15.70:40604) 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 -- 172.21.15.70:0/78628989 learned_addr learned my addr 172.21.15.70:0/78628989 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c977b640 1 --2- 172.21.15.70:0/78628989 >> v2:172.21.15.120:3300/0 conn(0x7ff0c4143ac0 0x7ff0c4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c9f7c640 1 --2- 172.21.15.70:0/78628989 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40cf7c0 0x7ff0c40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 -- 172.21.15.70:0/78628989 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40cf7c0 msgr2=0x7ff0c40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 --2- 172.21.15.70:0/78628989 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40cf7c0 0x7ff0c40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 -- 172.21.15.70:0/78628989 >> v2:172.21.15.120:3300/0 conn(0x7ff0c4143ac0 msgr2=0x7ff0c4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 --2- 172.21.15.70:0/78628989 >> v2:172.21.15.120:3300/0 conn(0x7ff0c4143ac0 0x7ff0c4070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c8f7a640 1 -- 172.21.15.70:0/78628989 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4070ee0 con 0x7ff0c40708b0 2023-11-26T07:18:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.602+0000 7ff0c977b640 1 --2- 172.21.15.70:0/78628989 >> v2:172.21.15.120:3300/0 conn(0x7ff0c4143ac0 0x7ff0c4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:38.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0c8f7a640 1 --2- 172.21.15.70:0/78628989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c40708b0 0x7ff0c40cf280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff0c406dca0 tx=0x7ff0b401e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a3838619935598 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0bbfff640 1 -- 172.21.15.70:0/78628989 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40a79a0 con 0x7ff0c40708b0 2023-11-26T07:18:38.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0bbfff640 1 -- 172.21.15.70:0/78628989 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b40a7b00 con 0x7ff0c40708b0 2023-11-26T07:18:38.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0bbfff640 1 -- 172.21.15.70:0/78628989 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40a7e90 con 0x7ff0c40708b0 2023-11-26T07:18:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 -- 172.21.15.70:0/78628989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c40708b0 msgr2=0x7ff0c40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/78628989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c40708b0 0x7ff0c40cf280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff0c406dca0 tx=0x7ff0b401e910 comp rx=0 tx=0).stop 2023-11-26T07:18:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 -- 172.21.15.70:0/78628989 shutdown_connections 2023-11-26T07:18:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/78628989 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40cf7c0 0x7ff0c40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/78628989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c40708b0 0x7ff0c40cf280 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/78628989 >> v2:172.21.15.120:3300/0 conn(0x7ff0c4143ac0 0x7ff0c4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 -- 172.21.15.70:0/78628989 >> 172.21.15.70:0/78628989 conn(0x7ff0c406a890 msgr2=0x7ff0c406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 -- 172.21.15.70:0/78628989 shutdown_connections 2023-11-26T07:18:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 -- 172.21.15.70:0/78628989 wait complete. 2023-11-26T07:18:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 Processor -- start 2023-11-26T07:18:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.606+0000 7ff0cb9df640 1 -- start start 2023-11-26T07:18:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40708b0 0x7ff0c40aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0c40cf7c0 0x7ff0c4139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c4143ac0 0x7ff0c40b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c413a140 con 0x7ff0c4143ac0 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40af240 con 0x7ff0c40cf7c0 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40af520 con 0x7ff0c40708b0 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c4143ac0 0x7ff0c40b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c4143ac0 0x7ff0c40b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40612/0 (socket says 172.21.15.70:40612) 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 -- 172.21.15.70:0/2171452796 learned_addr learned my addr 172.21.15.70:0/2171452796 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c977b640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40708b0 0x7ff0c40aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c8f7a640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0c40cf7c0 0x7ff0c4139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 -- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40708b0 msgr2=0x7ff0c40aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40708b0 0x7ff0c40aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 -- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0c40cf7c0 msgr2=0x7ff0c4139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0c40cf7c0 0x7ff0c4139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 -- 172.21.15.70:0/2171452796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b400b770 con 0x7ff0c4143ac0 2023-11-26T07:18:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c8f7a640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0c40cf7c0 0x7ff0c4139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0c9f7c640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c4143ac0 0x7ff0c40b02e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc007e60 tx=0x7ff0bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0b9ffb640 1 -- 172.21.15.70:0/2171452796 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc014620 con 0x7ff0c4143ac0 2023-11-26T07:18:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0b9ffb640 1 -- 172.21.15.70:0/2171452796 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc00ee90 con 0x7ff0c4143ac0 2023-11-26T07:18:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c40af800 con 0x7ff0c4143ac0 2023-11-26T07:18:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0b9ffb640 1 -- 172.21.15.70:0/2171452796 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0149e0 con 0x7ff0c4143ac0 2023-11-26T07:18:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c40afdc0 con 0x7ff0c4143ac0 2023-11-26T07:18:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c40affb0 con 0x7ff0c4143ac0 2023-11-26T07:18:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.610+0000 7ff0b9ffb640 1 -- 172.21.15.70:0/2171452796 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0bc014b40 con 0x7ff0c4143ac0 2023-11-26T07:18:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.614+0000 7ff0b9ffb640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff0a80664a0 0x7ff0a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.614+0000 7ff0b9ffb640 1 -- 172.21.15.70:0/2171452796 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0bc0846c0 con 0x7ff0c4143ac0 2023-11-26T07:18:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.614+0000 7ff0c977b640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff0a80664a0 0x7ff0a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.614+0000 7ff0c977b640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff0a80664a0 0x7ff0a8068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00045f0 tx=0x7ff0c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:38.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.618+0000 7ff0b9ffb640 1 -- 172.21.15.70:0/2171452796 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0bc051b50 con 0x7ff0c4143ac0 2023-11-26T07:18:38.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0c4067680 con 0x7ff0c4143ac0 2023-11-26T07:18:38.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0b9ffb640 1 -- 172.21.15.70:0/2171452796 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff0bc055170 con 0x7ff0c4143ac0 2023-11-26T07:18:38.781 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff0a80664a0 msgr2=0x7ff0a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff0a80664a0 0x7ff0a8068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00045f0 tx=0x7ff0c0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c4143ac0 msgr2=0x7ff0c40b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c4143ac0 0x7ff0c40b02e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc007e60 tx=0x7ff0bc00e4b0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 shutdown_connections 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff0a80664a0 0x7ff0a8068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c4143ac0 0x7ff0c40b02e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0c40cf7c0 0x7ff0c4139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 --2- 172.21.15.70:0/2171452796 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff0c40708b0 0x7ff0c40aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 >> 172.21.15.70:0/2171452796 conn(0x7ff0c406a890 msgr2=0x7ff0c4142420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 shutdown_connections 2023-11-26T07:18:38.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:38.778+0000 7ff0cb9df640 1 -- 172.21.15.70:0/2171452796 wait complete. 2023-11-26T07:18:38.802 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2023-11-26T07:18:38.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:38.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-26T07:18:38.830 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:38.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:18:38.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:38.831 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:18:38.887 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:18:38.887 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:38.897 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:18:38.897 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:38.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:39.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f807ae6b640 1 Processor -- start 2023-11-26T07:18:39.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f807ae6b640 1 -- start start 2023-11-26T07:18:39.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f807ae6b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80741596d0 0x7f8074071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f807ae6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80740b2f80 0x7f807406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f807ae6b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807406c750 con 0x7f80740ce680 2023-11-26T07:18:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f807ae6b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740cbe00 con 0x7f80741596d0 2023-11-26T07:18:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f807ae6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80740b3550 con 0x7f80740b2f80 2023-11-26T07:18:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f8078c07640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80741596d0 0x7f8074071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f8078c07640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80741596d0 0x7f8074071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40628/0 (socket says 172.21.15.70:40628) 2023-11-26T07:18:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f806bfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f80740ce680 0x7f80740b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60772/0 (socket says 172.21.15.70:60772) 2023-11-26T07:18:39.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f8078c07640 1 -- 172.21.15.70:0/2227403099 learned_addr learned my addr 172.21.15.70:0/2227403099 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:39.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f8078c07640 1 -- 172.21.15.70:0/2227403099 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80740b2f80 msgr2=0x7f807406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:39.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f8078c07640 1 --2- 172.21.15.70:0/2227403099 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80740b2f80 0x7f807406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f8078c07640 1 -- 172.21.15.70:0/2227403099 >> v1:172.21.15.70:6789/0 conn(0x7f80740ce680 legacy=0x7f80740b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f8078c07640 1 -- 172.21.15.70:0/2227403099 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8074071e80 con 0x7f80741596d0 2023-11-26T07:18:39.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.082+0000 7f806b7fe640 1 -- 172.21.15.70:0/2227403099 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279077249 0 0) 0x7f807406c750 con 0x7f80740ce680 2023-11-26T07:18:39.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f8078c07640 1 --2- 172.21.15.70:0/2227403099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80741596d0 0x7f8074071850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f807000aa10 tx=0x7f807001d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e94f4e0109989e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f806b7fe640 1 -- 172.21.15.70:0/2227403099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700a6860 con 0x7f80741596d0 2023-11-26T07:18:39.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f806b7fe640 1 -- 172.21.15.70:0/2227403099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80700a69c0 con 0x7f80741596d0 2023-11-26T07:18:39.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f806b7fe640 1 -- 172.21.15.70:0/2227403099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700a6d50 con 0x7f80741596d0 2023-11-26T07:18:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 -- 172.21.15.70:0/2227403099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80741596d0 msgr2=0x7f8074071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 --2- 172.21.15.70:0/2227403099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80741596d0 0x7f8074071850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f807000aa10 tx=0x7f807001d930 comp rx=0 tx=0).stop 2023-11-26T07:18:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 -- 172.21.15.70:0/2227403099 shutdown_connections 2023-11-26T07:18:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 --2- 172.21.15.70:0/2227403099 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80740b2f80 0x7f807406cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 --2- 172.21.15.70:0/2227403099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80741596d0 0x7f8074071850 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 -- 172.21.15.70:0/2227403099 >> 172.21.15.70:0/2227403099 conn(0x7f807406a890 msgr2=0x7f807406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 -- 172.21.15.70:0/2227403099 shutdown_connections 2023-11-26T07:18:39.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.086+0000 7f807ae6b640 1 -- 172.21.15.70:0/2227403099 wait complete. 2023-11-26T07:18:39.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 Processor -- start 2023-11-26T07:18:39.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 -- start start 2023-11-26T07:18:39.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80740b2f80 0x7f807413b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80740ce680 0x7f807415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80741596d0 0x7f807413b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807415acc0 con 0x7f80740b2f80 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074152a10 con 0x7f80740ce680 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807415c5d0 con 0x7f80741596d0 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80740b2f80 0x7f807413b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80740b2f80 0x7f807413b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40642/0 (socket says 172.21.15.70:40642) 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 -- 172.21.15.70:0/3794388542 learned_addr learned my addr 172.21.15.70:0/3794388542 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 -- 172.21.15.70:0/3794388542 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80741596d0 msgr2=0x7f807413b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80741596d0 0x7f807413b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 -- 172.21.15.70:0/3794388542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80740ce680 msgr2=0x7f807415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80740ce680 0x7f807415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 -- 172.21.15.70:0/3794388542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807000a670 con 0x7f80740b2f80 2023-11-26T07:18:39.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f8078c07640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80740b2f80 0x7f807413b1c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f807000aa10 tx=0x7f807001c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f80697fa640 1 -- 172.21.15.70:0/3794388542 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070004230 con 0x7f80740b2f80 2023-11-26T07:18:39.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f80697fa640 1 -- 172.21.15.70:0/3794388542 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8070004390 con 0x7f80740b2f80 2023-11-26T07:18:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f80697fa640 1 -- 172.21.15.70:0/3794388542 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700ba860 con 0x7f80740b2f80 2023-11-26T07:18:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807415a920 con 0x7f80740b2f80 2023-11-26T07:18:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.090+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8074152f20 con 0x7f80740b2f80 2023-11-26T07:18:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.094+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807415ae00 con 0x7f80740b2f80 2023-11-26T07:18:39.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.094+0000 7f80697fa640 1 -- 172.21.15.70:0/3794388542 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80700ba9c0 con 0x7f80740b2f80 2023-11-26T07:18:39.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.094+0000 7f80697fa640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8060066470 0x7f8060068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.094+0000 7f80697fa640 1 -- 172.21.15.70:0/3794388542 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f807011ec70 con 0x7f80740b2f80 2023-11-26T07:18:39.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.094+0000 7f806bfff640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8060066470 0x7f8060068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.094+0000 7f806bfff640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8060066470 0x7f8060068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80640011f0 tx=0x7f8064007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.098+0000 7f80697fa640 1 -- 172.21.15.70:0/3794388542 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f807415ae00 con 0x7f80740b2f80 2023-11-26T07:18:39.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f807415ae00 con 0x7f80740b2f80 2023-11-26T07:18:39.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f80697fa640 1 -- 172.21.15.70:0/3794388542 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f807415ae00 con 0x7f80740b2f80 2023-11-26T07:18:39.253 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:39.253 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:39.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8060066470 msgr2=0x7f8060068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8060066470 0x7f8060068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80640011f0 tx=0x7f8064007930 comp rx=0 tx=0).stop 2023-11-26T07:18:39.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80740b2f80 msgr2=0x7f807413b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80740b2f80 0x7f807413b1c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f807000aa10 tx=0x7f807001c170 comp rx=0 tx=0).stop 2023-11-26T07:18:39.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 shutdown_connections 2023-11-26T07:18:39.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f80741596d0 0x7f807413b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80740ce680 0x7f807415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8060066470 0x7f8060068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 --2- 172.21.15.70:0/3794388542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80740b2f80 0x7f807413b1c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 >> 172.21.15.70:0/3794388542 conn(0x7f807406a890 msgr2=0x7f80740cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 shutdown_connections 2023-11-26T07:18:39.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.250+0000 7f807ae6b640 1 -- 172.21.15.70:0/3794388542 wait complete. 2023-11-26T07:18:39.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:39.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:39.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab9ab94640 1 Processor -- start 2023-11-26T07:18:39.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab9ab94640 1 -- start start 2023-11-26T07:18:39.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab9ab94640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fab940cf280 0x7fab940cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab9ab94640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab940cc730 con 0x7fab94143ac0 2023-11-26T07:18:39.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab9ab94640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab94070ee0 con 0x7fab940cd1b0 2023-11-26T07:18:39.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab9ab94640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab94143ea0 con 0x7fab940cf280 2023-11-26T07:18:39.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab98930640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fab94143ac0 0x7fab94070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60782/0 (socket says 172.21.15.70:60782) 2023-11-26T07:18:39.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab98930640 1 -- 172.21.15.70:0/654728689 learned_addr learned my addr 172.21.15.70:0/654728689 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:39.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab93fff640 1 --2- 172.21.15.70:0/654728689 >> v2:172.21.15.120:3300/0 conn(0x7fab940cf280 0x7fab940cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393515507 0 0) 0x7fab940cc730 con 0x7fab94143ac0 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab84005740 con 0x7fab94143ac0 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416582526 0 0) 0x7fab84005740 con 0x7fab94143ac0 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 >> v2:172.21.15.120:3300/0 conn(0x7fab940cf280 msgr2=0x7fab940cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 --2- 172.21.15.70:0/654728689 >> v2:172.21.15.120:3300/0 conn(0x7fab940cf280 0x7fab940cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 >> v1:172.21.15.120:6789/0 conn(0x7fab940cd1b0 legacy=0x7fab940cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab940711c0 con 0x7fab94143ac0 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fab88001680 con 0x7fab94143ac0 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 >> v1:172.21.15.70:6789/0 conn(0x7fab94143ac0 legacy=0x7fab94070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab84005b90 0x7fab84005f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840069e0 0x7fab84006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab840073a0 0x7fab8400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8400e1c0 con 0x7fab840073a0 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8400e330 con 0x7fab84005b90 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8400e4f0 con 0x7fab840069e0 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab99131640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab840073a0 0x7fab8400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab98930640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab84005b90 0x7fab84005f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab93fff640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840069e0 0x7fab84006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab99131640 1 -- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840069e0 msgr2=0x7fab84006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab99131640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840069e0 0x7fab84006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab99131640 1 -- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab84005b90 msgr2=0x7fab84005f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab99131640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab84005b90 0x7fab84005f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.414+0000 7fab99131640 1 -- 172.21.15.70:0/654728689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84005740 con 0x7fab840073a0 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab99131640 1 -- 172.21.15.70:0/654728689 reap_dead start 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab99131640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab840073a0 0x7fab8400dba0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab8c001f60 tx=0x7fab8c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78823477767e14e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c003b80 con 0x7fab840073a0 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c003ce0 con 0x7fab840073a0 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab937fe640 1 -- 172.21.15.70:0/654728689 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0052f0 con 0x7fab840073a0 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab9ab94640 1 -- 172.21.15.70:0/654728689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab840073a0 msgr2=0x7fab8400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab9ab94640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab840073a0 0x7fab8400dba0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab8c001f60 tx=0x7fab8c01c860 comp rx=0 tx=0).stop 2023-11-26T07:18:39.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab9ab94640 1 -- 172.21.15.70:0/654728689 shutdown_connections 2023-11-26T07:18:39.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab9ab94640 1 --2- 172.21.15.70:0/654728689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab840073a0 0x7fab8400dba0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab9ab94640 1 -- 172.21.15.70:0/654728689 >> 172.21.15.70:0/654728689 conn(0x7fab9406a890 msgr2=0x7fab9406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab9ab94640 1 -- 172.21.15.70:0/654728689 shutdown_connections 2023-11-26T07:18:39.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.418+0000 7fab9ab94640 1 -- 172.21.15.70:0/654728689 wait complete. 2023-11-26T07:18:39.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 Processor -- start 2023-11-26T07:18:39.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 -- start start 2023-11-26T07:18:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840073a0 0x7fab9413afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9413c470 0x7fab9415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab94157a00 0x7fab940b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9415cfd0 con 0x7fab9413c470 2023-11-26T07:18:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab940aeb60 con 0x7fab94157a00 2023-11-26T07:18:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9415ca10 con 0x7fab840073a0 2023-11-26T07:18:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9413c470 0x7fab9415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9413c470 0x7fab9415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40658/0 (socket says 172.21.15.70:40658) 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 -- 172.21.15.70:0/3201825246 learned_addr learned my addr 172.21.15.70:0/3201825246 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab99131640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab94157a00 0x7fab940b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab98930640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840073a0 0x7fab9413afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 -- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840073a0 msgr2=0x7fab9413afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840073a0 0x7fab9413afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 -- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab94157a00 msgr2=0x7fab940b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab94157a00 0x7fab940b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 -- 172.21.15.70:0/3201825246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9415ccf0 con 0x7fab9413c470 2023-11-26T07:18:39.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab93fff640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9413c470 0x7fab9415c1c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fab80011960 tx=0x7fab80011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab917fa640 1 -- 172.21.15.70:0/3201825246 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8000fa30 con 0x7fab9413c470 2023-11-26T07:18:39.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab917fa640 1 -- 172.21.15.70:0/3201825246 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8000fb90 con 0x7fab9413c470 2023-11-26T07:18:39.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab940aedb0 con 0x7fab9413c470 2023-11-26T07:18:39.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab917fa640 1 -- 172.21.15.70:0/3201825246 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab80014440 con 0x7fab9413c470 2023-11-26T07:18:39.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.422+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9415c700 con 0x7fab9413c470 2023-11-26T07:18:39.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.426+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab94067680 con 0x7fab9413c470 2023-11-26T07:18:39.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.426+0000 7fab917fa640 1 -- 172.21.15.70:0/3201825246 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab800145a0 con 0x7fab9413c470 2023-11-26T07:18:39.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.426+0000 7fab917fa640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fab78066470 0x7fab78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.426+0000 7fab917fa640 1 -- 172.21.15.70:0/3201825246 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab80084670 con 0x7fab9413c470 2023-11-26T07:18:39.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.426+0000 7fab98930640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fab78066470 0x7fab78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.426+0000 7fab98930640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fab78066470 0x7fab78068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab880078f0 tx=0x7fab88001b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.433 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.430+0000 7fab917fa640 1 -- 172.21.15.70:0/3201825246 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab800519c0 con 0x7fab9413c470 2023-11-26T07:18:39.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.578+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab9406d7f0 con 0x7fab9413c470 2023-11-26T07:18:39.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab917fa640 1 -- 172.21.15.70:0/3201825246 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab800220a0 con 0x7fab9413c470 2023-11-26T07:18:39.584 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fab78066470 msgr2=0x7fab78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fab78066470 0x7fab78068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab880078f0 tx=0x7fab88001b60 comp rx=0 tx=0).stop 2023-11-26T07:18:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9413c470 msgr2=0x7fab9415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9413c470 0x7fab9415c1c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fab80011960 tx=0x7fab80011d60 comp rx=0 tx=0).stop 2023-11-26T07:18:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 shutdown_connections 2023-11-26T07:18:39.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fab78066470 0x7fab78068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9413c470 0x7fab9415c1c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab94157a00 0x7fab940b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 --2- 172.21.15.70:0/3201825246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fab840073a0 0x7fab9413afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 >> 172.21.15.70:0/3201825246 conn(0x7fab9406a890 msgr2=0x7fab94159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 shutdown_connections 2023-11-26T07:18:39.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.582+0000 7fab9ab94640 1 -- 172.21.15.70:0/3201825246 wait complete. 2023-11-26T07:18:39.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630e816640 1 Processor -- start 2023-11-26T07:18:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630e816640 1 -- start start 2023-11-26T07:18:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630e816640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f630813e290 0x7f63080cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630e816640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630806c520 con 0x7f630815f6b0 2023-11-26T07:18:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630e816640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630806c800 con 0x7f63080cf7c0 2023-11-26T07:18:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630e816640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63080cfc40 con 0x7f630813e290 2023-11-26T07:18:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630cdb3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f630815f6b0 0x7f63080cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60798/0 (socket says 172.21.15.70:60798) 2023-11-26T07:18:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f630cdb3640 1 -- 172.21.15.70:0/4246388208 learned_addr learned my addr 172.21.15.70:0/4246388208 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f6307fff640 1 --2- 172.21.15.70:0/4246388208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f630813e290 0x7f63080cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188281034 0 0) 0x7f630806c520 con 0x7f630815f6b0 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.742+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f0003530 con 0x7f630815f6b0 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134184563 0 0) 0x7f630806c800 con 0x7f63080cf7c0 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f630806c520 con 0x7f63080cf7c0 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6307fff640 1 -- 172.21.15.70:0/4246388208 >> v1:172.21.15.120:6789/0 conn(0x7f63080cf7c0 legacy=0x7f630815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6307fff640 1 -- 172.21.15.70:0/4246388208 >> v1:172.21.15.70:6789/0 conn(0x7f630815f6b0 legacy=0x7f63080cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3403510212 0 0) 0x7f62f0003530 con 0x7f630815f6b0 2023-11-26T07:18:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6307fff640 1 -- 172.21.15.70:0/4246388208 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630806cae0 con 0x7f630813e290 2023-11-26T07:18:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6307fff640 1 --2- 172.21.15.70:0/4246388208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f630813e290 0x7f63080cf280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f62f80097f0 tx=0x7f62f801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a0ea47ee669dc46 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300001a00 con 0x7f630813e290 2023-11-26T07:18:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f80a7050 con 0x7f630813e290 2023-11-26T07:18:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.746+0000 7f6306ffd640 1 -- 172.21.15.70:0/4246388208 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80ab600 con 0x7f630813e290 2023-11-26T07:18:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- 172.21.15.70:0/4246388208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f630813e290 msgr2=0x7f63080cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 --2- 172.21.15.70:0/4246388208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f630813e290 0x7f63080cf280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f62f80097f0 tx=0x7f62f801c3e0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- 172.21.15.70:0/4246388208 shutdown_connections 2023-11-26T07:18:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 --2- 172.21.15.70:0/4246388208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f630813e290 0x7f63080cf280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- 172.21.15.70:0/4246388208 >> 172.21.15.70:0/4246388208 conn(0x7f630806a890 msgr2=0x7f630806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- 172.21.15.70:0/4246388208 shutdown_connections 2023-11-26T07:18:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- 172.21.15.70:0/4246388208 wait complete. 2023-11-26T07:18:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 Processor -- start 2023-11-26T07:18:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- start start 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f63080cf7c0 0x7f63081f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f630813e290 0x7f6308154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f630815f6b0 0x7f63081f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630815dec0 con 0x7f630815f6b0 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630815d240 con 0x7f630813e290 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630e816640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630815d520 con 0x7f63080cf7c0 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f630815f6b0 0x7f63081f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f6307fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f63080cf7c0 0x7f63081f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f630815f6b0 0x7f63081f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40672/0 (socket says 172.21.15.70:40672) 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 -- 172.21.15.70:0/2155570879 learned_addr learned my addr 172.21.15.70:0/2155570879 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f63077fe640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f630813e290 0x7f6308154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 -- 172.21.15.70:0/2155570879 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f63080cf7c0 msgr2=0x7f63081f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f63080cf7c0 0x7f63081f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 -- 172.21.15.70:0/2155570879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f630813e290 msgr2=0x7f6308154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f630813e290 0x7f6308154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.750+0000 7f630cdb3640 1 -- 172.21.15.70:0/2155570879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8009420 con 0x7f630815f6b0 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f630cdb3640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f630815f6b0 0x7f63081f59a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f630000cc20 tx=0x7f630000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f6304ff9640 1 -- 172.21.15.70:0/2155570879 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000ce30 con 0x7f630815f6b0 2023-11-26T07:18:39.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f6304ff9640 1 -- 172.21.15.70:0/2155570879 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300012400 con 0x7f630815f6b0 2023-11-26T07:18:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f6304ff9640 1 -- 172.21.15.70:0/2155570879 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000127b0 con 0x7f630815f6b0 2023-11-26T07:18:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630815d800 con 0x7f630815f6b0 2023-11-26T07:18:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63081f8b80 con 0x7f630815f6b0 2023-11-26T07:18:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630815e000 con 0x7f630815f6b0 2023-11-26T07:18:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f6304ff9640 1 -- 172.21.15.70:0/2155570879 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6300012910 con 0x7f630815f6b0 2023-11-26T07:18:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f6304ff9640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f4066470 0x7f62f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f6304ff9640 1 -- 172.21.15.70:0/2155570879 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6300084420 con 0x7f630815f6b0 2023-11-26T07:18:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.754+0000 7f6307fff640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f4066470 0x7f62f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:39.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.758+0000 7f6307fff640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f4066470 0x7f62f4068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f62f80ad000 tx=0x7f62f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.758+0000 7f6304ff9640 1 -- 172.21.15.70:0/2155570879 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f630815e000 con 0x7f630815f6b0 2023-11-26T07:18:39.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.910+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f630815e000 con 0x7f630815f6b0 2023-11-26T07:18:39.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.910+0000 7f6304ff9640 1 -- 172.21.15.70:0/2155570879 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f630815e000 con 0x7f630815f6b0 2023-11-26T07:18:39.914 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f4066470 msgr2=0x7f62f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f4066470 0x7f62f4068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f62f80ad000 tx=0x7f62f8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f630815f6b0 msgr2=0x7f63081f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f630815f6b0 0x7f63081f59a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f630000cc20 tx=0x7f630000a430 comp rx=0 tx=0).stop 2023-11-26T07:18:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 shutdown_connections 2023-11-26T07:18:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f62f4066470 0x7f62f4068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f630815f6b0 0x7f63081f59a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f630813e290 0x7f6308154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 --2- 172.21.15.70:0/2155570879 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f63080cf7c0 0x7f63081f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 >> 172.21.15.70:0/2155570879 conn(0x7f630806a890 msgr2=0x7f6308071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 shutdown_connections 2023-11-26T07:18:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:39.914+0000 7f630e816640 1 -- 172.21.15.70:0/2155570879 wait complete. 2023-11-26T07:18:39.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:40.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.070+0000 7f530e3df640 1 Processor -- start 2023-11-26T07:18:40.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530e3df640 1 -- start start 2023-11-26T07:18:40.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530e3df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f53081596d0 0x7f5308071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530e3df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53080ce680 0x7f53080b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530e3df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53080b2db0 0x7f530815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530e3df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080b3240 con 0x7f53080b2db0 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530e3df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080cbe00 con 0x7f53081596d0 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530e3df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530806c750 con 0x7f53080ce680 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53080b2db0 0x7f530815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53080b2db0 0x7f530815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40674/0 (socket says 172.21.15.70:40674) 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 -- 172.21.15.70:0/1984797257 learned_addr learned my addr 172.21.15.70:0/1984797257 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f5307fff640 1 --2- 172.21.15.70:0/1984797257 >> v2:172.21.15.120:3300/0 conn(0x7f53081596d0 0x7f5308071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f53077fe640 1 --2- 172.21.15.70:0/1984797257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53080ce680 0x7f53080b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 -- 172.21.15.70:0/1984797257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53080ce680 msgr2=0x7f53080b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 --2- 172.21.15.70:0/1984797257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53080ce680 0x7f53080b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 -- 172.21.15.70:0/1984797257 >> v2:172.21.15.120:3300/0 conn(0x7f53081596d0 msgr2=0x7f5308071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 --2- 172.21.15.70:0/1984797257 >> v2:172.21.15.120:3300/0 conn(0x7f53081596d0 0x7f5308071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f530c97c640 1 -- 172.21.15.70:0/1984797257 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080b3550 con 0x7f53080b2db0 2023-11-26T07:18:40.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.074+0000 7f5307fff640 1 --2- 172.21.15.70:0/1984797257 >> v2:172.21.15.120:3300/0 conn(0x7f53081596d0 0x7f5308071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:40.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530c97c640 1 --2- 172.21.15.70:0/1984797257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f530815d2c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f530806e4d0 tx=0x7f530001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdf69b901aff15f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f5306ffd640 1 -- 172.21.15.70:0/1984797257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000b2d0 con 0x7f53080b2db0 2023-11-26T07:18:40.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f5306ffd640 1 -- 172.21.15.70:0/1984797257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530000b430 con 0x7f53080b2db0 2023-11-26T07:18:40.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f5306ffd640 1 -- 172.21.15.70:0/1984797257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53000a7af0 con 0x7f53080b2db0 2023-11-26T07:18:40.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 -- 172.21.15.70:0/1984797257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 msgr2=0x7f530815d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 --2- 172.21.15.70:0/1984797257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f530815d2c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f530806e4d0 tx=0x7f530001ebd0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 -- 172.21.15.70:0/1984797257 shutdown_connections 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 --2- 172.21.15.70:0/1984797257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f530815d2c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 --2- 172.21.15.70:0/1984797257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53080ce680 0x7f53080b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 --2- 172.21.15.70:0/1984797257 >> v2:172.21.15.120:3300/0 conn(0x7f53081596d0 0x7f5308071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 -- 172.21.15.70:0/1984797257 >> 172.21.15.70:0/1984797257 conn(0x7f530806a890 msgr2=0x7f530806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 -- 172.21.15.70:0/1984797257 shutdown_connections 2023-11-26T07:18:40.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 -- 172.21.15.70:0/1984797257 wait complete. 2023-11-26T07:18:40.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.078+0000 7f530e3df640 1 Processor -- start 2023-11-26T07:18:40.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 -- start start 2023-11-26T07:18:40.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f5308144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53080ce680 0x7f530814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53081596d0 0x7f5308148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530814a250 con 0x7f53080b2db0 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53081452f0 con 0x7f53080ce680 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53081495d0 con 0x7f53081596d0 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f5308144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f5308144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40676/0 (socket says 172.21.15.70:40676) 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 -- 172.21.15.70:0/2815887831 learned_addr learned my addr 172.21.15.70:0/2815887831 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530c97c640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53081596d0 0x7f5308148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f53077fe640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53080ce680 0x7f530814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 -- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53081596d0 msgr2=0x7f5308148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53081596d0 0x7f5308148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 -- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53080ce680 msgr2=0x7f530814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53080ce680 0x7f530814a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 -- 172.21.15.70:0/2815887831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530000bd40 con 0x7f53080b2db0 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530c97c640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53081596d0 0x7f5308148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f53077fe640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53080ce680 0x7f530814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5307fff640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f5308144db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52f800d800 tx=0x7f52f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5304ff9640 1 -- 172.21.15.70:0/2815887831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800b6c0 con 0x7f53080b2db0 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5304ff9640 1 -- 172.21.15.70:0/2815887831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f800b820 con 0x7f53080b2db0 2023-11-26T07:18:40.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f5304ff9640 1 -- 172.21.15.70:0/2815887831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800bbd0 con 0x7f53080b2db0 2023-11-26T07:18:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53081498b0 con 0x7f53080b2db0 2023-11-26T07:18:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5308149e70 con 0x7f53080b2db0 2023-11-26T07:18:40.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.082+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530814a4c0 con 0x7f53080b2db0 2023-11-26T07:18:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.086+0000 7f5304ff9640 1 -- 172.21.15.70:0/2815887831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52f800bd30 con 0x7f53080b2db0 2023-11-26T07:18:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.086+0000 7f5304ff9640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f52f4066470 0x7f52f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.086+0000 7f5304ff9640 1 -- 172.21.15.70:0/2815887831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52f8084410 con 0x7f53080b2db0 2023-11-26T07:18:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.086+0000 7f53077fe640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f52f4066470 0x7f52f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.086+0000 7f53077fe640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f52f4066470 0x7f52f4068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52fc004660 tx=0x7f52fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.090+0000 7f5304ff9640 1 -- 172.21.15.70:0/2815887831 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52f80517f0 con 0x7f53080b2db0 2023-11-26T07:18:40.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.238+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5308067680 con 0x7f53080b2db0 2023-11-26T07:18:40.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.238+0000 7f5304ff9640 1 -- 172.21.15.70:0/2815887831 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52f8054e10 con 0x7f53080b2db0 2023-11-26T07:18:40.242 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:40.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f52f4066470 msgr2=0x7f52f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f52f4066470 0x7f52f4068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52fc004660 tx=0x7f52fc008040 comp rx=0 tx=0).stop 2023-11-26T07:18:40.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 msgr2=0x7f5308144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f5308144db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f52f800d800 tx=0x7f52f800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 shutdown_connections 2023-11-26T07:18:40.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f53081596d0 0x7f5308148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53080ce680 0x7f530814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f52f4066470 0x7f52f4068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 --2- 172.21.15.70:0/2815887831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53080b2db0 0x7f5308144db0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 >> 172.21.15.70:0/2815887831 conn(0x7f530806a890 msgr2=0x7f53080b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 shutdown_connections 2023-11-26T07:18:40.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.242+0000 7f530e3df640 1 -- 172.21.15.70:0/2815887831 wait complete. 2023-11-26T07:18:40.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc9372640 1 Processor -- start 2023-11-26T07:18:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc9372640 1 -- start start 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc9372640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b3610 0x7f7bc40cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc9372640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7bc40b4080 0x7f7bc40cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc9372640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40cefa0 con 0x7f7bc40b45d0 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc9372640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40c9fa0 con 0x7f7bc40b4080 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc9372640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40b3ef0 con 0x7f7bc40b3610 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc37fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7bc40b4080 0x7f7bc40cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc37fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7bc40b4080 0x7f7bc40cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40688/0 (socket says 172.21.15.70:40688) 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc37fe640 1 -- 172.21.15.70:0/660119905 learned_addr learned my addr 172.21.15.70:0/660119905 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bbbfff640 1 --1- 172.21.15.70:0/660119905 >> v1:172.21.15.70:6789/0 conn(0x7f7bc40b45d0 0x7f7bc40cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60802/0 (socket says 172.21.15.70:60802) 2023-11-26T07:18:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc2ffd640 1 --2- 172.21.15.70:0/660119905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b3610 0x7f7bc40cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc37fe640 1 -- 172.21.15.70:0/660119905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b3610 msgr2=0x7f7bc40cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc37fe640 1 --2- 172.21.15.70:0/660119905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b3610 0x7f7bc40cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc37fe640 1 -- 172.21.15.70:0/660119905 >> v1:172.21.15.70:6789/0 conn(0x7f7bc40b45d0 legacy=0x7f7bc40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc37fe640 1 -- 172.21.15.70:0/660119905 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40d0f90 con 0x7f7bc40b4080 2023-11-26T07:18:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.398+0000 7f7bc2ffd640 1 --2- 172.21.15.70:0/660119905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b3610 0x7f7bc40cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:40.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc37fe640 1 --2- 172.21.15.70:0/660119905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b4080 0x7f7bc40cff80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009e50 tx=0x7f7bbc01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7765435754e70ee server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc27fc640 1 -- 172.21.15.70:0/660119905 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0af400 con 0x7f7bc40b4080 2023-11-26T07:18:40.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc27fc640 1 -- 172.21.15.70:0/660119905 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc0ab050 con 0x7f7bc40b4080 2023-11-26T07:18:40.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc27fc640 1 -- 172.21.15.70:0/660119905 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0af780 con 0x7f7bc40b4080 2023-11-26T07:18:40.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 -- 172.21.15.70:0/660119905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b4080 msgr2=0x7f7bc40cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 --2- 172.21.15.70:0/660119905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b4080 0x7f7bc40cff80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009e50 tx=0x7f7bbc01f1f0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 -- 172.21.15.70:0/660119905 shutdown_connections 2023-11-26T07:18:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 --2- 172.21.15.70:0/660119905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b4080 0x7f7bc40cff80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 --2- 172.21.15.70:0/660119905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b3610 0x7f7bc40cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 -- 172.21.15.70:0/660119905 >> 172.21.15.70:0/660119905 conn(0x7f7bc40d3030 msgr2=0x7f7bc40d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 -- 172.21.15.70:0/660119905 shutdown_connections 2023-11-26T07:18:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.402+0000 7f7bc9372640 1 -- 172.21.15.70:0/660119905 wait complete. 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 Processor -- start 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 -- start start 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40b3610 0x7f7bc40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b4080 0x7f7bc40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b45d0 0x7f7bc41451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40b7250 con 0x7f7bc40b45d0 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40b74b0 con 0x7f7bc40b3610 2023-11-26T07:18:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40b7790 con 0x7f7bc40b4080 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b45d0 0x7f7bc41451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b45d0 0x7f7bc41451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40692/0 (socket says 172.21.15.70:40692) 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 -- 172.21.15.70:0/176306520 learned_addr learned my addr 172.21.15.70:0/176306520 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc2ffd640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40b3610 0x7f7bc40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bbbfff640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b4080 0x7f7bc40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 -- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b4080 msgr2=0x7f7bc40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b4080 0x7f7bc40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 -- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40b3610 msgr2=0x7f7bc40b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40b3610 0x7f7bc40b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 -- 172.21.15.70:0/176306520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc009b30 con 0x7f7bc40b45d0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc37fe640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b45d0 0x7f7bc41451d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc01ce20 tx=0x7f7bbc01bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/176306520 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0afde0 con 0x7f7bc40b45d0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/176306520 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc009510 con 0x7f7bc40b45d0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/176306520 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0ba660 con 0x7f7bc40b45d0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc40b7a70 con 0x7f7bc40b45d0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.406+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc40b8030 con 0x7f7bc40b45d0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.410+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc4067500 con 0x7f7bc40b45d0 2023-11-26T07:18:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.410+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/176306520 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7bbc0b6040 con 0x7f7bc40b45d0 2023-11-26T07:18:40.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.410+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7ba4066470 0x7f7ba4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.410+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/176306520 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bbc122210 con 0x7f7bc40b45d0 2023-11-26T07:18:40.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.410+0000 7f7bc2ffd640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7ba4066470 0x7f7ba4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.410+0000 7f7bc2ffd640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7ba4066470 0x7f7ba4068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c900 tx=0x7f7bb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.414+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/176306520 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7bbc0ef620 con 0x7f7bc40b45d0 2023-11-26T07:18:40.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.574+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7bc40b8220 con 0x7f7bc40b45d0 2023-11-26T07:18:40.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.574+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/176306520 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7bbc0f2c40 con 0x7f7bc40b45d0 2023-11-26T07:18:40.579 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:40.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7ba4066470 msgr2=0x7f7ba4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7ba4066470 0x7f7ba4068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c900 tx=0x7f7bb4008040 comp rx=0 tx=0).stop 2023-11-26T07:18:40.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b45d0 msgr2=0x7f7bc41451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b45d0 0x7f7bc41451d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc01ce20 tx=0x7f7bbc01bf90 comp rx=0 tx=0).stop 2023-11-26T07:18:40.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 shutdown_connections 2023-11-26T07:18:40.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7ba4066470 0x7f7ba4068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bc40b45d0 0x7f7bc41451d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7bc40b4080 0x7f7bc40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 --2- 172.21.15.70:0/176306520 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7bc40b3610 0x7f7bc40b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 >> 172.21.15.70:0/176306520 conn(0x7f7bc40d3030 msgr2=0x7f7bc40cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 shutdown_connections 2023-11-26T07:18:40.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.578+0000 7f7bc9372640 1 -- 172.21.15.70:0/176306520 wait complete. 2023-11-26T07:18:40.600 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:18:40.600 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:40.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:40.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.742+0000 7f0fb92fe640 1 Processor -- start 2023-11-26T07:18:40.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb92fe640 1 -- start start 2023-11-26T07:18:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb92fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0fb415d580 0x7f0fb40d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb92fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d1f00 0x7f0fb40b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb92fe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40d0bc0 con 0x7f0fb40d3e60 2023-11-26T07:18:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb92fe640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb40d0320 con 0x7f0fb415d580 2023-11-26T07:18:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb92fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40d0600 con 0x7f0fb40d1f00 2023-11-26T07:18:40.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0fb415d580 0x7f0fb40d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb2ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0fb415d580 0x7f0fb40d3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40702/0 (socket says 172.21.15.70:40702) 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/3855996310 learned_addr learned my addr 172.21.15.70:0/3855996310 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0faa7fc640 1 --1- 172.21.15.70:0/3855996310 >> v1:172.21.15.70:6789/0 conn(0x7f0fb40d3e60 0x7f0fb40d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60810/0 (socket says 172.21.15.70:60810) 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb37fe640 1 --2- 172.21.15.70:0/3855996310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d1f00 0x7f0fb40b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/3855996310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d1f00 msgr2=0x7f0fb40b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb2ffd640 1 --2- 172.21.15.70:0/3855996310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d1f00 0x7f0fb40b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/3855996310 >> v1:172.21.15.70:6789/0 conn(0x7f0fb40d3e60 legacy=0x7f0fb40d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.746+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/3855996310 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40d08e0 con 0x7f0fb415d580 2023-11-26T07:18:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb2ffd640 1 --2- 172.21.15.70:0/3855996310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb415d580 0x7f0fb40d3920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009870 tx=0x7f0fa401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897a63235e1e2b53 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb27fc640 1 -- 172.21.15.70:0/3855996310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40ab640 con 0x7f0fb415d580 2023-11-26T07:18:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb27fc640 1 -- 172.21.15.70:0/3855996310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40a7070 con 0x7f0fb415d580 2023-11-26T07:18:40.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb27fc640 1 -- 172.21.15.70:0/3855996310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40ab9c0 con 0x7f0fb415d580 2023-11-26T07:18:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 -- 172.21.15.70:0/3855996310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb415d580 msgr2=0x7f0fb40d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/3855996310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb415d580 0x7f0fb40d3920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009870 tx=0x7f0fa401c510 comp rx=0 tx=0).stop 2023-11-26T07:18:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 -- 172.21.15.70:0/3855996310 shutdown_connections 2023-11-26T07:18:40.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/3855996310 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d1f00 0x7f0fb40b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/3855996310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb415d580 0x7f0fb40d3920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 -- 172.21.15.70:0/3855996310 >> 172.21.15.70:0/3855996310 conn(0x7f0fb409c550 msgr2=0x7f0fb40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 -- 172.21.15.70:0/3855996310 shutdown_connections 2023-11-26T07:18:40.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 -- 172.21.15.70:0/3855996310 wait complete. 2023-11-26T07:18:40.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 Processor -- start 2023-11-26T07:18:40.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.750+0000 7f0fb92fe640 1 -- start start 2023-11-26T07:18:40.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb40d1f00 0x7f0fb4155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d3e60 0x7f0fb40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fb415d580 0x7f0fb4154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40b7990 con 0x7f0fb40d1f00 2023-11-26T07:18:40.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4154e80 con 0x7f0fb415d580 2023-11-26T07:18:40.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4155160 con 0x7f0fb40d3e60 2023-11-26T07:18:40.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb40d1f00 0x7f0fb4155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb40d1f00 0x7f0fb4155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40712/0 (socket says 172.21.15.70:40712) 2023-11-26T07:18:40.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/2484663526 learned_addr learned my addr 172.21.15.70:0/2484663526 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:40.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0faa7fc640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d3e60 0x7f0fb40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb37fe640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fb415d580 0x7f0fb4154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d3e60 msgr2=0x7f0fb40b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d3e60 0x7f0fb40b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fb415d580 msgr2=0x7f0fb4154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fb415d580 0x7f0fb4154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 -- 172.21.15.70:0/2484663526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40094d0 con 0x7f0fb40d1f00 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb2ffd640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb40d1f00 0x7f0fb4155c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ad040 tx=0x7f0fa401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fabfff640 1 -- 172.21.15.70:0/2484663526 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40be3f0 con 0x7f0fb40d1f00 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fabfff640 1 -- 172.21.15.70:0/2484663526 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40be570 con 0x7f0fb40d1f00 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb4155440 con 0x7f0fb40d1f00 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fabfff640 1 -- 172.21.15.70:0/2484663526 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40be920 con 0x7f0fb40d1f00 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb40b7650 con 0x7f0fb40d1f00 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.754+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb4067680 con 0x7f0fb40d1f00 2023-11-26T07:18:40.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.758+0000 7f0fabfff640 1 -- 172.21.15.70:0/2484663526 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0fa40b43f0 con 0x7f0fb40d1f00 2023-11-26T07:18:40.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.758+0000 7f0fabfff640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0f94066470 0x7f0f94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:40.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.758+0000 7f0fabfff640 1 -- 172.21.15.70:0/2484663526 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fa411e220 con 0x7f0fb40d1f00 2023-11-26T07:18:40.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.758+0000 7f0faa7fc640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0f94066470 0x7f0f94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.758+0000 7f0faa7fc640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0f94066470 0x7f0f94068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c005fd0 tx=0x7f0f9c005ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.762+0000 7f0fabfff640 1 -- 172.21.15.70:0/2484663526 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0fa40eb7e0 con 0x7f0fb40d1f00 2023-11-26T07:18:40.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.914+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fb4160780 con 0x7f0fb40d1f00 2023-11-26T07:18:40.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.914+0000 7f0fabfff640 1 -- 172.21.15.70:0/2484663526 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f0fa40eee00 con 0x7f0fb40d1f00 2023-11-26T07:18:40.918 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:40.918 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0f94066470 msgr2=0x7f0f94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0f94066470 0x7f0f94068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c005fd0 tx=0x7f0f9c005ba0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb40d1f00 msgr2=0x7f0fb4155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb40d1f00 0x7f0fb4155c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ad040 tx=0x7f0fa401ad50 comp rx=0 tx=0).stop 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 shutdown_connections 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fb415d580 0x7f0fb4154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fb40d3e60 0x7f0fb40b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0f94066470 0x7f0f94068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 --2- 172.21.15.70:0/2484663526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fb40d1f00 0x7f0fb4155c40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 >> 172.21.15.70:0/2484663526 conn(0x7f0fb409c550 msgr2=0x7f0fb40d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 shutdown_connections 2023-11-26T07:18:40.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:40.918+0000 7f0fb92fe640 1 -- 172.21.15.70:0/2484663526 wait complete. 2023-11-26T07:18:40.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:40.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:41.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 Processor -- start 2023-11-26T07:18:41.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 -- start start 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe6bc143ac0 0x7fe6bc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0708b0 0x7fe6bc0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe6bc0cf7c0 0x7fe6bc0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc143ea0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cfbf0 con 0x7fe6bc0cf7c0 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c2c9a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0cc730 con 0x7fe6bc0708b0 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe6bc143ac0 0x7fe6bc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe6bc143ac0 0x7fe6bc070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40724/0 (socket says 172.21.15.70:40724) 2023-11-26T07:18:41.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 -- 172.21.15.70:0/1770521605 learned_addr learned my addr 172.21.15.70:0/1770521605 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:41.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6bbfff640 1 --2- 172.21.15.70:0/1770521605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0708b0 0x7fe6bc0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c1237640 1 --2- 172.21.15.70:0/1770521605 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc0cf7c0 0x7fe6bc0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 -- 172.21.15.70:0/1770521605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0708b0 msgr2=0x7fe6bc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:41.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 --2- 172.21.15.70:0/1770521605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0708b0 0x7fe6bc0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 -- 172.21.15.70:0/1770521605 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc0cf7c0 msgr2=0x7fe6bc0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:41.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 --2- 172.21.15.70:0/1770521605 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc0cf7c0 0x7fe6bc0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.078+0000 7fe6c0a36640 1 -- 172.21.15.70:0/1770521605 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc070ee0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c0a36640 1 --2- 172.21.15.70:0/1770521605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc070370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0718d0 tx=0x7fe6b001e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ec91023298b33f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6bb7fe640 1 -- 172.21.15.70:0/1770521605 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00a78b0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6bb7fe640 1 -- 172.21.15.70:0/1770521605 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b00a7a10 con 0x7fe6bc143ac0 2023-11-26T07:18:41.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6bb7fe640 1 -- 172.21.15.70:0/1770521605 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00a7da0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/1770521605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 msgr2=0x7fe6bc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/1770521605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc070370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0718d0 tx=0x7fe6b001e910 comp rx=0 tx=0).stop 2023-11-26T07:18:41.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/1770521605 shutdown_connections 2023-11-26T07:18:41.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/1770521605 >> v2:172.21.15.120:3300/0 conn(0x7fe6bc0cf7c0 0x7fe6bc0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/1770521605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0708b0 0x7fe6bc0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/1770521605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc070370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/1770521605 >> 172.21.15.70:0/1770521605 conn(0x7fe6bc06a890 msgr2=0x7fe6bc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/1770521605 shutdown_connections 2023-11-26T07:18:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.082+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/1770521605 wait complete. 2023-11-26T07:18:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 Processor -- start 2023-11-26T07:18:41.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 -- start start 2023-11-26T07:18:41.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc0708b0 0x7fe6bc0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0cf7c0 0x7fe6bc0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc0af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0b0c10 con 0x7fe6bc143ac0 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc1388c0 con 0x7fe6bc0708b0 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc138e40 con 0x7fe6bc0cf7c0 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc0af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40730/0 (socket says 172.21.15.70:40730) 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 -- 172.21.15.70:0/3290967994 learned_addr learned my addr 172.21.15.70:0/3290967994 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c0a36640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc0708b0 0x7fe6bc0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6bbfff640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0cf7c0 0x7fe6bc0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 -- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0cf7c0 msgr2=0x7fe6bc0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0cf7c0 0x7fe6bc0aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 -- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc0708b0 msgr2=0x7fe6bc0ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc0708b0 0x7fe6bc0ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 -- 172.21.15.70:0/3290967994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b000b770 con 0x7fe6bc143ac0 2023-11-26T07:18:41.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c0a36640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc0708b0 0x7fe6bc0ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:41.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c1237640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc0af260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4007e70 tx=0x7fe6b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6b97fa640 1 -- 172.21.15.70:0/3290967994 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4014620 con 0x7fe6bc143ac0 2023-11-26T07:18:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6b97fa640 1 -- 172.21.15.70:0/3290967994 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b40147a0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6b97fa640 1 -- 172.21.15.70:0/3290967994 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4014b50 con 0x7fe6bc143ac0 2023-11-26T07:18:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc0add90 con 0x7fe6bc143ac0 2023-11-26T07:18:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc138ad0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.086+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc138fd0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.090+0000 7fe6b97fa640 1 -- 172.21.15.70:0/3290967994 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6b4014cb0 con 0x7fe6bc143ac0 2023-11-26T07:18:41.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.090+0000 7fe6b97fa640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.090+0000 7fe6b97fa640 1 -- 172.21.15.70:0/3290967994 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6b4084890 con 0x7fe6bc143ac0 2023-11-26T07:18:41.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.090+0000 7fe6c0a36640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.090+0000 7fe6c0a36640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00b1000 tx=0x7fe6b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.094+0000 7fe6b97fa640 1 -- 172.21.15.70:0/3290967994 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6b4051d10 con 0x7fe6bc143ac0 2023-11-26T07:18:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.246+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6bc13b660 con 0x7fe6bc143ac0 2023-11-26T07:18:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.246+0000 7fe6b97fa640 1 -- 172.21.15.70:0/3290967994 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6b4055330 con 0x7fe6bc143ac0 2023-11-26T07:18:41.250 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 msgr2=0x7fe6a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00b1000 tx=0x7fe6b0008040 comp rx=0 tx=0).stop 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 msgr2=0x7fe6bc0af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc0af260 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4007e70 tx=0x7fe6b400e4b0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 shutdown_connections 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6bc143ac0 0x7fe6bc0af260 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6bc0cf7c0 0x7fe6bc0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 --2- 172.21.15.70:0/3290967994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6bc0708b0 0x7fe6bc0ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 >> 172.21.15.70:0/3290967994 conn(0x7fe6bc06a890 msgr2=0x7fe6bc0caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 shutdown_connections 2023-11-26T07:18:41.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.250+0000 7fe6c2c9a640 1 -- 172.21.15.70:0/3290967994 wait complete. 2023-11-26T07:18:41.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:41.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f746a93e640 1 Processor -- start 2023-11-26T07:18:41.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f746a93e640 1 -- start start 2023-11-26T07:18:41.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f746a93e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74640b2f80 0x7f7464071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f746a93e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746406c750 con 0x7f74641596d0 2023-11-26T07:18:41.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f746a93e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74640b3550 con 0x7f74640ce680 2023-11-26T07:18:41.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f746a93e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74640cbe00 con 0x7f74640b2f80 2023-11-26T07:18:41.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f7463fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f74641596d0 0x7f74640b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60824/0 (socket says 172.21.15.70:60824) 2023-11-26T07:18:41.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f74637fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74640b2f80 0x7f7464071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f7463fff640 1 -- 172.21.15.70:0/521509735 learned_addr learned my addr 172.21.15.70:0/521509735 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:41.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f7462ffd640 1 -- 172.21.15.70:0/521509735 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268523357 0 0) 0x7f746406c750 con 0x7f74641596d0 2023-11-26T07:18:41.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f7462ffd640 1 -- 172.21.15.70:0/521509735 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744c005740 con 0x7f74641596d0 2023-11-26T07:18:41.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f74637fe640 1 -- 172.21.15.70:0/521509735 >> v1:172.21.15.120:6789/0 conn(0x7f74640ce680 legacy=0x7f746406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f74637fe640 1 -- 172.21.15.70:0/521509735 >> v1:172.21.15.70:6789/0 conn(0x7f74641596d0 legacy=0x7f74640b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.410+0000 7f74637fe640 1 -- 172.21.15.70:0/521509735 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464071e80 con 0x7f74640b2f80 2023-11-26T07:18:41.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f74637fe640 1 --2- 172.21.15.70:0/521509735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640b2f80 0x7f7464071850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f74640cbf40 tx=0x7f745801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c336faf193cea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f7462ffd640 1 -- 172.21.15.70:0/521509735 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580ab600 con 0x7f74640b2f80 2023-11-26T07:18:41.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f7462ffd640 1 -- 172.21.15.70:0/521509735 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74580a7050 con 0x7f74640b2f80 2023-11-26T07:18:41.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f7462ffd640 1 -- 172.21.15.70:0/521509735 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580ab960 con 0x7f74640b2f80 2023-11-26T07:18:41.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 -- 172.21.15.70:0/521509735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640b2f80 msgr2=0x7f7464071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 --2- 172.21.15.70:0/521509735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640b2f80 0x7f7464071850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f74640cbf40 tx=0x7f745801c3f0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 -- 172.21.15.70:0/521509735 shutdown_connections 2023-11-26T07:18:41.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 --2- 172.21.15.70:0/521509735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74640b2f80 0x7f7464071850 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 -- 172.21.15.70:0/521509735 >> 172.21.15.70:0/521509735 conn(0x7f746406a890 msgr2=0x7f746406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 -- 172.21.15.70:0/521509735 shutdown_connections 2023-11-26T07:18:41.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 -- 172.21.15.70:0/521509735 wait complete. 2023-11-26T07:18:41.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.414+0000 7f746a93e640 1 Processor -- start 2023-11-26T07:18:41.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 -- start start 2023-11-26T07:18:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74640b2f80 0x7f746414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74640ce680 0x7f74640cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641596d0 0x7f7464150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640cdf40 con 0x7f74641596d0 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640cd2c0 con 0x7f74640b2f80 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640cd5a0 con 0x7f74640ce680 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641596d0 0x7f7464150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641596d0 0x7f7464150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40736/0 (socket says 172.21.15.70:40736) 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 -- 172.21.15.70:0/1164093976 learned_addr learned my addr 172.21.15.70:0/1164093976 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f74637fe640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74640ce680 0x7f74640cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7463fff640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74640b2f80 0x7f746414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 -- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74640ce680 msgr2=0x7f74640cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74640ce680 0x7f74640cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 -- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74640b2f80 msgr2=0x7f746414b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74640b2f80 0x7f746414b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 -- 172.21.15.70:0/1164093976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7458009420 con 0x7f74641596d0 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7468edb640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641596d0 0x7f7464150210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c770 tx=0x7f745c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7460ff9640 1 -- 172.21.15.70:0/1164093976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c003b80 con 0x7f74641596d0 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7460ff9640 1 -- 172.21.15.70:0/1164093976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c003ce0 con 0x7f74641596d0 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74640cd880 con 0x7f74641596d0 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f7460ff9640 1 -- 172.21.15.70:0/1164093976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00aa90 con 0x7f74641596d0 2023-11-26T07:18:41.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746414b5e0 con 0x7f74641596d0 2023-11-26T07:18:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.418+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74640ce080 con 0x7f74641596d0 2023-11-26T07:18:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.422+0000 7f7460ff9640 1 -- 172.21.15.70:0/1164093976 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f745c00abf0 con 0x7f74641596d0 2023-11-26T07:18:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.422+0000 7f7460ff9640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7450066470 0x7f7450068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.422+0000 7f7460ff9640 1 -- 172.21.15.70:0/1164093976 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f745c083ce0 con 0x7f74641596d0 2023-11-26T07:18:41.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.422+0000 7f7463fff640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7450066470 0x7f7450068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.422+0000 7f7463fff640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7450066470 0x7f7450068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f74540011f0 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.426+0000 7f7460ff9640 1 -- 172.21.15.70:0/1164093976 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74640ce080 con 0x7f74641596d0 2023-11-26T07:18:41.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74640ce080 con 0x7f74641596d0 2023-11-26T07:18:41.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f7460ff9640 1 -- 172.21.15.70:0/1164093976 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74640ce080 con 0x7f74641596d0 2023-11-26T07:18:41.580 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:41.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7450066470 msgr2=0x7f7450068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7450066470 0x7f7450068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f74540011f0 tx=0x7f7454009040 comp rx=0 tx=0).stop 2023-11-26T07:18:41.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641596d0 msgr2=0x7f7464150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641596d0 0x7f7464150210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c770 tx=0x7f745c00cc30 comp rx=0 tx=0).stop 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 shutdown_connections 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7450066470 0x7f7450068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641596d0 0x7f7464150210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f74640ce680 0x7f74640cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 --2- 172.21.15.70:0/1164093976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74640b2f80 0x7f746414b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 >> 172.21.15.70:0/1164093976 conn(0x7f746406a890 msgr2=0x7f74640aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 shutdown_connections 2023-11-26T07:18:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.578+0000 7f746a93e640 1 -- 172.21.15.70:0/1164093976 wait complete. 2023-11-26T07:18:41.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:41.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f785ab93640 1 Processor -- start 2023-11-26T07:18:41.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f785ab93640 1 -- start start 2023-11-26T07:18:41.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f785ab93640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f785415d2a0 0x7f78540d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f785ab93640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f785415d680 0x7f78540cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f785ab93640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78540cdc40 con 0x7f78540d0e80 2023-11-26T07:18:41.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f785ab93640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78540ce7a0 con 0x7f785415d680 2023-11-26T07:18:41.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f785ab93640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78540d1440 con 0x7f785415d2a0 2023-11-26T07:18:41.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859b91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f785415d2a0 0x7f78540d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859390640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f785415d680 0x7f78540cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859b91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f785415d2a0 0x7f78540d00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:58574/0 (socket says 172.21.15.70:58574) 2023-11-26T07:18:41.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859b91640 1 -- 172.21.15.70:0/3505262202 learned_addr learned my addr 172.21.15.70:0/3505262202 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:41.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859b91640 1 -- 172.21.15.70:0/3505262202 >> v2:172.21.15.120:3300/0 conn(0x7f785415d680 msgr2=0x7f78540cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:41.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859b91640 1 --2- 172.21.15.70:0/3505262202 >> v2:172.21.15.120:3300/0 conn(0x7f785415d680 0x7f78540cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859b91640 1 -- 172.21.15.70:0/3505262202 >> v1:172.21.15.120:6789/0 conn(0x7f78540d0e80 legacy=0x7f78540d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.738+0000 7f7859b91640 1 -- 172.21.15.70:0/3505262202 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78540cde70 con 0x7f785415d2a0 2023-11-26T07:18:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f7859b91640 1 --2- 172.21.15.70:0/3505262202 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f785415d2a0 0x7f78540d00e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7850009870 tx=0x7f785001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97fb7d199fba274 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f7858b8f640 1 -- 172.21.15.70:0/3505262202 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500aa670 con 0x7f785415d2a0 2023-11-26T07:18:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f7858b8f640 1 -- 172.21.15.70:0/3505262202 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78500aa7d0 con 0x7f785415d2a0 2023-11-26T07:18:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f7858b8f640 1 -- 172.21.15.70:0/3505262202 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500aab60 con 0x7f785415d2a0 2023-11-26T07:18:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 -- 172.21.15.70:0/3505262202 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f785415d2a0 msgr2=0x7f78540d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 --2- 172.21.15.70:0/3505262202 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f785415d2a0 0x7f78540d00e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7850009870 tx=0x7f785001c510 comp rx=0 tx=0).stop 2023-11-26T07:18:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 -- 172.21.15.70:0/3505262202 shutdown_connections 2023-11-26T07:18:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 --2- 172.21.15.70:0/3505262202 >> v2:172.21.15.120:3300/0 conn(0x7f785415d680 0x7f78540cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 --2- 172.21.15.70:0/3505262202 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f785415d2a0 0x7f78540d00e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 -- 172.21.15.70:0/3505262202 >> 172.21.15.70:0/3505262202 conn(0x7f78540d30a0 msgr2=0x7f78540d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 -- 172.21.15.70:0/3505262202 shutdown_connections 2023-11-26T07:18:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.742+0000 7f785ab93640 1 -- 172.21.15.70:0/3505262202 wait complete. 2023-11-26T07:18:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 Processor -- start 2023-11-26T07:18:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 -- start start 2023-11-26T07:18:41.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f78540d0e80 0x7f78540c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f785415d2a0 0x7f78540c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f785415d680 0x7f78540c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78540c7f60 con 0x7f785415d680 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78540c83f0 con 0x7f785415d2a0 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78540c7350 con 0x7f78540d0e80 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f78540d0e80 0x7f78540c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859390640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f785415d2a0 0x7f78540c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785a392640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f785415d680 0x7f78540c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f78540d0e80 0x7f78540c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:58578/0 (socket says 172.21.15.70:58578) 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 -- 172.21.15.70:0/972848282 learned_addr learned my addr 172.21.15.70:0/972848282 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 -- 172.21.15.70:0/972848282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f785415d2a0 msgr2=0x7f78540c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f785415d2a0 0x7f78540c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 -- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f785415d680 msgr2=0x7f78540c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f785415d680 0x7f78540c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 -- 172.21.15.70:0/972848282 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78500094d0 con 0x7f78540d0e80 2023-11-26T07:18:41.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f7859b91640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f78540d0e80 0x7f78540c6a90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78500ac040 tx=0x7f785001ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f784a7fc640 1 -- 172.21.15.70:0/972848282 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500b3800 con 0x7f78540d0e80 2023-11-26T07:18:41.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f784a7fc640 1 -- 172.21.15.70:0/972848282 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78500b3960 con 0x7f78540d0e80 2023-11-26T07:18:41.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f784a7fc640 1 -- 172.21.15.70:0/972848282 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500b3cf0 con 0x7f78540d0e80 2023-11-26T07:18:41.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.746+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78540c7630 con 0x7f78540d0e80 2023-11-26T07:18:41.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.750+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78540c7bf0 con 0x7f78540d0e80 2023-11-26T07:18:41.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.750+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7854067500 con 0x7f78540d0e80 2023-11-26T07:18:41.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.750+0000 7f784a7fc640 1 -- 172.21.15.70:0/972848282 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78500c8430 con 0x7f78540d0e80 2023-11-26T07:18:41.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.750+0000 7f784a7fc640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7838066470 0x7f7838068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:41.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.750+0000 7f784a7fc640 1 -- 172.21.15.70:0/972848282 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f785011eb10 con 0x7f78540d0e80 2023-11-26T07:18:41.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.750+0000 7f7859390640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7838066470 0x7f7838068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:41.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.750+0000 7f7859390640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7838066470 0x7f7838068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f78540b8700 tx=0x7f7844009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:41.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.754+0000 7f784a7fc640 1 -- 172.21.15.70:0/972848282 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78500ec020 con 0x7f78540d0e80 2023-11-26T07:18:41.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.910+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78540cd560 con 0x7f78540d0e80 2023-11-26T07:18:41.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f784a7fc640 1 -- 172.21.15.70:0/972848282 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78500c3020 con 0x7f78540d0e80 2023-11-26T07:18:41.916 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:41.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7838066470 msgr2=0x7f7838068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7838066470 0x7f7838068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f78540b8700 tx=0x7f7844009190 comp rx=0 tx=0).stop 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f78540d0e80 msgr2=0x7f78540c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f78540d0e80 0x7f78540c6a90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f78500ac040 tx=0x7f785001ad50 comp rx=0 tx=0).stop 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 shutdown_connections 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7838066470 0x7f7838068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f785415d680 0x7f78540c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f785415d2a0 0x7f78540c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 --2- 172.21.15.70:0/972848282 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f78540d0e80 0x7f78540c6a90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 >> 172.21.15.70:0/972848282 conn(0x7f78540d30a0 msgr2=0x7f78540d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 shutdown_connections 2023-11-26T07:18:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:41.914+0000 7f785ab93640 1 -- 172.21.15.70:0/972848282 wait complete. 2023-11-26T07:18:41.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:42.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75fa9c640 1 Processor -- start 2023-11-26T07:18:42.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75fa9c640 1 -- start start 2023-11-26T07:18:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75fa9c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc75814b1e0 0x7fc7580cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75fa9c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580cfc20 con 0x7fc7580cf7c0 2023-11-26T07:18:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75fa9c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758162080 con 0x7fc758070fd0 2023-11-26T07:18:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75fa9c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc758161d70 con 0x7fc75814b1e0 2023-11-26T07:18:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75d037640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc7580cf7c0 0x7fc7580708c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60826/0 (socket says 172.21.15.70:60826) 2023-11-26T07:18:42.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75d037640 1 -- 172.21.15.70:0/2187013296 learned_addr learned my addr 172.21.15.70:0/2187013296 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75d838640 1 --2- 172.21.15.70:0/2187013296 >> v2:172.21.15.120:3300/0 conn(0x7fc75814b1e0 0x7fc7580cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469622323 0 0) 0x7fc7580cfc20 con 0x7fc7580cf7c0 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc744003530 con 0x7fc7580cf7c0 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611518294 0 0) 0x7fc758162080 con 0x7fc758070fd0 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7580cfc20 con 0x7fc758070fd0 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3603058877 0 0) 0x7fc744003530 con 0x7fc7580cf7c0 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 >> v2:172.21.15.120:3300/0 conn(0x7fc75814b1e0 msgr2=0x7fc7580cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 --2- 172.21.15.70:0/2187013296 >> v2:172.21.15.120:3300/0 conn(0x7fc75814b1e0 0x7fc7580cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 >> v1:172.21.15.120:6789/0 conn(0x7fc758070fd0 legacy=0x7fc758162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75814b5c0 con 0x7fc7580cf7c0 2023-11-26T07:18:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fc748001680 con 0x7fc7580cf7c0 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 >> v1:172.21.15.70:6789/0 conn(0x7fc7580cf7c0 legacy=0x7fc7580708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc744003b10 0x7fc744003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7440047d0 0x7fc744004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc74400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758161d70 con 0x7fc744005190 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74400c010 con 0x7fc7440047d0 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74400c1d0 con 0x7fc744003b10 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75e039640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc74400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75d838640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc744003b10 0x7fc744003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.074+0000 7fc75d037640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7440047d0 0x7fc744004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75e039640 1 -- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc744003b10 msgr2=0x7fc744003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75e039640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc744003b10 0x7fc744003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75e039640 1 -- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7440047d0 msgr2=0x7fc744004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75e039640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7440047d0 0x7fc744004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75e039640 1 -- 172.21.15.70:0/2187013296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744003530 con 0x7fc744005190 2023-11-26T07:18:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75e039640 1 -- 172.21.15.70:0/2187013296 reap_dead start 2023-11-26T07:18:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75e039640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc74400b990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc750001fd0 tx=0x7fc75001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2d34f67d2ee410 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748007ea0 con 0x7fc744005190 2023-11-26T07:18:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750003ba0 con 0x7fc744005190 2023-11-26T07:18:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75c836640 1 -- 172.21.15.70:0/2187013296 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7500050d0 con 0x7fc744005190 2023-11-26T07:18:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2187013296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 msgr2=0x7fc74400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc74400b990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc750001fd0 tx=0x7fc75001c8e0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2187013296 shutdown_connections 2023-11-26T07:18:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2187013296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc74400b990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.078+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2187013296 >> 172.21.15.70:0/2187013296 conn(0x7fc75806a890 msgr2=0x7fc75806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2187013296 shutdown_connections 2023-11-26T07:18:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2187013296 wait complete. 2023-11-26T07:18:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 Processor -- start 2023-11-26T07:18:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 -- start start 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc758149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7581fa530 0x7fc758144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc758144650 0x7fc7581467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758146030 con 0x7fc744005190 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581f7800 con 0x7fc7581fa530 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75fa9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581f7ae0 con 0x7fc758144650 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc758149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc758149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40770/0 (socket says 172.21.15.70:40770) 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 -- 172.21.15.70:0/2317599619 learned_addr learned my addr 172.21.15.70:0/2317599619 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d037640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7581fa530 0x7fc758144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75e039640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc758144650 0x7fc7581467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 -- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc758144650 msgr2=0x7fc7581467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc758144650 0x7fc7581467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 -- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7581fa530 msgr2=0x7fc758144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7581fa530 0x7fc758144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 -- 172.21.15.70:0/2317599619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7581f7dc0 con 0x7fc744005190 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75e039640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc758144650 0x7fc7581467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.082+0000 7fc75d838640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc758149d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc754011960 tx=0x7fc754011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc74e7fc640 1 -- 172.21.15.70:0/2317599619 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75400fa30 con 0x7fc744005190 2023-11-26T07:18:42.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc74e7fc640 1 -- 172.21.15.70:0/2317599619 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75400fb90 con 0x7fc744005190 2023-11-26T07:18:42.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7581462d0 con 0x7fc744005190 2023-11-26T07:18:42.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc74e7fc640 1 -- 172.21.15.70:0/2317599619 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754014440 con 0x7fc744005190 2023-11-26T07:18:42.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75814a450 con 0x7fc744005190 2023-11-26T07:18:42.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc758067680 con 0x7fc744005190 2023-11-26T07:18:42.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc74e7fc640 1 -- 172.21.15.70:0/2317599619 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc75401d400 con 0x7fc744005190 2023-11-26T07:18:42.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc74e7fc640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc73c0664a0 0x7fc73c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc74e7fc640 1 -- 172.21.15.70:0/2317599619 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc754084650 con 0x7fc744005190 2023-11-26T07:18:42.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc75d037640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc73c0664a0 0x7fc73c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.086+0000 7fc75d037640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc73c0664a0 0x7fc73c068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc748001060 tx=0x7fc748001e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.090+0000 7fc74e7fc640 1 -- 172.21.15.70:0/2317599619 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc754051a30 con 0x7fc744005190 2023-11-26T07:18:42.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.250+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc7581f7f50 con 0x7fc744005190 2023-11-26T07:18:42.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.250+0000 7fc74e7fc640 1 -- 172.21.15.70:0/2317599619 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc754055050 con 0x7fc744005190 2023-11-26T07:18:42.255 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:42.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc73c0664a0 msgr2=0x7fc73c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc73c0664a0 0x7fc73c068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc748001060 tx=0x7fc748001e10 comp rx=0 tx=0).stop 2023-11-26T07:18:42.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 msgr2=0x7fc758149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc758149d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc754011960 tx=0x7fc754011d60 comp rx=0 tx=0).stop 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 shutdown_connections 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc758144650 0x7fc7581467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7581fa530 0x7fc758144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc73c0664a0 0x7fc73c068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 --2- 172.21.15.70:0/2317599619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc744005190 0x7fc758149d40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 >> 172.21.15.70:0/2317599619 conn(0x7fc75806a890 msgr2=0x7fc7580af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 shutdown_connections 2023-11-26T07:18:42.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.254+0000 7fc75fa9c640 1 -- 172.21.15.70:0/2317599619 wait complete. 2023-11-26T07:18:42.276 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2023-11-26T07:18:42.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:42.276 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-26T07:18:42.320 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:42.321 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:18:42.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:42.321 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:18:42.379 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:18:42.379 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:42.388 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:18:42.388 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:42.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:42.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9d3b1640 1 Processor -- start 2023-11-26T07:18:42.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9d3b1640 1 -- start start 2023-11-26T07:18:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9d3b1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fec980d1d90 0x7fec980d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9d3b1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980cdc40 con 0x7fec9815d680 2023-11-26T07:18:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9d3b1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980ce7a0 con 0x7fec9815d2a0 2023-11-26T07:18:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9d3b1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec980d1440 con 0x7fec980d1d90 2023-11-26T07:18:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9cbb0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fec980d1d90 0x7fec980d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec977fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fec9815d680 0x7fec980b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60842/0 (socket says 172.21.15.70:60842) 2023-11-26T07:18:42.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec977fe640 1 -- 172.21.15.70:0/2446295097 learned_addr learned my addr 172.21.15.70:0/2446295097 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:42.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9cbb0640 1 -- 172.21.15.70:0/2446295097 >> v1:172.21.15.120:6789/0 conn(0x7fec9815d2a0 legacy=0x7fec980d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:42.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9cbb0640 1 -- 172.21.15.70:0/2446295097 >> v1:172.21.15.70:6789/0 conn(0x7fec9815d680 legacy=0x7fec980b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.622+0000 7fec9cbb0640 1 -- 172.21.15.70:0/2446295097 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980cde70 con 0x7fec980d1d90 2023-11-26T07:18:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9cbb0640 1 --2- 172.21.15.70:0/2446295097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec980d1d90 0x7fec980d00e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fec90009d90 tx=0x7fec9001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c7d721e4ff25b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec96ffd640 1 -- 172.21.15.70:0/2446295097 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900a58b0 con 0x7fec980d1d90 2023-11-26T07:18:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec96ffd640 1 -- 172.21.15.70:0/2446295097 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec900a5a10 con 0x7fec980d1d90 2023-11-26T07:18:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec96ffd640 1 -- 172.21.15.70:0/2446295097 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900a5da0 con 0x7fec980d1d90 2023-11-26T07:18:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 -- 172.21.15.70:0/2446295097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec980d1d90 msgr2=0x7fec980d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/2446295097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec980d1d90 0x7fec980d00e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fec90009d90 tx=0x7fec9001c8e0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 -- 172.21.15.70:0/2446295097 shutdown_connections 2023-11-26T07:18:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/2446295097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec980d1d90 0x7fec980d00e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 -- 172.21.15.70:0/2446295097 >> 172.21.15.70:0/2446295097 conn(0x7fec980d30a0 msgr2=0x7fec980d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 -- 172.21.15.70:0/2446295097 shutdown_connections 2023-11-26T07:18:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 -- 172.21.15.70:0/2446295097 wait complete. 2023-11-26T07:18:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.626+0000 7fec9d3b1640 1 Processor -- start 2023-11-26T07:18:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 -- start start 2023-11-26T07:18:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec980d1d90 0x7fec98153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fec9815d2a0 0x7fec9815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9815d680 0x7fec980c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9815be50 con 0x7fec9815d680 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9815dc20 con 0x7fec980d1d90 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9815df00 con 0x7fec9815d2a0 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9815d680 0x7fec980c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9815d680 0x7fec980c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40788/0 (socket says 172.21.15.70:40788) 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 -- 172.21.15.70:0/1376873150 learned_addr learned my addr 172.21.15.70:0/1376873150 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 -- 172.21.15.70:0/1376873150 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fec9815d2a0 msgr2=0x7fec9815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fec9815d2a0 0x7fec9815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 -- 172.21.15.70:0/1376873150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec980d1d90 msgr2=0x7fec98153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec980d1d90 0x7fec98153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 -- 172.21.15.70:0/1376873150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90009a70 con 0x7fec9815d680 2023-11-26T07:18:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9cbb0640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9815d680 0x7fec980c8c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fec9001a510 tx=0x7fec90019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec94ff9640 1 -- 172.21.15.70:0/1376873150 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900b9860 con 0x7fec9815d680 2023-11-26T07:18:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec94ff9640 1 -- 172.21.15.70:0/1376873150 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec900b99c0 con 0x7fec9815d680 2023-11-26T07:18:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec94ff9640 1 -- 172.21.15.70:0/1376873150 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900b9d30 con 0x7fec9815d680 2023-11-26T07:18:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9815e1e0 con 0x7fec9815d680 2023-11-26T07:18:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec98154400 con 0x7fec9815d680 2023-11-26T07:18:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.630+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98067500 con 0x7fec9815d680 2023-11-26T07:18:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.634+0000 7fec94ff9640 1 -- 172.21.15.70:0/1376873150 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec900c4460 con 0x7fec9815d680 2023-11-26T07:18:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.634+0000 7fec94ff9640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fec84066470 0x7fec84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.634+0000 7fec94ff9640 1 -- 172.21.15.70:0/1376873150 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec9011f440 con 0x7fec9815d680 2023-11-26T07:18:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.634+0000 7fec97fff640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fec84066470 0x7fec84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.634+0000 7fec97fff640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fec84066470 0x7fec84068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fec88003cf0 tx=0x7fec880079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.638+0000 7fec94ff9640 1 -- 172.21.15.70:0/1376873150 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec900ec820 con 0x7fec9815d680 2023-11-26T07:18:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.790+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec98067500 con 0x7fec9815d680 2023-11-26T07:18:42.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.790+0000 7fec94ff9640 1 -- 172.21.15.70:0/1376873150 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fec900efe40 con 0x7fec9815d680 2023-11-26T07:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:42.794 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:42.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fec84066470 msgr2=0x7fec84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fec84066470 0x7fec84068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fec88003cf0 tx=0x7fec880079c0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9815d680 msgr2=0x7fec980c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9815d680 0x7fec980c8c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fec9001a510 tx=0x7fec90019680 comp rx=0 tx=0).stop 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 shutdown_connections 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fec84066470 0x7fec84068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec9815d680 0x7fec980c8c20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fec9815d2a0 0x7fec9815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 --2- 172.21.15.70:0/1376873150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec980d1d90 0x7fec98153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 >> 172.21.15.70:0/1376873150 conn(0x7fec980d30a0 msgr2=0x7fec980d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 shutdown_connections 2023-11-26T07:18:42.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.794+0000 7fec9d3b1640 1 -- 172.21.15.70:0/1376873150 wait complete. 2023-11-26T07:18:42.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:42.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:42.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.954+0000 7f20dd6e3640 1 Processor -- start 2023-11-26T07:18:42.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.954+0000 7f20dd6e3640 1 -- start start 2023-11-26T07:18:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.954+0000 7f20dd6e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f20d80ce680 0x7f20d8071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.954+0000 7f20dd6e3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f20d80b2870 0x7f20d80b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.954+0000 7f20dd6e3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80b3200 con 0x7f20d81596d0 2023-11-26T07:18:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.954+0000 7f20dd6e3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80cbe00 con 0x7f20d80ce680 2023-11-26T07:18:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.954+0000 7f20dd6e3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80cf990 con 0x7f20d80b2870 2023-11-26T07:18:42.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d67fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f20d81596d0 0x7f20d80cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60846/0 (socket says 172.21.15.70:60846) 2023-11-26T07:18:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d67fc640 1 -- 172.21.15.70:0/3111709264 learned_addr learned my addr 172.21.15.70:0/3111709264 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d6ffd640 1 --2- 172.21.15.70:0/3111709264 >> v2:172.21.15.70:3300/0 conn(0x7f20d80ce680 0x7f20d8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d77fe640 1 --2- 172.21.15.70:0/3111709264 >> v2:172.21.15.120:3300/0 conn(0x7f20d80b2870 0x7f20d80b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d5ffb640 1 -- 172.21.15.70:0/3111709264 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919784538 0 0) 0x7f20cc001120 con 0x7f20d81596d0 2023-11-26T07:18:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d5ffb640 1 -- 172.21.15.70:0/3111709264 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c0005740 con 0x7f20d81596d0 2023-11-26T07:18:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d6ffd640 1 -- 172.21.15.70:0/3111709264 >> v2:172.21.15.120:3300/0 conn(0x7f20d80b2870 msgr2=0x7f20d80b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d6ffd640 1 --2- 172.21.15.70:0/3111709264 >> v2:172.21.15.120:3300/0 conn(0x7f20d80b2870 0x7f20d80b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d6ffd640 1 -- 172.21.15.70:0/3111709264 >> v1:172.21.15.70:6789/0 conn(0x7f20d81596d0 legacy=0x7f20d80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d6ffd640 1 -- 172.21.15.70:0/3111709264 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d806c750 con 0x7f20d80ce680 2023-11-26T07:18:42.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d77fe640 1 --2- 172.21.15.70:0/3111709264 >> v2:172.21.15.120:3300/0 conn(0x7f20d80b2870 0x7f20d80b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d6ffd640 1 --2- 172.21.15.70:0/3111709264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d80ce680 0x7f20d8071850 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20d806e860 tx=0x7f20c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fd15ffeb6aaf14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d5ffb640 1 -- 172.21.15.70:0/3111709264 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80ab600 con 0x7f20d80ce680 2023-11-26T07:18:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d5ffb640 1 -- 172.21.15.70:0/3111709264 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80a7050 con 0x7f20d80ce680 2023-11-26T07:18:42.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.958+0000 7f20d5ffb640 1 -- 172.21.15.70:0/3111709264 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80ab980 con 0x7f20d80ce680 2023-11-26T07:18:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- 172.21.15.70:0/3111709264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d80ce680 msgr2=0x7f20d8071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/3111709264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d80ce680 0x7f20d8071850 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20d806e860 tx=0x7f20c801c460 comp rx=0 tx=0).stop 2023-11-26T07:18:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- 172.21.15.70:0/3111709264 shutdown_connections 2023-11-26T07:18:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/3111709264 >> v2:172.21.15.120:3300/0 conn(0x7f20d80b2870 0x7f20d80b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/3111709264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d80ce680 0x7f20d8071850 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- 172.21.15.70:0/3111709264 >> 172.21.15.70:0/3111709264 conn(0x7f20d806a890 msgr2=0x7f20d806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:42.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- 172.21.15.70:0/3111709264 shutdown_connections 2023-11-26T07:18:42.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- 172.21.15.70:0/3111709264 wait complete. 2023-11-26T07:18:42.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 Processor -- start 2023-11-26T07:18:42.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- start start 2023-11-26T07:18:42.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20d80b2870 0x7f20d814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20d80ce680 0x7f20d814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d81596d0 0x7f20d815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81f6320 con 0x7f20d81596d0 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d814dc90 con 0x7f20d80ce680 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20dd6e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81f6590 con 0x7f20d80b2870 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20d77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d81596d0 0x7f20d815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20d77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d81596d0 0x7f20d815a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40804/0 (socket says 172.21.15.70:40804) 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20d77fe640 1 -- 172.21.15.70:0/957641316 learned_addr learned my addr 172.21.15.70:0/957641316 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.962+0000 7f20d67fc640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20d80ce680 0x7f20d814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20d6ffd640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20d80b2870 0x7f20d814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20d77fe640 1 -- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20d80b2870 msgr2=0x7f20d814c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20d77fe640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20d80b2870 0x7f20d814c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20d77fe640 1 -- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20d80ce680 msgr2=0x7f20d814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:42.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20d77fe640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20d80ce680 0x7f20d814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:42.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20d77fe640 1 -- 172.21.15.70:0/957641316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8009420 con 0x7f20d81596d0 2023-11-26T07:18:42.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20d77fe640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d81596d0 0x7f20d815a770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20d000cef0 tx=0x7f20d000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20bf7fe640 1 -- 172.21.15.70:0/957641316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000d840 con 0x7f20d81596d0 2023-11-26T07:18:42.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20bf7fe640 1 -- 172.21.15.70:0/957641316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000d9c0 con 0x7f20d81596d0 2023-11-26T07:18:42.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20bf7fe640 1 -- 172.21.15.70:0/957641316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000dd70 con 0x7f20d81596d0 2023-11-26T07:18:42.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d81f6870 con 0x7f20d81596d0 2023-11-26T07:18:42.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d814df70 con 0x7f20d81596d0 2023-11-26T07:18:42.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d81f6a90 con 0x7f20d81596d0 2023-11-26T07:18:42.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20bf7fe640 1 -- 172.21.15.70:0/957641316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20d001e3b0 con 0x7f20d81596d0 2023-11-26T07:18:42.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.966+0000 7f20bf7fe640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20c4066470 0x7f20c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:42.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.970+0000 7f20bf7fe640 1 -- 172.21.15.70:0/957641316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20d0084930 con 0x7f20d81596d0 2023-11-26T07:18:42.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.970+0000 7f20d6ffd640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20c4066470 0x7f20c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:42.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.970+0000 7f20d6ffd640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20c4066470 0x7f20c4068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20c80ad000 tx=0x7f20c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:42.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:42.970+0000 7f20bf7fe640 1 -- 172.21.15.70:0/957641316 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20d0051e70 con 0x7f20d81596d0 2023-11-26T07:18:43.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.122+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20d8067680 con 0x7f20d81596d0 2023-11-26T07:18:43.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.122+0000 7f20bf7fe640 1 -- 172.21.15.70:0/957641316 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20d001a020 con 0x7f20d81596d0 2023-11-26T07:18:43.127 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:43.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20c4066470 msgr2=0x7f20c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20c4066470 0x7f20c4068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20c80ad000 tx=0x7f20c8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d81596d0 msgr2=0x7f20d815a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d81596d0 0x7f20d815a770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20d000cef0 tx=0x7f20d000a710 comp rx=0 tx=0).stop 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 shutdown_connections 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20c4066470 0x7f20c4068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20d81596d0 0x7f20d815a770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20d80ce680 0x7f20d814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 --2- 172.21.15.70:0/957641316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20d80b2870 0x7f20d814c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 >> 172.21.15.70:0/957641316 conn(0x7f20d806a890 msgr2=0x7f20d80afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 shutdown_connections 2023-11-26T07:18:43.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.126+0000 7f20dd6e3640 1 -- 172.21.15.70:0/957641316 wait complete. 2023-11-26T07:18:43.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:43.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e06e17640 1 Processor -- start 2023-11-26T07:18:43.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e06e17640 1 -- start start 2023-11-26T07:18:43.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e06e17640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3e0006cd50 0x7f3e000b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e06e17640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0015b2f0 con 0x7f3e000cf280 2023-11-26T07:18:43.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e06e17640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0006c5c0 con 0x7f3e00070d10 2023-11-26T07:18:43.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e06e17640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0015e1a0 con 0x7f3e0006cd50 2023-11-26T07:18:43.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e04bb3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3e000cf280 0x7f3e000cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60862/0 (socket says 172.21.15.70:60862) 2023-11-26T07:18:43.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e04bb3640 1 -- 172.21.15.70:0/24307898 learned_addr learned my addr 172.21.15.70:0/24307898 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:43.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220731941 0 0) 0x7f3dfc001120 con 0x7f3e000cf280 2023-11-26T07:18:43.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de8003530 con 0x7f3e000cf280 2023-11-26T07:18:43.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e053b4640 1 --2- 172.21.15.70:0/24307898 >> v2:172.21.15.120:3300/0 conn(0x7f3e0006cd50 0x7f3e000b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1307920629 0 0) 0x7f3de8003530 con 0x7f3e000cf280 2023-11-26T07:18:43.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 >> v2:172.21.15.120:3300/0 conn(0x7f3e0006cd50 msgr2=0x7f3e000b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 --2- 172.21.15.70:0/24307898 >> v2:172.21.15.120:3300/0 conn(0x7f3e0006cd50 0x7f3e000b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 >> v1:172.21.15.120:6789/0 conn(0x7f3e00070d10 legacy=0x7f3e0015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0015e480 con 0x7f3e000cf280 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f3dfc001810 con 0x7f3e000cf280 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 >> v1:172.21.15.70:6789/0 conn(0x7f3e000cf280 legacy=0x7f3e000cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8005190 0x7f3de800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0015e1a0 con 0x7f3de8003980 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de800c040 con 0x7f3de8005190 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de800c200 con 0x7f3de80047d0 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e04bb3640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3e053b4640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8005190 0x7f3de800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.286+0000 7f3df7fff640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e04bb3640 1 -- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3de80047d0 msgr2=0x7f3de8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e04bb3640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e04bb3640 1 -- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8005190 msgr2=0x7f3de800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e04bb3640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8005190 0x7f3de800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e04bb3640 1 -- 172.21.15.70:0/24307898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8003530 con 0x7f3de8003980 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e053b4640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8005190 0x7f3de800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e053b4640 1 -- 172.21.15.70:0/24307898 reap_dead start 2023-11-26T07:18:43.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e04bb3640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c240 tx=0x7f3dfc01f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8e7eaca205f296 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc005ae0 con 0x7f3de8003980 2023-11-26T07:18:43.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc0ab070 con 0x7f3de8003980 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3df77fe640 1 -- 172.21.15.70:0/24307898 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc007070 con 0x7f3de8003980 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e06e17640 1 -- 172.21.15.70:0/24307898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3de8003980 msgr2=0x7f3de8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e06e17640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00c240 tx=0x7f3dfc01f370 comp rx=0 tx=0).stop 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e06e17640 1 -- 172.21.15.70:0/24307898 shutdown_connections 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e06e17640 1 --2- 172.21.15.70:0/24307898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e06e17640 1 -- 172.21.15.70:0/24307898 >> 172.21.15.70:0/24307898 conn(0x7f3e0006a890 msgr2=0x7f3e0006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e06e17640 1 -- 172.21.15.70:0/24307898 shutdown_connections 2023-11-26T07:18:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.290+0000 7f3e06e17640 1 -- 172.21.15.70:0/24307898 wait complete. 2023-11-26T07:18:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 Processor -- start 2023-11-26T07:18:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 -- start start 2023-11-26T07:18:43.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8003980 0x7f3e00158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e000cd2f0 0x7f3e0014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e000cd770 0x7f3e0014bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00158670 con 0x7f3e000cd2f0 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e000afa70 con 0x7f3de8003980 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00157cd0 con 0x7f3e000cd770 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e000cd2f0 0x7f3e0014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e000cd2f0 0x7f3e0014b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40834/0 (socket says 172.21.15.70:40834) 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 -- 172.21.15.70:0/1264789194 learned_addr learned my addr 172.21.15.70:0/1264789194 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e04bb3640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8003980 0x7f3e00158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e053b4640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e000cd770 0x7f3e0014bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 -- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e000cd770 msgr2=0x7f3e0014bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e000cd770 0x7f3e0014bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 -- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8003980 msgr2=0x7f3e00158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8003980 0x7f3e00158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 -- 172.21.15.70:0/1264789194 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00157fb0 con 0x7f3e000cd2f0 2023-11-26T07:18:43.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df7fff640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e000cd2f0 0x7f3e0014b590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3df000e410 tx=0x7f3df000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df57fa640 1 -- 172.21.15.70:0/1264789194 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00052e0 con 0x7f3e000cd2f0 2023-11-26T07:18:43.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df57fa640 1 -- 172.21.15.70:0/1264789194 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0005440 con 0x7f3e000cd2f0 2023-11-26T07:18:43.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e00158290 con 0x7f3e000cd2f0 2023-11-26T07:18:43.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.294+0000 7f3df57fa640 1 -- 172.21.15.70:0/1264789194 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0003820 con 0x7f3e000cd2f0 2023-11-26T07:18:43.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.298+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e000aeed0 con 0x7f3e000cd2f0 2023-11-26T07:18:43.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.298+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e00067680 con 0x7f3e000cd2f0 2023-11-26T07:18:43.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.298+0000 7f3df57fa640 1 -- 172.21.15.70:0/1264789194 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3df0003980 con 0x7f3e000cd2f0 2023-11-26T07:18:43.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.298+0000 7f3df57fa640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3dec066470 0x7f3dec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.298+0000 7f3df57fa640 1 -- 172.21.15.70:0/1264789194 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3df00835e0 con 0x7f3e000cd2f0 2023-11-26T07:18:43.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.298+0000 7f3e04bb3640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3dec066470 0x7f3dec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.298+0000 7f3e04bb3640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3dec066470 0x7f3dec068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0af000 tx=0x7f3dfc0aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.302+0000 7f3df57fa640 1 -- 172.21.15.70:0/1264789194 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3df0050b00 con 0x7f3e000cd2f0 2023-11-26T07:18:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.454+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e0015d770 con 0x7f3e000cd2f0 2023-11-26T07:18:43.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.454+0000 7f3df57fa640 1 -- 172.21.15.70:0/1264789194 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3df0054120 con 0x7f3e000cd2f0 2023-11-26T07:18:43.458 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:43.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.454+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3dec066470 msgr2=0x7f3dec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.454+0000 7f3e06e17640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3dec066470 0x7f3dec068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0af000 tx=0x7f3dfc0aa000 comp rx=0 tx=0).stop 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.454+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e000cd2f0 msgr2=0x7f3e0014b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.454+0000 7f3e06e17640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e000cd2f0 0x7f3e0014b590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3df000e410 tx=0x7f3df000e8d0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 shutdown_connections 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3dec066470 0x7f3dec068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e000cd2f0 0x7f3e0014b590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e000cd770 0x7f3e0014bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 --2- 172.21.15.70:0/1264789194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3de8003980 0x7f3e00158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 >> 172.21.15.70:0/1264789194 conn(0x7f3e0006a890 msgr2=0x7f3e0015bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 shutdown_connections 2023-11-26T07:18:43.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.458+0000 7f3e06e17640 1 -- 172.21.15.70:0/1264789194 wait complete. 2023-11-26T07:18:43.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.614+0000 7f3355b85640 1 Processor -- start 2023-11-26T07:18:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.614+0000 7f3355b85640 1 -- start start 2023-11-26T07:18:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355b85640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3350160850 0x7f33500d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355b85640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500ce290 con 0x7f3350160f60 2023-11-26T07:18:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355b85640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500ce570 con 0x7f33500cf330 2023-11-26T07:18:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355b85640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500ce850 con 0x7f3350160850 2023-11-26T07:18:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355384640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3350160f60 0x7f33500b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48038/0 (socket says 172.21.15.70:48038) 2023-11-26T07:18:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355384640 1 -- 172.21.15.70:0/2345690195 learned_addr learned my addr 172.21.15.70:0/2345690195 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3354b83640 1 --2- 172.21.15.70:0/2345690195 >> v2:172.21.15.120:3300/0 conn(0x7f3350160850 0x7f33500d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375837196 0 0) 0x7f33500ce290 con 0x7f3350160f60 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3338003530 con 0x7f3350160f60 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024954758 0 0) 0x7f33500ce570 con 0x7f33500cf330 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33500ce290 con 0x7f33500cf330 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 844299087 0 0) 0x7f3338003530 con 0x7f3350160f60 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 >> v2:172.21.15.120:3300/0 conn(0x7f3350160850 msgr2=0x7f33500d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 --2- 172.21.15.70:0/2345690195 >> v2:172.21.15.120:3300/0 conn(0x7f3350160850 0x7f33500d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 >> v1:172.21.15.120:6789/0 conn(0x7f33500cf330 legacy=0x7f33500cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500ceb30 con 0x7f3350160f60 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f3348001a00 con 0x7f3350160f60 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 >> v1:172.21.15.70:6789/0 conn(0x7f3350160f60 legacy=0x7f33500b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3338003b10 0x7f3338003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3338004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3338005190 0x7f333800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500ce850 con 0x7f33380047d0 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333800c010 con 0x7f3338005190 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333800c1d0 con 0x7f3338003b10 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3347fff640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3338004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355384640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3338005190 0x7f333800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3354b83640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3338003b10 0x7f3338003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3347fff640 1 -- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3338003b10 msgr2=0x7f3338003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3347fff640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3338003b10 0x7f3338003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3347fff640 1 -- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3338005190 msgr2=0x7f333800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3347fff640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3338005190 0x7f333800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3347fff640 1 -- 172.21.15.70:0/2345690195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338003530 con 0x7f33380047d0 2023-11-26T07:18:43.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355384640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3338005190 0x7f333800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:43.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.618+0000 7f3355384640 1 -- 172.21.15.70:0/2345690195 reap_dead start 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3347fff640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3338004c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f33400018d0 tx=0x7f334001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd101fb306e52593 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400052d0 con 0x7f33380047d0 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340005450 con 0x7f33380047d0 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f33477fe640 1 -- 172.21.15.70:0/2345690195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400a8910 con 0x7f33380047d0 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 -- 172.21.15.70:0/2345690195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 msgr2=0x7f3338004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3338004c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f33400018d0 tx=0x7f334001ecb0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 -- 172.21.15.70:0/2345690195 shutdown_connections 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 --2- 172.21.15.70:0/2345690195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3338004c50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 -- 172.21.15.70:0/2345690195 >> 172.21.15.70:0/2345690195 conn(0x7f335009c5a0 msgr2=0x7f33500d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 -- 172.21.15.70:0/2345690195 shutdown_connections 2023-11-26T07:18:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 -- 172.21.15.70:0/2345690195 wait complete. 2023-11-26T07:18:43.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.622+0000 7f3355b85640 1 Processor -- start 2023-11-26T07:18:43.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 -- start start 2023-11-26T07:18:43.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3350156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33500c7b20 0x7f33500cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33500cca10 0x7f335006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500cd5e0 con 0x7f33380047d0 2023-11-26T07:18:43.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500b72d0 con 0x7f33500c7b20 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500cd020 con 0x7f33500cca10 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3350156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3350156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42252/0 (socket says 172.21.15.70:42252) 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 -- 172.21.15.70:0/587268208 learned_addr learned my addr 172.21.15.70:0/587268208 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355384640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33500cca10 0x7f335006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3347fff640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33500c7b20 0x7f33500cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 -- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33500cca10 msgr2=0x7f335006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33500cca10 0x7f335006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 -- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33500c7b20 msgr2=0x7f33500cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33500c7b20 0x7f33500cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 -- 172.21.15.70:0/587268208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500cd300 con 0x7f33380047d0 2023-11-26T07:18:43.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355384640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33500cca10 0x7f335006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:43.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3347fff640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33500c7b20 0x7f33500cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:43.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3354b83640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3350156790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f334c011500 tx=0x7f334c0119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f33457fa640 1 -- 172.21.15.70:0/587268208 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c015870 con 0x7f33380047d0 2023-11-26T07:18:43.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f33457fa640 1 -- 172.21.15.70:0/587268208 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0159d0 con 0x7f33380047d0 2023-11-26T07:18:43.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33500ca4d0 con 0x7f33380047d0 2023-11-26T07:18:43.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f33457fa640 1 -- 172.21.15.70:0/587268208 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c015d40 con 0x7f33380047d0 2023-11-26T07:18:43.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3350156cd0 con 0x7f33380047d0 2023-11-26T07:18:43.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.626+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33500ccdf0 con 0x7f33380047d0 2023-11-26T07:18:43.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.630+0000 7f33457fa640 1 -- 172.21.15.70:0/587268208 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f334c013400 con 0x7f33380047d0 2023-11-26T07:18:43.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.630+0000 7f33457fa640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f333c0664a0 0x7f333c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.630+0000 7f33457fa640 1 -- 172.21.15.70:0/587268208 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f334c084250 con 0x7f33380047d0 2023-11-26T07:18:43.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.630+0000 7f3347fff640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f333c0664a0 0x7f333c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.630+0000 7f3347fff640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f333c0664a0 0x7f333c068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f33400b0000 tx=0x7f33400aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.634+0000 7f33457fa640 1 -- 172.21.15.70:0/587268208 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f334c051640 con 0x7f33380047d0 2023-11-26T07:18:43.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.782+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33500ca310 con 0x7f33380047d0 2023-11-26T07:18:43.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.782+0000 7f33457fa640 1 -- 172.21.15.70:0/587268208 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f334c054c60 con 0x7f33380047d0 2023-11-26T07:18:43.786 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f333c0664a0 msgr2=0x7f333c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f333c0664a0 0x7f333c068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f33400b0000 tx=0x7f33400aa070 comp rx=0 tx=0).stop 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 msgr2=0x7f3350156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3350156790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f334c011500 tx=0x7f334c0119c0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 shutdown_connections 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33500cca10 0x7f335006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33500c7b20 0x7f33500cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f333c0664a0 0x7f333c068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 --2- 172.21.15.70:0/587268208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33380047d0 0x7f3350156790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 >> 172.21.15.70:0/587268208 conn(0x7f335009c5a0 msgr2=0x7f335015fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 shutdown_connections 2023-11-26T07:18:43.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.786+0000 7f3355b85640 1 -- 172.21.15.70:0/587268208 wait complete. 2023-11-26T07:18:43.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58d5fc1640 1 Processor -- start 2023-11-26T07:18:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58d5fc1640 1 -- start start 2023-11-26T07:18:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58d5fc1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 0x7f58d0071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58d5fc1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d006c750 con 0x7f58d00b2f80 2023-11-26T07:18:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58d5fc1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d00b3550 con 0x7f58d00ce680 2023-11-26T07:18:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58d5fc1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00cbe00 con 0x7f58d01596d0 2023-11-26T07:18:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f58d00b2f80 0x7f58d006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48054/0 (socket says 172.21.15.70:48054) 2023-11-26T07:18:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cffff640 1 -- 172.21.15.70:0/4088195546 learned_addr learned my addr 172.21.15.70:0/4088195546 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 0x7f58d0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674533004 0 0) 0x7f58d006c750 con 0x7f58d00b2f80 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58bc003530 con 0x7f58d00b2f80 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972829813 0 0) 0x7f58bc003530 con 0x7f58d00b2f80 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 msgr2=0x7f58d0071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 0x7f58d0071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 >> v1:172.21.15.120:6789/0 conn(0x7f58d00ce680 legacy=0x7f58d00b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0071e80 con 0x7f58d00b2f80 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f58c8001a00 con 0x7f58d00b2f80 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 >> v1:172.21.15.70:6789/0 conn(0x7f58d00b2f80 legacy=0x7f58d006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc0039b0 0x7f58bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 0x7f58bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc004d10 0x7f58bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00cbe00 con 0x7f58bc0039b0 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc00ba40 con 0x7f58bc004d10 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc00ddc0 con 0x7f58d01596d0 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc0039b0 0x7f58bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cffff640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc004d10 0x7f58bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58c7fff640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 0x7f58bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cf7fe640 1 -- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 msgr2=0x7f58bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58d01596d0 0x7f58bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cf7fe640 1 -- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc004d10 msgr2=0x7f58bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.946+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc004d10 0x7f58bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58cf7fe640 1 -- 172.21.15.70:0/4088195546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc003530 con 0x7f58bc0039b0 2023-11-26T07:18:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58cffff640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58bc004d10 0x7f58bc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc0039b0 0x7f58bc003d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009ae0 tx=0x7f58c001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da89245fd9451467 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c00a5640 con 0x7f58bc0039b0 2023-11-26T07:18:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00a57a0 con 0x7f58bc0039b0 2023-11-26T07:18:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58ceffd640 1 -- 172.21.15.70:0/4088195546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c00a5b50 con 0x7f58bc0039b0 2023-11-26T07:18:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58d5fc1640 1 -- 172.21.15.70:0/4088195546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc0039b0 msgr2=0x7f58bc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58d5fc1640 1 --2- 172.21.15.70:0/4088195546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58bc0039b0 0x7f58bc003d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009ae0 tx=0x7f58c001ca50 comp rx=0 tx=0).stop 2023-11-26T07:18:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58cffff640 1 -- 172.21.15.70:0/4088195546 reap_dead start 2023-11-26T07:18:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58d5fc1640 1 -- 172.21.15.70:0/4088195546 shutdown_connections 2023-11-26T07:18:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58d5fc1640 1 -- 172.21.15.70:0/4088195546 >> 172.21.15.70:0/4088195546 conn(0x7f58d006a890 msgr2=0x7f58d006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58d5fc1640 1 -- 172.21.15.70:0/4088195546 shutdown_connections 2023-11-26T07:18:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.950+0000 7f58d5fc1640 1 -- 172.21.15.70:0/4088195546 wait complete. 2023-11-26T07:18:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 Processor -- start 2023-11-26T07:18:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 -- start start 2023-11-26T07:18:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58bc0039b0 0x7f58d0154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58d0156ee0 0x7f58d0157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d01515f0 0x7f58d0151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0151fb0 con 0x7f58d0156ee0 2023-11-26T07:18:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01584d0 con 0x7f58d01515f0 2023-11-26T07:18:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0157950 con 0x7f58bc0039b0 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58d0156ee0 0x7f58d0157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58d0156ee0 0x7f58d0157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42278/0 (socket says 172.21.15.70:42278) 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 -- 172.21.15.70:0/3622347943 learned_addr learned my addr 172.21.15.70:0/3622347943 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58bc0039b0 0x7f58d0154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58cffff640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d01515f0 0x7f58d0151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 -- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58bc0039b0 msgr2=0x7f58d0154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58bc0039b0 0x7f58d0154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 -- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d01515f0 msgr2=0x7f58d0151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d01515f0 0x7f58d0151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 -- 172.21.15.70:0/3622347943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0157c30 con 0x7f58d0156ee0 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58c7fff640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58d0156ee0 0x7f58d0157360 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58b800afd0 tx=0x7f58b800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58ccff9640 1 -- 172.21.15.70:0/3622347943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8011c70 con 0x7f58d0156ee0 2023-11-26T07:18:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58ccff9640 1 -- 172.21.15.70:0/3622347943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8011df0 con 0x7f58d0156ee0 2023-11-26T07:18:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d0157f10 con 0x7f58d0156ee0 2023-11-26T07:18:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58ccff9640 1 -- 172.21.15.70:0/3622347943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8005310 con 0x7f58d0156ee0 2023-11-26T07:18:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.954+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d015be20 con 0x7f58d0156ee0 2023-11-26T07:18:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.958+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d0067680 con 0x7f58d0156ee0 2023-11-26T07:18:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.958+0000 7f58ccff9640 1 -- 172.21.15.70:0/3622347943 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58b8003600 con 0x7f58d0156ee0 2023-11-26T07:18:43.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.958+0000 7f58ccff9640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58b00664a0 0x7f58b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:43.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.958+0000 7f58ccff9640 1 -- 172.21.15.70:0/3622347943 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58b80876a0 con 0x7f58d0156ee0 2023-11-26T07:18:43.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.958+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58b00664a0 0x7f58b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:43.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.958+0000 7f58cf7fe640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58b00664a0 0x7f58b0068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58c00af000 tx=0x7f58c00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:43.962+0000 7f58ccff9640 1 -- 172.21.15.70:0/3622347943 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58b8054bd0 con 0x7f58d0156ee0 2023-11-26T07:18:44.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.126+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f58d006dc20 con 0x7f58d0156ee0 2023-11-26T07:18:44.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.126+0000 7f58ccff9640 1 -- 172.21.15.70:0/3622347943 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f58b80581f0 con 0x7f58d0156ee0 2023-11-26T07:18:44.131 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:44.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58b00664a0 msgr2=0x7f58b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58b00664a0 0x7f58b0068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58c00af000 tx=0x7f58c00046d0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58d0156ee0 msgr2=0x7f58d0157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58d0156ee0 0x7f58d0157360 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58b800afd0 tx=0x7f58b800f5a0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 shutdown_connections 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f58b00664a0 0x7f58b0068960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58d0156ee0 0x7f58d0157360 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d01515f0 0x7f58d0151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 --2- 172.21.15.70:0/3622347943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f58bc0039b0 0x7f58d0154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 >> 172.21.15.70:0/3622347943 conn(0x7f58d006a890 msgr2=0x7f58d00cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 shutdown_connections 2023-11-26T07:18:44.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.130+0000 7f58d5fc1640 1 -- 172.21.15.70:0/3622347943 wait complete. 2023-11-26T07:18:44.152 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:18:44.153 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:44.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.334+0000 7eff4dec8640 1 Processor -- start 2023-11-26T07:18:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.334+0000 7eff4dec8640 1 -- start start 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4dec8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4815d1f0 0x7eff4806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4dec8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7eff480b44c0 0x7eff48071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4dec8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7eff4806b4a0 0x7eff4806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4dec8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480b2fa0 con 0x7eff480b44c0 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4dec8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4806be70 con 0x7eff4806b4a0 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4dec8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff48071d50 con 0x7eff4815d1f0 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7eff480b44c0 0x7eff48071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7eff480b44c0 0x7eff48071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42290/0 (socket says 172.21.15.70:42290) 2023-11-26T07:18:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 -- 172.21.15.70:0/2459973194 learned_addr learned my addr 172.21.15.70:0/2459973194 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4d6c7640 1 --2- 172.21.15.70:0/2459973194 >> v2:172.21.15.120:3300/0 conn(0x7eff4806b4a0 0x7eff4806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff4cec6640 1 --2- 172.21.15.70:0/2459973194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4815d1f0 0x7eff4806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 -- 172.21.15.70:0/2459973194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4815d1f0 msgr2=0x7eff4806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 --2- 172.21.15.70:0/2459973194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4815d1f0 0x7eff4806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 -- 172.21.15.70:0/2459973194 >> v2:172.21.15.120:3300/0 conn(0x7eff4806b4a0 msgr2=0x7eff4806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 --2- 172.21.15.70:0/2459973194 >> v2:172.21.15.120:3300/0 conn(0x7eff4806b4a0 0x7eff4806b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.338+0000 7eff47fff640 1 -- 172.21.15.70:0/2459973194 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480b2640 con 0x7eff480b44c0 2023-11-26T07:18:44.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff47fff640 1 --2- 172.21.15.70:0/2459973194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff48071520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff48070060 tx=0x7eff3401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78d7594d211b37b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff477fe640 1 -- 172.21.15.70:0/2459973194 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340a7070 con 0x7eff480b44c0 2023-11-26T07:18:44.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff477fe640 1 -- 172.21.15.70:0/2459973194 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff340ab430 con 0x7eff480b44c0 2023-11-26T07:18:44.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff477fe640 1 -- 172.21.15.70:0/2459973194 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340ab7c0 con 0x7eff480b44c0 2023-11-26T07:18:44.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 -- 172.21.15.70:0/2459973194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 msgr2=0x7eff48071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 --2- 172.21.15.70:0/2459973194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff48071520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff48070060 tx=0x7eff3401c470 comp rx=0 tx=0).stop 2023-11-26T07:18:44.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 -- 172.21.15.70:0/2459973194 shutdown_connections 2023-11-26T07:18:44.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 --2- 172.21.15.70:0/2459973194 >> v2:172.21.15.120:3300/0 conn(0x7eff4806b4a0 0x7eff4806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 --2- 172.21.15.70:0/2459973194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff48071520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 --2- 172.21.15.70:0/2459973194 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4815d1f0 0x7eff4806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 -- 172.21.15.70:0/2459973194 >> 172.21.15.70:0/2459973194 conn(0x7eff48070a00 msgr2=0x7eff48070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 -- 172.21.15.70:0/2459973194 shutdown_connections 2023-11-26T07:18:44.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 -- 172.21.15.70:0/2459973194 wait complete. 2023-11-26T07:18:44.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 Processor -- start 2023-11-26T07:18:44.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.342+0000 7eff4dec8640 1 -- start start 2023-11-26T07:18:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4806b4a0 0x7eff4815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff4815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff4815d1f0 0x7eff4813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4815ab60 con 0x7eff480b44c0 2023-11-26T07:18:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff481554e0 con 0x7eff4815d1f0 2023-11-26T07:18:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480cc590 con 0x7eff4806b4a0 2023-11-26T07:18:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff4815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff4815fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42296/0 (socket says 172.21.15.70:42296) 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 -- 172.21.15.70:0/746675428 learned_addr learned my addr 172.21.15.70:0/746675428 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4cec6640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4806b4a0 0x7eff4815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4d6c7640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff4815d1f0 0x7eff4813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 -- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4806b4a0 msgr2=0x7eff4815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4806b4a0 0x7eff4815b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 -- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff4815d1f0 msgr2=0x7eff4813ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff4815d1f0 0x7eff4813ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 -- 172.21.15.70:0/746675428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340094d0 con 0x7eff480b44c0 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff47fff640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff4815fab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff340ad040 tx=0x7eff34019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff457fa640 1 -- 172.21.15.70:0/746675428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340b4830 con 0x7eff480b44c0 2023-11-26T07:18:44.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff457fa640 1 -- 172.21.15.70:0/746675428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff340b4990 con 0x7eff480b44c0 2023-11-26T07:18:44.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff457fa640 1 -- 172.21.15.70:0/746675428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340b4d40 con 0x7eff480b44c0 2023-11-26T07:18:44.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4815fff0 con 0x7eff480b44c0 2023-11-26T07:18:44.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4815ad70 con 0x7eff480b44c0 2023-11-26T07:18:44.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff48067500 con 0x7eff480b44c0 2023-11-26T07:18:44.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.346+0000 7eff457fa640 1 -- 172.21.15.70:0/746675428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff340c2460 con 0x7eff480b44c0 2023-11-26T07:18:44.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.350+0000 7eff457fa640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff2c066470 0x7eff2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.350+0000 7eff457fa640 1 -- 172.21.15.70:0/746675428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff3411e4f0 con 0x7eff480b44c0 2023-11-26T07:18:44.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.350+0000 7eff4cec6640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff2c066470 0x7eff2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.350+0000 7eff4cec6640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff2c066470 0x7eff2c068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00b930 tx=0x7eff3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.354+0000 7eff457fa640 1 -- 172.21.15.70:0/746675428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff340eb970 con 0x7eff480b44c0 2023-11-26T07:18:44.506 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.502+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff4806cb30 con 0x7eff480b44c0 2023-11-26T07:18:44.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.502+0000 7eff457fa640 1 -- 172.21.15.70:0/746675428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7eff340eef90 con 0x7eff480b44c0 2023-11-26T07:18:44.507 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:44.507 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:04.768928+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:44.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff2c066470 msgr2=0x7eff2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff2c066470 0x7eff2c068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00b930 tx=0x7eff3c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 msgr2=0x7eff4815fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff4815fab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7eff340ad040 tx=0x7eff34019210 comp rx=0 tx=0).stop 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 shutdown_connections 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7eff2c066470 0x7eff2c068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff480b44c0 0x7eff4815fab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff4815d1f0 0x7eff4813ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 --2- 172.21.15.70:0/746675428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7eff4806b4a0 0x7eff4815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 >> 172.21.15.70:0/746675428 conn(0x7eff48070a00 msgr2=0x7eff480af670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 shutdown_connections 2023-11-26T07:18:44.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.506+0000 7eff4dec8640 1 -- 172.21.15.70:0/746675428 wait complete. 2023-11-26T07:18:44.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:44.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd528879640 1 Processor -- start 2023-11-26T07:18:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd528879640 1 -- start start 2023-11-26T07:18:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd528879640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd5240ce7c0 0x7fd52415f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd528879640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52406c520 con 0x7fd5240cf990 2023-11-26T07:18:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd528879640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52406c800 con 0x7fd52413e290 2023-11-26T07:18:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd528879640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52406cae0 con 0x7fd5240ce7c0 2023-11-26T07:18:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd519d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd5240cf990 0x7fd52415efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48070/0 (socket says 172.21.15.70:48070) 2023-11-26T07:18:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd519d9b640 1 -- 172.21.15.70:0/3885160163 learned_addr learned my addr 172.21.15.70:0/3885160163 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd522d9d640 1 --2- 172.21.15.70:0/3885160163 >> v2:172.21.15.120:3300/0 conn(0x7fd5240ce7c0 0x7fd52415f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995926942 0 0) 0x7fd52406c520 con 0x7fd5240cf990 2023-11-26T07:18:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd510003530 con 0x7fd5240cf990 2023-11-26T07:18:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151003041 0 0) 0x7fd52406c800 con 0x7fd52413e290 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd52406c520 con 0x7fd52413e290 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424138058 0 0) 0x7fd510003530 con 0x7fd5240cf990 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 >> v2:172.21.15.120:3300/0 conn(0x7fd5240ce7c0 msgr2=0x7fd52415f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 --2- 172.21.15.70:0/3885160163 >> v2:172.21.15.120:3300/0 conn(0x7fd5240ce7c0 0x7fd52415f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 >> v1:172.21.15.120:6789/0 conn(0x7fd52413e290 legacy=0x7fd5240cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52406cdc0 con 0x7fd5240cf990 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fd50c001680 con 0x7fd5240cf990 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 >> v1:172.21.15.70:6789/0 conn(0x7fd5240cf990 legacy=0x7fd52415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd510003b10 0x7fd510003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5100047d0 0x7fd510004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd510005190 0x7fd51000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52406cae0 con 0x7fd510003b10 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000c0c0 con 0x7fd5100047d0 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51000c280 con 0x7fd510005190 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.666+0000 7fd52259c640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd510003b10 0x7fd510003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd519d9b640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5100047d0 0x7fd510004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd522d9d640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd510005190 0x7fd51000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd52259c640 1 -- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd510005190 msgr2=0x7fd51000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd52259c640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd510005190 0x7fd51000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd52259c640 1 -- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5100047d0 msgr2=0x7fd510004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:44.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd52259c640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5100047d0 0x7fd510004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd52259c640 1 -- 172.21.15.70:0/3885160163 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510003530 con 0x7fd510003b10 2023-11-26T07:18:44.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd522d9d640 1 -- 172.21.15.70:0/3885160163 reap_dead start 2023-11-26T07:18:44.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd52259c640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd510003b10 0x7fd510003f10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd514001fd0 tx=0x7fd51401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d640d4c11d788f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514003b80 con 0x7fd510003b10 2023-11-26T07:18:44.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514003d00 con 0x7fd510003b10 2023-11-26T07:18:44.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.670+0000 7fd521d9b640 1 -- 172.21.15.70:0/3885160163 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514005310 con 0x7fd510003b10 2023-11-26T07:18:44.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- 172.21.15.70:0/3885160163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd510003b10 msgr2=0x7fd510003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd510003b10 0x7fd510003f10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd514001fd0 tx=0x7fd51401c870 comp rx=0 tx=0).stop 2023-11-26T07:18:44.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- 172.21.15.70:0/3885160163 shutdown_connections 2023-11-26T07:18:44.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 --2- 172.21.15.70:0/3885160163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd510003b10 0x7fd510003f10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- 172.21.15.70:0/3885160163 >> 172.21.15.70:0/3885160163 conn(0x7fd52406a890 msgr2=0x7fd52406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- 172.21.15.70:0/3885160163 shutdown_connections 2023-11-26T07:18:44.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- 172.21.15.70:0/3885160163 wait complete. 2023-11-26T07:18:44.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 Processor -- start 2023-11-26T07:18:44.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- start start 2023-11-26T07:18:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd510003b10 0x7fd52413d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd52413bb70 0x7fd5241f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52415a150 0x7fd52415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5241f9ef0 con 0x7fd52415a150 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52415ab10 con 0x7fd510003b10 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd528879640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5241f9270 con 0x7fd52413bb70 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52415a150 0x7fd52415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52415a150 0x7fd52415a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42316/0 (socket says 172.21.15.70:42316) 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 -- 172.21.15.70:0/3169915324 learned_addr learned my addr 172.21.15.70:0/3169915324 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd519d9b640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd52413bb70 0x7fd5241f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd52259c640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd510003b10 0x7fd52413d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 -- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd52413bb70 msgr2=0x7fd5241f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd52413bb70 0x7fd5241f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 -- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd510003b10 msgr2=0x7fd52413d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd510003b10 0x7fd52413d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.674+0000 7fd522d9d640 1 -- 172.21.15.70:0/3169915324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5241f9550 con 0x7fd52415a150 2023-11-26T07:18:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd522d9d640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52415a150 0x7fd52415a5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd52406e400 tx=0x7fd51c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd51b7fe640 1 -- 172.21.15.70:0/3169915324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c004240 con 0x7fd52415a150 2023-11-26T07:18:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd51b7fe640 1 -- 172.21.15.70:0/3169915324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0043a0 con 0x7fd52415a150 2023-11-26T07:18:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5241f9830 con 0x7fd52415a150 2023-11-26T07:18:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd51b7fe640 1 -- 172.21.15.70:0/3169915324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00f8d0 con 0x7fd52415a150 2023-11-26T07:18:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52413d8e0 con 0x7fd52415a150 2023-11-26T07:18:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd524067680 con 0x7fd52415a150 2023-11-26T07:18:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd51b7fe640 1 -- 172.21.15.70:0/3169915324 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd51c00fa30 con 0x7fd52415a150 2023-11-26T07:18:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.678+0000 7fd51b7fe640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd504066470 0x7fd504068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.682+0000 7fd51b7fe640 1 -- 172.21.15.70:0/3169915324 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd51c084060 con 0x7fd52415a150 2023-11-26T07:18:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.682+0000 7fd52259c640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd504066470 0x7fd504068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.682+0000 7fd52259c640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd504066470 0x7fd504068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5140ad000 tx=0x7fd5140a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:44.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.682+0000 7fd51b7fe640 1 -- 172.21.15.70:0/3169915324 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd51c0514f0 con 0x7fd52415a150 2023-11-26T07:18:44.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.834+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd52406df50 con 0x7fd52415a150 2023-11-26T07:18:44.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.834+0000 7fd51b7fe640 1 -- 172.21.15.70:0/3169915324 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd51c054b10 con 0x7fd52415a150 2023-11-26T07:18:44.839 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:44.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd504066470 msgr2=0x7fd504068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd504066470 0x7fd504068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5140ad000 tx=0x7fd5140a7070 comp rx=0 tx=0).stop 2023-11-26T07:18:44.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52415a150 msgr2=0x7fd52415a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:44.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52415a150 0x7fd52415a5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd52406e400 tx=0x7fd51c011cf0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 shutdown_connections 2023-11-26T07:18:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd504066470 0x7fd504068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd52415a150 0x7fd52415a5d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd52413bb70 0x7fd5241f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 --2- 172.21.15.70:0/3169915324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd510003b10 0x7fd52413d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 >> 172.21.15.70:0/3169915324 conn(0x7fd52406a890 msgr2=0x7fd5241391a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 shutdown_connections 2023-11-26T07:18:44.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:44.838+0000 7fd528879640 1 -- 172.21.15.70:0/3169915324 wait complete. 2023-11-26T07:18:44.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.001+0000 7fdb50454640 1 Processor -- start 2023-11-26T07:18:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.001+0000 7fdb50454640 1 -- start start 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.001+0000 7fdb50454640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdb481614b0 0x7fdb480cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.001+0000 7fdb50454640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdb48071970 0x7fdb48161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.001+0000 7fdb50454640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4815d970 con 0x7fdb48070ba0 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.001+0000 7fdb50454640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb48161dd0 con 0x7fdb48071970 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.001+0000 7fdb50454640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4815dc30 con 0x7fdb481614b0 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d9ef640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdb48071970 0x7fdb48161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4e9f1640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fdb48070ba0 0x7fdb4806dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48084/0 (socket says 172.21.15.70:48084) 2023-11-26T07:18:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4e9f1640 1 -- 172.21.15.70:0/91563585 learned_addr learned my addr 172.21.15.70:0/91563585 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:45.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4e1f0640 1 --2- 172.21.15.70:0/91563585 >> v2:172.21.15.120:3300/0 conn(0x7fdb481614b0 0x7fdb480cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d9ef640 1 -- 172.21.15.70:0/91563585 >> v2:172.21.15.120:3300/0 conn(0x7fdb481614b0 msgr2=0x7fdb480cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:45.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d9ef640 1 --2- 172.21.15.70:0/91563585 >> v2:172.21.15.120:3300/0 conn(0x7fdb481614b0 0x7fdb480cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d9ef640 1 -- 172.21.15.70:0/91563585 >> v1:172.21.15.70:6789/0 conn(0x7fdb48070ba0 legacy=0x7fdb4806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d9ef640 1 -- 172.21.15.70:0/91563585 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4815df10 con 0x7fdb48071970 2023-11-26T07:18:45.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d1ee640 1 -- 172.21.15.70:0/91563585 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111056832 0 0) 0x7fdb4815d970 con 0x7fdb48070ba0 2023-11-26T07:18:45.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4e1f0640 1 --2- 172.21.15.70:0/91563585 >> v2:172.21.15.120:3300/0 conn(0x7fdb481614b0 0x7fdb480cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:45.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d9ef640 1 --2- 172.21.15.70:0/91563585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb48071970 0x7fdb48161890 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdb48067300 tx=0x7fdb3801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231cc97b616cd5de server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d1ee640 1 -- 172.21.15.70:0/91563585 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb380ab600 con 0x7fdb48071970 2023-11-26T07:18:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d1ee640 1 -- 172.21.15.70:0/91563585 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb380ab760 con 0x7fdb48071970 2023-11-26T07:18:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.005+0000 7fdb4d1ee640 1 -- 172.21.15.70:0/91563585 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb380abaf0 con 0x7fdb48071970 2023-11-26T07:18:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- 172.21.15.70:0/91563585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb48071970 msgr2=0x7fdb48161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 --2- 172.21.15.70:0/91563585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb48071970 0x7fdb48161890 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdb48067300 tx=0x7fdb3801c430 comp rx=0 tx=0).stop 2023-11-26T07:18:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- 172.21.15.70:0/91563585 shutdown_connections 2023-11-26T07:18:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 --2- 172.21.15.70:0/91563585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb48071970 0x7fdb48161890 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 --2- 172.21.15.70:0/91563585 >> v2:172.21.15.120:3300/0 conn(0x7fdb481614b0 0x7fdb480cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- 172.21.15.70:0/91563585 >> 172.21.15.70:0/91563585 conn(0x7fdb480cf710 msgr2=0x7fdb480cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- 172.21.15.70:0/91563585 shutdown_connections 2023-11-26T07:18:45.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- 172.21.15.70:0/91563585 wait complete. 2023-11-26T07:18:45.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 Processor -- start 2023-11-26T07:18:45.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- start start 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb48070ba0 0x7fdb481525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb48071970 0x7fdb4815fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb481614b0 0x7fdb48141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48141580 con 0x7fdb481614b0 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb48153140 con 0x7fdb48070ba0 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb50454640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb481502f0 con 0x7fdb48071970 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb4e9f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb481614b0 0x7fdb48141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb4e9f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb481614b0 0x7fdb48141040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42322/0 (socket says 172.21.15.70:42322) 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.009+0000 7fdb4e9f1640 1 -- 172.21.15.70:0/3364640454 learned_addr learned my addr 172.21.15.70:0/3364640454 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e1f0640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb48070ba0 0x7fdb481525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4d9ef640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb48071970 0x7fdb4815fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e9f1640 1 -- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb48071970 msgr2=0x7fdb4815fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e9f1640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb48071970 0x7fdb4815fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e9f1640 1 -- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb48070ba0 msgr2=0x7fdb481525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e9f1640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb48070ba0 0x7fdb481525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e9f1640 1 -- 172.21.15.70:0/3364640454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38009420 con 0x7fdb481614b0 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4d9ef640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb48071970 0x7fdb4815fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e1f0640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb48070ba0 0x7fdb481525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:45.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb4e9f1640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb481614b0 0x7fdb48141040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c7e0 tx=0x7fdb4000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb3effd640 1 -- 172.21.15.70:0/3364640454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000a5e0 con 0x7fdb481614b0 2023-11-26T07:18:45.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb3effd640 1 -- 172.21.15.70:0/3364640454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4000a760 con 0x7fdb481614b0 2023-11-26T07:18:45.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb48071540 con 0x7fdb481614b0 2023-11-26T07:18:45.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb3effd640 1 -- 172.21.15.70:0/3364640454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000ab10 con 0x7fdb481614b0 2023-11-26T07:18:45.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb48155320 con 0x7fdb481614b0 2023-11-26T07:18:45.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48067680 con 0x7fdb481614b0 2023-11-26T07:18:45.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.013+0000 7fdb3effd640 1 -- 172.21.15.70:0/3364640454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb4000ac70 con 0x7fdb481614b0 2023-11-26T07:18:45.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.017+0000 7fdb3effd640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdb2c066470 0x7fdb2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.017+0000 7fdb3effd640 1 -- 172.21.15.70:0/3364640454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdb40083640 con 0x7fdb481614b0 2023-11-26T07:18:45.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.017+0000 7fdb4e1f0640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdb2c066470 0x7fdb2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.017+0000 7fdb4e1f0640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdb2c066470 0x7fdb2c068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009970 tx=0x7fdb44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.021+0000 7fdb3effd640 1 -- 172.21.15.70:0/3364640454 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb40050a40 con 0x7fdb481614b0 2023-11-26T07:18:45.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb4806bbf0 con 0x7fdb481614b0 2023-11-26T07:18:45.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb3effd640 1 -- 172.21.15.70:0/3364640454 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb40054060 con 0x7fdb481614b0 2023-11-26T07:18:45.173 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdb2c066470 msgr2=0x7fdb2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdb2c066470 0x7fdb2c068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009970 tx=0x7fdb44008040 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb481614b0 msgr2=0x7fdb48141040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb481614b0 0x7fdb48141040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c7e0 tx=0x7fdb4000cca0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 shutdown_connections 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdb2c066470 0x7fdb2c068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb481614b0 0x7fdb48141040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb48071970 0x7fdb4815fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 --2- 172.21.15.70:0/3364640454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb48070ba0 0x7fdb481525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 >> 172.21.15.70:0/3364640454 conn(0x7fdb480cf710 msgr2=0x7fdb481511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 shutdown_connections 2023-11-26T07:18:45.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.169+0000 7fdb50454640 1 -- 172.21.15.70:0/3364640454 wait complete. 2023-11-26T07:18:45.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:45.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.329+0000 7f32d21df640 1 Processor -- start 2023-11-26T07:18:45.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.329+0000 7f32d21df640 1 -- start start 2023-11-26T07:18:45.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32d21df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f32cc143ac0 0x7f32cc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32d21df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32cc0cc730 con 0x7f32cc0708b0 2023-11-26T07:18:45.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32d21df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32cc070ee0 con 0x7f32cc0cf990 2023-11-26T07:18:45.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32d21df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc143ea0 con 0x7f32cc143ac0 2023-11-26T07:18:45.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32caffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f32cc0708b0 0x7f32cc0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48088/0 (socket says 172.21.15.70:48088) 2023-11-26T07:18:45.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32caffd640 1 -- 172.21.15.70:0/2839329078 learned_addr learned my addr 172.21.15.70:0/2839329078 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:45.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32cb7fe640 1 --2- 172.21.15.70:0/2839329078 >> v2:172.21.15.120:3300/0 conn(0x7f32cc143ac0 0x7f32cc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122744280 0 0) 0x7f32cc0cc730 con 0x7f32cc0708b0 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b4003530 con 0x7f32cc0708b0 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222814362 0 0) 0x7f32cc070ee0 con 0x7f32cc0cf990 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32cc0cc730 con 0x7f32cc0cf990 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32cb7fe640 1 -- 172.21.15.70:0/2839329078 >> v1:172.21.15.120:6789/0 conn(0x7f32cc0cf990 legacy=0x7f32cc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2214008761 0 0) 0x7f32b4003530 con 0x7f32cc0708b0 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32cb7fe640 1 -- 172.21.15.70:0/2839329078 >> v1:172.21.15.70:6789/0 conn(0x7f32cc0708b0 legacy=0x7f32cc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.333+0000 7f32cb7fe640 1 -- 172.21.15.70:0/2839329078 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0711c0 con 0x7f32cc143ac0 2023-11-26T07:18:45.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32cb7fe640 1 --2- 172.21.15.70:0/2839329078 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 0x7f32cc070370 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0097c0 tx=0x7f32bc01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd0ea43fc44b5bae server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0001680 con 0x7f32cc143ac0 2023-11-26T07:18:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc0a7050 con 0x7f32cc143ac0 2023-11-26T07:18:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32ca7fc640 1 -- 172.21.15.70:0/2839329078 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0ab600 con 0x7f32cc143ac0 2023-11-26T07:18:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 -- 172.21.15.70:0/2839329078 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 msgr2=0x7f32cc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 --2- 172.21.15.70:0/2839329078 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 0x7f32cc070370 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0097c0 tx=0x7f32bc01c3a0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 -- 172.21.15.70:0/2839329078 shutdown_connections 2023-11-26T07:18:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 --2- 172.21.15.70:0/2839329078 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 0x7f32cc070370 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 -- 172.21.15.70:0/2839329078 >> 172.21.15.70:0/2839329078 conn(0x7f32cc06a890 msgr2=0x7f32cc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 -- 172.21.15.70:0/2839329078 shutdown_connections 2023-11-26T07:18:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 -- 172.21.15.70:0/2839329078 wait complete. 2023-11-26T07:18:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.337+0000 7f32d21df640 1 Processor -- start 2023-11-26T07:18:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 -- start start 2023-11-26T07:18:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f32cc0708b0 0x7f32cc1388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32cc0cf990 0x7f32cc13e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 0x7f32cc0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc138de0 con 0x7f32cc0cf990 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc13faf0 con 0x7f32cc143ac0 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc13ece0 con 0x7f32cc0708b0 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32cc0cf990 0x7f32cc13e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32cc0cf990 0x7f32cc13e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42330/0 (socket says 172.21.15.70:42330) 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 -- 172.21.15.70:0/3218805363 learned_addr learned my addr 172.21.15.70:0/3218805363 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32cb7fe640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f32cc0708b0 0x7f32cc1388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32cbfff640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 0x7f32cc0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 -- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f32cc0708b0 msgr2=0x7f32cc1388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f32cc0708b0 0x7f32cc1388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 -- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 msgr2=0x7f32cc0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 0x7f32cc0b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 -- 172.21.15.70:0/3218805363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc009420 con 0x7f32cc0cf990 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32caffd640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32cc0cf990 0x7f32cc13e7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c520 tx=0x7f32c000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32b3fff640 1 -- 172.21.15.70:0/3218805363 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0005cf0 con 0x7f32cc0cf990 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32b3fff640 1 -- 172.21.15.70:0/3218805363 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c0005e50 con 0x7f32cc0cf990 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32b3fff640 1 -- 172.21.15.70:0/3218805363 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0007270 con 0x7f32cc0cf990 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32cc13f660 con 0x7f32cc0cf990 2023-11-26T07:18:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc13cf60 con 0x7f32cc0cf990 2023-11-26T07:18:45.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.341+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc142150 con 0x7f32cc0cf990 2023-11-26T07:18:45.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.345+0000 7f32b3fff640 1 -- 172.21.15.70:0/3218805363 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f32c00073d0 con 0x7f32cc0cf990 2023-11-26T07:18:45.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.345+0000 7f32b3fff640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f32b8066470 0x7f32b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.345+0000 7f32b3fff640 1 -- 172.21.15.70:0/3218805363 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f32c00834f0 con 0x7f32cc0cf990 2023-11-26T07:18:45.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.345+0000 7f32cb7fe640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f32b8066470 0x7f32b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.345+0000 7f32cb7fe640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f32b8066470 0x7f32b8068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0ad000 tx=0x7f32bc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.349+0000 7f32b3fff640 1 -- 172.21.15.70:0/3218805363 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32c0050900 con 0x7f32cc0cf990 2023-11-26T07:18:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32cc0b3ee0 con 0x7f32cc0cf990 2023-11-26T07:18:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32b3fff640 1 -- 172.21.15.70:0/3218805363 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32c0053f20 con 0x7f32cc0cf990 2023-11-26T07:18:45.504 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f32b8066470 msgr2=0x7f32b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f32b8066470 0x7f32b8068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0ad000 tx=0x7f32bc0a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32cc0cf990 msgr2=0x7f32cc13e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32cc0cf990 0x7f32cc13e7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c520 tx=0x7f32c000c9e0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 shutdown_connections 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f32b8066470 0x7f32b8068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32cc0cf990 0x7f32cc13e7a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32cc143ac0 0x7f32cc0b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 --2- 172.21.15.70:0/3218805363 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f32cc0708b0 0x7f32cc1388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 >> 172.21.15.70:0/3218805363 conn(0x7f32cc06a890 msgr2=0x7f32cc167be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 shutdown_connections 2023-11-26T07:18:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.501+0000 7f32d21df640 1 -- 172.21.15.70:0/3218805363 wait complete. 2023-11-26T07:18:45.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f32e4640 1 Processor -- start 2023-11-26T07:18:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f32e4640 1 -- start start 2023-11-26T07:18:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f32e4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f94ec06cd50 0x7f94ec0b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f32e4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec15b2f0 con 0x7f94ec070d10 2023-11-26T07:18:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f32e4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec06c5c0 con 0x7f94ec0cf280 2023-11-26T07:18:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f32e4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec15e1a0 con 0x7f94ec06cd50 2023-11-26T07:18:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f087f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f94ec070d10 0x7f94ec15d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48098/0 (socket says 172.21.15.70:48098) 2023-11-26T07:18:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f087f640 1 -- 172.21.15.70:0/259825672 learned_addr learned my addr 172.21.15.70:0/259825672 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1881640 1 --2- 172.21.15.70:0/259825672 >> v2:172.21.15.120:3300/0 conn(0x7f94ec06cd50 0x7f94ec0b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006766479 0 0) 0x7f94dc001120 con 0x7f94ec070d10 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d8003530 con 0x7f94ec070d10 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426202837 0 0) 0x7f94d8003530 con 0x7f94ec070d10 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 >> v2:172.21.15.120:3300/0 conn(0x7f94ec06cd50 msgr2=0x7f94ec0b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 --2- 172.21.15.70:0/259825672 >> v2:172.21.15.120:3300/0 conn(0x7f94ec06cd50 0x7f94ec0b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 >> v1:172.21.15.120:6789/0 conn(0x7f94ec0cf280 legacy=0x7f94ec0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec15e480 con 0x7f94ec070d10 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f94dc001810 con 0x7f94ec070d10 2023-11-26T07:18:45.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 >> v1:172.21.15.70:6789/0 conn(0x7f94ec070d10 legacy=0x7f94ec15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94d80039d0 0x7f94d8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94d80047d0 0x7f94d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec15e1a0 con 0x7f94d8005190 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d800c070 con 0x7f94d80047d0 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d800c230 con 0x7f94d80039d0 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1881640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f087f640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94d80047d0 0x7f94d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1080640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94d80039d0 0x7f94d8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1881640 1 -- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94d80039d0 msgr2=0x7f94d8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1881640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94d80039d0 0x7f94d8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1881640 1 -- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94d80047d0 msgr2=0x7f94d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:45.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1881640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94d80047d0 0x7f94d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.661+0000 7f94f1881640 1 -- 172.21.15.70:0/259825672 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8003530 con 0x7f94d8005190 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f1881640 1 -- 172.21.15.70:0/259825672 reap_dead start 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f1881640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94d800b990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009fc0 tx=0x7f94e401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c238bd33ad3b6319 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e40a5cb0 con 0x7f94d8005190 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e400f040 con 0x7f94d8005190 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94e3fff640 1 -- 172.21.15.70:0/259825672 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4003be0 con 0x7f94d8005190 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f32e4640 1 -- 172.21.15.70:0/259825672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 msgr2=0x7f94d800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f32e4640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94d800b990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009fc0 tx=0x7f94e401cca0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f32e4640 1 -- 172.21.15.70:0/259825672 shutdown_connections 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f32e4640 1 --2- 172.21.15.70:0/259825672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94d800b990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f32e4640 1 -- 172.21.15.70:0/259825672 >> 172.21.15.70:0/259825672 conn(0x7f94ec06a890 msgr2=0x7f94ec06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f32e4640 1 -- 172.21.15.70:0/259825672 shutdown_connections 2023-11-26T07:18:45.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.665+0000 7f94f32e4640 1 -- 172.21.15.70:0/259825672 wait complete. 2023-11-26T07:18:45.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 Processor -- start 2023-11-26T07:18:45.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 -- start start 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94ec153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94ec0b0e50 0x7f94ec0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94ec1545c0 0x7f94ec154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0b1810 con 0x7f94d8005190 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec1563d0 con 0x7f94ec0b0e50 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec155f40 con 0x7f94ec1545c0 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94ec153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94ec153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42348/0 (socket says 172.21.15.70:42348) 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 -- 172.21.15.70:0/1826425617 learned_addr learned my addr 172.21.15.70:0/1826425617 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f087f640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94ec0b0e50 0x7f94ec0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1881640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94ec1545c0 0x7f94ec154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 -- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94ec1545c0 msgr2=0x7f94ec154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94ec1545c0 0x7f94ec154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 -- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94ec0b0e50 msgr2=0x7f94ec0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94ec0b0e50 0x7f94ec0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 -- 172.21.15.70:0/1826425617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec155330 con 0x7f94d8005190 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f1080640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94ec153a10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f94e800f5a0 tx=0x7f94e800fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94e1ffb640 1 -- 172.21.15.70:0/1826425617 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8005320 con 0x7f94d8005190 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94e1ffb640 1 -- 172.21.15.70:0/1826425617 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8005480 con 0x7f94d8005190 2023-11-26T07:18:45.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94e1ffb640 1 -- 172.21.15.70:0/1826425617 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8007250 con 0x7f94d8005190 2023-11-26T07:18:45.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec155610 con 0x7f94d8005190 2023-11-26T07:18:45.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.669+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec155bd0 con 0x7f94d8005190 2023-11-26T07:18:45.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.673+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec067680 con 0x7f94d8005190 2023-11-26T07:18:45.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.673+0000 7f94e1ffb640 1 -- 172.21.15.70:0/1826425617 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94e80073b0 con 0x7f94d8005190 2023-11-26T07:18:45.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.673+0000 7f94e1ffb640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94d0066470 0x7f94d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:45.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.673+0000 7f94e1ffb640 1 -- 172.21.15.70:0/1826425617 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f94e8083400 con 0x7f94d8005190 2023-11-26T07:18:45.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.673+0000 7f94f087f640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94d0066470 0x7f94d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:45.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.673+0000 7f94f087f640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94d0066470 0x7f94d0068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94dc001060 tx=0x7f94dc001ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:45.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.677+0000 7f94e1ffb640 1 -- 172.21.15.70:0/1826425617 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94e80508b0 con 0x7f94d8005190 2023-11-26T07:18:45.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.841+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94ec15e730 con 0x7f94d8005190 2023-11-26T07:18:45.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.841+0000 7f94e1ffb640 1 -- 172.21.15.70:0/1826425617 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f94e8053ed0 con 0x7f94d8005190 2023-11-26T07:18:45.846 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94d0066470 msgr2=0x7f94d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94d0066470 0x7f94d0068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94dc001060 tx=0x7f94dc001ce0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 msgr2=0x7f94ec153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94ec153a10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f94e800f5a0 tx=0x7f94e800fa60 comp rx=0 tx=0).stop 2023-11-26T07:18:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 shutdown_connections 2023-11-26T07:18:45.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94ec1545c0 0x7f94ec154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94ec0b0e50 0x7f94ec0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94d0066470 0x7f94d0068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 --2- 172.21.15.70:0/1826425617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8005190 0x7f94ec153a10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:45.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 >> 172.21.15.70:0/1826425617 conn(0x7f94ec06a890 msgr2=0x7f94ec0cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:45.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 shutdown_connections 2023-11-26T07:18:45.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:45.845+0000 7f94f32e4640 1 -- 172.21.15.70:0/1826425617 wait complete. 2023-11-26T07:18:45.867 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2023-11-26T07:18:45.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:45.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-26T07:18:45.891 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:45.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:18:45.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:45.891 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-26T07:18:45.948 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:18:45.948 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:45.957 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:18:45.958 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:46.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee6a13640 1 Processor -- start 2023-11-26T07:18:46.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee6a13640 1 -- start start 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee6a13640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ee00cf710 0x7f6ee00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee6a13640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee00cc730 con 0x7f6ee0143ac0 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee6a13640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee0070ee0 con 0x7f6ee00cf280 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee6a13640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee0143ea0 con 0x7f6ee00cf710 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6edffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6ee0143ac0 0x7f6ee0070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48108/0 (socket says 172.21.15.70:48108) 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6edffff640 1 -- 172.21.15.70:0/1267977371 learned_addr learned my addr 172.21.15.70:0/1267977371 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee4fb0640 1 --2- 172.21.15.70:0/1267977371 >> v2:172.21.15.120:3300/0 conn(0x7f6ee00cf710 0x7f6ee00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6edeffd640 1 -- 172.21.15.70:0/1267977371 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165210463 0 0) 0x7f6ee00cc730 con 0x7f6ee0143ac0 2023-11-26T07:18:46.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6edeffd640 1 -- 172.21.15.70:0/1267977371 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec8005740 con 0x7f6ee0143ac0 2023-11-26T07:18:46.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee4fb0640 1 -- 172.21.15.70:0/1267977371 >> v1:172.21.15.120:6789/0 conn(0x7f6ee00cf280 legacy=0x7f6ee00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6edeffd640 1 -- 172.21.15.70:0/1267977371 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 209906324 0 0) 0x7f6ec8005740 con 0x7f6ee0143ac0 2023-11-26T07:18:46.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee4fb0640 1 -- 172.21.15.70:0/1267977371 >> v1:172.21.15.70:6789/0 conn(0x7f6ee0143ac0 legacy=0x7f6ee0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.141+0000 7f6ee4fb0640 1 -- 172.21.15.70:0/1267977371 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00711c0 con 0x7f6ee00cf710 2023-11-26T07:18:46.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee4fb0640 1 --2- 172.21.15.70:0/1267977371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf710 0x7f6ee00cd8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009d90 tx=0x7f6ed801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca9c9aeab48e279a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6edeffd640 1 -- 172.21.15.70:0/1267977371 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0001680 con 0x7f6ee00cf710 2023-11-26T07:18:46.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6edeffd640 1 -- 172.21.15.70:0/1267977371 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed80a56b0 con 0x7f6ee00cf710 2023-11-26T07:18:46.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6edeffd640 1 -- 172.21.15.70:0/1267977371 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80a5a20 con 0x7f6ee00cf710 2023-11-26T07:18:46.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee6a13640 1 -- 172.21.15.70:0/1267977371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf710 msgr2=0x7f6ee00cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/1267977371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf710 0x7f6ee00cd8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009d90 tx=0x7f6ed801c870 comp rx=0 tx=0).stop 2023-11-26T07:18:46.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee6a13640 1 -- 172.21.15.70:0/1267977371 shutdown_connections 2023-11-26T07:18:46.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/1267977371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf710 0x7f6ee00cd8c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee6a13640 1 -- 172.21.15.70:0/1267977371 >> 172.21.15.70:0/1267977371 conn(0x7f6ee006a890 msgr2=0x7f6ee006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee6a13640 1 -- 172.21.15.70:0/1267977371 shutdown_connections 2023-11-26T07:18:46.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.145+0000 7f6ee6a13640 1 -- 172.21.15.70:0/1267977371 wait complete. 2023-11-26T07:18:46.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 Processor -- start 2023-11-26T07:18:46.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 -- start start 2023-11-26T07:18:46.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf280 0x7f6ee00aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee00cf710 0x7f6ee0159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6ee0143ac0 0x7f6ee0132eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00af360 con 0x7f6ee00cf710 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee015a040 con 0x7f6ee00cf280 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00af570 con 0x7f6ee0143ac0 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee00cf710 0x7f6ee0159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee00cf710 0x7f6ee0159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42354/0 (socket says 172.21.15.70:42354) 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 -- 172.21.15.70:0/2421496112 learned_addr learned my addr 172.21.15.70:0/2421496112 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 -- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6ee0143ac0 msgr2=0x7f6ee0132eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6ee0143ac0 0x7f6ee0132eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 -- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf280 msgr2=0x7f6ee00aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edffff640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf280 0x7f6ee00aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf280 0x7f6ee00aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 -- 172.21.15.70:0/2421496112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8009a70 con 0x7f6ee00cf710 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edffff640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf280 0x7f6ee00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edf7fe640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee00cf710 0x7f6ee0159b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c3c0 tx=0x7f6ed400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edcff9640 1 -- 172.21.15.70:0/2421496112 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40052d0 con 0x7f6ee00cf710 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edcff9640 1 -- 172.21.15.70:0/2421496112 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4005430 con 0x7f6ee00cf710 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6edcff9640 1 -- 172.21.15.70:0/2421496112 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4003840 con 0x7f6ee00cf710 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee00af850 con 0x7f6ee00cf710 2023-11-26T07:18:46.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.149+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee00afe10 con 0x7f6ee00cf710 2023-11-26T07:18:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.153+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee0067680 con 0x7f6ee00cf710 2023-11-26T07:18:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.153+0000 7f6edcff9640 1 -- 172.21.15.70:0/2421496112 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ed40039a0 con 0x7f6ee00cf710 2023-11-26T07:18:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.153+0000 7f6edcff9640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6ecc066470 0x7f6ecc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.153+0000 7f6edcff9640 1 -- 172.21.15.70:0/2421496112 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6ed4083560 con 0x7f6ee00cf710 2023-11-26T07:18:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.153+0000 7f6edffff640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6ecc066470 0x7f6ecc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.153+0000 7f6edffff640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6ecc066470 0x7f6ecc068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00011f0 tx=0x7f6ed0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.157+0000 7f6edcff9640 1 -- 172.21.15.70:0/2421496112 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ed40508c0 con 0x7f6ee00cf710 2023-11-26T07:18:46.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.309+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ee0073ce0 con 0x7f6ee00cf710 2023-11-26T07:18:46.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.309+0000 7f6edcff9640 1 -- 172.21.15.70:0/2421496112 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16755 (secure 0 0 0) 0x7f6ee0073ce0 con 0x7f6ee00cf710 2023-11-26T07:18:46.313 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:46.314 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:45.864270+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:46.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.309+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6ecc066470 msgr2=0x7f6ecc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.309+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6ecc066470 0x7f6ecc068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00011f0 tx=0x7f6ed0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.309+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee00cf710 msgr2=0x7f6ee0159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.309+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee00cf710 0x7f6ee0159b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c3c0 tx=0x7f6ed400c880 comp rx=0 tx=0).stop 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 shutdown_connections 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6ecc066470 0x7f6ecc068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ee00cf710 0x7f6ee0159b00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6ee0143ac0 0x7f6ee0132eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 --2- 172.21.15.70:0/2421496112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ee00cf280 0x7f6ee00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 >> 172.21.15.70:0/2421496112 conn(0x7f6ee006a890 msgr2=0x7f6ee0139b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 shutdown_connections 2023-11-26T07:18:46.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.313+0000 7f6ee6a13640 1 -- 172.21.15.70:0/2421496112 wait complete. 2023-11-26T07:18:46.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:46.335 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:46.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29499df640 1 Processor -- start 2023-11-26T07:18:46.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29499df640 1 -- start start 2023-11-26T07:18:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29499df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f29440cf280 0x7f29440cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29499df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29440cd1b0 0x7f29440cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29499df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29440cc730 con 0x7f2944143ac0 2023-11-26T07:18:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29499df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2944143ea0 con 0x7f29440cd1b0 2023-11-26T07:18:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29499df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440cfc50 con 0x7f29440cf280 2023-11-26T07:18:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29437fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29440cd1b0 0x7f29440cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29437fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29440cd1b0 0x7f29440cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42368/0 (socket says 172.21.15.70:42368) 2023-11-26T07:18:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29437fe640 1 -- 172.21.15.70:0/3199225005 learned_addr learned my addr 172.21.15.70:0/3199225005 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f293a7fc640 1 --2- 172.21.15.70:0/3199225005 >> v2:172.21.15.120:3300/0 conn(0x7f29440cf280 0x7f29440cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29437fe640 1 -- 172.21.15.70:0/3199225005 >> v2:172.21.15.120:3300/0 conn(0x7f29440cf280 msgr2=0x7f29440cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29437fe640 1 --2- 172.21.15.70:0/3199225005 >> v2:172.21.15.120:3300/0 conn(0x7f29440cf280 0x7f29440cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29437fe640 1 -- 172.21.15.70:0/3199225005 >> v1:172.21.15.120:6789/0 conn(0x7f2944143ac0 legacy=0x7f2944070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.473+0000 7f29437fe640 1 -- 172.21.15.70:0/3199225005 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944070ee0 con 0x7f29440cd1b0 2023-11-26T07:18:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29437fe640 1 --2- 172.21.15.70:0/3199225005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f29440cd5c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f29440aeb10 tx=0x7f293c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c288f1b6517f0e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29427fc640 1 -- 172.21.15.70:0/3199225005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0aa660 con 0x7f29440cd1b0 2023-11-26T07:18:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29427fc640 1 -- 172.21.15.70:0/3199225005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0aa7c0 con 0x7f29440cd1b0 2023-11-26T07:18:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29427fc640 1 -- 172.21.15.70:0/3199225005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0aab50 con 0x7f29440cd1b0 2023-11-26T07:18:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 -- 172.21.15.70:0/3199225005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 msgr2=0x7f29440cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 --2- 172.21.15.70:0/3199225005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f29440cd5c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f29440aeb10 tx=0x7f293c01c500 comp rx=0 tx=0).stop 2023-11-26T07:18:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 -- 172.21.15.70:0/3199225005 shutdown_connections 2023-11-26T07:18:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 --2- 172.21.15.70:0/3199225005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f29440cd5c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 --2- 172.21.15.70:0/3199225005 >> v2:172.21.15.120:3300/0 conn(0x7f29440cf280 0x7f29440cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 -- 172.21.15.70:0/3199225005 >> 172.21.15.70:0/3199225005 conn(0x7f294406a890 msgr2=0x7f294406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 -- 172.21.15.70:0/3199225005 shutdown_connections 2023-11-26T07:18:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.477+0000 7f29499df640 1 -- 172.21.15.70:0/3199225005 wait complete. 2023-11-26T07:18:46.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 Processor -- start 2023-11-26T07:18:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 -- start start 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f2944159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f29440cf280 0x7f29440cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2944143ac0 0x7f2944139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440b0c70 con 0x7f29440cd1b0 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440b0f50 con 0x7f2944143ac0 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294415ca20 con 0x7f29440cf280 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f2944159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f2944159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42370/0 (socket says 172.21.15.70:42370) 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 -- 172.21.15.70:0/2884826361 learned_addr learned my addr 172.21.15.70:0/2884826361 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29437fe640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2944143ac0 0x7f2944139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f293a7fc640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f29440cf280 0x7f29440cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 -- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f29440cf280 msgr2=0x7f29440cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f29440cf280 0x7f29440cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 -- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2944143ac0 msgr2=0x7f2944139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2944143ac0 0x7f2944139980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 -- 172.21.15.70:0/2884826361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0094d0 con 0x7f29440cd1b0 2023-11-26T07:18:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2942ffd640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f2944159c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f293400c500 tx=0x7f293400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2940ff9640 1 -- 172.21.15.70:0/2884826361 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934005220 con 0x7f29440cd1b0 2023-11-26T07:18:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2940ff9640 1 -- 172.21.15.70:0/2884826361 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934005380 con 0x7f29440cd1b0 2023-11-26T07:18:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f2940ff9640 1 -- 172.21.15.70:0/2884826361 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934007270 con 0x7f29440cd1b0 2023-11-26T07:18:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294415cd00 con 0x7f29440cd1b0 2023-11-26T07:18:46.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.481+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29440af370 con 0x7f29440cd1b0 2023-11-26T07:18:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.485+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29440af5c0 con 0x7f29440cd1b0 2023-11-26T07:18:46.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.485+0000 7f2940ff9640 1 -- 172.21.15.70:0/2884826361 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29340073d0 con 0x7f29440cd1b0 2023-11-26T07:18:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.485+0000 7f2940ff9640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2924066470 0x7f2924068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.485+0000 7f2940ff9640 1 -- 172.21.15.70:0/2884826361 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2934083760 con 0x7f29440cd1b0 2023-11-26T07:18:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.485+0000 7f293a7fc640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2924066470 0x7f2924068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.485+0000 7f293a7fc640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2924066470 0x7f2924068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2944140ba0 tx=0x7f292c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.489+0000 7f2940ff9640 1 -- 172.21.15.70:0/2884826361 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2934050b70 con 0x7f29440cd1b0 2023-11-26T07:18:46.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.637+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2944067680 con 0x7f29440cd1b0 2023-11-26T07:18:46.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.637+0000 7f2940ff9640 1 -- 172.21.15.70:0/2884826361 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2934054190 con 0x7f29440cd1b0 2023-11-26T07:18:46.643 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2924066470 msgr2=0x7f2924068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2924066470 0x7f2924068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2944140ba0 tx=0x7f292c00b040 comp rx=0 tx=0).stop 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 msgr2=0x7f2944159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f2944159c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f293400c500 tx=0x7f293400c9c0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 shutdown_connections 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2944143ac0 0x7f2944139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f29440cf280 0x7f29440cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2924066470 0x7f2924068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 --2- 172.21.15.70:0/2884826361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29440cd1b0 0x7f2944159c40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 >> 172.21.15.70:0/2884826361 conn(0x7f294406a890 msgr2=0x7f29441414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 shutdown_connections 2023-11-26T07:18:46.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.641+0000 7f29499df640 1 -- 172.21.15.70:0/2884826361 wait complete. 2023-11-26T07:18:46.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.797+0000 7f3b539d1640 1 Processor -- start 2023-11-26T07:18:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.797+0000 7f3b539d1640 1 -- start start 2023-11-26T07:18:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b539d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 0x7f3b4c0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b539d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3b4c070e00 0x7f3b4c162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b539d1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c162080 con 0x7f3b4c14b1e0 2023-11-26T07:18:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b539d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c161d70 con 0x7f3b4c070e00 2023-11-26T07:18:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b539d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c14b5c0 con 0x7f3b4c0cf990 2023-11-26T07:18:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b51f6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3b4c070e00 0x7f3b4c162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b51f6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3b4c070e00 0x7f3b4c162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42376/0 (socket says 172.21.15.70:42376) 2023-11-26T07:18:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b51f6e640 1 -- 172.21.15.70:0/3160877099 learned_addr learned my addr 172.21.15.70:0/3160877099 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b51f6e640 1 -- 172.21.15.70:0/3160877099 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 msgr2=0x7f3b4c0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b51f6e640 1 --2- 172.21.15.70:0/3160877099 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 0x7f3b4c0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b51f6e640 1 -- 172.21.15.70:0/3160877099 >> v1:172.21.15.120:6789/0 conn(0x7f3b4c14b1e0 legacy=0x7f3b4c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.801+0000 7f3b51f6e640 1 -- 172.21.15.70:0/3160877099 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c071580 con 0x7f3b4c070e00 2023-11-26T07:18:46.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b51f6e640 1 --2- 172.21.15.70:0/3160877099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c162510 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009e50 tx=0x7f3b4401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9fb10287c14883 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b43fff640 1 -- 172.21.15.70:0/3160877099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440a5820 con 0x7f3b4c070e00 2023-11-26T07:18:46.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b43fff640 1 -- 172.21.15.70:0/3160877099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b440a5980 con 0x7f3b4c070e00 2023-11-26T07:18:46.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b43fff640 1 -- 172.21.15.70:0/3160877099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440a5d10 con 0x7f3b4c070e00 2023-11-26T07:18:46.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 -- 172.21.15.70:0/3160877099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 msgr2=0x7f3b4c162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3160877099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c162510 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009e50 tx=0x7f3b4401c9a0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 -- 172.21.15.70:0/3160877099 shutdown_connections 2023-11-26T07:18:46.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3160877099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c162510 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3160877099 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 0x7f3b4c0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 -- 172.21.15.70:0/3160877099 >> 172.21.15.70:0/3160877099 conn(0x7f3b4c06a890 msgr2=0x7f3b4c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 -- 172.21.15.70:0/3160877099 shutdown_connections 2023-11-26T07:18:46.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 -- 172.21.15.70:0/3160877099 wait complete. 2023-11-26T07:18:46.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 Processor -- start 2023-11-26T07:18:46.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.805+0000 7f3b539d1640 1 -- start start 2023-11-26T07:18:46.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c1612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 0x7f3b4c0aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4c14b1e0 0x7f3b4c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0ab4c0 con 0x7f3b4c070e00 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0ab7a0 con 0x7f3b4c14b1e0 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0aba80 con 0x7f3b4c0cf990 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c1612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42384/0 (socket says 172.21.15.70:42384) 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 -- 172.21.15.70:0/3311378929 learned_addr learned my addr 172.21.15.70:0/3311378929 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b50f6c640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 0x7f3b4c0aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b51f6e640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4c14b1e0 0x7f3b4c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 -- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 msgr2=0x7f3b4c0aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 0x7f3b4c0aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 -- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4c14b1e0 msgr2=0x7f3b4c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4c14b1e0 0x7f3b4c146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 -- 172.21.15.70:0/3311378929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44009b30 con 0x7f3b4c070e00 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b5176d640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c1612c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800b3e0 tx=0x7f3b4800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b41ffb640 1 -- 172.21.15.70:0/3311378929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48011830 con 0x7f3b4c070e00 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b41ffb640 1 -- 172.21.15.70:0/3311378929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b480119b0 con 0x7f3b4c070e00 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b41ffb640 1 -- 172.21.15.70:0/3311378929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48011d60 con 0x7f3b4c070e00 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c0abd60 con 0x7f3b4c070e00 2023-11-26T07:18:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c1619d0 con 0x7f3b4c070e00 2023-11-26T07:18:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c067680 con 0x7f3b4c070e00 2023-11-26T07:18:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.809+0000 7f3b41ffb640 1 -- 172.21.15.70:0/3311378929 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b4801a400 con 0x7f3b4c070e00 2023-11-26T07:18:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.813+0000 7f3b41ffb640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.813+0000 7f3b41ffb640 1 -- 172.21.15.70:0/3311378929 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3b48083f00 con 0x7f3b4c070e00 2023-11-26T07:18:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.813+0000 7f3b50f6c640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.813+0000 7f3b50f6c640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c163c10 tx=0x7f3b3c009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:46.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.817+0000 7f3b41ffb640 1 -- 172.21.15.70:0/3311378929 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b480513b0 con 0x7f3b4c070e00 2023-11-26T07:18:46.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b4c0cf220 con 0x7f3b4c070e00 2023-11-26T07:18:46.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b41ffb640 1 -- 172.21.15.70:0/3311378929 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b48015020 con 0x7f3b4c070e00 2023-11-26T07:18:46.973 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:46.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 msgr2=0x7f3b30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c163c10 tx=0x7f3b3c009110 comp rx=0 tx=0).stop 2023-11-26T07:18:46.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 msgr2=0x7f3b4c1612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c1612c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800b3e0 tx=0x7f3b4800b8a0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 shutdown_connections 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b4c14b1e0 0x7f3b4c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b4c0cf990 0x7f3b4c0aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b30066470 0x7f3b30068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 --2- 172.21.15.70:0/3311378929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b4c070e00 0x7f3b4c1612c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.969+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 >> 172.21.15.70:0/3311378929 conn(0x7f3b4c06a890 msgr2=0x7f3b4c14a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.973+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 shutdown_connections 2023-11-26T07:18:46.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:46.973+0000 7f3b539d1640 1 -- 172.21.15.70:0/3311378929 wait complete. 2023-11-26T07:18:46.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:47.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.129+0000 7f8cb4c32640 1 Processor -- start 2023-11-26T07:18:47.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.129+0000 7f8cb4c32640 1 -- start start 2023-11-26T07:18:47.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.129+0000 7f8cb4c32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8cb00cf280 0x7f8cb00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.129+0000 7f8cb4c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb00cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.129+0000 7f8cb4c32640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb00cc730 con 0x7f8cb0143ac0 2023-11-26T07:18:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.129+0000 7f8cb4c32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb0143ea0 con 0x7f8cb00cf280 2023-11-26T07:18:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.129+0000 7f8cb4c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00cfc50 con 0x7f8cb00cd1b0 2023-11-26T07:18:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8cae59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8cb0143ac0 0x7f8cb0070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48112/0 (socket says 172.21.15.70:48112) 2023-11-26T07:18:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8cae59c640 1 -- 172.21.15.70:0/3496287211 learned_addr learned my addr 172.21.15.70:0/3496287211 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8ca7fff640 1 --2- 172.21.15.70:0/3496287211 >> v2:172.21.15.70:3300/0 conn(0x7f8cb00cf280 0x7f8cb00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8caed9d640 1 --2- 172.21.15.70:0/3496287211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb00cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8cadd9b640 1 -- 172.21.15.70:0/3496287211 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686897143 0 0) 0x7f8cb00cc730 con 0x7f8cb0143ac0 2023-11-26T07:18:47.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8cadd9b640 1 -- 172.21.15.70:0/3496287211 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c9c005740 con 0x7f8cb0143ac0 2023-11-26T07:18:47.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8ca7fff640 1 -- 172.21.15.70:0/3496287211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 msgr2=0x7f8cb00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:47.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8ca7fff640 1 --2- 172.21.15.70:0/3496287211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb00cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8ca7fff640 1 -- 172.21.15.70:0/3496287211 >> v1:172.21.15.70:6789/0 conn(0x7f8cb0143ac0 legacy=0x7f8cb0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8ca7fff640 1 -- 172.21.15.70:0/3496287211 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0070ee0 con 0x7f8cb00cf280 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8ca7fff640 1 --2- 172.21.15.70:0/3496287211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb00cf280 0x7f8cb00cf710 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c980097c0 tx=0x7f8c9801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc09d05d6093ceb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8cadd9b640 1 -- 172.21.15.70:0/3496287211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c980ab680 con 0x7f8cb00cf280 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8cadd9b640 1 -- 172.21.15.70:0/3496287211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c980ab7e0 con 0x7f8cb00cf280 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.133+0000 7f8cadd9b640 1 -- 172.21.15.70:0/3496287211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c980abb70 con 0x7f8cb00cf280 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- 172.21.15.70:0/3496287211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb00cf280 msgr2=0x7f8cb00cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/3496287211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb00cf280 0x7f8cb00cf710 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8c980097c0 tx=0x7f8c9801c480 comp rx=0 tx=0).stop 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- 172.21.15.70:0/3496287211 shutdown_connections 2023-11-26T07:18:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/3496287211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb00cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/3496287211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb00cf280 0x7f8cb00cf710 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- 172.21.15.70:0/3496287211 >> 172.21.15.70:0/3496287211 conn(0x7f8cb006a890 msgr2=0x7f8cb006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- 172.21.15.70:0/3496287211 shutdown_connections 2023-11-26T07:18:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- 172.21.15.70:0/3496287211 wait complete. 2023-11-26T07:18:47.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 Processor -- start 2023-11-26T07:18:47.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- start start 2023-11-26T07:18:47.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb0139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cb00cf280 0x7f8cb0156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb0143ac0 0x7f8cb0157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb01569d0 con 0x7f8cb0143ac0 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0155d50 con 0x7f8cb00cf280 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cb4c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0156030 con 0x7f8cb00cd1b0 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8caed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb0143ac0 0x7f8cb0157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8caed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb0143ac0 0x7f8cb0157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42390/0 (socket says 172.21.15.70:42390) 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8caed9d640 1 -- 172.21.15.70:0/616785556 learned_addr learned my addr 172.21.15.70:0/616785556 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8ca7fff640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cb00cf280 0x7f8cb0156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.137+0000 7f8cae59c640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb0139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8caed9d640 1 -- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 msgr2=0x7f8cb0139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8caed9d640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb0139080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8caed9d640 1 -- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cb00cf280 msgr2=0x7f8cb0156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8caed9d640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cb00cf280 0x7f8cb0156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8caed9d640 1 -- 172.21.15.70:0/616785556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98009420 con 0x7f8cb0143ac0 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8caed9d640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb0143ac0 0x7f8cb0157380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8007e60 tx=0x7f8ca800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8ca6ffd640 1 -- 172.21.15.70:0/616785556 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8014420 con 0x7f8cb0143ac0 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8ca6ffd640 1 -- 172.21.15.70:0/616785556 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca80145a0 con 0x7f8cb0143ac0 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8ca6ffd640 1 -- 172.21.15.70:0/616785556 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8014950 con 0x7f8cb0143ac0 2023-11-26T07:18:47.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb0156310 con 0x7f8cb0143ac0 2023-11-26T07:18:47.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb0157ac0 con 0x7f8cb0143ac0 2023-11-26T07:18:47.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb0156b10 con 0x7f8cb0143ac0 2023-11-26T07:18:47.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.141+0000 7f8ca6ffd640 1 -- 172.21.15.70:0/616785556 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ca8014ab0 con 0x7f8cb0143ac0 2023-11-26T07:18:47.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.145+0000 7f8ca6ffd640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c900664a0 0x7f8c90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.145+0000 7f8ca6ffd640 1 -- 172.21.15.70:0/616785556 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8ca8084720 con 0x7f8cb0143ac0 2023-11-26T07:18:47.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.145+0000 7f8cae59c640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c900664a0 0x7f8c90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.145+0000 7f8cae59c640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c900664a0 0x7f8c90068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0005890 tx=0x7f8ca0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.149+0000 7f8ca6ffd640 1 -- 172.21.15.70:0/616785556 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ca8051b30 con 0x7f8cb0143ac0 2023-11-26T07:18:47.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cb0067680 con 0x7f8cb0143ac0 2023-11-26T07:18:47.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8ca6ffd640 1 -- 172.21.15.70:0/616785556 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ca8055150 con 0x7f8cb0143ac0 2023-11-26T07:18:47.301 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:47.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c900664a0 msgr2=0x7f8c90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c900664a0 0x7f8c90068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0005890 tx=0x7f8ca0009040 comp rx=0 tx=0).stop 2023-11-26T07:18:47.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb0143ac0 msgr2=0x7f8cb0157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb0143ac0 0x7f8cb0157380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8007e60 tx=0x7f8ca800e4b0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 shutdown_connections 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c900664a0 0x7f8c90068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cb0143ac0 0x7f8cb0157380 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8cb00cf280 0x7f8cb0156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 --2- 172.21.15.70:0/616785556 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8cb00cd1b0 0x7f8cb0139080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 >> 172.21.15.70:0/616785556 conn(0x7f8cb006a890 msgr2=0x7f8cb015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 shutdown_connections 2023-11-26T07:18:47.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.297+0000 7f8cb4c32640 1 -- 172.21.15.70:0/616785556 wait complete. 2023-11-26T07:18:47.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:47.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1217aea640 1 Processor -- start 2023-11-26T07:18:47.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1217aea640 1 -- start start 2023-11-26T07:18:47.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1217aea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f12100cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1217aea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100cfc20 con 0x7f1210070fd0 2023-11-26T07:18:47.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1217aea640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1210162080 con 0x7f12100cf7c0 2023-11-26T07:18:47.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1217aea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1210161d70 con 0x7f121014b1e0 2023-11-26T07:18:47.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1216087640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1210070fd0 0x7f1210162510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48128/0 (socket says 172.21.15.70:48128) 2023-11-26T07:18:47.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1216087640 1 -- 172.21.15.70:0/4198319693 learned_addr learned my addr 172.21.15.70:0/4198319693 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1215886640 1 --2- 172.21.15.70:0/4198319693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f12100cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540245046 0 0) 0x7f12100cfc20 con 0x7f1210070fd0 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc003530 con 0x7f1210070fd0 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43419836 0 0) 0x7f1210162080 con 0x7f12100cf7c0 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12100cfc20 con 0x7f12100cf7c0 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1215886640 1 -- 172.21.15.70:0/4198319693 >> v1:172.21.15.120:6789/0 conn(0x7f12100cf7c0 legacy=0x7f12100708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2527208270 0 0) 0x7f11fc003530 con 0x7f1210070fd0 2023-11-26T07:18:47.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1215886640 1 -- 172.21.15.70:0/4198319693 >> v1:172.21.15.70:6789/0 conn(0x7f1210070fd0 legacy=0x7f1210162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.457+0000 7f1215886640 1 -- 172.21.15.70:0/4198319693 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121014b5c0 con 0x7f121014b1e0 2023-11-26T07:18:47.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1215886640 1 --2- 172.21.15.70:0/4198319693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f12100cf280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f120c0097f0 tx=0x7f120c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a55f2cf1818bb26 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208001a00 con 0x7f121014b1e0 2023-11-26T07:18:47.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c0a7050 con 0x7f121014b1e0 2023-11-26T07:18:47.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1214884640 1 -- 172.21.15.70:0/4198319693 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0ab620 con 0x7f121014b1e0 2023-11-26T07:18:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1217aea640 1 -- 172.21.15.70:0/4198319693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 msgr2=0x7f12100cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1217aea640 1 --2- 172.21.15.70:0/4198319693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f12100cf280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f120c0097f0 tx=0x7f120c01c3b0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1217aea640 1 -- 172.21.15.70:0/4198319693 shutdown_connections 2023-11-26T07:18:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1217aea640 1 --2- 172.21.15.70:0/4198319693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f12100cf280 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1217aea640 1 -- 172.21.15.70:0/4198319693 >> 172.21.15.70:0/4198319693 conn(0x7f121006a890 msgr2=0x7f121006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1217aea640 1 -- 172.21.15.70:0/4198319693 shutdown_connections 2023-11-26T07:18:47.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.461+0000 7f1217aea640 1 -- 172.21.15.70:0/4198319693 wait complete. 2023-11-26T07:18:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 Processor -- start 2023-11-26T07:18:47.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 -- start start 2023-11-26T07:18:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1210070fd0 0x7f12100ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12100cf7c0 0x7f121015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f121015e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121015e940 con 0x7f12100cf7c0 2023-11-26T07:18:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121014a520 con 0x7f1210070fd0 2023-11-26T07:18:47.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121014aa50 con 0x7f121014b1e0 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12100cf7c0 0x7f121015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12100cf7c0 0x7f121015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42398/0 (socket says 172.21.15.70:42398) 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 -- 172.21.15.70:0/1896970526 learned_addr learned my addr 172.21.15.70:0/1896970526 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215886640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1210070fd0 0x7f12100ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1216087640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f121015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 -- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 msgr2=0x7f121015e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f121015e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 -- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1210070fd0 msgr2=0x7f12100ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1210070fd0 0x7f12100ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 -- 172.21.15.70:0/1896970526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c009420 con 0x7f12100cf7c0 2023-11-26T07:18:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1215085640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12100cf7c0 0x7f121015dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f120000c4c0 tx=0x7f120000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f12067fc640 1 -- 172.21.15.70:0/1896970526 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000052d0 con 0x7f12100cf7c0 2023-11-26T07:18:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f12067fc640 1 -- 172.21.15.70:0/1896970526 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200005430 con 0x7f12100cf7c0 2023-11-26T07:18:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f12067fc640 1 -- 172.21.15.70:0/1896970526 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200012870 con 0x7f12100cf7c0 2023-11-26T07:18:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12101491f0 con 0x7f12100cf7c0 2023-11-26T07:18:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.465+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1210148ba0 con 0x7f12100cf7c0 2023-11-26T07:18:47.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.469+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1210149380 con 0x7f12100cf7c0 2023-11-26T07:18:47.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.469+0000 7f12067fc640 1 -- 172.21.15.70:0/1896970526 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12000129d0 con 0x7f12100cf7c0 2023-11-26T07:18:47.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.469+0000 7f12067fc640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11f4066470 0x7f11f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.469+0000 7f12067fc640 1 -- 172.21.15.70:0/1896970526 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1200083940 con 0x7f12100cf7c0 2023-11-26T07:18:47.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.469+0000 7f1215886640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11f4066470 0x7f11f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.469+0000 7f1215886640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11f4066470 0x7f11f4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f120c0ad000 tx=0x7f120c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.473+0000 7f12067fc640 1 -- 172.21.15.70:0/1896970526 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1200050de0 con 0x7f12100cf7c0 2023-11-26T07:18:47.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1210067680 con 0x7f12100cf7c0 2023-11-26T07:18:47.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f12067fc640 1 -- 172.21.15.70:0/1896970526 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1200083030 con 0x7f12100cf7c0 2023-11-26T07:18:47.637 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11f4066470 msgr2=0x7f11f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11f4066470 0x7f11f4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f120c0ad000 tx=0x7f120c0a6000 comp rx=0 tx=0).stop 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12100cf7c0 msgr2=0x7f121015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12100cf7c0 0x7f121015dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f120000c4c0 tx=0x7f120000c980 comp rx=0 tx=0).stop 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 shutdown_connections 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11f4066470 0x7f11f4068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12100cf7c0 0x7f121015dec0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f121014b1e0 0x7f121015e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 --2- 172.21.15.70:0/1896970526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1210070fd0 0x7f12100ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.633+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 >> 172.21.15.70:0/1896970526 conn(0x7f121006a890 msgr2=0x7f1210162510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.637+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 shutdown_connections 2023-11-26T07:18:47.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.637+0000 7f1217aea640 1 -- 172.21.15.70:0/1896970526 wait complete. 2023-11-26T07:18:47.658 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:18:47.658 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:18:47.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:47.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.801+0000 7f0388eea640 1 Processor -- start 2023-11-26T07:18:47.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.801+0000 7f0388eea640 1 -- start start 2023-11-26T07:18:47.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.801+0000 7f0388eea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03840cf990 0x7f038415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.801+0000 7f0388eea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f038415f4e0 0x7f03840cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.801+0000 7f0388eea640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038406c520 con 0x7f038413e290 2023-11-26T07:18:47.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.801+0000 7f0388eea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038406c800 con 0x7f03840cf990 2023-11-26T07:18:47.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.801+0000 7f0388eea640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038406cae0 con 0x7f038415f4e0 2023-11-26T07:18:47.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03840cf990 0x7f038415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03840cf990 0x7f038415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42412/0 (socket says 172.21.15.70:42412) 2023-11-26T07:18:47.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 -- 172.21.15.70:0/3304479385 learned_addr learned my addr 172.21.15.70:0/3304479385 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:47.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0382d9d640 1 --2- 172.21.15.70:0/3304479385 >> v2:172.21.15.120:3300/0 conn(0x7f038415f4e0 0x7f03840cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 -- 172.21.15.70:0/3304479385 >> v2:172.21.15.120:3300/0 conn(0x7f038415f4e0 msgr2=0x7f03840cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:47.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 --2- 172.21.15.70:0/3304479385 >> v2:172.21.15.120:3300/0 conn(0x7f038415f4e0 0x7f03840cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 -- 172.21.15.70:0/3304479385 >> v1:172.21.15.120:6789/0 conn(0x7f038413e290 legacy=0x7f03840cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 -- 172.21.15.70:0/3304479385 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038406cdc0 con 0x7f03840cf990 2023-11-26T07:18:47.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f0381d9b640 1 --2- 172.21.15.70:0/3304479385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03840cf990 0x7f038415efa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0384155cf0 tx=0x7f037801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a617b18aa2b5e918 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f038159a640 1 -- 172.21.15.70:0/3304479385 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780aa650 con 0x7f03840cf990 2023-11-26T07:18:47.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f038159a640 1 -- 172.21.15.70:0/3304479385 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780aa7b0 con 0x7f03840cf990 2023-11-26T07:18:47.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.805+0000 7f038159a640 1 -- 172.21.15.70:0/3304479385 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780aab40 con 0x7f03840cf990 2023-11-26T07:18:47.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- 172.21.15.70:0/3304479385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03840cf990 msgr2=0x7f038415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 --2- 172.21.15.70:0/3304479385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03840cf990 0x7f038415efa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0384155cf0 tx=0x7f037801c4d0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- 172.21.15.70:0/3304479385 shutdown_connections 2023-11-26T07:18:47.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 --2- 172.21.15.70:0/3304479385 >> v2:172.21.15.120:3300/0 conn(0x7f038415f4e0 0x7f03840cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 --2- 172.21.15.70:0/3304479385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03840cf990 0x7f038415efa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- 172.21.15.70:0/3304479385 >> 172.21.15.70:0/3304479385 conn(0x7f038406a890 msgr2=0x7f038406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- 172.21.15.70:0/3304479385 shutdown_connections 2023-11-26T07:18:47.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- 172.21.15.70:0/3304479385 wait complete. 2023-11-26T07:18:47.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 Processor -- start 2023-11-26T07:18:47.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- start start 2023-11-26T07:18:47.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03840cf990 0x7f038415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f038413e290 0x7f0384152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038415f4e0 0x7f038413c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038415ea00 con 0x7f038415f4e0 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038415e720 con 0x7f03840cf990 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f0388eea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03840aff40 con 0x7f038413e290 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.809+0000 7f038259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03840cf990 0x7f038415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0382d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038415f4e0 0x7f038413c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f038259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03840cf990 0x7f038415e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:42934/0 (socket says 172.21.15.70:42934) 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f038259c640 1 -- 172.21.15.70:0/119594271 learned_addr learned my addr 172.21.15.70:0/119594271 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:47.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0381d9b640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f038413e290 0x7f0384152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0382d9d640 1 -- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f038413e290 msgr2=0x7f0384152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0382d9d640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f038413e290 0x7f0384152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0382d9d640 1 -- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03840cf990 msgr2=0x7f038415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0382d9d640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03840cf990 0x7f038415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0382d9d640 1 -- 172.21.15.70:0/119594271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780094d0 con 0x7f038415f4e0 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f038259c640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03840cf990 0x7f038415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0382d9d640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038415f4e0 0x7f038413c720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f037c00eba0 tx=0x7f037c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0372ffd640 1 -- 172.21.15.70:0/119594271 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c00cd20 con 0x7f038415f4e0 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0372ffd640 1 -- 172.21.15.70:0/119594271 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c00f040 con 0x7f038415f4e0 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03840b0220 con 0x7f038415f4e0 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0372ffd640 1 -- 172.21.15.70:0/119594271 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0146c0 con 0x7f038415f4e0 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0384127e30 con 0x7f038415f4e0 2023-11-26T07:18:47.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0384067680 con 0x7f038415f4e0 2023-11-26T07:18:47.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.813+0000 7f0372ffd640 1 -- 172.21.15.70:0/119594271 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f037c014820 con 0x7f038415f4e0 2023-11-26T07:18:47.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.817+0000 7f0372ffd640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0364066470 0x7f0364068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:47.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.817+0000 7f0372ffd640 1 -- 172.21.15.70:0/119594271 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f037c0849f0 con 0x7f038415f4e0 2023-11-26T07:18:47.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.817+0000 7f038259c640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0364066470 0x7f0364068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:47.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.817+0000 7f038259c640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0364066470 0x7f0364068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0374001ca0 tx=0x7f0374009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:47.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.821+0000 7f0372ffd640 1 -- 172.21.15.70:0/119594271 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f037c051f30 con 0x7f038415f4e0 2023-11-26T07:18:47.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03840b06d0 con 0x7f038415f4e0 2023-11-26T07:18:47.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0372ffd640 1 -- 172.21.15.70:0/119594271 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16755 (secure 0 0 0) 0x7f037c018020 con 0x7f038415f4e0 2023-11-26T07:18:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:47.977 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:45.864270+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0364066470 msgr2=0x7f0364068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0364066470 0x7f0364068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0374001ca0 tx=0x7f0374009040 comp rx=0 tx=0).stop 2023-11-26T07:18:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038415f4e0 msgr2=0x7f038413c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038415f4e0 0x7f038413c720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f037c00eba0 tx=0x7f037c00c490 comp rx=0 tx=0).stop 2023-11-26T07:18:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 shutdown_connections 2023-11-26T07:18:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0364066470 0x7f0364068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038415f4e0 0x7f038413c720 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f038413e290 0x7f0384152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 --2- 172.21.15.70:0/119594271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03840cf990 0x7f038415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:47.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 >> 172.21.15.70:0/119594271 conn(0x7f038406a890 msgr2=0x7f038406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:47.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 shutdown_connections 2023-11-26T07:18:47.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:47.973+0000 7f0388eea640 1 -- 172.21.15.70:0/119594271 wait complete. 2023-11-26T07:18:47.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:47.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:48.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f31d65640 1 Processor -- start 2023-11-26T07:18:48.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f31d65640 1 -- start start 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f31d65640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f31d65640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5f2c0d1bc0 0x7f5f2c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f31d65640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c0cf0e0 con 0x7f5f2c0b2160 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f31d65640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c15dac0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f31d65640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0ceb20 con 0x7f5f2c15d6e0 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f2bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5f2c0d1bc0 0x7f5f2c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f2affd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5f2c0b2160 0x7f5f2c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48130/0 (socket says 172.21.15.70:48130) 2023-11-26T07:18:48.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.133+0000 7f5f2affd640 1 -- 172.21.15.70:0/712168949 learned_addr learned my addr 172.21.15.70:0/712168949 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:48.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2bfff640 1 -- 172.21.15.70:0/712168949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 msgr2=0x7f5f2c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2bfff640 1 --2- 172.21.15.70:0/712168949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2bfff640 1 -- 172.21.15.70:0/712168949 >> v1:172.21.15.70:6789/0 conn(0x7f5f2c0b2160 legacy=0x7f5f2c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2bfff640 1 -- 172.21.15.70:0/712168949 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c0cee00 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2bfff640 1 --2- 172.21.15.70:0/712168949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c0b0750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009d90 tx=0x7f5f2401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1179ee61f23b61e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2a7fc640 1 -- 172.21.15.70:0/712168949 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240a5900 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2a7fc640 1 -- 172.21.15.70:0/712168949 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f240a5a60 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f2a7fc640 1 -- 172.21.15.70:0/712168949 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240a5df0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 -- 172.21.15.70:0/712168949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 msgr2=0x7f5f2c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 --2- 172.21.15.70:0/712168949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c0b0750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009d90 tx=0x7f5f2401c950 comp rx=0 tx=0).stop 2023-11-26T07:18:48.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 -- 172.21.15.70:0/712168949 shutdown_connections 2023-11-26T07:18:48.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 --2- 172.21.15.70:0/712168949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c0b0750 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 --2- 172.21.15.70:0/712168949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 -- 172.21.15.70:0/712168949 >> 172.21.15.70:0/712168949 conn(0x7f5f2c09c550 msgr2=0x7f5f2c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 -- 172.21.15.70:0/712168949 shutdown_connections 2023-11-26T07:18:48.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.137+0000 7f5f31d65640 1 -- 172.21.15.70:0/712168949 wait complete. 2023-11-26T07:18:48.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 Processor -- start 2023-11-26T07:18:48.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 -- start start 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f2c0b2160 0x7f5f2c159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c1595b0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c159830 con 0x7f5f2c0b2160 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c159b10 con 0x7f5f2c15d6e0 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42442/0 (socket says 172.21.15.70:42442) 2023-11-26T07:18:48.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 -- 172.21.15.70:0/1407101183 learned_addr learned my addr 172.21.15.70:0/1407101183 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2b7fe640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f2c0b2160 0x7f5f2c159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2bfff640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 -- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 msgr2=0x7f5f2c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 -- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f2c0b2160 msgr2=0x7f5f2c159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f2c0b2160 0x7f5f2c159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 -- 172.21.15.70:0/1407101183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009a70 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2bfff640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f2affd640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c157f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c500 tx=0x7f5f2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f13fff640 1 -- 172.21.15.70:0/1407101183 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20005cf0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f13fff640 1 -- 172.21.15.70:0/1407101183 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20005e50 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f13fff640 1 -- 172.21.15.70:0/1407101183 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200072f0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.141+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c159df0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.145+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c15a3b0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.145+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c15a5a0 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.145+0000 7f5f13fff640 1 -- 172.21.15.70:0/1407101183 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f20007450 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.145+0000 7f5f13fff640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5f18066470 0x7f5f18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.145+0000 7f5f13fff640 1 -- 172.21.15.70:0/1407101183 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5f20083460 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.145+0000 7f5f2b7fe640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5f18066470 0x7f5f18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.145+0000 7f5f2b7fe640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5f18066470 0x7f5f18068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006fd0 tx=0x7f5f1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.149+0000 7f5f13fff640 1 -- 172.21.15.70:0/1407101183 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f20050900 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f2c067680 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f13fff640 1 -- 172.21.15.70:0/1407101183 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f20017020 con 0x7f5f2c0d1bc0 2023-11-26T07:18:48.305 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:48.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5f18066470 msgr2=0x7f5f18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5f18066470 0x7f5f18068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006fd0 tx=0x7f5f1c008040 comp rx=0 tx=0).stop 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 msgr2=0x7f5f2c157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c157f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c500 tx=0x7f5f2000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 shutdown_connections 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5f18066470 0x7f5f18068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f2c0d1bc0 0x7f5f2c157f20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5f2c15d6e0 0x7f5f2c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 --2- 172.21.15.70:0/1407101183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f2c0b2160 0x7f5f2c159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 >> 172.21.15.70:0/1407101183 conn(0x7f5f2c09c550 msgr2=0x7f5f2c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 shutdown_connections 2023-11-26T07:18:48.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.301+0000 7f5f31d65640 1 -- 172.21.15.70:0/1407101183 wait complete. 2023-11-26T07:18:48.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:48.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bf7c1640 1 Processor -- start 2023-11-26T07:18:48.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bf7c1640 1 -- start start 2023-11-26T07:18:48.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bf7c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b814b1e0 0x7fa6b80cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bf7c1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6b80cf7c0 0x7fa6b80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bf7c1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b80cfc20 con 0x7fa6b8070e00 2023-11-26T07:18:48.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bf7c1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b8162080 con 0x7fa6b80cf7c0 2023-11-26T07:18:48.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bf7c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8161d70 con 0x7fa6b814b1e0 2023-11-26T07:18:48.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.461+0000 7fa6bcd5c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6b80cf7c0 0x7fa6b80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bcd5c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6b80cf7c0 0x7fa6b80708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42446/0 (socket says 172.21.15.70:42446) 2023-11-26T07:18:48.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bcd5c640 1 -- 172.21.15.70:0/1462807391 learned_addr learned my addr 172.21.15.70:0/1462807391 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:48.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bd55d640 1 --2- 172.21.15.70:0/1462807391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b814b1e0 0x7fa6b80cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bcd5c640 1 -- 172.21.15.70:0/1462807391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b814b1e0 msgr2=0x7fa6b80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bcd5c640 1 --2- 172.21.15.70:0/1462807391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b814b1e0 0x7fa6b80cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bcd5c640 1 -- 172.21.15.70:0/1462807391 >> v1:172.21.15.120:6789/0 conn(0x7fa6b8070e00 legacy=0x7fa6b80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bcd5c640 1 -- 172.21.15.70:0/1462807391 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b814b5c0 con 0x7fa6b80cf7c0 2023-11-26T07:18:48.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bd55d640 1 --2- 172.21.15.70:0/1462807391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b814b1e0 0x7fa6b80cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:48.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6bcd5c640 1 --2- 172.21.15.70:0/1462807391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80708c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009870 tx=0x7fa6a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84851361e764d228 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6affff640 1 -- 172.21.15.70:0/1462807391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80aa5f0 con 0x7fa6b80cf7c0 2023-11-26T07:18:48.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6affff640 1 -- 172.21.15.70:0/1462807391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a80aa750 con 0x7fa6b80cf7c0 2023-11-26T07:18:48.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.465+0000 7fa6affff640 1 -- 172.21.15.70:0/1462807391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80aaae0 con 0x7fa6b80cf7c0 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/1462807391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b80cf7c0 msgr2=0x7fa6b80708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/1462807391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80708c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8009870 tx=0x7fa6a801c4d0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/1462807391 shutdown_connections 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/1462807391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80708c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/1462807391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b814b1e0 0x7fa6b80cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/1462807391 >> 172.21.15.70:0/1462807391 conn(0x7fa6b806a890 msgr2=0x7fa6b806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/1462807391 shutdown_connections 2023-11-26T07:18:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/1462807391 wait complete. 2023-11-26T07:18:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 Processor -- start 2023-11-26T07:18:48.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- start start 2023-11-26T07:18:48.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b8070e00 0x7fa6b8149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b814b1e0 0x7fa6b80b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b814a5c0 con 0x7fa6b814b1e0 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8144910 con 0x7fa6b80cf7c0 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bf7c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b8145500 con 0x7fa6b8070e00 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b814b1e0 0x7fa6b80b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b814b1e0 0x7fa6b80b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42450/0 (socket says 172.21.15.70:42450) 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 -- 172.21.15.70:0/3691556570 learned_addr learned my addr 172.21.15.70:0/3691556570 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bd55d640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b8070e00 0x7fa6b8149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bcd5c640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 -- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b8070e00 msgr2=0x7fa6b8149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b8070e00 0x7fa6b8149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 -- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6b80cf7c0 msgr2=0x7fa6b80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bdd5e640 1 -- 172.21.15.70:0/3691556570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80094d0 con 0x7fa6b814b1e0 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bcd5c640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.469+0000 7fa6bd55d640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b8070e00 0x7fa6b8149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6bdd5e640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b814b1e0 0x7fa6b80b0930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c780 tx=0x7fa6b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6adffb640 1 -- 172.21.15.70:0/3691556570 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0004b70 con 0x7fa6b814b1e0 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6adffb640 1 -- 172.21.15.70:0/3691556570 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b000ce90 con 0x7fa6b814b1e0 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6adffb640 1 -- 172.21.15.70:0/3691556570 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000a850 con 0x7fa6b814b1e0 2023-11-26T07:18:48.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b814a000 con 0x7fa6b814b1e0 2023-11-26T07:18:48.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b81457a0 con 0x7fa6b814b1e0 2023-11-26T07:18:48.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b8145360 con 0x7fa6b814b1e0 2023-11-26T07:18:48.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6adffb640 1 -- 172.21.15.70:0/3691556570 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6b000a9b0 con 0x7fa6b814b1e0 2023-11-26T07:18:48.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6adffb640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa69c066470 0x7fa69c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6adffb640 1 -- 172.21.15.70:0/3691556570 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa6b00840c0 con 0x7fa6b814b1e0 2023-11-26T07:18:48.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6bd55d640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa69c066470 0x7fa69c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.473+0000 7fa6bd55d640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa69c066470 0x7fa69c068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a9b0 tx=0x7fa6b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.477+0000 7fa6adffb640 1 -- 172.21.15.70:0/3691556570 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6b8145360 con 0x7fa6b814b1e0 2023-11-26T07:18:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.629+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6b8145360 con 0x7fa6b814b1e0 2023-11-26T07:18:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.629+0000 7fa6adffb640 1 -- 172.21.15.70:0/3691556570 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6b8145360 con 0x7fa6b814b1e0 2023-11-26T07:18:48.634 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa69c066470 msgr2=0x7fa69c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa69c066470 0x7fa69c068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a9b0 tx=0x7fa6b4008040 comp rx=0 tx=0).stop 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b814b1e0 msgr2=0x7fa6b80b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b814b1e0 0x7fa6b80b0930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c780 tx=0x7fa6b000cc40 comp rx=0 tx=0).stop 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 shutdown_connections 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa69c066470 0x7fa69c068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6b814b1e0 0x7fa6b80b0930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6b80cf7c0 0x7fa6b80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 --2- 172.21.15.70:0/3691556570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa6b8070e00 0x7fa6b8149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 >> 172.21.15.70:0/3691556570 conn(0x7fa6b806a890 msgr2=0x7fa6b80a8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 shutdown_connections 2023-11-26T07:18:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.633+0000 7fa6bf7c1640 1 -- 172.21.15.70:0/3691556570 wait complete. 2023-11-26T07:18:48.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:48.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f742198d640 1 Processor -- start 2023-11-26T07:18:48.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f742198d640 1 -- start start 2023-11-26T07:18:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f742198d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f741c143ac0 0x7f741c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f742198d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f741c0cf990 0x7f741c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f742198d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c0cc730 con 0x7f741c0708b0 2023-11-26T07:18:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f742198d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c143ea0 con 0x7f741c143ac0 2023-11-26T07:18:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f742198d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c070ee0 con 0x7f741c0cf990 2023-11-26T07:18:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f741c143ac0 0x7f741c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f741c143ac0 0x7f741c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42454/0 (socket says 172.21.15.70:42454) 2023-11-26T07:18:48.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741affd640 1 -- 172.21.15.70:0/2488795001 learned_addr learned my addr 172.21.15.70:0/2488795001 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:48.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741b7fe640 1 --2- 172.21.15.70:0/2488795001 >> v2:172.21.15.120:3300/0 conn(0x7f741c0cf990 0x7f741c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741affd640 1 -- 172.21.15.70:0/2488795001 >> v2:172.21.15.120:3300/0 conn(0x7f741c0cf990 msgr2=0x7f741c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:48.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741affd640 1 --2- 172.21.15.70:0/2488795001 >> v2:172.21.15.120:3300/0 conn(0x7f741c0cf990 0x7f741c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741affd640 1 -- 172.21.15.70:0/2488795001 >> v1:172.21.15.120:6789/0 conn(0x7f741c0708b0 legacy=0x7f741c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.793+0000 7f741affd640 1 -- 172.21.15.70:0/2488795001 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0711c0 con 0x7f741c143ac0 2023-11-26T07:18:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f741affd640 1 --2- 172.21.15.70:0/2488795001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c070370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f741c06e570 tx=0x7f740c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506d925dd193c245 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f7419ffb640 1 -- 172.21.15.70:0/2488795001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0ab610 con 0x7f741c143ac0 2023-11-26T07:18:48.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f7419ffb640 1 -- 172.21.15.70:0/2488795001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c0ab770 con 0x7f741c143ac0 2023-11-26T07:18:48.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f7419ffb640 1 -- 172.21.15.70:0/2488795001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0abb00 con 0x7f741c143ac0 2023-11-26T07:18:48.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 -- 172.21.15.70:0/2488795001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 msgr2=0x7f741c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 --2- 172.21.15.70:0/2488795001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c070370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f741c06e570 tx=0x7f740c01c500 comp rx=0 tx=0).stop 2023-11-26T07:18:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 -- 172.21.15.70:0/2488795001 shutdown_connections 2023-11-26T07:18:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 --2- 172.21.15.70:0/2488795001 >> v2:172.21.15.120:3300/0 conn(0x7f741c0cf990 0x7f741c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 --2- 172.21.15.70:0/2488795001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c070370 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 -- 172.21.15.70:0/2488795001 >> 172.21.15.70:0/2488795001 conn(0x7f741c06a890 msgr2=0x7f741c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 -- 172.21.15.70:0/2488795001 shutdown_connections 2023-11-26T07:18:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.797+0000 7f742198d640 1 -- 172.21.15.70:0/2488795001 wait complete. 2023-11-26T07:18:48.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 Processor -- start 2023-11-26T07:18:48.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 -- start start 2023-11-26T07:18:48.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f741c0708b0 0x7f741c13ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f741c0cf990 0x7f741c1641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c13a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c159f90 con 0x7f741c143ac0 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c159b20 con 0x7f741c0cf990 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1587a0 con 0x7f741c0708b0 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c13a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c13a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42458/0 (socket says 172.21.15.70:42458) 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 -- 172.21.15.70:0/111539917 learned_addr learned my addr 172.21.15.70:0/111539917 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741affd640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f741c0708b0 0x7f741c13ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741a7fc640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f741c0cf990 0x7f741c1641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 -- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f741c0708b0 msgr2=0x7f741c13ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f741c0708b0 0x7f741c13ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 -- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f741c0cf990 msgr2=0x7f741c1641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f741c0cf990 0x7f741c1641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 -- 172.21.15.70:0/111539917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c0094d0 con 0x7f741c143ac0 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741affd640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f741c0708b0 0x7f741c13ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741a7fc640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f741c0cf990 0x7f741c1641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f741b7fe640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c13a8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f741400efc0 tx=0x7f741400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f7403fff640 1 -- 172.21.15.70:0/111539917 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414014480 con 0x7f741c143ac0 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f7403fff640 1 -- 172.21.15.70:0/111539917 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400f040 con 0x7f741c143ac0 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f7403fff640 1 -- 172.21.15.70:0/111539917 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414014820 con 0x7f741c143ac0 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c158a80 con 0x7f741c143ac0 2023-11-26T07:18:48.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.801+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c159040 con 0x7f741c143ac0 2023-11-26T07:18:48.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.805+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c067680 con 0x7f741c143ac0 2023-11-26T07:18:48.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.805+0000 7f7403fff640 1 -- 172.21.15.70:0/111539917 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7414014980 con 0x7f741c143ac0 2023-11-26T07:18:48.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.805+0000 7f7403fff640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7408066470 0x7f7408068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:48.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.805+0000 7f7403fff640 1 -- 172.21.15.70:0/111539917 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7414084e20 con 0x7f741c143ac0 2023-11-26T07:18:48.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.805+0000 7f741affd640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7408066470 0x7f7408068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:48.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.805+0000 7f741affd640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7408066470 0x7f7408068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f740c0af000 tx=0x7f740c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:48.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.809+0000 7f7403fff640 1 -- 172.21.15.70:0/111539917 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7414052180 con 0x7f741c143ac0 2023-11-26T07:18:48.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f741c0b3850 con 0x7f741c143ac0 2023-11-26T07:18:48.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f7403fff640 1 -- 172.21.15.70:0/111539917 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74140180a0 con 0x7f741c143ac0 2023-11-26T07:18:48.965 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:48.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7408066470 msgr2=0x7f7408068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7408066470 0x7f7408068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f740c0af000 tx=0x7f740c0a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:48.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 msgr2=0x7f741c13a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c13a8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f741400efc0 tx=0x7f741400c490 comp rx=0 tx=0).stop 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 shutdown_connections 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7408066470 0x7f7408068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f741c143ac0 0x7f741c13a8f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f741c0cf990 0x7f741c1641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 --2- 172.21.15.70:0/111539917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f741c0708b0 0x7f741c13ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 >> 172.21.15.70:0/111539917 conn(0x7f741c06a890 msgr2=0x7f741c0b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 shutdown_connections 2023-11-26T07:18:48.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:48.961+0000 7f742198d640 1 -- 172.21.15.70:0/111539917 wait complete. 2023-11-26T07:18:48.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:18:49.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f076d46b640 1 Processor -- start 2023-11-26T07:18:49.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f076d46b640 1 -- start start 2023-11-26T07:18:49.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f076d46b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f07680713d0 0x7f076806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f076d46b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0768160c90 con 0x7f07680b2c30 2023-11-26T07:18:49.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f076d46b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0768160f70 con 0x7f076806bab0 2023-11-26T07:18:49.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f076d46b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0768161250 con 0x7f07680713d0 2023-11-26T07:18:49.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f0766ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f07680b2c30 0x7f0768070cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48132/0 (socket says 172.21.15.70:48132) 2023-11-26T07:18:49.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f0766ffd640 1 -- 172.21.15.70:0/3485580044 learned_addr learned my addr 172.21.15.70:0/3485580044 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f075e7fc640 1 --2- 172.21.15.70:0/3485580044 >> v2:172.21.15.70:3300/0 conn(0x7f07680713d0 0x7f076806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f07667fc640 1 -- 172.21.15.70:0/3485580044 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261934450 0 0) 0x7f0768160c90 con 0x7f07680b2c30 2023-11-26T07:18:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f07667fc640 1 -- 172.21.15.70:0/3485580044 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0754003530 con 0x7f07680b2c30 2023-11-26T07:18:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f075e7fc640 1 -- 172.21.15.70:0/3485580044 >> v1:172.21.15.120:6789/0 conn(0x7f076806bab0 legacy=0x7f076815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f075e7fc640 1 -- 172.21.15.70:0/3485580044 >> v1:172.21.15.70:6789/0 conn(0x7f07680b2c30 legacy=0x7f0768070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.121+0000 7f075e7fc640 1 -- 172.21.15.70:0/3485580044 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0768161530 con 0x7f07680713d0 2023-11-26T07:18:49.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f075e7fc640 1 --2- 172.21.15.70:0/3485580044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f076806ccc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07580097c0 tx=0x7f075801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89de96dc418c888e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f07667fc640 1 -- 172.21.15.70:0/3485580044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580a7070 con 0x7f07680713d0 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f07667fc640 1 -- 172.21.15.70:0/3485580044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07580ab430 con 0x7f07680713d0 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f07667fc640 1 -- 172.21.15.70:0/3485580044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580ab7a0 con 0x7f07680713d0 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f076d46b640 1 -- 172.21.15.70:0/3485580044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 msgr2=0x7f076806ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f076d46b640 1 --2- 172.21.15.70:0/3485580044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f076806ccc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07580097c0 tx=0x7f075801c410 comp rx=0 tx=0).stop 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f076d46b640 1 -- 172.21.15.70:0/3485580044 shutdown_connections 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f076d46b640 1 --2- 172.21.15.70:0/3485580044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f076806ccc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f076d46b640 1 -- 172.21.15.70:0/3485580044 >> 172.21.15.70:0/3485580044 conn(0x7f07680b1610 msgr2=0x7f07680b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f076d46b640 1 -- 172.21.15.70:0/3485580044 shutdown_connections 2023-11-26T07:18:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.125+0000 7f076d46b640 1 -- 172.21.15.70:0/3485580044 wait complete. 2023-11-26T07:18:49.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 Processor -- start 2023-11-26T07:18:49.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 -- start start 2023-11-26T07:18:49.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f076806bab0 0x7f0768144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f07680ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680b2c30 0x7f0768142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076815d1d0 con 0x7f07680713d0 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680ae700 con 0x7f07680b2c30 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076815b2c0 con 0x7f076806bab0 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f07680ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f07680ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42470/0 (socket says 172.21.15.70:42470) 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 -- 172.21.15.70:0/1871616942 learned_addr learned my addr 172.21.15.70:0/1871616942 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f0766ffd640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f076806bab0 0x7f0768144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f07677fe640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680b2c30 0x7f0768142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 -- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f076806bab0 msgr2=0x7f0768144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f076806bab0 0x7f0768144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 -- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680b2c30 msgr2=0x7f0768142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680b2c30 0x7f0768142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 -- 172.21.15.70:0/1871616942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009420 con 0x7f07680713d0 2023-11-26T07:18:49.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075e7fc640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f07680ae070 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f07580ad040 tx=0x7f075801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075ffff640 1 -- 172.21.15.70:0/1871616942 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580b5810 con 0x7f07680713d0 2023-11-26T07:18:49.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075ffff640 1 -- 172.21.15.70:0/1871616942 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07580b5970 con 0x7f07680713d0 2023-11-26T07:18:49.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f075ffff640 1 -- 172.21.15.70:0/1871616942 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580b5ce0 con 0x7f07680713d0 2023-11-26T07:18:49.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076815b5a0 con 0x7f07680713d0 2023-11-26T07:18:49.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.129+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076815bb60 con 0x7f07680713d0 2023-11-26T07:18:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.133+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0768074b00 con 0x7f07680713d0 2023-11-26T07:18:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.133+0000 7f075ffff640 1 -- 172.21.15.70:0/1871616942 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07580bf410 con 0x7f07680713d0 2023-11-26T07:18:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.133+0000 7f075ffff640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0748066470 0x7f0748068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.133+0000 7f075ffff640 1 -- 172.21.15.70:0/1871616942 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f075811e820 con 0x7f07680713d0 2023-11-26T07:18:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.133+0000 7f0766ffd640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0748066470 0x7f0748068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.133+0000 7f0766ffd640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0748066470 0x7f0748068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0750005890 tx=0x7f0750009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.137+0000 7f075ffff640 1 -- 172.21.15.70:0/1871616942 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07580ebcb0 con 0x7f07680713d0 2023-11-26T07:18:49.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.297+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0768067500 con 0x7f07680713d0 2023-11-26T07:18:49.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.297+0000 7f075ffff640 1 -- 172.21.15.70:0/1871616942 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f07580c4020 con 0x7f07680713d0 2023-11-26T07:18:49.303 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0748066470 msgr2=0x7f0748068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0748066470 0x7f0748068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0750005890 tx=0x7f0750009040 comp rx=0 tx=0).stop 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 msgr2=0x7f07680ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f07680ae070 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f07580ad040 tx=0x7f075801ac50 comp rx=0 tx=0).stop 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 shutdown_connections 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0748066470 0x7f0748068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680713d0 0x7f07680ae070 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680b2c30 0x7f0768142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 --2- 172.21.15.70:0/1871616942 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f076806bab0 0x7f0768144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 >> 172.21.15.70:0/1871616942 conn(0x7f07680b1610 msgr2=0x7f076814b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 shutdown_connections 2023-11-26T07:18:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.301+0000 7f076d46b640 1 -- 172.21.15.70:0/1871616942 wait complete. 2023-11-26T07:18:49.323 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2023-11-26T07:18:49.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:49.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-26T07:18:49.347 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:49.347 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:18:49.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:18:49.348 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-26T07:18:49.400 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:18:49.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:49.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd6fec640 1 Processor -- start 2023-11-26T07:18:49.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd6fec640 1 -- start start 2023-11-26T07:18:49.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd6fec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3bd00d1bc0 0x7f3bd00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd6fec640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3bd00b2160 0x7f3bd00b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd6fec640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd00cf0e0 con 0x7f3bd015d6e0 2023-11-26T07:18:49.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd6fec640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd015dac0 con 0x7f3bd00b2160 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd6fec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00ceb20 con 0x7f3bd00d1bc0 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd5589640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3bd00b2160 0x7f3bd00b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd5589640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3bd00b2160 0x7f3bd00b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42478/0 (socket says 172.21.15.70:42478) 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd5589640 1 -- 172.21.15.70:0/1675396122 learned_addr learned my addr 172.21.15.70:0/1675396122 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/1675396122 >> v2:172.21.15.120:3300/0 conn(0x7f3bd00d1bc0 0x7f3bd00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd5589640 1 -- 172.21.15.70:0/1675396122 >> v2:172.21.15.120:3300/0 conn(0x7f3bd00d1bc0 msgr2=0x7f3bd00d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd5589640 1 --2- 172.21.15.70:0/1675396122 >> v2:172.21.15.120:3300/0 conn(0x7f3bd00d1bc0 0x7f3bd00d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd5589640 1 -- 172.21.15.70:0/1675396122 >> v1:172.21.15.120:6789/0 conn(0x7f3bd015d6e0 legacy=0x7f3bd00d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.533+0000 7f3bd5589640 1 -- 172.21.15.70:0/1675396122 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd00cee00 con 0x7f3bd00b2160 2023-11-26T07:18:49.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd5589640 1 --2- 172.21.15.70:0/1675396122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd00b2160 0x7f3bd00b0750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00ca2a0 tx=0x7f3bc801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebb751f6f22c09f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1675396122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a5740 con 0x7f3bd00b2160 2023-11-26T07:18:49.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1675396122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80a58a0 con 0x7f3bd00b2160 2023-11-26T07:18:49.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bc77fe640 1 -- 172.21.15.70:0/1675396122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a5c30 con 0x7f3bd00b2160 2023-11-26T07:18:49.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 -- 172.21.15.70:0/1675396122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd00b2160 msgr2=0x7f3bd00b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/1675396122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd00b2160 0x7f3bd00b0750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00ca2a0 tx=0x7f3bc801c990 comp rx=0 tx=0).stop 2023-11-26T07:18:49.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 -- 172.21.15.70:0/1675396122 shutdown_connections 2023-11-26T07:18:49.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/1675396122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd00b2160 0x7f3bd00b0750 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/1675396122 >> v2:172.21.15.120:3300/0 conn(0x7f3bd00d1bc0 0x7f3bd00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 -- 172.21.15.70:0/1675396122 >> 172.21.15.70:0/1675396122 conn(0x7f3bd009c550 msgr2=0x7f3bd00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 -- 172.21.15.70:0/1675396122 shutdown_connections 2023-11-26T07:18:49.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.537+0000 7f3bd6fec640 1 -- 172.21.15.70:0/1675396122 wait complete. 2023-11-26T07:18:49.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 Processor -- start 2023-11-26T07:18:49.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 -- start start 2023-11-26T07:18:49.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00b2160 0x7f3bd00ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bd00d1bc0 0x7f3bd01536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd015d6e0 0x7f3bd01591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0154ad0 con 0x7f3bd015d6e0 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0153ec0 con 0x7f3bd00b2160 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd01541a0 con 0x7f3bd00d1bc0 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd015d6e0 0x7f3bd01591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd015d6e0 0x7f3bd01591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42488/0 (socket says 172.21.15.70:42488) 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 -- 172.21.15.70:0/3215841878 learned_addr learned my addr 172.21.15.70:0/3215841878 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd4d88640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00b2160 0x7f3bd00ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bc7fff640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bd00d1bc0 0x7f3bd01536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 -- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bd00d1bc0 msgr2=0x7f3bd01536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bd00d1bc0 0x7f3bd01536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 -- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00b2160 msgr2=0x7f3bd00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00b2160 0x7f3bd00ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 -- 172.21.15.70:0/3215841878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8009b30 con 0x7f3bd015d6e0 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd5589640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd015d6e0 0x7f3bd01591f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3bc801a5c0 tx=0x7f3bc8019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bc57fa640 1 -- 172.21.15.70:0/3215841878 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80b8670 con 0x7f3bd015d6e0 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bc57fa640 1 -- 172.21.15.70:0/3215841878 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80b87d0 con 0x7f3bd015d6e0 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bc57fa640 1 -- 172.21.15.70:0/3215841878 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80b8b80 con 0x7f3bd015d6e0 2023-11-26T07:18:49.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd0154480 con 0x7f3bd015d6e0 2023-11-26T07:18:49.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd00ccfe0 con 0x7f3bd015d6e0 2023-11-26T07:18:49.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.541+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd0154c40 con 0x7f3bd015d6e0 2023-11-26T07:18:49.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.545+0000 7f3bc57fa640 1 -- 172.21.15.70:0/3215841878 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bc80b8ce0 con 0x7f3bd015d6e0 2023-11-26T07:18:49.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.545+0000 7f3bc57fa640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3bbc0664a0 0x7f3bbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.545+0000 7f3bc57fa640 1 -- 172.21.15.70:0/3215841878 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3bc811f200 con 0x7f3bd015d6e0 2023-11-26T07:18:49.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.545+0000 7f3bd4d88640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3bbc0664a0 0x7f3bbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.545+0000 7f3bd4d88640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3bbc0664a0 0x7f3bbc068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098e0 tx=0x7f3bcc009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.549+0000 7f3bc57fa640 1 -- 172.21.15.70:0/3215841878 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3bc80ec730 con 0x7f3bd015d6e0 2023-11-26T07:18:49.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.729+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bd0154c10 con 0x7f3bd015d6e0 2023-11-26T07:18:49.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.729+0000 7f3bc57fa640 1 -- 172.21.15.70:0/3215841878 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f3bc80efd50 con 0x7f3bd015d6e0 2023-11-26T07:18:49.735 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:49.735 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:49.735 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:49.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3bbc0664a0 msgr2=0x7f3bbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3bbc0664a0 0x7f3bbc068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098e0 tx=0x7f3bcc009060 comp rx=0 tx=0).stop 2023-11-26T07:18:49.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd015d6e0 msgr2=0x7f3bd01591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd015d6e0 0x7f3bd01591f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3bc801a5c0 tx=0x7f3bc8019730 comp rx=0 tx=0).stop 2023-11-26T07:18:49.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 shutdown_connections 2023-11-26T07:18:49.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3bbc0664a0 0x7f3bbc068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bd015d6e0 0x7f3bd01591f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bd00d1bc0 0x7f3bd01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 --2- 172.21.15.70:0/3215841878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bd00b2160 0x7f3bd00ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 >> 172.21.15.70:0/3215841878 conn(0x7f3bd009c550 msgr2=0x7f3bd00734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 shutdown_connections 2023-11-26T07:18:49.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.733+0000 7f3bd6fec640 1 -- 172.21.15.70:0/3215841878 wait complete. 2023-11-26T07:18:49.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:49.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f4406c32640 1 Processor -- start 2023-11-26T07:18:49.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f4406c32640 1 -- start start 2023-11-26T07:18:49.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f4406c32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f440015d6e0 0x7f44000d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f4406c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 0x7f44000b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f4406c32640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44000cf0e0 con 0x7f44000b2160 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f4406c32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440015dac0 con 0x7f440015d6e0 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f4406c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44000ceb20 con 0x7f44000d1bc0 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f44049ce640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f440015d6e0 0x7f44000d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f43fffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f44000b2160 0x7f44000d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48138/0 (socket says 172.21.15.70:48138) 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f44049ce640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f440015d6e0 0x7f44000d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42502/0 (socket says 172.21.15.70:42502) 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f43fffff640 1 -- 172.21.15.70:0/2569161430 learned_addr learned my addr 172.21.15.70:0/2569161430 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f44051cf640 1 --2- 172.21.15.70:0/2569161430 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 0x7f44000b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f44049ce640 1 -- 172.21.15.70:0/2569161430 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 msgr2=0x7f44000b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f44049ce640 1 --2- 172.21.15.70:0/2569161430 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 0x7f44000b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f44049ce640 1 -- 172.21.15.70:0/2569161430 >> v1:172.21.15.70:6789/0 conn(0x7f44000b2160 legacy=0x7f44000d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f44049ce640 1 -- 172.21.15.70:0/2569161430 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000cee00 con 0x7f440015d6e0 2023-11-26T07:18:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.889+0000 7f43ff7fe640 1 -- 172.21.15.70:0/2569161430 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092317438 0 0) 0x7f44000cf0e0 con 0x7f44000b2160 2023-11-26T07:18:49.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.893+0000 7f44049ce640 1 --2- 172.21.15.70:0/2569161430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440015d6e0 0x7f44000d0df0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f43f40097c0 tx=0x7f43f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22816ff635dd63b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.893+0000 7f43ff7fe640 1 -- 172.21.15.70:0/2569161430 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40ab600 con 0x7f440015d6e0 2023-11-26T07:18:49.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.893+0000 7f43ff7fe640 1 -- 172.21.15.70:0/2569161430 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f40a7050 con 0x7f440015d6e0 2023-11-26T07:18:49.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.893+0000 7f43ff7fe640 1 -- 172.21.15.70:0/2569161430 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40ab980 con 0x7f440015d6e0 2023-11-26T07:18:49.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.893+0000 7f4406c32640 1 -- 172.21.15.70:0/2569161430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440015d6e0 msgr2=0x7f44000d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.893+0000 7f4406c32640 1 --2- 172.21.15.70:0/2569161430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440015d6e0 0x7f44000d0df0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f43f40097c0 tx=0x7f43f401c480 comp rx=0 tx=0).stop 2023-11-26T07:18:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.893+0000 7f4406c32640 1 -- 172.21.15.70:0/2569161430 shutdown_connections 2023-11-26T07:18:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 --2- 172.21.15.70:0/2569161430 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 0x7f44000b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 --2- 172.21.15.70:0/2569161430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f440015d6e0 0x7f44000d0df0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 -- 172.21.15.70:0/2569161430 >> 172.21.15.70:0/2569161430 conn(0x7f440009c550 msgr2=0x7f44000d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 -- 172.21.15.70:0/2569161430 shutdown_connections 2023-11-26T07:18:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 -- 172.21.15.70:0/2569161430 wait complete. 2023-11-26T07:18:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 Processor -- start 2023-11-26T07:18:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 -- start start 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44000b2160 0x7f440015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 0x7f44000ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440015d6e0 0x7f4400159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400160000 con 0x7f44000b2160 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400160250 con 0x7f440015d6e0 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f4406c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4400160530 con 0x7f44000d1bc0 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44000b2160 0x7f440015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44000b2160 0x7f440015dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42518/0 (socket says 172.21.15.70:42518) 2023-11-26T07:18:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 -- 172.21.15.70:0/3907102416 learned_addr learned my addr 172.21.15.70:0/3907102416 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 -- 172.21.15.70:0/3907102416 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 msgr2=0x7f44000ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 0x7f44000ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 -- 172.21.15.70:0/3907102416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440015d6e0 msgr2=0x7f4400159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440015d6e0 0x7f4400159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 -- 172.21.15.70:0/3907102416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4009420 con 0x7f44000b2160 2023-11-26T07:18:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.897+0000 7f44049ce640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44000b2160 0x7f440015dc00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f43f401a0b0 tx=0x7f43f4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fd7fa640 1 -- 172.21.15.70:0/3907102416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40b4410 con 0x7f44000b2160 2023-11-26T07:18:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fd7fa640 1 -- 172.21.15.70:0/3907102416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f40b4590 con 0x7f44000b2160 2023-11-26T07:18:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4400160810 con 0x7f44000b2160 2023-11-26T07:18:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fd7fa640 1 -- 172.21.15.70:0/3907102416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40b4940 con 0x7f44000b2160 2023-11-26T07:18:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4400159a90 con 0x7f44000b2160 2023-11-26T07:18:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4400067680 con 0x7f44000b2160 2023-11-26T07:18:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fd7fa640 1 -- 172.21.15.70:0/3907102416 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43f40b2040 con 0x7f44000b2160 2023-11-26T07:18:49.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fd7fa640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f43e4066470 0x7f43e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:49.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fd7fa640 1 -- 172.21.15.70:0/3907102416 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f43f411dd30 con 0x7f44000b2160 2023-11-26T07:18:49.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fffff640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f43e4066470 0x7f43e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.901+0000 7f43fffff640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f43e4066470 0x7f43e4068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0011f0 tx=0x7f43ec007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:49.905+0000 7f43fd7fa640 1 -- 172.21.15.70:0/3907102416 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43f40eb130 con 0x7f44000b2160 2023-11-26T07:18:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.057+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44001590b0 con 0x7f44000b2160 2023-11-26T07:18:50.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f43fd7fa640 1 -- 172.21.15.70:0/3907102416 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16755 (secure 0 0 0) 0x7f43f40ee750 con 0x7f44000b2160 2023-11-26T07:18:50.064 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:50.064 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:45.864270+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f43e4066470 msgr2=0x7f43e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f43e4066470 0x7f43e4068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0011f0 tx=0x7f43ec007930 comp rx=0 tx=0).stop 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44000b2160 msgr2=0x7f440015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44000b2160 0x7f440015dc00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f43f401a0b0 tx=0x7f43f4019220 comp rx=0 tx=0).stop 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 shutdown_connections 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f440015d6e0 0x7f4400159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f44000d1bc0 0x7f44000ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f43e4066470 0x7f43e4068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 --2- 172.21.15.70:0/3907102416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44000b2160 0x7f440015dc00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 >> 172.21.15.70:0/3907102416 conn(0x7f440009c550 msgr2=0x7f44000734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 shutdown_connections 2023-11-26T07:18:50.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.061+0000 7f4406c32640 1 -- 172.21.15.70:0/3907102416 wait complete. 2023-11-26T07:18:50.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:18:01.934679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:18:02.464153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:18:50.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:18:50.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423ff8d640 1 Processor -- start 2023-11-26T07:18:50.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423ff8d640 1 -- start start 2023-11-26T07:18:50.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423ff8d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42380d1bc0 0x7f42380d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423ff8d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f42380b2160 0x7f42380b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423ff8d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380cf0e0 con 0x7f423815d6e0 2023-11-26T07:18:50.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423ff8d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423815dac0 con 0x7f42380b2160 2023-11-26T07:18:50.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423ff8d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42380ceb20 con 0x7f42380d1bc0 2023-11-26T07:18:50.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423e52a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f42380b2160 0x7f42380b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423d528640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42380d1bc0 0x7f42380d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423dd29640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f423815d6e0 0x7f42380d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:52768/0 (socket says 172.21.15.70:52768) 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423dd29640 1 -- 172.21.15.70:0/118119584 learned_addr learned my addr 172.21.15.70:0/118119584 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423cd27640 1 -- 172.21.15.70:0/118119584 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184838920 0 0) 0x7f42380cf0e0 con 0x7f423815d6e0 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423cd27640 1 -- 172.21.15.70:0/118119584 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4224003530 con 0x7f423815d6e0 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423e52a640 1 -- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42380d1bc0 msgr2=0x7f42380d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423e52a640 1 --2- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42380d1bc0 0x7f42380d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.221+0000 7f423e52a640 1 -- 172.21.15.70:0/118119584 >> v1:172.21.15.120:6789/0 conn(0x7f423815d6e0 legacy=0x7f42380d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423e52a640 1 -- 172.21.15.70:0/118119584 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42380cee00 con 0x7f42380b2160 2023-11-26T07:18:50.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423d528640 1 --2- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42380d1bc0 0x7f42380d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:18:50.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423e52a640 1 --2- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 0x7f42380b0750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4230009d90 tx=0x7f423001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeccb83b49767431 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423cd27640 1 -- 172.21.15.70:0/118119584 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300a5900 con 0x7f42380b2160 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423cd27640 1 -- 172.21.15.70:0/118119584 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42300a5a60 con 0x7f42380b2160 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423cd27640 1 -- 172.21.15.70:0/118119584 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300a5df0 con 0x7f42380b2160 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423ff8d640 1 -- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 msgr2=0x7f42380b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423ff8d640 1 --2- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 0x7f42380b0750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4230009d90 tx=0x7f423001c950 comp rx=0 tx=0).stop 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423ff8d640 1 -- 172.21.15.70:0/118119584 shutdown_connections 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423ff8d640 1 --2- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 0x7f42380b0750 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423ff8d640 1 --2- 172.21.15.70:0/118119584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42380d1bc0 0x7f42380d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.225+0000 7f423ff8d640 1 -- 172.21.15.70:0/118119584 >> 172.21.15.70:0/118119584 conn(0x7f423809c550 msgr2=0x7f42380d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 -- 172.21.15.70:0/118119584 shutdown_connections 2023-11-26T07:18:50.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 -- 172.21.15.70:0/118119584 wait complete. 2023-11-26T07:18:50.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 Processor -- start 2023-11-26T07:18:50.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 -- start start 2023-11-26T07:18:50.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 0x7f42380b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42380d1bc0 0x7f423806bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f423815d6e0 0x7f4238154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4238155020 con 0x7f42380d1bc0 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4238155be0 con 0x7f42380b2160 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423ff8d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42380cb340 con 0x7f423815d6e0 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42380d1bc0 0x7f423806bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42380d1bc0 0x7f423806bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42520/0 (socket says 172.21.15.70:42520) 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 -- 172.21.15.70:0/2414377836 learned_addr learned my addr 172.21.15.70:0/2414377836 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423e52a640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f423815d6e0 0x7f4238154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423dd29640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 0x7f42380b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 -- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f423815d6e0 msgr2=0x7f4238154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f423815d6e0 0x7f4238154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 -- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 msgr2=0x7f42380b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 0x7f42380b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 -- 172.21.15.70:0/2414377836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009420 con 0x7f42380d1bc0 2023-11-26T07:18:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.229+0000 7f423d528640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42380d1bc0 0x7f423806bf60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f422800ebe0 tx=0x7f422800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f422e7fc640 1 -- 172.21.15.70:0/2414377836 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800eee0 con 0x7f42380d1bc0 2023-11-26T07:18:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f422e7fc640 1 -- 172.21.15.70:0/2414377836 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422800cc30 con 0x7f42380d1bc0 2023-11-26T07:18:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f422e7fc640 1 -- 172.21.15.70:0/2414377836 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228013470 con 0x7f42380d1bc0 2023-11-26T07:18:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4230009a70 con 0x7f42380d1bc0 2023-11-26T07:18:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4238156110 con 0x7f42380d1bc0 2023-11-26T07:18:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42380d2900 con 0x7f42380d1bc0 2023-11-26T07:18:50.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f422e7fc640 1 -- 172.21.15.70:0/2414377836 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f42280135d0 con 0x7f42380d1bc0 2023-11-26T07:18:50.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f422e7fc640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f421c066470 0x7f421c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f422e7fc640 1 -- 172.21.15.70:0/2414377836 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4228084110 con 0x7f42380d1bc0 2023-11-26T07:18:50.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f423dd29640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f421c066470 0x7f421c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.233+0000 7f423dd29640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f421c066470 0x7f421c068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42340011f0 tx=0x7f4234007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.237+0000 7f422e7fc640 1 -- 172.21.15.70:0/2414377836 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42280515c0 con 0x7f42380d1bc0 2023-11-26T07:18:50.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42380cb4b0 con 0x7f42380d1bc0 2023-11-26T07:18:50.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f422e7fc640 1 -- 172.21.15.70:0/2414377836 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42380cb4b0 con 0x7f42380d1bc0 2023-11-26T07:18:50.396 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f421c066470 msgr2=0x7f421c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f421c066470 0x7f421c068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f42340011f0 tx=0x7f4234007d40 comp rx=0 tx=0).stop 2023-11-26T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42380d1bc0 msgr2=0x7f423806bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42380d1bc0 0x7f423806bf60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f422800ebe0 tx=0x7f422800c520 comp rx=0 tx=0).stop 2023-11-26T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 shutdown_connections 2023-11-26T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f421c066470 0x7f421c068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42380d1bc0 0x7f423806bf60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f423815d6e0 0x7f4238154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 --2- 172.21.15.70:0/2414377836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42380b2160 0x7f42380b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 >> 172.21.15.70:0/2414377836 conn(0x7f423809c550 msgr2=0x7f4238159280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 shutdown_connections 2023-11-26T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.393+0000 7f423ff8d640 1 -- 172.21.15.70:0/2414377836 wait complete. 2023-11-26T07:18:50.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:18:50.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb10d565640 1 Processor -- start 2023-11-26T07:18:50.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb10d565640 1 -- start start 2023-11-26T07:18:50.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb10d565640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb1080b2160 0x7fb1080d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb10d565640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080cf0e0 con 0x7fb10815d6e0 2023-11-26T07:18:50.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb10d565640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080ceb20 con 0x7fb1080d1bc0 2023-11-26T07:18:50.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb10d565640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10815dac0 con 0x7fb1080b2160 2023-11-26T07:18:50.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb106ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb10815d6e0 0x7fb1080d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48154/0 (socket says 172.21.15.70:48154) 2023-11-26T07:18:50.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb106ffd640 1 -- 172.21.15.70:0/3169427495 learned_addr learned my addr 172.21.15.70:0/3169427495 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:50.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb1077fe640 1 --2- 172.21.15.70:0/3169427495 >> v2:172.21.15.120:3300/0 conn(0x7fb1080b2160 0x7fb1080d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb1067fc640 1 -- 172.21.15.70:0/3169427495 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417732172 0 0) 0x7fb1080cf0e0 con 0x7fb10815d6e0 2023-11-26T07:18:50.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb1067fc640 1 -- 172.21.15.70:0/3169427495 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f4003530 con 0x7fb10815d6e0 2023-11-26T07:18:50.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb1077fe640 1 -- 172.21.15.70:0/3169427495 >> v1:172.21.15.120:6789/0 conn(0x7fb1080d1bc0 legacy=0x7fb1080b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb1077fe640 1 -- 172.21.15.70:0/3169427495 >> v1:172.21.15.70:6789/0 conn(0x7fb10815d6e0 legacy=0x7fb1080d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.553+0000 7fb1077fe640 1 -- 172.21.15.70:0/3169427495 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080cee00 con 0x7fb1080b2160 2023-11-26T07:18:50.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb1077fe640 1 --2- 172.21.15.70:0/3169427495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080b2160 0x7fb1080d0df0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097c0 tx=0x7fb10001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cd1e0341a66c06d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb1067fc640 1 -- 172.21.15.70:0/3169427495 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000ab600 con 0x7fb1080b2160 2023-11-26T07:18:50.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb1067fc640 1 -- 172.21.15.70:0/3169427495 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000a7050 con 0x7fb1080b2160 2023-11-26T07:18:50.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb1067fc640 1 -- 172.21.15.70:0/3169427495 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000ab980 con 0x7fb1080b2160 2023-11-26T07:18:50.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb10d565640 1 -- 172.21.15.70:0/3169427495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080b2160 msgr2=0x7fb1080d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb10d565640 1 --2- 172.21.15.70:0/3169427495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080b2160 0x7fb1080d0df0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097c0 tx=0x7fb10001c480 comp rx=0 tx=0).stop 2023-11-26T07:18:50.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb10d565640 1 -- 172.21.15.70:0/3169427495 shutdown_connections 2023-11-26T07:18:50.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb10d565640 1 --2- 172.21.15.70:0/3169427495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080b2160 0x7fb1080d0df0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb10d565640 1 -- 172.21.15.70:0/3169427495 >> 172.21.15.70:0/3169427495 conn(0x7fb10809c550 msgr2=0x7fb1080d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb10d565640 1 -- 172.21.15.70:0/3169427495 shutdown_connections 2023-11-26T07:18:50.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.557+0000 7fb10d565640 1 -- 172.21.15.70:0/3169427495 wait complete. 2023-11-26T07:18:50.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 Processor -- start 2023-11-26T07:18:50.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 -- start start 2023-11-26T07:18:50.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1080b2160 0x7fb1080cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080d1bc0 0x7fb108151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10815d6e0 0x7fb108152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cc5c0 con 0x7fb10815d6e0 2023-11-26T07:18:50.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cad00 con 0x7fb1080d1bc0 2023-11-26T07:18:50.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb10d565640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cafe0 con 0x7fb1080b2160 2023-11-26T07:18:50.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10815d6e0 0x7fb108152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10815d6e0 0x7fb108152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42522/0 (socket says 172.21.15.70:42522) 2023-11-26T07:18:50.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 -- 172.21.15.70:0/1000744987 learned_addr learned my addr 172.21.15.70:0/1000744987 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:50.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb0fe7fc640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080d1bc0 0x7fb108151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb106ffd640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1080b2160 0x7fb1080cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 -- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1080b2160 msgr2=0x7fb1080cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1080b2160 0x7fb1080cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 -- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080d1bc0 msgr2=0x7fb108151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080d1bc0 0x7fb108151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 -- 172.21.15.70:0/1000744987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100009420 con 0x7fb10815d6e0 2023-11-26T07:18:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb1077fe640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10815d6e0 0x7fb108152050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1000ae040 tx=0x7fb100019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.561+0000 7fb0fffff640 1 -- 172.21.15.70:0/1000744987 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000b4410 con 0x7fb10815d6e0 2023-11-26T07:18:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb0fffff640 1 -- 172.21.15.70:0/1000744987 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000b4570 con 0x7fb10815d6e0 2023-11-26T07:18:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1080cb2c0 con 0x7fb10815d6e0 2023-11-26T07:18:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb0fffff640 1 -- 172.21.15.70:0/1000744987 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000b4900 con 0x7fb10815d6e0 2023-11-26T07:18:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1080cb880 con 0x7fb10815d6e0 2023-11-26T07:18:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1080d2690 con 0x7fb10815d6e0 2023-11-26T07:18:50.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb0fffff640 1 -- 172.21.15.70:0/1000744987 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1000b2040 con 0x7fb10815d6e0 2023-11-26T07:18:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb0fffff640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0e8066470 0x7fb0e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb0fffff640 1 -- 172.21.15.70:0/1000744987 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb10011df10 con 0x7fb10815d6e0 2023-11-26T07:18:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb106ffd640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0e8066470 0x7fb0e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.565+0000 7fb106ffd640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0e8066470 0x7fb0e8068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80011f0 tx=0x7fb0f8007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.569+0000 7fb0fffff640 1 -- 172.21.15.70:0/1000744987 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1000eb3b0 con 0x7fb10815d6e0 2023-11-26T07:18:50.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.717+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1080d0ef0 con 0x7fb10815d6e0 2023-11-26T07:18:50.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb0fffff640 1 -- 172.21.15.70:0/1000744987 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1000ee9d0 con 0x7fb10815d6e0 2023-11-26T07:18:50.724 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:18:50.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0e8066470 msgr2=0x7fb0e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0e8066470 0x7fb0e8068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80011f0 tx=0x7fb0f8007d40 comp rx=0 tx=0).stop 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10815d6e0 msgr2=0x7fb108152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10815d6e0 0x7fb108152050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1000ae040 tx=0x7fb100019220 comp rx=0 tx=0).stop 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 shutdown_connections 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0e8066470 0x7fb0e8068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10815d6e0 0x7fb108152050 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1080d1bc0 0x7fb108151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 --2- 172.21.15.70:0/1000744987 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1080b2160 0x7fb1080cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 >> 172.21.15.70:0/1000744987 conn(0x7fb10809c550 msgr2=0x7fb1080cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 shutdown_connections 2023-11-26T07:18:50.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.721+0000 7fb10d565640 1 -- 172.21.15.70:0/1000744987 wait complete. 2023-11-26T07:18:50.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:18:50.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f929ab94640 1 Processor -- start 2023-11-26T07:18:50.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f929ab94640 1 -- start start 2023-11-26T07:18:50.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f929ab94640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f92940cf280 0x7f92940cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f929ab94640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f92940cd1b0 0x7f92940cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f929ab94640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92940cc730 con 0x7f9294143ac0 2023-11-26T07:18:50.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f929ab94640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9294143ea0 con 0x7f92940cd1b0 2023-11-26T07:18:50.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f929ab94640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92940cfc50 con 0x7f92940cf280 2023-11-26T07:18:50.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9298930640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9294143ac0 0x7f9294070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48162/0 (socket says 172.21.15.70:48162) 2023-11-26T07:18:50.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9298930640 1 -- 172.21.15.70:0/352111708 learned_addr learned my addr 172.21.15.70:0/352111708 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:50.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9299131640 1 --2- 172.21.15.70:0/352111708 >> v2:172.21.15.70:3300/0 conn(0x7f92940cd1b0 0x7f92940cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9293fff640 1 --2- 172.21.15.70:0/352111708 >> v2:172.21.15.120:3300/0 conn(0x7f92940cf280 0x7f92940cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f92937fe640 1 -- 172.21.15.70:0/352111708 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850782226 0 0) 0x7f92940cc730 con 0x7f9294143ac0 2023-11-26T07:18:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f92937fe640 1 -- 172.21.15.70:0/352111708 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9284005740 con 0x7f9294143ac0 2023-11-26T07:18:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9299131640 1 -- 172.21.15.70:0/352111708 >> v2:172.21.15.120:3300/0 conn(0x7f92940cf280 msgr2=0x7f92940cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9299131640 1 --2- 172.21.15.70:0/352111708 >> v2:172.21.15.120:3300/0 conn(0x7f92940cf280 0x7f92940cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9299131640 1 -- 172.21.15.70:0/352111708 >> v1:172.21.15.70:6789/0 conn(0x7f9294143ac0 legacy=0x7f9294070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.881+0000 7f9299131640 1 -- 172.21.15.70:0/352111708 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294070ee0 con 0x7f92940cd1b0 2023-11-26T07:18:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.885+0000 7f9299131640 1 --2- 172.21.15.70:0/352111708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cd1b0 0x7f92940cd5c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f92940aeb10 tx=0x7f928c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e8ab2018d590ac server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f92937fe640 1 -- 172.21.15.70:0/352111708 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0a59d0 con 0x7f92940cd1b0 2023-11-26T07:18:50.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f92937fe640 1 -- 172.21.15.70:0/352111708 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c0a5b30 con 0x7f92940cd1b0 2023-11-26T07:18:50.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f92937fe640 1 -- 172.21.15.70:0/352111708 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0a5ea0 con 0x7f92940cd1b0 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 -- 172.21.15.70:0/352111708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cd1b0 msgr2=0x7f92940cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 --2- 172.21.15.70:0/352111708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cd1b0 0x7f92940cd5c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f92940aeb10 tx=0x7f928c01c910 comp rx=0 tx=0).stop 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 -- 172.21.15.70:0/352111708 shutdown_connections 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 --2- 172.21.15.70:0/352111708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cd1b0 0x7f92940cd5c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 --2- 172.21.15.70:0/352111708 >> v2:172.21.15.120:3300/0 conn(0x7f92940cf280 0x7f92940cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 -- 172.21.15.70:0/352111708 >> 172.21.15.70:0/352111708 conn(0x7f929406a890 msgr2=0x7f929406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 -- 172.21.15.70:0/352111708 shutdown_connections 2023-11-26T07:18:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 -- 172.21.15.70:0/352111708 wait complete. 2023-11-26T07:18:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 Processor -- start 2023-11-26T07:18:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.889+0000 7f929ab94640 1 -- start start 2023-11-26T07:18:50.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92940cd1b0 0x7f92940b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cf280 0x7f92940acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9294143ac0 0x7f929415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940b10a0 con 0x7f92940cf280 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940b1a70 con 0x7f92940cd1b0 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92940b01f0 con 0x7f9294143ac0 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cf280 0x7f92940acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cf280 0x7f92940acf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42540/0 (socket says 172.21.15.70:42540) 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 -- 172.21.15.70:0/3004057257 learned_addr learned my addr 172.21.15.70:0/3004057257 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9298930640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92940cd1b0 0x7f92940b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9299131640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9294143ac0 0x7f929415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 -- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9294143ac0 msgr2=0x7f929415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9294143ac0 0x7f929415b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 -- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92940cd1b0 msgr2=0x7f92940b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:50.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92940cd1b0 0x7f92940b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:50.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 -- 172.21.15.70:0/3004057257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009a70 con 0x7f92940cf280 2023-11-26T07:18:50.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9299131640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9294143ac0 0x7f929415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:50.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f9293fff640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cf280 0x7f92940acf50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f928000d5f0 tx=0x7f928000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f92917fa640 1 -- 172.21.15.70:0/3004057257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800125f0 con 0x7f92940cf280 2023-11-26T07:18:50.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f92917fa640 1 -- 172.21.15.70:0/3004057257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280012750 con 0x7f92940cf280 2023-11-26T07:18:50.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f92917fa640 1 -- 172.21.15.70:0/3004057257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280012ae0 con 0x7f92940cf280 2023-11-26T07:18:50.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92940b0490 con 0x7f92940cf280 2023-11-26T07:18:50.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92940b0d30 con 0x7f92940cf280 2023-11-26T07:18:50.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92940b0ef0 con 0x7f92940cf280 2023-11-26T07:18:50.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.893+0000 7f92917fa640 1 -- 172.21.15.70:0/3004057257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9280012c40 con 0x7f92940cf280 2023-11-26T07:18:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.897+0000 7f92917fa640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f92780664c0 0x7f9278068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.897+0000 7f92917fa640 1 -- 172.21.15.70:0/3004057257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f92800841a0 con 0x7f92940cf280 2023-11-26T07:18:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.897+0000 7f9298930640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f92780664c0 0x7f9278068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.897+0000 7f9298930640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f92780664c0 0x7f9278068980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92880011f0 tx=0x7f9288007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:50.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:50.901+0000 7f92917fa640 1 -- 172.21.15.70:0/3004057257 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9280051710 con 0x7f92940cf280 2023-11-26T07:18:51.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.053+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9294067680 con 0x7f92940cf280 2023-11-26T07:18:51.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.053+0000 7f92917fa640 1 -- 172.21.15.70:0/3004057257 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9280007380 con 0x7f92940cf280 2023-11-26T07:18:51.060 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f92780664c0 msgr2=0x7f9278068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f92780664c0 0x7f9278068980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92880011f0 tx=0x7f9288007d40 comp rx=0 tx=0).stop 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cf280 msgr2=0x7f92940acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cf280 0x7f92940acf50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f928000d5f0 tx=0x7f928000dab0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 shutdown_connections 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f92780664c0 0x7f9278068980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92940cf280 0x7f92940acf50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9294143ac0 0x7f929415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 --2- 172.21.15.70:0/3004057257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92940cd1b0 0x7f92940b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 >> 172.21.15.70:0/3004057257 conn(0x7f929406a890 msgr2=0x7f92940b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 shutdown_connections 2023-11-26T07:18:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.057+0000 7f929ab94640 1 -- 172.21.15.70:0/3004057257 wait complete. 2023-11-26T07:18:51.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:51.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.213+0000 7f48dc232640 1 Processor -- start 2023-11-26T07:18:51.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48dc232640 1 -- start start 2023-11-26T07:18:51.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48dc232640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48d415d580 0x7f48d40d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48dc232640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d40d3e60 0x7f48d40d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48dc232640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d40d21e0 con 0x7f48d40d1d30 2023-11-26T07:18:51.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48dc232640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d40d0bc0 con 0x7f48d415d580 2023-11-26T07:18:51.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48dc232640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40d0320 con 0x7f48d40d3e60 2023-11-26T07:18:51.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d9fce640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48d415d580 0x7f48d40d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d9fce640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f48d415d580 0x7f48d40d3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:43060/0 (socket says 172.21.15.70:43060) 2023-11-26T07:18:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d9fce640 1 -- 172.21.15.70:0/3865078708 learned_addr learned my addr 172.21.15.70:0/3865078708 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d97cd640 1 --2- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d40d3e60 0x7f48d40d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d9fce640 1 -- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d40d3e60 msgr2=0x7f48d40d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d9fce640 1 --2- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d40d3e60 0x7f48d40d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d9fce640 1 -- 172.21.15.70:0/3865078708 >> v1:172.21.15.120:6789/0 conn(0x7f48d40d1d30 legacy=0x7f48d40cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.217+0000 7f48d9fce640 1 -- 172.21.15.70:0/3865078708 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40d0600 con 0x7f48d415d580 2023-11-26T07:18:51.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48d9fce640 1 --2- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d415d580 0x7f48d40d3920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009870 tx=0x7f48d001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=871f64be9fa2f0b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48d8fcc640 1 -- 172.21.15.70:0/3865078708 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00aa670 con 0x7f48d415d580 2023-11-26T07:18:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48d8fcc640 1 -- 172.21.15.70:0/3865078708 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00aa7d0 con 0x7f48d415d580 2023-11-26T07:18:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48d8fcc640 1 -- 172.21.15.70:0/3865078708 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00aab60 con 0x7f48d415d580 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 -- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d415d580 msgr2=0x7f48d40d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 --2- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d415d580 0x7f48d40d3920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009870 tx=0x7f48d001c510 comp rx=0 tx=0).stop 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 -- 172.21.15.70:0/3865078708 shutdown_connections 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 --2- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d40d3e60 0x7f48d40d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 --2- 172.21.15.70:0/3865078708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d415d580 0x7f48d40d3920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 -- 172.21.15.70:0/3865078708 >> 172.21.15.70:0/3865078708 conn(0x7f48d409c550 msgr2=0x7f48d40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 -- 172.21.15.70:0/3865078708 shutdown_connections 2023-11-26T07:18:51.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.221+0000 7f48dc232640 1 -- 172.21.15.70:0/3865078708 wait complete. 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 Processor -- start 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 -- start start 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d40d1d30 0x7f48d41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d40d3e60 0x7f48d415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d415d580 0x7f48d41603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4154dc0 con 0x7f48d40d1d30 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4154140 con 0x7f48d40d3e60 2023-11-26T07:18:51.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4154420 con 0x7f48d415d580 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d40d1d30 0x7f48d41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d40d1d30 0x7f48d41551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42550/0 (socket says 172.21.15.70:42550) 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 -- 172.21.15.70:0/334672893 learned_addr learned my addr 172.21.15.70:0/334672893 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d97cd640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d40d3e60 0x7f48d415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48da7cf640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d415d580 0x7f48d41603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 -- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d415d580 msgr2=0x7f48d41603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d415d580 0x7f48d41603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 -- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d40d3e60 msgr2=0x7f48d415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d40d3e60 0x7f48d415c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 -- 172.21.15.70:0/334672893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00094d0 con 0x7f48d40d1d30 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48da7cf640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d415d580 0x7f48d41603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48d9fce640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d40d1d30 0x7f48d41551e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ac040 tx=0x7f48d001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48ca7fc640 1 -- 172.21.15.70:0/334672893 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00b3800 con 0x7f48d40d1d30 2023-11-26T07:18:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48ca7fc640 1 -- 172.21.15.70:0/334672893 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00b3980 con 0x7f48d40d1d30 2023-11-26T07:18:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d4154700 con 0x7f48d40d1d30 2023-11-26T07:18:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48ca7fc640 1 -- 172.21.15.70:0/334672893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00b3d30 con 0x7f48d40d1d30 2023-11-26T07:18:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d4160930 con 0x7f48d40d1d30 2023-11-26T07:18:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.225+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d4155030 con 0x7f48d40d1d30 2023-11-26T07:18:51.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.229+0000 7f48ca7fc640 1 -- 172.21.15.70:0/334672893 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48d00b2380 con 0x7f48d40d1d30 2023-11-26T07:18:51.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.229+0000 7f48ca7fc640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b8066470 0x7f48b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.229+0000 7f48ca7fc640 1 -- 172.21.15.70:0/334672893 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f48d011e6b0 con 0x7f48d40d1d30 2023-11-26T07:18:51.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.229+0000 7f48d97cd640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b8066470 0x7f48b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.229+0000 7f48d97cd640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b8066470 0x7f48b8068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48d41601e0 tx=0x7f48c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.233+0000 7f48ca7fc640 1 -- 172.21.15.70:0/334672893 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48d00ebac0 con 0x7f48d40d1d30 2023-11-26T07:18:51.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.413+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48d41566e0 con 0x7f48d40d1d30 2023-11-26T07:18:51.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.413+0000 7f48ca7fc640 1 -- 172.21.15.70:0/334672893 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f48d00aa630 con 0x7f48d40d1d30 2023-11-26T07:18:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:51.418 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:51.418 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b8066470 msgr2=0x7f48b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b8066470 0x7f48b8068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f48d41601e0 tx=0x7f48c4009190 comp rx=0 tx=0).stop 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d40d1d30 msgr2=0x7f48d41551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d40d1d30 0x7f48d41551e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ac040 tx=0x7f48d001ad50 comp rx=0 tx=0).stop 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 shutdown_connections 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48d415d580 0x7f48d41603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48d40d3e60 0x7f48d415c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b8066470 0x7f48b8068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 --2- 172.21.15.70:0/334672893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48d40d1d30 0x7f48d41551e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 >> 172.21.15.70:0/334672893 conn(0x7f48d409c550 msgr2=0x7f48d4155fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:51.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 shutdown_connections 2023-11-26T07:18:51.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.417+0000 7f48dc232640 1 -- 172.21.15.70:0/334672893 wait complete. 2023-11-26T07:18:51.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cbaf0f640 1 Processor -- start 2023-11-26T07:18:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cbaf0f640 1 -- start start 2023-11-26T07:18:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cbaf0f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb406b190 0x7f3cb4146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cbaf0f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb4146380 con 0x7f3cb4145fa0 2023-11-26T07:18:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cbaf0f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb4071660 con 0x7f3cb406a490 2023-11-26T07:18:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cbaf0f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4071480 con 0x7f3cb406b190 2023-11-26T07:18:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cb8cab640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3cb4145fa0 0x7f3cb4072420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48178/0 (socket says 172.21.15.70:48178) 2023-11-26T07:18:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cb8cab640 1 -- 172.21.15.70:0/3064326622 learned_addr learned my addr 172.21.15.70:0/3064326622 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cabfff640 1 --2- 172.21.15.70:0/3064326622 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb406b190 0x7f3cb4146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cab7fe640 1 -- 172.21.15.70:0/3064326622 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804461359 0 0) 0x7f3cb4146380 con 0x7f3cb4145fa0 2023-11-26T07:18:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cab7fe640 1 -- 172.21.15.70:0/3064326622 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c9c003530 con 0x7f3cb4145fa0 2023-11-26T07:18:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cab7fe640 1 -- 172.21.15.70:0/3064326622 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668609113 0 0) 0x7f3cb4071660 con 0x7f3cb406a490 2023-11-26T07:18:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cab7fe640 1 -- 172.21.15.70:0/3064326622 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb4146380 con 0x7f3cb406a490 2023-11-26T07:18:51.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cabfff640 1 -- 172.21.15.70:0/3064326622 >> v1:172.21.15.120:6789/0 conn(0x7f3cb406a490 legacy=0x7f3cb406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cabfff640 1 -- 172.21.15.70:0/3064326622 >> v1:172.21.15.70:6789/0 conn(0x7f3cb4145fa0 legacy=0x7f3cb4072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.573+0000 7f3cabfff640 1 -- 172.21.15.70:0/3064326622 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4071940 con 0x7f3cb406b190 2023-11-26T07:18:51.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cabfff640 1 --2- 172.21.15.70:0/3064326622 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb406b190 0x7f3cb4146530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40097f0 tx=0x7f3ca401cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22ef8f42afc2a34 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cab7fe640 1 -- 172.21.15.70:0/3064326622 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40aa610 con 0x7f3cb406b190 2023-11-26T07:18:51.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cab7fe640 1 -- 172.21.15.70:0/3064326622 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca40a6040 con 0x7f3cb406b190 2023-11-26T07:18:51.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cab7fe640 1 -- 172.21.15.70:0/3064326622 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40aa990 con 0x7f3cb406b190 2023-11-26T07:18:51.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/3064326622 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb406b190 msgr2=0x7f3cb4146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/3064326622 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb406b190 0x7f3cb4146530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40097f0 tx=0x7f3ca401cef0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/3064326622 shutdown_connections 2023-11-26T07:18:51.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/3064326622 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb406b190 0x7f3cb4146530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/3064326622 >> 172.21.15.70:0/3064326622 conn(0x7f3cb40cff00 msgr2=0x7f3cb40d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:51.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/3064326622 shutdown_connections 2023-11-26T07:18:51.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.577+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/3064326622 wait complete. 2023-11-26T07:18:51.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 Processor -- start 2023-11-26T07:18:51.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 -- start start 2023-11-26T07:18:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a490 0x7f3cb4159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3cb406b190 0x7f3cb4134900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb4145fa0 0x7f3cb4134e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4072000 con 0x7f3cb406a490 2023-11-26T07:18:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb413ffa0 con 0x7f3cb406b190 2023-11-26T07:18:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb413f390 con 0x7f3cb4145fa0 2023-11-26T07:18:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a490 0x7f3cb4159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a490 0x7f3cb4159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42558/0 (socket says 172.21.15.70:42558) 2023-11-26T07:18:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 -- 172.21.15.70:0/2942765391 learned_addr learned my addr 172.21.15.70:0/2942765391 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 -- 172.21.15.70:0/2942765391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb4145fa0 msgr2=0x7f3cb4134e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb4145fa0 0x7f3cb4134e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 -- 172.21.15.70:0/2942765391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3cb406b190 msgr2=0x7f3cb4134900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3cb406b190 0x7f3cb4134900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 -- 172.21.15.70:0/2942765391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009420 con 0x7f3cb406a490 2023-11-26T07:18:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cb8cab640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a490 0x7f3cb4159dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c4d0 tx=0x7f3cb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3ca97fa640 1 -- 172.21.15.70:0/2942765391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0005cf0 con 0x7f3cb406a490 2023-11-26T07:18:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3ca97fa640 1 -- 172.21.15.70:0/2942765391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb0005e50 con 0x7f3cb406a490 2023-11-26T07:18:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3ca97fa640 1 -- 172.21.15.70:0/2942765391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0007270 con 0x7f3cb406a490 2023-11-26T07:18:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb413f670 con 0x7f3cb406a490 2023-11-26T07:18:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.581+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb413fc30 con 0x7f3cb406a490 2023-11-26T07:18:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.585+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4140410 con 0x7f3cb406a490 2023-11-26T07:18:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.585+0000 7f3ca97fa640 1 -- 172.21.15.70:0/2942765391 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3cb00073d0 con 0x7f3cb406a490 2023-11-26T07:18:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.585+0000 7f3ca97fa640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3ca0066470 0x7f3ca0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.585+0000 7f3ca97fa640 1 -- 172.21.15.70:0/2942765391 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3cb00833c0 con 0x7f3cb406a490 2023-11-26T07:18:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.585+0000 7f3cabfff640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3ca0066470 0x7f3ca0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.585+0000 7f3cabfff640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3ca0066470 0x7f3ca0068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40ae000 tx=0x7f3ca4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.589+0000 7f3ca97fa640 1 -- 172.21.15.70:0/2942765391 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3cb4140410 con 0x7f3cb406a490 2023-11-26T07:18:51.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.741+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cb4140410 con 0x7f3cb406a490 2023-11-26T07:18:51.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.741+0000 7f3ca97fa640 1 -- 172.21.15.70:0/2942765391 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16755 (secure 0 0 0) 0x7f3cb4140410 con 0x7f3cb406a490 2023-11-26T07:18:51.745 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:51.745 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:45.864270+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:51.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.741+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3ca0066470 msgr2=0x7f3ca0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.741+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3ca0066470 0x7f3ca0068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40ae000 tx=0x7f3ca4008040 comp rx=0 tx=0).stop 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.741+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a490 msgr2=0x7f3cb4159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.741+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a490 0x7f3cb4159dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c4d0 tx=0x7f3cb000c990 comp rx=0 tx=0).stop 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 shutdown_connections 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3cb4145fa0 0x7f3cb4134e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3cb406b190 0x7f3cb4134900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3ca0066470 0x7f3ca0068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 --2- 172.21.15.70:0/2942765391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3cb406a490 0x7f3cb4159dd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 >> 172.21.15.70:0/2942765391 conn(0x7f3cb40cff00 msgr2=0x7f3cb40af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 shutdown_connections 2023-11-26T07:18:51.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.745+0000 7f3cbaf0f640 1 -- 172.21.15.70:0/2942765391 wait complete. 2023-11-26T07:18:51.767 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:18:51.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:51.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.901+0000 7f36ed009640 1 Processor -- start 2023-11-26T07:18:51.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36ed009640 1 -- start start 2023-11-26T07:18:51.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36ed009640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f36e80d3d30 0x7f36e80cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36ed009640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80d4170 con 0x7f36e8160f60 2023-11-26T07:18:51.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36ed009640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80cdfd0 con 0x7f36e8160850 2023-11-26T07:18:51.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36ed009640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e80ce290 con 0x7f36e80d3d30 2023-11-26T07:18:51.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36ec808640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f36e8160f60 0x7f36e80b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48190/0 (socket says 172.21.15.70:48190) 2023-11-26T07:18:51.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36ec808640 1 -- 172.21.15.70:0/3139878480 learned_addr learned my addr 172.21.15.70:0/3139878480 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:51.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e77fe640 1 --2- 172.21.15.70:0/3139878480 >> v2:172.21.15.120:3300/0 conn(0x7f36e80d3d30 0x7f36e80cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e6ffd640 1 -- 172.21.15.70:0/3139878480 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533891436 0 0) 0x7f36e80d4170 con 0x7f36e8160f60 2023-11-26T07:18:51.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e6ffd640 1 -- 172.21.15.70:0/3139878480 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d0003530 con 0x7f36e8160f60 2023-11-26T07:18:51.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e6ffd640 1 -- 172.21.15.70:0/3139878480 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021483153 0 0) 0x7f36e80cdfd0 con 0x7f36e8160850 2023-11-26T07:18:51.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e6ffd640 1 -- 172.21.15.70:0/3139878480 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e80d4170 con 0x7f36e8160850 2023-11-26T07:18:51.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e77fe640 1 -- 172.21.15.70:0/3139878480 >> v1:172.21.15.120:6789/0 conn(0x7f36e8160850 legacy=0x7f36e80cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e77fe640 1 -- 172.21.15.70:0/3139878480 >> v1:172.21.15.70:6789/0 conn(0x7f36e8160f60 legacy=0x7f36e80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.905+0000 7f36e77fe640 1 -- 172.21.15.70:0/3139878480 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80ce570 con 0x7f36e80d3d30 2023-11-26T07:18:51.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36e77fe640 1 --2- 172.21.15.70:0/3139878480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e80d3d30 0x7f36e80cda90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097c0 tx=0x7f36dc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cf0604f5ec4e4e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36e6ffd640 1 -- 172.21.15.70:0/3139878480 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0ab670 con 0x7f36e80d3d30 2023-11-26T07:18:51.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36e6ffd640 1 -- 172.21.15.70:0/3139878480 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc0ab7d0 con 0x7f36e80d3d30 2023-11-26T07:18:51.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36e6ffd640 1 -- 172.21.15.70:0/3139878480 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0abb60 con 0x7f36e80d3d30 2023-11-26T07:18:51.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 -- 172.21.15.70:0/3139878480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e80d3d30 msgr2=0x7f36e80cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 --2- 172.21.15.70:0/3139878480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e80d3d30 0x7f36e80cda90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0097c0 tx=0x7f36dc01c450 comp rx=0 tx=0).stop 2023-11-26T07:18:51.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 -- 172.21.15.70:0/3139878480 shutdown_connections 2023-11-26T07:18:51.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 --2- 172.21.15.70:0/3139878480 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e80d3d30 0x7f36e80cda90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 -- 172.21.15.70:0/3139878480 >> 172.21.15.70:0/3139878480 conn(0x7f36e809c5a0 msgr2=0x7f36e80d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:51.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 -- 172.21.15.70:0/3139878480 shutdown_connections 2023-11-26T07:18:51.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 -- 172.21.15.70:0/3139878480 wait complete. 2023-11-26T07:18:51.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.909+0000 7f36ed009640 1 Processor -- start 2023-11-26T07:18:51.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 -- start start 2023-11-26T07:18:51.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f36e80d3d30 0x7f36e815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e8160850 0x7f36e809d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36e8160f60 0x7f36e815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e815b0a0 con 0x7f36e8160f60 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e815dbf0 con 0x7f36e8160850 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e815ded0 con 0x7f36e80d3d30 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36e8160f60 0x7f36e815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36e8160f60 0x7f36e815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42566/0 (socket says 172.21.15.70:42566) 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 -- 172.21.15.70:0/428576246 learned_addr learned my addr 172.21.15.70:0/428576246 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36e77fe640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e8160850 0x7f36e809d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36e7fff640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f36e80d3d30 0x7f36e815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 -- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f36e80d3d30 msgr2=0x7f36e815ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f36e80d3d30 0x7f36e815ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 -- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e8160850 msgr2=0x7f36e809d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e8160850 0x7f36e809d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 -- 172.21.15.70:0/428576246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009420 con 0x7f36e8160f60 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ec808640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36e8160f60 0x7f36e815ec90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36e000caf0 tx=0x7f36e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36e4ff9640 1 -- 172.21.15.70:0/428576246 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e000aca0 con 0x7f36e8160f60 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36e4ff9640 1 -- 172.21.15.70:0/428576246 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e000ae00 con 0x7f36e8160f60 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36e4ff9640 1 -- 172.21.15.70:0/428576246 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0012620 con 0x7f36e8160f60 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e815e1b0 con 0x7f36e8160f60 2023-11-26T07:18:51.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e815e770 con 0x7f36e8160f60 2023-11-26T07:18:51.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.913+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e815e960 con 0x7f36e8160f60 2023-11-26T07:18:51.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.917+0000 7f36e4ff9640 1 -- 172.21.15.70:0/428576246 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36e0007070 con 0x7f36e8160f60 2023-11-26T07:18:51.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.917+0000 7f36e4ff9640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f36d4066470 0x7f36d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:51.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.917+0000 7f36e4ff9640 1 -- 172.21.15.70:0/428576246 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f36e0083d60 con 0x7f36e8160f60 2023-11-26T07:18:51.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.917+0000 7f36e7fff640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f36d4066470 0x7f36d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:51.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.917+0000 7f36e7fff640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f36d4066470 0x7f36d4068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f36d80011f0 tx=0x7f36d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:51.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:51.921+0000 7f36e4ff9640 1 -- 172.21.15.70:0/428576246 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36e00512a0 con 0x7f36e8160f60 2023-11-26T07:18:52.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e8067500 con 0x7f36e8160f60 2023-11-26T07:18:52.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36e4ff9640 1 -- 172.21.15.70:0/428576246 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f36e0017090 con 0x7f36e8160f60 2023-11-26T07:18:52.109 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:52.109 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:52.109 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f36d4066470 msgr2=0x7f36d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f36d4066470 0x7f36d4068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f36d80011f0 tx=0x7f36d8009040 comp rx=0 tx=0).stop 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36e8160f60 msgr2=0x7f36e815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36e8160f60 0x7f36e815ec90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36e000caf0 tx=0x7f36e000a060 comp rx=0 tx=0).stop 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 shutdown_connections 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f36d4066470 0x7f36d4068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36e8160f60 0x7f36e815ec90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36e8160850 0x7f36e809d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 --2- 172.21.15.70:0/428576246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f36e80d3d30 0x7f36e815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 >> 172.21.15.70:0/428576246 conn(0x7f36e809c5a0 msgr2=0x7f36e815bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 shutdown_connections 2023-11-26T07:18:52.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.105+0000 7f36ed009640 1 -- 172.21.15.70:0/428576246 wait complete. 2023-11-26T07:18:52.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:18:52.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c5b854640 1 Processor -- start 2023-11-26T07:18:52.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c5b854640 1 -- start start 2023-11-26T07:18:52.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c5b854640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c540cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c5b854640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c540cfc20 con 0x7f2c54143ac0 2023-11-26T07:18:52.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c5b854640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c540cc730 con 0x7f2c540cd1b0 2023-11-26T07:18:52.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c5b854640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54143ea0 con 0x7f2c540cf280 2023-11-26T07:18:52.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c595f0640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2c54143ac0 0x7f2c54070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48198/0 (socket says 172.21.15.70:48198) 2023-11-26T07:18:52.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c595f0640 1 -- 172.21.15.70:0/1539273875 learned_addr learned my addr 172.21.15.70:0/1539273875 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c58def640 1 --2- 172.21.15.70:0/1539273875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c540cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c4bfff640 1 -- 172.21.15.70:0/1539273875 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708452099 0 0) 0x7f2c540cfc20 con 0x7f2c54143ac0 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c4bfff640 1 -- 172.21.15.70:0/1539273875 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c40003530 con 0x7f2c54143ac0 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c4bfff640 1 -- 172.21.15.70:0/1539273875 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350016986 0 0) 0x7f2c540cc730 con 0x7f2c540cd1b0 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c4bfff640 1 -- 172.21.15.70:0/1539273875 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c540cfc20 con 0x7f2c540cd1b0 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c58def640 1 -- 172.21.15.70:0/1539273875 >> v1:172.21.15.120:6789/0 conn(0x7f2c540cd1b0 legacy=0x7f2c540cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c58def640 1 -- 172.21.15.70:0/1539273875 >> v1:172.21.15.70:6789/0 conn(0x7f2c54143ac0 legacy=0x7f2c54070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.265+0000 7f2c58def640 1 -- 172.21.15.70:0/1539273875 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54070ee0 con 0x7f2c540cf280 2023-11-26T07:18:52.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c58def640 1 --2- 172.21.15.70:0/1539273875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c540cf6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c440097f0 tx=0x7f2c4401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20636c913d4c396f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c4bfff640 1 -- 172.21.15.70:0/1539273875 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440aa620 con 0x7f2c540cf280 2023-11-26T07:18:52.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c4bfff640 1 -- 172.21.15.70:0/1539273875 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440aa780 con 0x7f2c540cf280 2023-11-26T07:18:52.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c4bfff640 1 -- 172.21.15.70:0/1539273875 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440aab10 con 0x7f2c540cf280 2023-11-26T07:18:52.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c5b854640 1 -- 172.21.15.70:0/1539273875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 msgr2=0x7f2c540cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1539273875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c540cf6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c440097f0 tx=0x7f2c4401c4c0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c5b854640 1 -- 172.21.15.70:0/1539273875 shutdown_connections 2023-11-26T07:18:52.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1539273875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c540cf6e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c5b854640 1 -- 172.21.15.70:0/1539273875 >> 172.21.15.70:0/1539273875 conn(0x7f2c5406a890 msgr2=0x7f2c5406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:52.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c5b854640 1 -- 172.21.15.70:0/1539273875 shutdown_connections 2023-11-26T07:18:52.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.269+0000 7f2c5b854640 1 -- 172.21.15.70:0/1539273875 wait complete. 2023-11-26T07:18:52.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 Processor -- start 2023-11-26T07:18:52.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 -- start start 2023-11-26T07:18:52.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c540cd1b0 0x7f2c5413fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c5413aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c54143ac0 0x7f2c54141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5415c820 con 0x7f2c540cd1b0 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5413b000 con 0x7f2c54143ac0 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5415bba0 con 0x7f2c540cf280 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c540cd1b0 0x7f2c5413fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c540cd1b0 0x7f2c5413fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42572/0 (socket says 172.21.15.70:42572) 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 -- 172.21.15.70:0/1524110132 learned_addr learned my addr 172.21.15.70:0/1524110132 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c58def640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c5413aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c59df1640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c54143ac0 0x7f2c54141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 -- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 msgr2=0x7f2c5413aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c5413aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 -- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c54143ac0 msgr2=0x7f2c54141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c54143ac0 0x7f2c54141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 -- 172.21.15.70:0/1524110132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44009420 con 0x7f2c540cd1b0 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c59df1640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c54143ac0 0x7f2c54141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c595f0640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c540cd1b0 0x7f2c5413fcc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000c4f0 tx=0x7f2c5000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c49ffb640 1 -- 172.21.15.70:0/1524110132 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50005cf0 con 0x7f2c540cd1b0 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c49ffb640 1 -- 172.21.15.70:0/1524110132 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c50005e50 con 0x7f2c540cd1b0 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5415be80 con 0x7f2c540cd1b0 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c49ffb640 1 -- 172.21.15.70:0/1524110132 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50007270 con 0x7f2c540cd1b0 2023-11-26T07:18:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.273+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5415c440 con 0x7f2c540cd1b0 2023-11-26T07:18:52.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.277+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5415c960 con 0x7f2c540cd1b0 2023-11-26T07:18:52.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.277+0000 7f2c49ffb640 1 -- 172.21.15.70:0/1524110132 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c500073d0 con 0x7f2c540cd1b0 2023-11-26T07:18:52.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.277+0000 7f2c49ffb640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c38066470 0x7f2c38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.277+0000 7f2c49ffb640 1 -- 172.21.15.70:0/1524110132 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2c50083320 con 0x7f2c540cd1b0 2023-11-26T07:18:52.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.277+0000 7f2c58def640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c38066470 0x7f2c38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.277+0000 7f2c58def640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c38066470 0x7f2c38068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c440ae000 tx=0x7f2c440a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.281+0000 7f2c49ffb640 1 -- 172.21.15.70:0/1524110132 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c50050860 con 0x7f2c540cd1b0 2023-11-26T07:18:52.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.461+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c54067680 con 0x7f2c540cd1b0 2023-11-26T07:18:52.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.461+0000 7f2c49ffb640 1 -- 172.21.15.70:0/1524110132 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f2c50053e80 con 0x7f2c540cd1b0 2023-11-26T07:18:52.467 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:52.467 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/595372215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":595372215},{"type":"v1","addr":"172.21.15.120:6835","nonce":595372215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/4126219384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4126219384},{"type":"v1","addr":"172.21.15.70:6836","nonce":4126219384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1621043190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":1621043190},{"type":"v1","addr":"172.21.15.70:6837","nonce":1621043190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:18:03.482099+0000","modified":"2023-11-26T07:18:06.487816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6833/559747401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":559747401},{"type":"v1","addr":"172.21.15.120:6833","nonce":559747401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-26T07:18:52.467 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c38066470 msgr2=0x7f2c38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c38066470 0x7f2c38068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c440ae000 tx=0x7f2c440a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c540cd1b0 msgr2=0x7f2c5413fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c540cd1b0 0x7f2c5413fcc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000c4f0 tx=0x7f2c5000c9b0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 shutdown_connections 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c54143ac0 0x7f2c54141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c540cf280 0x7f2c5413aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c38066470 0x7f2c38068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 --2- 172.21.15.70:0/1524110132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c540cd1b0 0x7f2c5413fcc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 >> 172.21.15.70:0/1524110132 conn(0x7f2c5406a890 msgr2=0x7f2c540b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 shutdown_connections 2023-11-26T07:18:52.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.465+0000 7f2c5b854640 1 -- 172.21.15.70:0/1524110132 wait complete. 2023-11-26T07:18:52.487 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:18:52.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e399a0640 1 Processor -- start 2023-11-26T07:18:52.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e399a0640 1 -- start start 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e399a0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e3415d230 0x7f3e340d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e399a0640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d610 0x7f3e340cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e399a0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e340ce180 con 0x7f3e340cfaa0 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e399a0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e340ce3b0 con 0x7f3e3415d230 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e399a0640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340ce690 con 0x7f3e3415d610 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e3899e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e3415d230 0x7f3e340d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e3919f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3e340cfaa0 0x7f3e340b3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48204/0 (socket says 172.21.15.70:48204) 2023-11-26T07:18:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e3919f640 1 -- 172.21.15.70:0/1891749128 learned_addr learned my addr 172.21.15.70:0/1891749128 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e2bfff640 1 --2- 172.21.15.70:0/1891749128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d610 0x7f3e340cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e3899e640 1 -- 172.21.15.70:0/1891749128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d610 msgr2=0x7f3e340cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e3899e640 1 --2- 172.21.15.70:0/1891749128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d610 0x7f3e340cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e3899e640 1 -- 172.21.15.70:0/1891749128 >> v1:172.21.15.70:6789/0 conn(0x7f3e340cfaa0 legacy=0x7f3e340b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e3899e640 1 -- 172.21.15.70:0/1891749128 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340ce970 con 0x7f3e3415d230 2023-11-26T07:18:52.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.621+0000 7f3e2b7fe640 1 -- 172.21.15.70:0/1891749128 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309050835 0 0) 0x7f3e340ce180 con 0x7f3e340cfaa0 2023-11-26T07:18:52.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e3899e640 1 --2- 172.21.15.70:0/1891749128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e3415d230 0x7f3e340d3be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3e300097c0 tx=0x7f3e3001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853270795024c225 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e2b7fe640 1 -- 172.21.15.70:0/1891749128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300ab5f0 con 0x7f3e3415d230 2023-11-26T07:18:52.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e2b7fe640 1 -- 172.21.15.70:0/1891749128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e300ab750 con 0x7f3e3415d230 2023-11-26T07:18:52.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e2b7fe640 1 -- 172.21.15.70:0/1891749128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300abae0 con 0x7f3e3415d230 2023-11-26T07:18:52.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 -- 172.21.15.70:0/1891749128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e3415d230 msgr2=0x7f3e340d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1891749128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e3415d230 0x7f3e340d3be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3e300097c0 tx=0x7f3e3001c3f0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 -- 172.21.15.70:0/1891749128 shutdown_connections 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1891749128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d610 0x7f3e340cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1891749128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e3415d230 0x7f3e340d3be0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 -- 172.21.15.70:0/1891749128 >> 172.21.15.70:0/1891749128 conn(0x7f3e340d30c0 msgr2=0x7f3e340d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 -- 172.21.15.70:0/1891749128 shutdown_connections 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.625+0000 7f3e399a0640 1 -- 172.21.15.70:0/1891749128 wait complete. 2023-11-26T07:18:52.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 Processor -- start 2023-11-26T07:18:52.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 -- start start 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e340cfaa0 0x7f3e340c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d230 0x7f3e34153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e3415d610 0x7f3e3415f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340cb900 con 0x7f3e340cfaa0 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340cc480 con 0x7f3e3415d610 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e340cbb50 con 0x7f3e3415d230 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e340cfaa0 0x7f3e340c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e340cfaa0 0x7f3e340c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42600/0 (socket says 172.21.15.70:42600) 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 -- 172.21.15.70:0/1201978697 learned_addr learned my addr 172.21.15.70:0/1201978697 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e2bfff640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d230 0x7f3e34153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3919f640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e3415d610 0x7f3e3415f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 -- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d230 msgr2=0x7f3e34153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d230 0x7f3e34153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 -- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e3415d610 msgr2=0x7f3e3415f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e3415d610 0x7f3e3415f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 -- 172.21.15.70:0/1201978697 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30009420 con 0x7f3e340cfaa0 2023-11-26T07:18:52.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e3899e640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e340cfaa0 0x7f3e340c8bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3e300ad040 tx=0x7f3e3001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e297fa640 1 -- 172.21.15.70:0/1201978697 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30004220 con 0x7f3e340cfaa0 2023-11-26T07:18:52.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e297fa640 1 -- 172.21.15.70:0/1201978697 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e300b9070 con 0x7f3e340cfaa0 2023-11-26T07:18:52.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e297fa640 1 -- 172.21.15.70:0/1201978697 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30003620 con 0x7f3e340cfaa0 2023-11-26T07:18:52.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e340cbe30 con 0x7f3e340cfaa0 2023-11-26T07:18:52.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.629+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e340c9100 con 0x7f3e340cfaa0 2023-11-26T07:18:52.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.633+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e34067c10 con 0x7f3e340cfaa0 2023-11-26T07:18:52.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.633+0000 7f3e297fa640 1 -- 172.21.15.70:0/1201978697 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e30003780 con 0x7f3e340cfaa0 2023-11-26T07:18:52.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.633+0000 7f3e297fa640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e20066470 0x7f3e20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.633+0000 7f3e297fa640 1 -- 172.21.15.70:0/1201978697 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3e300bb070 con 0x7f3e340cfaa0 2023-11-26T07:18:52.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.633+0000 7f3e2bfff640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e20066470 0x7f3e20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.633+0000 7f3e2bfff640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e20066470 0x7f3e20068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e34155e70 tx=0x7f3e24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.637+0000 7f3e297fa640 1 -- 172.21.15.70:0/1201978697 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e300ebba0 con 0x7f3e340cfaa0 2023-11-26T07:18:52.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e340d1480 con 0x7f3e340cfaa0 2023-11-26T07:18:52.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e297fa640 1 -- 172.21.15.70:0/1201978697 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16755 (secure 0 0 0) 0x7f3e300c4090 con 0x7f3e340cfaa0 2023-11-26T07:18:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:18:52.793 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:18:45.864270+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:18:01.934679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-26T07:18:02.464153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.24","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:18:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e20066470 msgr2=0x7f3e20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e20066470 0x7f3e20068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e34155e70 tx=0x7f3e24008040 comp rx=0 tx=0).stop 2023-11-26T07:18:52.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e340cfaa0 msgr2=0x7f3e340c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e340cfaa0 0x7f3e340c8bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3e300ad040 tx=0x7f3e3001ac30 comp rx=0 tx=0).stop 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 shutdown_connections 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e3415d610 0x7f3e3415f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e3415d230 0x7f3e34153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e20066470 0x7f3e20068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 --2- 172.21.15.70:0/1201978697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e340cfaa0 0x7f3e340c8bc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 >> 172.21.15.70:0/1201978697 conn(0x7f3e340d30c0 msgr2=0x7f3e340cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.789+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 shutdown_connections 2023-11-26T07:18:52.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.793+0000 7f3e399a0640 1 -- 172.21.15.70:0/1201978697 wait complete. 2023-11-26T07:18:52.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:18:52.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 Processor -- start 2023-11-26T07:18:52.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 -- start start 2023-11-26T07:18:52.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa31415d6e0 0x7fa3140d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa3140d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa3140d19f0 0x7fa3140cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31415dac0 con 0x7fa3140d19f0 2023-11-26T07:18:52.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3140d1e80 con 0x7fa31415d6e0 2023-11-26T07:18:52.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa318d72640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140cf0e0 con 0x7fa3140b2160 2023-11-26T07:18:52.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa3140d19f0 0x7fa3140cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa3140d19f0 0x7fa3140cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42606/0 (socket says 172.21.15.70:42606) 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 -- 172.21.15.70:0/305579254 learned_addr learned my addr 172.21.15.70:0/305579254 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa31259c640 1 --2- 172.21.15.70:0/305579254 >> v2:172.21.15.120:3300/0 conn(0x7fa31415d6e0 0x7fa3140d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa311d9b640 1 --2- 172.21.15.70:0/305579254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa3140d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 -- 172.21.15.70:0/305579254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 msgr2=0x7fa3140d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 --2- 172.21.15.70:0/305579254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa3140d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 -- 172.21.15.70:0/305579254 >> v2:172.21.15.120:3300/0 conn(0x7fa31415d6e0 msgr2=0x7fa3140d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 --2- 172.21.15.70:0/305579254 >> v2:172.21.15.120:3300/0 conn(0x7fa31415d6e0 0x7fa3140d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa312d9d640 1 -- 172.21.15.70:0/305579254 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140ceb20 con 0x7fa3140d19f0 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa311d9b640 1 --2- 172.21.15.70:0/305579254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa3140d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:52.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.953+0000 7fa31259c640 1 --2- 172.21.15.70:0/305579254 >> v2:172.21.15.120:3300/0 conn(0x7fa31415d6e0 0x7fa3140d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:18:52.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa312d9d640 1 --2- 172.21.15.70:0/305579254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3140d19f0 0x7fa3140cfbf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa3140b5db0 tx=0x7fa30c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456d0e55dfdd3306 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa31159a640 1 -- 172.21.15.70:0/305579254 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a6490 con 0x7fa3140d19f0 2023-11-26T07:18:52.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa31159a640 1 -- 172.21.15.70:0/305579254 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0a65f0 con 0x7fa3140d19f0 2023-11-26T07:18:52.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa31159a640 1 -- 172.21.15.70:0/305579254 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a6980 con 0x7fa3140d19f0 2023-11-26T07:18:52.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 -- 172.21.15.70:0/305579254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3140d19f0 msgr2=0x7fa3140cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 --2- 172.21.15.70:0/305579254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3140d19f0 0x7fa3140cfbf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa3140b5db0 tx=0x7fa30c01c710 comp rx=0 tx=0).stop 2023-11-26T07:18:52.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 -- 172.21.15.70:0/305579254 shutdown_connections 2023-11-26T07:18:52.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 --2- 172.21.15.70:0/305579254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3140d19f0 0x7fa3140cfbf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 --2- 172.21.15.70:0/305579254 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa3140d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 --2- 172.21.15.70:0/305579254 >> v2:172.21.15.120:3300/0 conn(0x7fa31415d6e0 0x7fa3140d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 -- 172.21.15.70:0/305579254 >> 172.21.15.70:0/305579254 conn(0x7fa31409c550 msgr2=0x7fa3140d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:52.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 -- 172.21.15.70:0/305579254 shutdown_connections 2023-11-26T07:18:52.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.957+0000 7fa318d72640 1 -- 172.21.15.70:0/305579254 wait complete. 2023-11-26T07:18:52.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 Processor -- start 2023-11-26T07:18:52.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 -- start start 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa314157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3140d19f0 0x7fa3140cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa31415d6e0 0x7fa314155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140b88b0 con 0x7fa31415d6e0 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140cc030 con 0x7fa3140d19f0 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa314156030 con 0x7fa3140b2160 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa31415d6e0 0x7fa314155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa31415d6e0 0x7fa314155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42618/0 (socket says 172.21.15.70:42618) 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 -- 172.21.15.70:0/1877630858 learned_addr learned my addr 172.21.15.70:0/1877630858 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa31259c640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa314157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa311d9b640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3140d19f0 0x7fa3140cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 -- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 msgr2=0x7fa314157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa314157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 -- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3140d19f0 msgr2=0x7fa3140cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3140d19f0 0x7fa3140cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 -- 172.21.15.70:0/1877630858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009b30 con 0x7fa31415d6e0 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa312d9d640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa31415d6e0 0x7fa314155af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa30c01cfb0 tx=0x7fa30c0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa302ffd640 1 -- 172.21.15.70:0/1877630858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a7670 con 0x7fa31415d6e0 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa302ffd640 1 -- 172.21.15.70:0/1877630858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0a77d0 con 0x7fa31415d6e0 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa302ffd640 1 -- 172.21.15.70:0/1877630858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a7b80 con 0x7fa31415d6e0 2023-11-26T07:18:52.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.961+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3140cc260 con 0x7fa31415d6e0 2023-11-26T07:18:52.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.965+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3140cc820 con 0x7fa31415d6e0 2023-11-26T07:18:52.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.965+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa314067680 con 0x7fa31415d6e0 2023-11-26T07:18:52.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.965+0000 7fa302ffd640 1 -- 172.21.15.70:0/1877630858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa30c0a7ce0 con 0x7fa31415d6e0 2023-11-26T07:18:52.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.965+0000 7fa302ffd640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa2f4066470 0x7fa2f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:52.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.965+0000 7fa302ffd640 1 -- 172.21.15.70:0/1877630858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa30c11e6f0 con 0x7fa31415d6e0 2023-11-26T07:18:52.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.965+0000 7fa31259c640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa2f4066470 0x7fa2f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:52.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.965+0000 7fa31259c640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa2f4066470 0x7fa2f4068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa31406cb50 tx=0x7fa304008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:52.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:52.969+0000 7fa302ffd640 1 -- 172.21.15.70:0/1877630858 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa30c0ebbc0 con 0x7fa31415d6e0 2023-11-26T07:18:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.153+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa314067cb0 con 0x7fa31415d6e0 2023-11-26T07:18:53.159 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-11-26T07:18:53.153+0000 7fe8c07be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:18:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.157+0000 7fa302ffd640 1 -- 172.21.15.70:0/1877630858 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa30c009510 con 0x7fa31415d6e0 2023-11-26T07:18:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:18:53.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa2f4066470 msgr2=0x7fa2f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:53.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa2f4066470 0x7fa2f4068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa31406cb50 tx=0x7fa304008040 comp rx=0 tx=0).stop 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa31415d6e0 msgr2=0x7fa314155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa31415d6e0 0x7fa314155af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa30c01cfb0 tx=0x7fa30c0194b0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 shutdown_connections 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa2f4066470 0x7fa2f4068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa31415d6e0 0x7fa314155af0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3140d19f0 0x7fa3140cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 --2- 172.21.15.70:0/1877630858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa3140b2160 0x7fa314157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 >> 172.21.15.70:0/1877630858 conn(0x7fa31409c550 msgr2=0x7fa3140d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:53.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 shutdown_connections 2023-11-26T07:18:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.161+0000 7fa318d72640 1 -- 172.21.15.70:0/1877630858 wait complete. 2023-11-26T07:18:53.171 INFO:tasks.ceph.mds.d.smithi120.stderr: -2816> 2023-11-26T07:18:08.322+0000 7efed5ed8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:18:53.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:18:53.222 INFO:tasks.ceph.mds.d.smithi120.stdout:starting mds.d at 2023-11-26T07:18:53.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.317+0000 7fbf35ad6640 1 Processor -- start 2023-11-26T07:18:53.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf35ad6640 1 -- start start 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf35ad6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbf300d1bc0 0x7fbf300d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf35ad6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300cf0e0 con 0x7fbf3015d6e0 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf35ad6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300ceb20 con 0x7fbf300b2160 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf35ad6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3015dac0 con 0x7fbf300d1bc0 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf2f7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbf3015d6e0 0x7fbf300d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:48206/0 (socket says 172.21.15.70:48206) 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf2f7fe640 1 -- 172.21.15.70:0/2451457242 learned_addr learned my addr 172.21.15.70:0/2451457242 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf27fff640 1 --2- 172.21.15.70:0/2451457242 >> v2:172.21.15.120:3300/0 conn(0x7fbf300d1bc0 0x7fbf300d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf2effd640 1 -- 172.21.15.70:0/2451457242 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198381715 0 0) 0x7fbf300cf0e0 con 0x7fbf3015d6e0 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf2effd640 1 -- 172.21.15.70:0/2451457242 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf1c003530 con 0x7fbf3015d6e0 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf2effd640 1 -- 172.21.15.70:0/2451457242 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557836889 0 0) 0x7fbf300ceb20 con 0x7fbf300b2160 2023-11-26T07:18:53.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf2effd640 1 -- 172.21.15.70:0/2451457242 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf300cf0e0 con 0x7fbf300b2160 2023-11-26T07:18:53.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf27fff640 1 -- 172.21.15.70:0/2451457242 >> v1:172.21.15.120:6789/0 conn(0x7fbf300b2160 legacy=0x7fbf300b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:53.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf27fff640 1 -- 172.21.15.70:0/2451457242 >> v1:172.21.15.70:6789/0 conn(0x7fbf3015d6e0 legacy=0x7fbf300d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:53.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.321+0000 7fbf27fff640 1 -- 172.21.15.70:0/2451457242 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300cee00 con 0x7fbf300d1bc0 2023-11-26T07:18:53.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf27fff640 1 --2- 172.21.15.70:0/2451457242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 0x7fbf300d0df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf180097c0 tx=0x7fbf1801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3f5054dc6b10ec server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:53.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf2effd640 1 -- 172.21.15.70:0/2451457242 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf180ab600 con 0x7fbf300d1bc0 2023-11-26T07:18:53.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf2effd640 1 -- 172.21.15.70:0/2451457242 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf180a7050 con 0x7fbf300d1bc0 2023-11-26T07:18:53.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf2effd640 1 -- 172.21.15.70:0/2451457242 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf180ab980 con 0x7fbf300d1bc0 2023-11-26T07:18:53.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 -- 172.21.15.70:0/2451457242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 msgr2=0x7fbf300d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/2451457242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 0x7fbf300d0df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf180097c0 tx=0x7fbf1801c480 comp rx=0 tx=0).stop 2023-11-26T07:18:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 -- 172.21.15.70:0/2451457242 shutdown_connections 2023-11-26T07:18:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/2451457242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 0x7fbf300d0df0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 -- 172.21.15.70:0/2451457242 >> 172.21.15.70:0/2451457242 conn(0x7fbf3009c550 msgr2=0x7fbf300d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 -- 172.21.15.70:0/2451457242 shutdown_connections 2023-11-26T07:18:53.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 -- 172.21.15.70:0/2451457242 wait complete. 2023-11-26T07:18:53.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 Processor -- start 2023-11-26T07:18:53.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.325+0000 7fbf35ad6640 1 -- start start 2023-11-26T07:18:53.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf300b2160 0x7fbf301596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:53.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 0x7fbf300b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:53.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf3015d6e0 0x7fbf30154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30159f60 con 0x7fbf3015d6e0 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3015a240 con 0x7fbf300d1bc0 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3015a520 con 0x7fbf300b2160 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf3015d6e0 0x7fbf30154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2f7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf300b2160 0x7fbf301596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf3015d6e0 0x7fbf30154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42630/0 (socket says 172.21.15.70:42630) 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 -- 172.21.15.70:0/1931705107 learned_addr learned my addr 172.21.15.70:0/1931705107 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf27fff640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 0x7fbf300b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 -- 172.21.15.70:0/1931705107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf300b2160 msgr2=0x7fbf301596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf300b2160 0x7fbf301596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 -- 172.21.15.70:0/1931705107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 msgr2=0x7fbf300b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:53.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 0x7fbf300b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 -- 172.21.15.70:0/1931705107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009420 con 0x7fbf3015d6e0 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2ffff640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf3015d6e0 0x7fbf30154330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c7a0 tx=0x7fbf2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2cff9640 1 -- 172.21.15.70:0/1931705107 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28003b80 con 0x7fbf3015d6e0 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2cff9640 1 -- 172.21.15.70:0/1931705107 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf28003ce0 con 0x7fbf3015d6e0 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf2cff9640 1 -- 172.21.15.70:0/1931705107 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800aa90 con 0x7fbf3015d6e0 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3015a800 con 0x7fbf3015d6e0 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf30159be0 con 0x7fbf3015d6e0 2023-11-26T07:18:53.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.329+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf30067680 con 0x7fbf3015d6e0 2023-11-26T07:18:53.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.333+0000 7fbf2cff9640 1 -- 172.21.15.70:0/1931705107 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf2800abf0 con 0x7fbf3015d6e0 2023-11-26T07:18:53.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.333+0000 7fbf2cff9640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf10066470 0x7fbf10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:53.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.333+0000 7fbf2cff9640 1 -- 172.21.15.70:0/1931705107 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fbf28083cc0 con 0x7fbf3015d6e0 2023-11-26T07:18:53.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.333+0000 7fbf2f7fe640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf10066470 0x7fbf10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:53.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.333+0000 7fbf2f7fe640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf10066470 0x7fbf10068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf20007fd0 tx=0x7fbf20007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:53.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.337+0000 7fbf2cff9640 1 -- 172.21.15.70:0/1931705107 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf2808a080 con 0x7fbf3015d6e0 2023-11-26T07:18:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:53.517+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf300d3500 con 0x7fbf3015d6e0 2023-11-26T07:18:54.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.157+0000 7fbf2cff9640 1 -- 172.21.15.70:0/1931705107 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf28051110 con 0x7fbf3015d6e0 2023-11-26T07:18:54.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf10066470 msgr2=0x7fbf10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf10066470 0x7fbf10068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf20007fd0 tx=0x7fbf20007d80 comp rx=0 tx=0).stop 2023-11-26T07:18:54.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf3015d6e0 msgr2=0x7fbf30154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf3015d6e0 0x7fbf30154330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c7a0 tx=0x7fbf2800cc60 comp rx=0 tx=0).stop 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 shutdown_connections 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf10066470 0x7fbf10068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf3015d6e0 0x7fbf30154330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf300d1bc0 0x7fbf300b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 --2- 172.21.15.70:0/1931705107 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf300b2160 0x7fbf301596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 >> 172.21.15.70:0/1931705107 conn(0x7fbf3009c550 msgr2=0x7fbf30154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 shutdown_connections 2023-11-26T07:18:54.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.161+0000 7fbf35ad6640 1 -- 172.21.15.70:0/1931705107 wait complete. 2023-11-26T07:18:54.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:18:54.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb39d1640 1 Processor -- start 2023-11-26T07:18:54.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb39d1640 1 -- start start 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb39d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac14b1e0 0x7f2eac0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb39d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2eac070fd0 0x7f2eac162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb39d1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0cfc20 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb39d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac162080 con 0x7f2eac070fd0 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb39d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac161d70 con 0x7f2eac14b1e0 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb1f6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2eac070fd0 0x7f2eac162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb1f6e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2eac070fd0 0x7f2eac162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45586/0 (socket says 172.21.15.70:45586) 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb1f6e640 1 -- 172.21.15.70:0/351282444 learned_addr learned my addr 172.21.15.70:0/351282444 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:54.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb176d640 1 --2- 172.21.15.70:0/351282444 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac14b1e0 0x7f2eac0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb1f6e640 1 -- 172.21.15.70:0/351282444 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac14b1e0 msgr2=0x7f2eac0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:54.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb1f6e640 1 --2- 172.21.15.70:0/351282444 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac14b1e0 0x7f2eac0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb1f6e640 1 -- 172.21.15.70:0/351282444 >> v1:172.21.15.120:6789/0 conn(0x7f2eac0cf7c0 legacy=0x7f2eac0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.325+0000 7f2eb1f6e640 1 -- 172.21.15.70:0/351282444 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac14b5c0 con 0x7f2eac070fd0 2023-11-26T07:18:54.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb1f6e640 1 --2- 172.21.15.70:0/351282444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac070fd0 0x7f2eac162510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009e50 tx=0x7f2ea401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90033e18c9b91d7e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2ea3fff640 1 -- 172.21.15.70:0/351282444 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40a58a0 con 0x7f2eac070fd0 2023-11-26T07:18:54.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2ea3fff640 1 -- 172.21.15.70:0/351282444 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40a5a00 con 0x7f2eac070fd0 2023-11-26T07:18:54.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2ea3fff640 1 -- 172.21.15.70:0/351282444 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40a5d90 con 0x7f2eac070fd0 2023-11-26T07:18:54.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 -- 172.21.15.70:0/351282444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac070fd0 msgr2=0x7f2eac162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/351282444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac070fd0 0x7f2eac162510 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009e50 tx=0x7f2ea401c9e0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 -- 172.21.15.70:0/351282444 shutdown_connections 2023-11-26T07:18:54.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/351282444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac070fd0 0x7f2eac162510 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/351282444 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac14b1e0 0x7f2eac0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 -- 172.21.15.70:0/351282444 >> 172.21.15.70:0/351282444 conn(0x7f2eac06a890 msgr2=0x7f2eac06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:54.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 -- 172.21.15.70:0/351282444 shutdown_connections 2023-11-26T07:18:54.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.329+0000 7f2eb39d1640 1 -- 172.21.15.70:0/351282444 wait complete. 2023-11-26T07:18:54.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 Processor -- start 2023-11-26T07:18:54.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 -- start start 2023-11-26T07:18:54.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac070fd0 0x7f2eac146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0cf7c0 0x7f2eac164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eac14b1e0 0x7f2eac1645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1618d0 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0aa2b0 con 0x7f2eac14b1e0 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac145990 con 0x7f2eac070fd0 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0cf7c0 0x7f2eac164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0cf7c0 0x7f2eac164090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45596/0 (socket says 172.21.15.70:45596) 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 -- 172.21.15.70:0/3702316561 learned_addr learned my addr 172.21.15.70:0/3702316561 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb176d640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac070fd0 0x7f2eac146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb1f6e640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eac14b1e0 0x7f2eac1645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 -- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac070fd0 msgr2=0x7f2eac146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac070fd0 0x7f2eac146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 -- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eac14b1e0 msgr2=0x7f2eac1645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eac14b1e0 0x7f2eac1645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:54.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 -- 172.21.15.70:0/3702316561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009b30 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb0f6c640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0cf7c0 0x7f2eac164090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c500 tx=0x7f2e9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2ea1ffb640 1 -- 172.21.15.70:0/3702316561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c005220 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2ea1ffb640 1 -- 172.21.15.70:0/3702316561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c005380 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2ea1ffb640 1 -- 172.21.15.70:0/3702316561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c007270 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac145c70 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.333+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac164b10 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.337+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac1457f0 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.337+0000 7f2ea1ffb640 1 -- 172.21.15.70:0/3702316561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e9c0073d0 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.337+0000 7f2ea1ffb640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2e90066470 0x7f2e90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:54.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.337+0000 7f2ea1ffb640 1 -- 172.21.15.70:0/3702316561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f2e9c0838d0 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.337+0000 7f2eb176d640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2e90066470 0x7f2e90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:54.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.337+0000 7f2eb176d640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2e90066470 0x7f2e90068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009a50 tx=0x7f2ea8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:54.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.341+0000 7f2ea1ffb640 1 -- 172.21.15.70:0/3702316561 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2eac1457f0 con 0x7f2eac0cf7c0 2023-11-26T07:18:54.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:54.489+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2eac1457f0 con 0x7f2eac0cf7c0 2023-11-26T07:18:55.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.161+0000 7f2ea1ffb640 1 -- 172.21.15.70:0/3702316561 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2eac1457f0 con 0x7f2eac0cf7c0 2023-11-26T07:18:55.165 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:18:55.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.161+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2e90066470 msgr2=0x7f2e90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.161+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2e90066470 0x7f2e90068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009a50 tx=0x7f2ea8008040 comp rx=0 tx=0).stop 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.161+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0cf7c0 msgr2=0x7f2eac164090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.161+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0cf7c0 0x7f2eac164090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c500 tx=0x7f2e9c00c9c0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 shutdown_connections 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2e90066470 0x7f2e90068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0cf7c0 0x7f2eac164090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eac14b1e0 0x7f2eac1645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 --2- 172.21.15.70:0/3702316561 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eac070fd0 0x7f2eac146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 >> 172.21.15.70:0/3702316561 conn(0x7f2eac06a890 msgr2=0x7f2eac14a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 shutdown_connections 2023-11-26T07:18:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.165+0000 7f2eb39d1640 1 -- 172.21.15.70:0/3702316561 wait complete. 2023-11-26T07:18:55.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:18:55.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f83504e3640 1 Processor -- start 2023-11-26T07:18:55.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f83504e3640 1 -- start start 2023-11-26T07:18:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f83504e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f834813e290 0x7f83480cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f83504e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834815f6b0 0x7f83480cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f83504e3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834806c520 con 0x7f83480cf7c0 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f83504e3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83480cfc40 con 0x7f834813e290 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f83504e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834815fb40 con 0x7f834815f6b0 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f834e27f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f834813e290 0x7f83480cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f834da7e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f83480cf7c0 0x7f834815efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53358/0 (socket says 172.21.15.70:53358) 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f834e27f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f834813e290 0x7f83480cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45598/0 (socket says 172.21.15.70:45598) 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f834da7e640 1 -- 172.21.15.70:0/2315282190 learned_addr learned my addr 172.21.15.70:0/2315282190 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.337+0000 7f834ea80640 1 --2- 172.21.15.70:0/2315282190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834815f6b0 0x7f83480cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834e27f640 1 -- 172.21.15.70:0/2315282190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834815f6b0 msgr2=0x7f83480cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834e27f640 1 --2- 172.21.15.70:0/2315282190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834815f6b0 0x7f83480cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834e27f640 1 -- 172.21.15.70:0/2315282190 >> v1:172.21.15.70:6789/0 conn(0x7f83480cf7c0 legacy=0x7f834815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834e27f640 1 -- 172.21.15.70:0/2315282190 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834806c800 con 0x7f834813e290 2023-11-26T07:18:55.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834e27f640 1 --2- 172.21.15.70:0/2315282190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834813e290 0x7f83480cf280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f83440097c0 tx=0x7f834401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ade5df00e95d9a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:55.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834d27d640 1 -- 172.21.15.70:0/2315282190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440ab650 con 0x7f834813e290 2023-11-26T07:18:55.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834d27d640 1 -- 172.21.15.70:0/2315282190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83440ab7b0 con 0x7f834813e290 2023-11-26T07:18:55.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f834d27d640 1 -- 172.21.15.70:0/2315282190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440abb40 con 0x7f834813e290 2023-11-26T07:18:55.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f83504e3640 1 -- 172.21.15.70:0/2315282190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834813e290 msgr2=0x7f83480cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.341+0000 7f83504e3640 1 --2- 172.21.15.70:0/2315282190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834813e290 0x7f83480cf280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f83440097c0 tx=0x7f834401c450 comp rx=0 tx=0).stop 2023-11-26T07:18:55.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- 172.21.15.70:0/2315282190 shutdown_connections 2023-11-26T07:18:55.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 --2- 172.21.15.70:0/2315282190 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834815f6b0 0x7f83480cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 --2- 172.21.15.70:0/2315282190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834813e290 0x7f83480cf280 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- 172.21.15.70:0/2315282190 >> 172.21.15.70:0/2315282190 conn(0x7f834806a890 msgr2=0x7f834806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:55.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- 172.21.15.70:0/2315282190 shutdown_connections 2023-11-26T07:18:55.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- 172.21.15.70:0/2315282190 wait complete. 2023-11-26T07:18:55.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 Processor -- start 2023-11-26T07:18:55.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- start start 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83480cf7c0 0x7f834813f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834813e290 0x7f8348071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834815f6b0 0x7f834813bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834813e7f0 con 0x7f834815f6b0 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834813ead0 con 0x7f83480cf7c0 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f83504e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834813edb0 con 0x7f834813e290 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834815f6b0 0x7f834813bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834815f6b0 0x7f834813bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45608/0 (socket says 172.21.15.70:45608) 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 -- 172.21.15.70:0/1269847715 learned_addr learned my addr 172.21.15.70:0/1269847715 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:18:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834e27f640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83480cf7c0 0x7f834813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834da7e640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834813e290 0x7f8348071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 -- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834813e290 msgr2=0x7f8348071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834813e290 0x7f8348071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 -- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83480cf7c0 msgr2=0x7f834813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83480cf7c0 0x7f834813f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 -- 172.21.15.70:0/1269847715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8344009420 con 0x7f834815f6b0 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834e27f640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83480cf7c0 0x7f834813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:18:55.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.345+0000 7f834ea80640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834815f6b0 0x7f834813bb90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8340007e60 tx=0x7f834000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:55.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f833effd640 1 -- 172.21.15.70:0/1269847715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340014420 con 0x7f834815f6b0 2023-11-26T07:18:55.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f833effd640 1 -- 172.21.15.70:0/1269847715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83400145a0 con 0x7f834815f6b0 2023-11-26T07:18:55.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f833effd640 1 -- 172.21.15.70:0/1269847715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340014950 con 0x7f834815f6b0 2023-11-26T07:18:55.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834813f090 con 0x7f834815f6b0 2023-11-26T07:18:55.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8348072220 con 0x7f834815f6b0 2023-11-26T07:18:55.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8348067680 con 0x7f834815f6b0 2023-11-26T07:18:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f833effd640 1 -- 172.21.15.70:0/1269847715 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8340014ab0 con 0x7f834815f6b0 2023-11-26T07:18:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f833effd640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f832c066470 0x7f832c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:18:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f833effd640 1 -- 172.21.15.70:0/1269847715 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f8340084760 con 0x7f834815f6b0 2023-11-26T07:18:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f834e27f640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f832c066470 0x7f832c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:18:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.349+0000 7f834e27f640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f832c066470 0x7f832c068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f83440af000 tx=0x7f83440a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:18:55.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.353+0000 7f833effd640 1 -- 172.21.15.70:0/1269847715 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8340051c20 con 0x7f834815f6b0 2023-11-26T07:18:55.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:55.501+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f834806df50 con 0x7f834815f6b0 2023-11-26T07:18:56.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f833effd640 1 -- 172.21.15.70:0/1269847715 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8340055240 con 0x7f834815f6b0 2023-11-26T07:18:56.172 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2023-11-26T07:18:56.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f832c066470 msgr2=0x7f832c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f832c066470 0x7f832c068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f83440af000 tx=0x7f83440a7000 comp rx=0 tx=0).stop 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834815f6b0 msgr2=0x7f834813bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834815f6b0 0x7f834813bb90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8340007e60 tx=0x7f834000e4b0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 shutdown_connections 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f832c066470 0x7f832c068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834815f6b0 0x7f834813bb90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f834813e290 0x7f8348071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 --2- 172.21.15.70:0/1269847715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f83480cf7c0 0x7f834813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:18:56.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 >> 172.21.15.70:0/1269847715 conn(0x7f834806a890 msgr2=0x7f83480aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:18:56.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 shutdown_connections 2023-11-26T07:18:56.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:18:56.169+0000 7f83504e3640 1 -- 172.21.15.70:0/1269847715 wait complete. 2023-11-26T07:18:56.201 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:18:56.201 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:18:56.201 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:18:56.201 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:56.201 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:18:56.201 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:18:56.201 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:56.202 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:18:56.202 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:18:56.202 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:18:56.202 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:56.202 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:18:56.202 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:18:56.203 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:18:56.203 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:18:56.214 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:18:56.214 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:18:56.215 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:18:56.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:18:56.226 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:18:56.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:18:56.258 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:18:56.258 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:56.260 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:18:56.260 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:56.269 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:18:56.270 DEBUG:teuthology.parallel:result is None 2023-11-26T07:18:56.343 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-11-26T07:18:56.344 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2023-11-26T07:18:56.354 INFO:tasks.ceph.mds.d.smithi120.stdout:starting mds.d at 2023-11-26T07:18:57.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-11-26T07:18:58.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:18:58.993 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:02.226 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:19:02.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:19:02.230 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:19:02.230 DEBUG:teuthology.parallel:result is None 2023-11-26T07:19:02.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:19:02.317 INFO:tasks.ceph.mds.b.smithi120.stdout:starting mds.b at 2023-11-26T07:19:02.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2fe217640 1 Processor -- start 2023-11-26T07:19:02.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2fe217640 1 -- start start 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2fe217640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc2f80cf280 0x7fc2f80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2fe217640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2f80cd1b0 0x7fc2f80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2fe217640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80cc730 con 0x7fc2f8143ac0 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2fe217640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f8143ea0 con 0x7fc2f80cf280 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2fe217640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80cfc50 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2effff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc2f80cf280 0x7fc2f80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2f77fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc2f8143ac0 0x7fc2f8070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53390/0 (socket says 172.21.15.70:53390) 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2f77fe640 1 -- 172.21.15.70:0/584867512 learned_addr learned my addr 172.21.15.70:0/584867512 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2f7fff640 1 --2- 172.21.15.70:0/584867512 >> v2:172.21.15.120:3300/0 conn(0x7fc2f80cd1b0 0x7fc2f80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2effff640 1 -- 172.21.15.70:0/584867512 >> v2:172.21.15.120:3300/0 conn(0x7fc2f80cd1b0 msgr2=0x7fc2f80cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2effff640 1 --2- 172.21.15.70:0/584867512 >> v2:172.21.15.120:3300/0 conn(0x7fc2f80cd1b0 0x7fc2f80cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2effff640 1 -- 172.21.15.70:0/584867512 >> v1:172.21.15.70:6789/0 conn(0x7fc2f8143ac0 legacy=0x7fc2f8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2effff640 1 -- 172.21.15.70:0/584867512 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8070ee0 con 0x7fc2f80cf280 2023-11-26T07:19:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.377+0000 7fc2f6ffd640 1 -- 172.21.15.70:0/584867512 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471632787 0 0) 0x7fc2f80cc730 con 0x7fc2f8143ac0 2023-11-26T07:19:02.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2effff640 1 --2- 172.21.15.70:0/584867512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cf280 0x7fc2f80cf710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806e570 tx=0x7fc2e001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df894115da3777 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:02.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2f6ffd640 1 -- 172.21.15.70:0/584867512 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00ab660 con 0x7fc2f80cf280 2023-11-26T07:19:02.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2f6ffd640 1 -- 172.21.15.70:0/584867512 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00ab7c0 con 0x7fc2f80cf280 2023-11-26T07:19:02.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2f6ffd640 1 -- 172.21.15.70:0/584867512 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00abb50 con 0x7fc2f80cf280 2023-11-26T07:19:02.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 -- 172.21.15.70:0/584867512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cf280 msgr2=0x7fc2f80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 --2- 172.21.15.70:0/584867512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cf280 0x7fc2f80cf710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806e570 tx=0x7fc2e001c460 comp rx=0 tx=0).stop 2023-11-26T07:19:02.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 -- 172.21.15.70:0/584867512 shutdown_connections 2023-11-26T07:19:02.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 --2- 172.21.15.70:0/584867512 >> v2:172.21.15.120:3300/0 conn(0x7fc2f80cd1b0 0x7fc2f80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 --2- 172.21.15.70:0/584867512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cf280 0x7fc2f80cf710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 -- 172.21.15.70:0/584867512 >> 172.21.15.70:0/584867512 conn(0x7fc2f806a890 msgr2=0x7fc2f806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:02.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 -- 172.21.15.70:0/584867512 shutdown_connections 2023-11-26T07:19:02.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.381+0000 7fc2fe217640 1 -- 172.21.15.70:0/584867512 wait complete. 2023-11-26T07:19:02.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 Processor -- start 2023-11-26T07:19:02.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 -- start start 2023-11-26T07:19:02.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cd1b0 0x7fc2f815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc2f80cf280 0x7fc2f815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f8143ac0 0x7fc2f813ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f815b0d0 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f815b3b0 con 0x7fc2f8143ac0 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f815b690 con 0x7fc2f80cf280 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cd1b0 0x7fc2f815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cd1b0 0x7fc2f815c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45654/0 (socket says 172.21.15.70:45654) 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 -- 172.21.15.70:0/623015600 learned_addr learned my addr 172.21.15.70:0/623015600 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f7fff640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f8143ac0 0x7fc2f813ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2effff640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc2f80cf280 0x7fc2f815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 -- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc2f80cf280 msgr2=0x7fc2f815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc2f80cf280 0x7fc2f815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 -- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f8143ac0 msgr2=0x7fc2f813ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f8143ac0 0x7fc2f813ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:02.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 -- 172.21.15.70:0/623015600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0009420 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f77fe640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cd1b0 0x7fc2f815c170 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80011f0 tx=0x7fc2e800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:02.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f4ff9640 1 -- 172.21.15.70:0/623015600 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80074e0 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f4ff9640 1 -- 172.21.15.70:0/623015600 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8007640 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f815b970 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2f4ff9640 1 -- 172.21.15.70:0/623015600 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8004a10 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.385+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f815adc0 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.389+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f815be90 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.389+0000 7fc2f4ff9640 1 -- 172.21.15.70:0/623015600 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2e8004b70 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.389+0000 7fc2f4ff9640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc2d8066470 0x7fc2d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.389+0000 7fc2f4ff9640 1 -- 172.21.15.70:0/623015600 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc2e8082d40 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.389+0000 7fc2effff640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc2d8066470 0x7fc2d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.389+0000 7fc2effff640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc2d8066470 0x7fc2d8068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00af000 tx=0x7fc2e00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.393+0000 7fc2f4ff9640 1 -- 172.21.15.70:0/623015600 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2e8050600 con 0x7fc2f80cd1b0 2023-11-26T07:19:02.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:02.553+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc2f8067680 con 0x7fc2f80cd1b0 2023-11-26T07:19:03.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-11-26T07:19:04.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.085+0000 7fc2f4ff9640 1 -- 172.21.15.70:0/623015600 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc2e8018070 con 0x7fc2f80cd1b0 2023-11-26T07:19:04.091 INFO:teuthology.orchestra.run.smithi070.stderr: removed all blocklist entries 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc2d8066470 msgr2=0x7fc2d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc2d8066470 0x7fc2d8068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00af000 tx=0x7fc2e00a7000 comp rx=0 tx=0).stop 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cd1b0 msgr2=0x7fc2f815c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cd1b0 0x7fc2f815c170 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80011f0 tx=0x7fc2e800c9b0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 shutdown_connections 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f8143ac0 0x7fc2f813ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc2f80cf280 0x7fc2f815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc2d8066470 0x7fc2d8068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 --2- 172.21.15.70:0/623015600 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2f80cd1b0 0x7fc2f815c170 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 >> 172.21.15.70:0/623015600 conn(0x7fc2f806a890 msgr2=0x7fc2f8140610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:04.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 shutdown_connections 2023-11-26T07:19:04.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.089+0000 7fc2fe217640 1 -- 172.21.15.70:0/623015600 wait complete. 2023-11-26T07:19:04.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:19:04.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe2265df640 1 Processor -- start 2023-11-26T07:19:04.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe2265df640 1 -- start start 2023-11-26T07:19:04.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe2265df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22013e290 0x7fe2200cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe2265df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe22015f6b0 0x7fe2200cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe2265df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22006c520 con 0x7fe2200cf7c0 2023-11-26T07:19:04.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe2265df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2200cfc40 con 0x7fe22015f6b0 2023-11-26T07:19:04.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe2265df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22015fb40 con 0x7fe22013e290 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe21ffff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22013e290 0x7fe2200cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe21f7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe2200cf7c0 0x7fe22015efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:33274/0 (socket says 172.21.15.70:33274) 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe21f7fe640 1 -- 172.21.15.70:0/3720899398 learned_addr learned my addr 172.21.15.70:0/3720899398 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe224b7c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe22015f6b0 0x7fe2200cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe21effd640 1 -- 172.21.15.70:0/3720899398 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789747681 0 0) 0x7fe22006c520 con 0x7fe2200cf7c0 2023-11-26T07:19:04.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe21effd640 1 -- 172.21.15.70:0/3720899398 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe208003530 con 0x7fe2200cf7c0 2023-11-26T07:19:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe224b7c640 1 -- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22013e290 msgr2=0x7fe2200cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe224b7c640 1 --2- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22013e290 0x7fe2200cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe224b7c640 1 -- 172.21.15.70:0/3720899398 >> v1:172.21.15.120:6789/0 conn(0x7fe2200cf7c0 legacy=0x7fe22015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe224b7c640 1 -- 172.21.15.70:0/3720899398 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22006c800 con 0x7fe22015f6b0 2023-11-26T07:19:04.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.257+0000 7fe21ffff640 1 --2- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22013e290 0x7fe2200cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:19:04.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe224b7c640 1 --2- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe22015f6b0 0x7fe2200cd7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe218009d90 tx=0x7fe21801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3668448895366410 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:04.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe21effd640 1 -- 172.21.15.70:0/3720899398 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2180a59e0 con 0x7fe22015f6b0 2023-11-26T07:19:04.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe21effd640 1 -- 172.21.15.70:0/3720899398 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2180a5b40 con 0x7fe22015f6b0 2023-11-26T07:19:04.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe21effd640 1 -- 172.21.15.70:0/3720899398 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2180ad440 con 0x7fe22015f6b0 2023-11-26T07:19:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 -- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe22015f6b0 msgr2=0x7fe2200cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 --2- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe22015f6b0 0x7fe2200cd7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe218009d90 tx=0x7fe21801c920 comp rx=0 tx=0).stop 2023-11-26T07:19:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 -- 172.21.15.70:0/3720899398 shutdown_connections 2023-11-26T07:19:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 --2- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe22015f6b0 0x7fe2200cd7b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 --2- 172.21.15.70:0/3720899398 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22013e290 0x7fe2200cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 -- 172.21.15.70:0/3720899398 >> 172.21.15.70:0/3720899398 conn(0x7fe22006a890 msgr2=0x7fe22006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:04.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 -- 172.21.15.70:0/3720899398 shutdown_connections 2023-11-26T07:19:04.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.261+0000 7fe2265df640 1 -- 172.21.15.70:0/3720899398 wait complete. 2023-11-26T07:19:04.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 Processor -- start 2023-11-26T07:19:04.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 -- start start 2023-11-26T07:19:04.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200cf7c0 0x7fe22015e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe22013e290 0x7fe2200adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22015f6b0 0x7fe22015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22015c150 con 0x7fe22013e290 2023-11-26T07:19:04.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220070410 con 0x7fe2200cf7c0 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200b4000 con 0x7fe22015f6b0 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe22013e290 0x7fe2200adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe22013e290 0x7fe2200adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33328/0 (socket says 172.21.15.70:33328) 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 -- 172.21.15.70:0/1361787429 learned_addr learned my addr 172.21.15.70:0/1361787429 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21ffff640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200cf7c0 0x7fe22015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe224b7c640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22015f6b0 0x7fe22015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 -- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22015f6b0 msgr2=0x7fe22015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22015f6b0 0x7fe22015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 -- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200cf7c0 msgr2=0x7fe22015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200cf7c0 0x7fe22015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 -- 172.21.15.70:0/1361787429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009420 con 0x7fe22013e290 2023-11-26T07:19:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21f7fe640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe22013e290 0x7fe2200adba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c450 tx=0x7fe21400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21cff9640 1 -- 172.21.15.70:0/1361787429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214005cf0 con 0x7fe22013e290 2023-11-26T07:19:04.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21cff9640 1 -- 172.21.15.70:0/1361787429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe214005e50 con 0x7fe22013e290 2023-11-26T07:19:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe21cff9640 1 -- 172.21.15.70:0/1361787429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214007290 con 0x7fe22013e290 2023-11-26T07:19:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe218009a70 con 0x7fe22013e290 2023-11-26T07:19:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe220070990 con 0x7fe22013e290 2023-11-26T07:19:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.265+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe220070580 con 0x7fe22013e290 2023-11-26T07:19:04.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.269+0000 7fe21cff9640 1 -- 172.21.15.70:0/1361787429 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe2140073f0 con 0x7fe22013e290 2023-11-26T07:19:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.269+0000 7fe21cff9640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe20c066470 0x7fe20c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.269+0000 7fe21cff9640 1 -- 172.21.15.70:0/1361787429 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe214083060 con 0x7fe22013e290 2023-11-26T07:19:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.269+0000 7fe21ffff640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe20c066470 0x7fe20c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.269+0000 7fe21ffff640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe20c066470 0x7fe20c068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe210009cf0 tx=0x7fe210009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:04.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.273+0000 7fe21cff9640 1 -- 172.21.15.70:0/1361787429 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2140b4280 con 0x7fe22013e290 2023-11-26T07:19:04.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe220067680 con 0x7fe22013e290 2023-11-26T07:19:04.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe21cff9640 1 -- 172.21.15.70:0/1361787429 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe214017070 con 0x7fe22013e290 2023-11-26T07:19:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:04.480 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_dump": [ 2023-11-26T07:19:04.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.a", 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlK818ExAA3Pl7hruKT9tvdseH1RoDNw==", 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.481 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.b", 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl+74KIBAAAU2yWLE9nGWyh2Eew8a2cQ==", 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.c", 2023-11-26T07:19:04.482 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl2a4KGxAAGVTHr4IYGCxqIbJI4GAlHw==", 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.d", 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlkKVrJxAA/tao4nxlwlxXqNbpcOQO0w==", 2023-11-26T07:19:04.483 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.0", 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDv8GJlMTzJDRAAtRLnzO4hzBrRsOTxU0sn1g==", 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.484 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.1", 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDy8GJlYwIPFBAA08sYURmRGI+e5KAfsYCowQ==", 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.2", 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD18GJl2yAVGxAAbmsr89meMeh8tOtuLwO2nQ==", 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.486 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.3", 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD48GJlgsovIRAAR7B4+PHY5+5A/pLTUYSv/Q==", 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.4", 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD+8GJllmjnJRAAfX4zIcgsX+H5/jgeJd4fJQ==", 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.5", 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAB8WJlebhlLBAAXicxjU2Nww1KEts/9c6YWQ==", 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.488 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.6", 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAE8WJlrYwEMxAAt996EyIggEIdDG5Jo8pxLg==", 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.7", 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAH8WJlUqeLOhAAMXAlFPwvIZkjtwDqTqj9Dg==", 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.0", 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA==", 2023-11-26T07:19:04.490 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.1", 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl19ntNBAAm+Na43D/jVnw3XfgG4syqg==", 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.491 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.2", 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlbfhnMRAAUU4/Sqog5uGnzt4xD/6M6g==", 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:19:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.3", 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlUVjqOhAAg1iYDvnKqcoojshB4YtI7Q==", 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:19:04.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.admin", 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDs8GJlRiV4MhAABZ2mWkM6iWcfvniCtWCj4w==", 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-mds", 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAS8WJlNmrwOhAA9S8DS8bkzxdZV51LCa9KZA==", 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-mds" 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-mgr", 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAS8WJl37fwOhAATUSrPUE8JQoJdst5pyaoKQ==", 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.495 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-osd", 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAS8WJl2cDwOhAA89bY0mEWMVxGlbjtcmGd4Q==", 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-osd" 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.496 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-rbd", 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAS8WJlRsrwOhAAVMt6Qkb3EZ/FIwEpqrtt9w==", 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAS8WJlNtXwOhAAS71zWiZUu/HG/Fxg7KK3fg==", 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.bootstrap-rgw", 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAS8WJlWd7wOhAAUWX7ftmH00L7XgGw1XNcuw==", 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.x", 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl5WcCDxAAAQ7rZ5sJaZ6CGeJ2izEpNA==", 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.498 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.y", 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlc3stCxAAjCksCvC5/30P/2m2kedt6w==", 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:19:04.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:04.500 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-11-26T07:19:04.500 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe20c066470 msgr2=0x7fe20c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe20c066470 0x7fe20c068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe210009cf0 tx=0x7fe210009190 comp rx=0 tx=0).stop 2023-11-26T07:19:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe22013e290 msgr2=0x7fe2200adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe22013e290 0x7fe2200adba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c450 tx=0x7fe21400c910 comp rx=0 tx=0).stop 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 shutdown_connections 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe20c066470 0x7fe20c068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe22013e290 0x7fe2200adba0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe22015f6b0 0x7fe22015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 --2- 172.21.15.70:0/1361787429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2200cf7c0 0x7fe22015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 >> 172.21.15.70:0/1361787429 conn(0x7fe22006a890 msgr2=0x7fe2200b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 shutdown_connections 2023-11-26T07:19:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.477+0000 7fe2265df640 1 -- 172.21.15.70:0/1361787429 wait complete. 2023-11-26T07:19:04.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-26T07:19:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67fec9640 1 Processor -- start 2023-11-26T07:19:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67fec9640 1 -- start start 2023-11-26T07:19:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67fec9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb67815d6e0 0x7fb6780d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67fec9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6780b2160 0x7fb6780d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67fec9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6780cf0e0 con 0x7fb6780d19f0 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67fec9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67815dac0 con 0x7fb6780b2160 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67fec9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780d1e80 con 0x7fb67815d6e0 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67d464640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6780b2160 0x7fb6780d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67e466640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb6780d19f0 0x7fb6780cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55810/0 (socket says 172.21.15.70:55810) 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67e466640 1 -- 172.21.15.70:0/2811896705 learned_addr learned my addr 172.21.15.70:0/2811896705 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67d464640 1 -- 172.21.15.70:0/2811896705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb67815d6e0 msgr2=0x7fb6780d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67dc65640 1 --2- 172.21.15.70:0/2811896705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb67815d6e0 0x7fb6780d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67d464640 1 --2- 172.21.15.70:0/2811896705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb67815d6e0 0x7fb6780d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67cc63640 1 -- 172.21.15.70:0/2811896705 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154517895 0 0) 0x7fb6780cf0e0 con 0x7fb6780d19f0 2023-11-26T07:19:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67d464640 1 -- 172.21.15.70:0/2811896705 >> v1:172.21.15.70:6789/0 conn(0x7fb6780d19f0 legacy=0x7fb6780cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67d464640 1 -- 172.21.15.70:0/2811896705 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780ceb20 con 0x7fb6780b2160 2023-11-26T07:19:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.637+0000 7fb67dc65640 1 --2- 172.21.15.70:0/2811896705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb67815d6e0 0x7fb6780d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67d464640 1 --2- 172.21.15.70:0/2811896705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6780b2160 0x7fb6780d14b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097c0 tx=0x7fb66801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafd91384ec192 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67cc63640 1 -- 172.21.15.70:0/2811896705 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680ab600 con 0x7fb6780b2160 2023-11-26T07:19:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67cc63640 1 -- 172.21.15.70:0/2811896705 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6680a7050 con 0x7fb6780b2160 2023-11-26T07:19:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67cc63640 1 -- 172.21.15.70:0/2811896705 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680ab980 con 0x7fb6780b2160 2023-11-26T07:19:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 -- 172.21.15.70:0/2811896705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6780b2160 msgr2=0x7fb6780d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 --2- 172.21.15.70:0/2811896705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6780b2160 0x7fb6780d14b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097c0 tx=0x7fb66801c480 comp rx=0 tx=0).stop 2023-11-26T07:19:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 -- 172.21.15.70:0/2811896705 shutdown_connections 2023-11-26T07:19:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 --2- 172.21.15.70:0/2811896705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6780b2160 0x7fb6780d14b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 --2- 172.21.15.70:0/2811896705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb67815d6e0 0x7fb6780d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 -- 172.21.15.70:0/2811896705 >> 172.21.15.70:0/2811896705 conn(0x7fb67809c550 msgr2=0x7fb6780d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 -- 172.21.15.70:0/2811896705 shutdown_connections 2023-11-26T07:19:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.641+0000 7fb67fec9640 1 -- 172.21.15.70:0/2811896705 wait complete. 2023-11-26T07:19:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 Processor -- start 2023-11-26T07:19:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 -- start start 2023-11-26T07:19:04.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6780b2160 0x7fb6780b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6780d19f0 0x7fb6780c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb67815d6e0 0x7fb6780cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c7830 con 0x7fb67815d6e0 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780cc9e0 con 0x7fb6780d19f0 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c6e90 con 0x7fb6780b2160 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb67815d6e0 0x7fb6780cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb67815d6e0 0x7fb6780cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33344/0 (socket says 172.21.15.70:33344) 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 -- 172.21.15.70:0/1440944658 learned_addr learned my addr 172.21.15.70:0/1440944658 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67d464640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6780d19f0 0x7fb6780c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67dc65640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6780b2160 0x7fb6780b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 -- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6780b2160 msgr2=0x7fb6780b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6780b2160 0x7fb6780b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 -- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6780d19f0 msgr2=0x7fb6780c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6780d19f0 0x7fb6780c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 -- 172.21.15.70:0/1440944658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668009420 con 0x7fb67815d6e0 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67e466640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb67815d6e0 0x7fb6780cbf20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c810 tx=0x7fb67000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb66e7fc640 1 -- 172.21.15.70:0/1440944658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000a640 con 0x7fb67815d6e0 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb66e7fc640 1 -- 172.21.15.70:0/1440944658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67000a7c0 con 0x7fb67815d6e0 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb66e7fc640 1 -- 172.21.15.70:0/1440944658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000ab70 con 0x7fb67815d6e0 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6780c7170 con 0x7fb67815d6e0 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.645+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6780b30e0 con 0x7fb67815d6e0 2023-11-26T07:19:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.649+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb678067680 con 0x7fb67815d6e0 2023-11-26T07:19:04.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.649+0000 7fb66e7fc640 1 -- 172.21.15.70:0/1440944658 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb67000acd0 con 0x7fb67815d6e0 2023-11-26T07:19:04.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.649+0000 7fb66e7fc640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb65c066470 0x7fb65c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:04.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.649+0000 7fb66e7fc640 1 -- 172.21.15.70:0/1440944658 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb670082f40 con 0x7fb67815d6e0 2023-11-26T07:19:04.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.649+0000 7fb67dc65640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb65c066470 0x7fb65c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:04.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.649+0000 7fb67dc65640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb65c066470 0x7fb65c068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb67806c1b0 tx=0x7fb674008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:04.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.653+0000 7fb66e7fc640 1 -- 172.21.15.70:0/1440944658 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6700507b0 con 0x7fb67815d6e0 2023-11-26T07:19:04.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.857+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb67815e480 con 0x7fb67815d6e0 2023-11-26T07:19:04.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb66e7fc640 1 -- 172.21.15.70:0/1440944658 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb670018020 con 0x7fb67815d6e0 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb65c066470 msgr2=0x7fb65c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb65c066470 0x7fb65c068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb67806c1b0 tx=0x7fb674008040 comp rx=0 tx=0).stop 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb67815d6e0 msgr2=0x7fb6780cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb67815d6e0 0x7fb6780cbf20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c810 tx=0x7fb67000ccd0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 shutdown_connections 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb65c066470 0x7fb65c068930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb67815d6e0 0x7fb6780cbf20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6780d19f0 0x7fb6780c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 --2- 172.21.15.70:0/1440944658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6780b2160 0x7fb6780b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:04.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 >> 172.21.15.70:0/1440944658 conn(0x7fb67809c550 msgr2=0x7fb67815ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:04.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 shutdown_connections 2023-11-26T07:19:04.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:04.861+0000 7fb67fec9640 1 -- 172.21.15.70:0/1440944658 wait complete. 2023-11-26T07:19:04.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-26T07:19:05.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f803a446640 1 Processor -- start 2023-11-26T07:19:05.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f803a446640 1 -- start start 2023-11-26T07:19:05.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f803a446640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f803406f3e0 0x7f8034161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f803a446640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8034099a70 0x7f8034161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f803a446640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80340cf260 con 0x7f803406f000 2023-11-26T07:19:05.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f803a446640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803409a010 con 0x7f8034099a70 2023-11-26T07:19:05.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f803a446640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803409a2f0 con 0x7f803406f3e0 2023-11-26T07:19:05.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80389e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8034099a70 0x7f8034161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80389e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8034099a70 0x7f8034161bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33350/0 (socket says 172.21.15.70:33350) 2023-11-26T07:19:05.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80389e3640 1 -- 172.21.15.70:0/2337464733 learned_addr learned my addr 172.21.15.70:0/2337464733 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:05.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80337fe640 1 --2- 172.21.15.70:0/2337464733 >> v2:172.21.15.120:3300/0 conn(0x7f803406f3e0 0x7f8034161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80389e3640 1 -- 172.21.15.70:0/2337464733 >> v2:172.21.15.120:3300/0 conn(0x7f803406f3e0 msgr2=0x7f8034161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:05.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80389e3640 1 --2- 172.21.15.70:0/2337464733 >> v2:172.21.15.120:3300/0 conn(0x7f803406f3e0 0x7f8034161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80389e3640 1 -- 172.21.15.70:0/2337464733 >> v1:172.21.15.120:6789/0 conn(0x7f803406f000 legacy=0x7f803406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.021+0000 7f80389e3640 1 -- 172.21.15.70:0/2337464733 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803409a5d0 con 0x7f8034099a70 2023-11-26T07:19:05.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f80389e3640 1 --2- 172.21.15.70:0/2337464733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8034099a70 0x7f8034161bd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8034072340 tx=0x7f802c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f5e89e99200b2c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f8032ffd640 1 -- 172.21.15.70:0/2337464733 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0af400 con 0x7f8034099a70 2023-11-26T07:19:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f8032ffd640 1 -- 172.21.15.70:0/2337464733 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c0ab050 con 0x7f8034099a70 2023-11-26T07:19:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f8032ffd640 1 -- 172.21.15.70:0/2337464733 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0af780 con 0x7f8034099a70 2023-11-26T07:19:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 -- 172.21.15.70:0/2337464733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8034099a70 msgr2=0x7f8034161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 --2- 172.21.15.70:0/2337464733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8034099a70 0x7f8034161bd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8034072340 tx=0x7f802c01f1c0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 -- 172.21.15.70:0/2337464733 shutdown_connections 2023-11-26T07:19:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 --2- 172.21.15.70:0/2337464733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8034099a70 0x7f8034161bd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 --2- 172.21.15.70:0/2337464733 >> v2:172.21.15.120:3300/0 conn(0x7f803406f3e0 0x7f8034161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 -- 172.21.15.70:0/2337464733 >> 172.21.15.70:0/2337464733 conn(0x7f80340b2d10 msgr2=0x7f80340b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 -- 172.21.15.70:0/2337464733 shutdown_connections 2023-11-26T07:19:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 -- 172.21.15.70:0/2337464733 wait complete. 2023-11-26T07:19:05.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.025+0000 7f803a446640 1 Processor -- start 2023-11-26T07:19:05.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 -- start start 2023-11-26T07:19:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f803406f000 0x7f80341f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f803406f3e0 0x7f803415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8034099a70 0x7f80340cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80341f3640 con 0x7f803406f3e0 2023-11-26T07:19:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803415cca0 con 0x7f803406f000 2023-11-26T07:19:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803415e830 con 0x7f8034099a70 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f803406f3e0 0x7f803415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f8033fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f803406f000 0x7f80341f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f803406f3e0 0x7f803415c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33356/0 (socket says 172.21.15.70:33356) 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 -- 172.21.15.70:0/2500444889 learned_addr learned my addr 172.21.15.70:0/2500444889 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80389e3640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8034099a70 0x7f80340cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 -- 172.21.15.70:0/2500444889 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8034099a70 msgr2=0x7f80340cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8034099a70 0x7f80340cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 -- 172.21.15.70:0/2500444889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f803406f000 msgr2=0x7f80341f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f803406f000 0x7f80341f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 -- 172.21.15.70:0/2500444889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c009b30 con 0x7f803406f3e0 2023-11-26T07:19:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f80337fe640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f803406f3e0 0x7f803415c760 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f802800d800 tx=0x7f802800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f8030ff9640 1 -- 172.21.15.70:0/2500444889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800b6c0 con 0x7f803406f3e0 2023-11-26T07:19:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f8030ff9640 1 -- 172.21.15.70:0/2500444889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800b820 con 0x7f803406f3e0 2023-11-26T07:19:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f8030ff9640 1 -- 172.21.15.70:0/2500444889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800bb90 con 0x7f803406f3e0 2023-11-26T07:19:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803415ead0 con 0x7f803406f3e0 2023-11-26T07:19:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803415f090 con 0x7f803406f3e0 2023-11-26T07:19:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.029+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8034067680 con 0x7f803406f3e0 2023-11-26T07:19:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.033+0000 7f8030ff9640 1 -- 172.21.15.70:0/2500444889 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f802800bcf0 con 0x7f803406f3e0 2023-11-26T07:19:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.033+0000 7f8030ff9640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8020066470 0x7f8020068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.033+0000 7f8030ff9640 1 -- 172.21.15.70:0/2500444889 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8028083f40 con 0x7f803406f3e0 2023-11-26T07:19:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.033+0000 7f8033fff640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8020066470 0x7f8020068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.033+0000 7f8033fff640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8020066470 0x7f8020068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8024007fd0 tx=0x7f8024009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.037+0000 7f8030ff9640 1 -- 172.21.15.70:0/2500444889 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80280517b0 con 0x7f803406f3e0 2023-11-26T07:19:05.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.241+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f80340c61a0 con 0x7f803406f3e0 2023-11-26T07:19:05.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.245+0000 7f8030ff9640 1 -- 172.21.15.70:0/2500444889 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8028054dd0 con 0x7f803406f3e0 2023-11-26T07:19:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8020066470 msgr2=0x7f8020068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8020066470 0x7f8020068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8024007fd0 tx=0x7f8024009040 comp rx=0 tx=0).stop 2023-11-26T07:19:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f803406f3e0 msgr2=0x7f803415c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f803406f3e0 0x7f803415c760 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f802800d800 tx=0x7f802800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 shutdown_connections 2023-11-26T07:19:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8020066470 0x7f8020068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f803406f3e0 0x7f803415c760 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8034099a70 0x7f80340cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 --2- 172.21.15.70:0/2500444889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f803406f000 0x7f80341f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 >> 172.21.15.70:0/2500444889 conn(0x7f80340b2d10 msgr2=0x7f803406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 shutdown_connections 2023-11-26T07:19:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.249+0000 7f803a446640 1 -- 172.21.15.70:0/2500444889 wait complete. 2023-11-26T07:19:05.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-26T07:19:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ec9a640 1 Processor -- start 2023-11-26T07:19:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ec9a640 1 -- start start 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ec9a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad48160d30 0x7fad480d3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ec9a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad480d0330 0x7fad480b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ec9a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad480ce9d0 con 0x7fad480b20e0 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ec9a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad480cf550 con 0x7fad48160d30 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ec9a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad48161110 con 0x7fad480d0330 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ca36640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad48160d30 0x7fad480d3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ca36640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad48160d30 0x7fad480d3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33370/0 (socket says 172.21.15.70:33370) 2023-11-26T07:19:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ca36640 1 -- 172.21.15.70:0/1612146982 learned_addr learned my addr 172.21.15.70:0/1612146982 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:05.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4d237640 1 --2- 172.21.15.70:0/1612146982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad480d0330 0x7fad480b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ca36640 1 -- 172.21.15.70:0/1612146982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad480d0330 msgr2=0x7fad480b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:05.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ca36640 1 --2- 172.21.15.70:0/1612146982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad480d0330 0x7fad480b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ca36640 1 -- 172.21.15.70:0/1612146982 >> v1:172.21.15.70:6789/0 conn(0x7fad480b20e0 legacy=0x7fad480cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.405+0000 7fad4ca36640 1 -- 172.21.15.70:0/1612146982 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480cecb0 con 0x7fad48160d30 2023-11-26T07:19:05.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ca36640 1 --2- 172.21.15.70:0/1612146982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48160d30 0x7fad480d3de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0098a0 tx=0x7fad3c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9d0d921959aae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad477fe640 1 -- 172.21.15.70:0/1612146982 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0aa650 con 0x7fad48160d30 2023-11-26T07:19:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad477fe640 1 -- 172.21.15.70:0/1612146982 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0aa7b0 con 0x7fad48160d30 2023-11-26T07:19:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad477fe640 1 -- 172.21.15.70:0/1612146982 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0aab40 con 0x7fad48160d30 2023-11-26T07:19:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 -- 172.21.15.70:0/1612146982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48160d30 msgr2=0x7fad480d3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/1612146982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48160d30 0x7fad480d3de0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0098a0 tx=0x7fad3c01c4f0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 -- 172.21.15.70:0/1612146982 shutdown_connections 2023-11-26T07:19:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/1612146982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad480d0330 0x7fad480b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/1612146982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad48160d30 0x7fad480d3de0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 -- 172.21.15.70:0/1612146982 >> 172.21.15.70:0/1612146982 conn(0x7fad4809c560 msgr2=0x7fad480d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 -- 172.21.15.70:0/1612146982 shutdown_connections 2023-11-26T07:19:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.409+0000 7fad4ec9a640 1 -- 172.21.15.70:0/1612146982 wait complete. 2023-11-26T07:19:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 Processor -- start 2023-11-26T07:19:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 -- start start 2023-11-26T07:19:05.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b20e0 0x7fad48154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad480d0330 0x7fad480ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad48160d30 0x7fad480affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481549c0 con 0x7fad480b20e0 2023-11-26T07:19:05.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480b6480 con 0x7fad480d0330 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad480c8c10 con 0x7fad48160d30 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b20e0 0x7fad48154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b20e0 0x7fad48154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33374/0 (socket says 172.21.15.70:33374) 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 -- 172.21.15.70:0/371805525 learned_addr learned my addr 172.21.15.70:0/371805525 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad47fff640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad480d0330 0x7fad480ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 -- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad48160d30 msgr2=0x7fad480affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4d237640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad48160d30 0x7fad480affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad48160d30 0x7fad480affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 -- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad480d0330 msgr2=0x7fad480ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad480d0330 0x7fad480ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 -- 172.21.15.70:0/371805525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0094d0 con 0x7fad480b20e0 2023-11-26T07:19:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad47fff640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad480d0330 0x7fad480ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4d237640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad48160d30 0x7fad480affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ca36640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b20e0 0x7fad48154480 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0ac040 tx=0x7fad3c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad457fa640 1 -- 172.21.15.70:0/371805525 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0b3800 con 0x7fad480b20e0 2023-11-26T07:19:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad457fa640 1 -- 172.21.15.70:0/371805525 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0b39a0 con 0x7fad480b20e0 2023-11-26T07:19:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad457fa640 1 -- 172.21.15.70:0/371805525 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0b3d50 con 0x7fad480b20e0 2023-11-26T07:19:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.413+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480c8ef0 con 0x7fad480b20e0 2023-11-26T07:19:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.417+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad480b6110 con 0x7fad480b20e0 2023-11-26T07:19:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.417+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48067680 con 0x7fad480b20e0 2023-11-26T07:19:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.417+0000 7fad457fa640 1 -- 172.21.15.70:0/371805525 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad3c0b2380 con 0x7fad480b20e0 2023-11-26T07:19:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.417+0000 7fad457fa640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fad2c066470 0x7fad2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.417+0000 7fad457fa640 1 -- 172.21.15.70:0/371805525 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad3c11e2b0 con 0x7fad480b20e0 2023-11-26T07:19:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.417+0000 7fad47fff640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fad2c066470 0x7fad2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.417+0000 7fad47fff640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fad2c066470 0x7fad2c068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad480b0b10 tx=0x7fad34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.421+0000 7fad457fa640 1 -- 172.21.15.70:0/371805525 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad3c0ebb20 con 0x7fad480b20e0 2023-11-26T07:19:05.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.621+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fad48074130 con 0x7fad480b20e0 2023-11-26T07:19:05.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.625+0000 7fad457fa640 1 -- 172.21.15.70:0/371805525 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fad3c0ef140 con 0x7fad480b20e0 2023-11-26T07:19:05.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fad2c066470 msgr2=0x7fad2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fad2c066470 0x7fad2c068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad480b0b10 tx=0x7fad34009040 comp rx=0 tx=0).stop 2023-11-26T07:19:05.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b20e0 msgr2=0x7fad48154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b20e0 0x7fad48154480 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0ac040 tx=0x7fad3c01ad30 comp rx=0 tx=0).stop 2023-11-26T07:19:05.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 shutdown_connections 2023-11-26T07:19:05.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fad48160d30 0x7fad480affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad480d0330 0x7fad480ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fad2c066470 0x7fad2c068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 --2- 172.21.15.70:0/371805525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad480b20e0 0x7fad48154480 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 >> 172.21.15.70:0/371805525 conn(0x7fad4809c560 msgr2=0x7fad4806ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:05.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 shutdown_connections 2023-11-26T07:19:05.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.629+0000 7fad4ec9a640 1 -- 172.21.15.70:0/371805525 wait complete. 2023-11-26T07:19:05.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-26T07:19:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc071e5a640 1 Processor -- start 2023-11-26T07:19:05.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc071e5a640 1 -- start start 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc071e5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c1596d0 0x7fc06c071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc071e5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc06c0ce680 0x7fc06c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc071e5a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06c06c750 con 0x7fc06c0b2db0 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc071e5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06c0b3240 con 0x7fc06c0ce680 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc071e5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0cbe00 con 0x7fc06c1596d0 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc06affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc06c0ce680 0x7fc06c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc06affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc06c0ce680 0x7fc06c0b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33382/0 (socket says 172.21.15.70:33382) 2023-11-26T07:19:05.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc06affd640 1 -- 172.21.15.70:0/3060634129 learned_addr learned my addr 172.21.15.70:0/3060634129 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:05.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.785+0000 7fc06b7fe640 1 --2- 172.21.15.70:0/3060634129 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c1596d0 0x7fc06c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06affd640 1 -- 172.21.15.70:0/3060634129 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c1596d0 msgr2=0x7fc06c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:05.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06affd640 1 --2- 172.21.15.70:0/3060634129 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c1596d0 0x7fc06c071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06affd640 1 -- 172.21.15.70:0/3060634129 >> v1:172.21.15.120:6789/0 conn(0x7fc06c0b2db0 legacy=0x7fc06c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06affd640 1 -- 172.21.15.70:0/3060634129 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0b3550 con 0x7fc06c0ce680 2023-11-26T07:19:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06affd640 1 --2- 172.21.15.70:0/3060634129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0ce680 0x7fc06c0b2870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc060009870 tx=0x7fc06001d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd1d05a3c4652f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06a7fc640 1 -- 172.21.15.70:0/3060634129 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600a76a0 con 0x7fc06c0ce680 2023-11-26T07:19:05.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06a7fc640 1 -- 172.21.15.70:0/3060634129 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0600a7800 con 0x7fc06c0ce680 2023-11-26T07:19:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc06a7fc640 1 -- 172.21.15.70:0/3060634129 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600a7b90 con 0x7fc06c0ce680 2023-11-26T07:19:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc071e5a640 1 -- 172.21.15.70:0/3060634129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0ce680 msgr2=0x7fc06c0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.789+0000 7fc071e5a640 1 --2- 172.21.15.70:0/3060634129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0ce680 0x7fc06c0b2870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc060009870 tx=0x7fc06001d770 comp rx=0 tx=0).stop 2023-11-26T07:19:05.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- 172.21.15.70:0/3060634129 shutdown_connections 2023-11-26T07:19:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 --2- 172.21.15.70:0/3060634129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0ce680 0x7fc06c0b2870 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 --2- 172.21.15.70:0/3060634129 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c1596d0 0x7fc06c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- 172.21.15.70:0/3060634129 >> 172.21.15.70:0/3060634129 conn(0x7fc06c06a890 msgr2=0x7fc06c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- 172.21.15.70:0/3060634129 shutdown_connections 2023-11-26T07:19:05.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- 172.21.15.70:0/3060634129 wait complete. 2023-11-26T07:19:05.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 Processor -- start 2023-11-26T07:19:05.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- start start 2023-11-26T07:19:05.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0b2db0 0x7fc06c13a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c0ce680 0x7fc06c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc06c1596d0 0x7fc06c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0ccc70 con 0x7fc06c0b2db0 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0cc0a0 con 0x7fc06c1596d0 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc071e5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0cc340 con 0x7fc06c0ce680 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0b2db0 0x7fc06c13a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0b2db0 0x7fc06c13a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33386/0 (socket says 172.21.15.70:33386) 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 -- 172.21.15.70:0/1782583357 learned_addr learned my addr 172.21.15.70:0/1782583357 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 -- 172.21.15.70:0/1782583357 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c0ce680 msgr2=0x7fc06c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c0ce680 0x7fc06c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 -- 172.21.15.70:0/1782583357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc06c1596d0 msgr2=0x7fc06c14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc06c1596d0 0x7fc06c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:05.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.793+0000 7fc06b7fe640 1 -- 172.21.15.70:0/1782583357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600094d0 con 0x7fc06c0b2db0 2023-11-26T07:19:05.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc06b7fe640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0b2db0 0x7fc06c13a3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e870 tx=0x7fc05c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc053fff640 1 -- 172.21.15.70:0/1782583357 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c009510 con 0x7fc06c0b2db0 2023-11-26T07:19:05.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc053fff640 1 -- 172.21.15.70:0/1782583357 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00eec0 con 0x7fc06c0b2db0 2023-11-26T07:19:05.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc053fff640 1 -- 172.21.15.70:0/1782583357 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00cb40 con 0x7fc06c0b2db0 2023-11-26T07:19:05.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c0cc620 con 0x7fc06c0b2db0 2023-11-26T07:19:05.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c13ae40 con 0x7fc06c0b2db0 2023-11-26T07:19:05.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c067680 con 0x7fc06c0b2db0 2023-11-26T07:19:05.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc053fff640 1 -- 172.21.15.70:0/1782583357 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc05c00cca0 con 0x7fc06c0b2db0 2023-11-26T07:19:05.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc053fff640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc058066470 0x7fc058068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:05.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc053fff640 1 -- 172.21.15.70:0/1782583357 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc05c083fe0 con 0x7fc06c0b2db0 2023-11-26T07:19:05.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.797+0000 7fc06affd640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc058066470 0x7fc058068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:05.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.801+0000 7fc06affd640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc058066470 0x7fc058068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0600af000 tx=0x7fc060004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:05.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:05.801+0000 7fc053fff640 1 -- 172.21.15.70:0/1782583357 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc05c0517e0 con 0x7fc06c0b2db0 2023-11-26T07:19:06.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.005+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc06c0711b0 con 0x7fc06c0b2db0 2023-11-26T07:19:06.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.009+0000 7fc053fff640 1 -- 172.21.15.70:0/1782583357 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc05c0170a0 con 0x7fc06c0b2db0 2023-11-26T07:19:06.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.009+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc058066470 msgr2=0x7fc058068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.009+0000 7fc071e5a640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc058066470 0x7fc058068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0600af000 tx=0x7fc060004740 comp rx=0 tx=0).stop 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.009+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0b2db0 msgr2=0x7fc06c13a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.009+0000 7fc071e5a640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0b2db0 0x7fc06c13a3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e870 tx=0x7fc05c00ec70 comp rx=0 tx=0).stop 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 shutdown_connections 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc06c1596d0 0x7fc06c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc06c0ce680 0x7fc06c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc058066470 0x7fc058068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 --2- 172.21.15.70:0/1782583357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc06c0b2db0 0x7fc06c13a3c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 >> 172.21.15.70:0/1782583357 conn(0x7fc06c06a890 msgr2=0x7fc06c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 shutdown_connections 2023-11-26T07:19:06.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.013+0000 7fc071e5a640 1 -- 172.21.15.70:0/1782583357 wait complete. 2023-11-26T07:19:06.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-26T07:19:06.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a88b57640 1 Processor -- start 2023-11-26T07:19:06.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a88b57640 1 -- start start 2023-11-26T07:19:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a88b57640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0a8415d6e0 0x7f0a840d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a88b57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840b2160 0x7f0a840d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a88b57640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840cf0e0 con 0x7f0a840d19f0 2023-11-26T07:19:06.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a88b57640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8415dac0 con 0x7f0a8415d6e0 2023-11-26T07:19:06.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a88b57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840d1e80 con 0x7f0a840b2160 2023-11-26T07:19:06.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a8259c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0a8415d6e0 0x7f0a840d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a82d9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0a840d19f0 0x7f0a840cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:33306/0 (socket says 172.21.15.70:33306) 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a81d9b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840b2160 0x7f0a840d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.169+0000 7f0a82d9d640 1 -- 172.21.15.70:0/1836332246 learned_addr learned my addr 172.21.15.70:0/1836332246 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a8159a640 1 -- 172.21.15.70:0/1836332246 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030551961 0 0) 0x7f0a840cf0e0 con 0x7f0a840d19f0 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a81d9b640 1 -- 172.21.15.70:0/1836332246 >> v2:172.21.15.120:3300/0 conn(0x7f0a8415d6e0 msgr2=0x7f0a840d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a81d9b640 1 --2- 172.21.15.70:0/1836332246 >> v2:172.21.15.120:3300/0 conn(0x7f0a8415d6e0 0x7f0a840d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a81d9b640 1 -- 172.21.15.70:0/1836332246 >> v1:172.21.15.120:6789/0 conn(0x7f0a840d19f0 legacy=0x7f0a840cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a81d9b640 1 -- 172.21.15.70:0/1836332246 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840ceb20 con 0x7f0a840b2160 2023-11-26T07:19:06.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a81d9b640 1 --2- 172.21.15.70:0/1836332246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840b2160 0x7f0a840d14b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a780097c0 tx=0x7f0a7801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c4b22a82076aa12 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a8159a640 1 -- 172.21.15.70:0/1836332246 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780ab600 con 0x7f0a840b2160 2023-11-26T07:19:06.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a8159a640 1 -- 172.21.15.70:0/1836332246 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a780a7050 con 0x7f0a840b2160 2023-11-26T07:19:06.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a8159a640 1 -- 172.21.15.70:0/1836332246 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780ab980 con 0x7f0a840b2160 2023-11-26T07:19:06.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a88b57640 1 -- 172.21.15.70:0/1836332246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840b2160 msgr2=0x7f0a840d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.173+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1836332246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840b2160 0x7f0a840d14b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a780097c0 tx=0x7f0a7801c480 comp rx=0 tx=0).stop 2023-11-26T07:19:06.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- 172.21.15.70:0/1836332246 shutdown_connections 2023-11-26T07:19:06.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1836332246 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840b2160 0x7f0a840d14b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1836332246 >> v2:172.21.15.120:3300/0 conn(0x7f0a8415d6e0 0x7f0a840d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- 172.21.15.70:0/1836332246 >> 172.21.15.70:0/1836332246 conn(0x7f0a8409c550 msgr2=0x7f0a840d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:06.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- 172.21.15.70:0/1836332246 shutdown_connections 2023-11-26T07:19:06.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- 172.21.15.70:0/1836332246 wait complete. 2023-11-26T07:19:06.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 Processor -- start 2023-11-26T07:19:06.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- start start 2023-11-26T07:19:06.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840b2160 0x7f0a841fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840d19f0 0x7f0a8414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a8415d6e0 0x7f0a84159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a841589c0 con 0x7f0a8415d6e0 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a841502e0 con 0x7f0a840b2160 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a88b57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8415a760 con 0x7f0a840d19f0 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a82d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a8415d6e0 0x7f0a84159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a8259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840b2160 0x7f0a841fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a8259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840b2160 0x7f0a841fa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:49784/0 (socket says 172.21.15.70:49784) 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a8259c640 1 -- 172.21.15.70:0/1803683969 learned_addr learned my addr 172.21.15.70:0/1803683969 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:06.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a81d9b640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840d19f0 0x7f0a8414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a82d9d640 1 -- 172.21.15.70:0/1803683969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840d19f0 msgr2=0x7f0a8414fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a82d9d640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840d19f0 0x7f0a8414fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a82d9d640 1 -- 172.21.15.70:0/1803683969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840b2160 msgr2=0x7f0a841fa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a82d9d640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840b2160 0x7f0a841fa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.177+0000 7f0a82d9d640 1 -- 172.21.15.70:0/1803683969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78009420 con 0x7f0a8415d6e0 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a82d9d640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a8415d6e0 0x7f0a84159f10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c6e0 tx=0x7f0a7c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a72ffd640 1 -- 172.21.15.70:0/1803683969 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004d70 con 0x7f0a8415d6e0 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a72ffd640 1 -- 172.21.15.70:0/1803683969 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c00a640 con 0x7f0a8415d6e0 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a72ffd640 1 -- 172.21.15.70:0/1803683969 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00aa30 con 0x7f0a8415d6e0 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8415aa40 con 0x7f0a8415d6e0 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a84158ef0 con 0x7f0a8415d6e0 2023-11-26T07:19:06.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8415ac80 con 0x7f0a8415d6e0 2023-11-26T07:19:06.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a72ffd640 1 -- 172.21.15.70:0/1803683969 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a7c00ab90 con 0x7f0a8415d6e0 2023-11-26T07:19:06.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a72ffd640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0a64066470 0x7f0a64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.181+0000 7f0a72ffd640 1 -- 172.21.15.70:0/1803683969 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a7c082fb0 con 0x7f0a8415d6e0 2023-11-26T07:19:06.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.185+0000 7f0a8259c640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0a64066470 0x7f0a64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.185+0000 7f0a8259c640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0a64066470 0x7f0a64068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a840c6a20 tx=0x7f0a74009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.185+0000 7f0a72ffd640 1 -- 172.21.15.70:0/1803683969 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a7c050820 con 0x7f0a8415d6e0 2023-11-26T07:19:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.389+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0a84067680 con 0x7f0a8415d6e0 2023-11-26T07:19:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.389+0000 7f0a72ffd640 1 -- 172.21.15.70:0/1803683969 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0a7c018070 con 0x7f0a8415d6e0 2023-11-26T07:19:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0a64066470 msgr2=0x7f0a64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0a64066470 0x7f0a64068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a840c6a20 tx=0x7f0a74009190 comp rx=0 tx=0).stop 2023-11-26T07:19:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a8415d6e0 msgr2=0x7f0a84159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a8415d6e0 0x7f0a84159f10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c6e0 tx=0x7f0a7c00cba0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 shutdown_connections 2023-11-26T07:19:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0a64066470 0x7f0a64068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a8415d6e0 0x7f0a84159f10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0a840d19f0 0x7f0a8414fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 --2- 172.21.15.70:0/1803683969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a840b2160 0x7f0a841fa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 >> 172.21.15.70:0/1803683969 conn(0x7f0a8409c550 msgr2=0x7f0a840d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:06.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 shutdown_connections 2023-11-26T07:19:06.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.393+0000 7f0a88b57640 1 -- 172.21.15.70:0/1803683969 wait complete. 2023-11-26T07:19:06.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-26T07:19:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd881d1d640 1 Processor -- start 2023-11-26T07:19:06.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd881d1d640 1 -- start start 2023-11-26T07:19:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd881d1d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd881d1d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd87c0cd1b0 0x7fd87c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd881d1d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0cfc20 con 0x7fd87c143ac0 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd881d1d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c143ea0 con 0x7fd87c0cd1b0 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd881d1d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0cc730 con 0x7fd87c0cf280 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd87bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd87c0cd1b0 0x7fd87c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd87b7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd87c143ac0 0x7fd87c070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55834/0 (socket says 172.21.15.70:55834) 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd87b7fe640 1 -- 172.21.15.70:0/4292072206 learned_addr learned my addr 172.21.15.70:0/4292072206 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.549+0000 7fd87affd640 1 --2- 172.21.15.70:0/4292072206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87bfff640 1 -- 172.21.15.70:0/4292072206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 msgr2=0x7fd87c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87bfff640 1 --2- 172.21.15.70:0/4292072206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c0cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87bfff640 1 -- 172.21.15.70:0/4292072206 >> v1:172.21.15.70:6789/0 conn(0x7fd87c143ac0 legacy=0x7fd87c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87bfff640 1 -- 172.21.15.70:0/4292072206 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c070ee0 con 0x7fd87c0cd1b0 2023-11-26T07:19:06.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87bfff640 1 --2- 172.21.15.70:0/4292072206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c0cd1b0 0x7fd87c0cd5e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd874009d90 tx=0x7fd87401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5615c88c87ed3d03 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87a7fc640 1 -- 172.21.15.70:0/4292072206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740a5a10 con 0x7fd87c0cd1b0 2023-11-26T07:19:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87a7fc640 1 -- 172.21.15.70:0/4292072206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8740a5b70 con 0x7fd87c0cd1b0 2023-11-26T07:19:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd87a7fc640 1 -- 172.21.15.70:0/4292072206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740ad440 con 0x7fd87c0cd1b0 2023-11-26T07:19:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd881d1d640 1 -- 172.21.15.70:0/4292072206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c0cd1b0 msgr2=0x7fd87c0cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.553+0000 7fd881d1d640 1 --2- 172.21.15.70:0/4292072206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c0cd1b0 0x7fd87c0cd5e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd874009d90 tx=0x7fd87401c950 comp rx=0 tx=0).stop 2023-11-26T07:19:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- 172.21.15.70:0/4292072206 shutdown_connections 2023-11-26T07:19:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 --2- 172.21.15.70:0/4292072206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c0cd1b0 0x7fd87c0cd5e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 --2- 172.21.15.70:0/4292072206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c0cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- 172.21.15.70:0/4292072206 >> 172.21.15.70:0/4292072206 conn(0x7fd87c06a890 msgr2=0x7fd87c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- 172.21.15.70:0/4292072206 shutdown_connections 2023-11-26T07:19:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- 172.21.15.70:0/4292072206 wait complete. 2023-11-26T07:19:06.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 Processor -- start 2023-11-26T07:19:06.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- start start 2023-11-26T07:19:06.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87c0cd1b0 0x7fd87c13bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c143ac0 0x7fd87c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0afaa0 con 0x7fd87c143ac0 2023-11-26T07:19:06.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c13cac0 con 0x7fd87c0cd1b0 2023-11-26T07:19:06.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd881d1d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c15d540 con 0x7fd87c0cf280 2023-11-26T07:19:06.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c143ac0 0x7fd87c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c143ac0 0x7fd87c15d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33426/0 (socket says 172.21.15.70:33426) 2023-11-26T07:19:06.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 -- 172.21.15.70:0/3092159734 learned_addr learned my addr 172.21.15.70:0/3092159734 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:06.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87b7fe640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87c0cd1b0 0x7fd87c13bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87affd640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 -- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 msgr2=0x7fd87c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 -- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87c0cd1b0 msgr2=0x7fd87c13bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87c0cd1b0 0x7fd87c13bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 -- 172.21.15.70:0/3092159734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874009a70 con 0x7fd87c143ac0 2023-11-26T07:19:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.557+0000 7fd87bfff640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c143ac0 0x7fd87c15d000 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd8740b0040 tx=0x7fd8740196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd863fff640 1 -- 172.21.15.70:0/3092159734 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740add90 con 0x7fd87c143ac0 2023-11-26T07:19:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd863fff640 1 -- 172.21.15.70:0/3092159734 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874009450 con 0x7fd87c143ac0 2023-11-26T07:19:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd863fff640 1 -- 172.21.15.70:0/3092159734 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740b9690 con 0x7fd87c143ac0 2023-11-26T07:19:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c0b1340 con 0x7fd87c143ac0 2023-11-26T07:19:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c0b1900 con 0x7fd87c143ac0 2023-11-26T07:19:06.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c142f90 con 0x7fd87c143ac0 2023-11-26T07:19:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd863fff640 1 -- 172.21.15.70:0/3092159734 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8740b97f0 con 0x7fd87c143ac0 2023-11-26T07:19:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd863fff640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd868066470 0x7fd868068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd863fff640 1 -- 172.21.15.70:0/3092159734 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd87411f020 con 0x7fd87c143ac0 2023-11-26T07:19:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd87b7fe640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd868066470 0x7fd868068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.561+0000 7fd87b7fe640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd868066470 0x7fd868068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd86c005890 tx=0x7fd86c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.565+0000 7fd863fff640 1 -- 172.21.15.70:0/3092159734 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8740ec880 con 0x7fd87c143ac0 2023-11-26T07:19:06.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.769+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd87c13cc30 con 0x7fd87c143ac0 2023-11-26T07:19:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.773+0000 7fd863fff640 1 -- 172.21.15.70:0/3092159734 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd8740efea0 con 0x7fd87c143ac0 2023-11-26T07:19:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd868066470 msgr2=0x7fd868068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd868066470 0x7fd868068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd86c005890 tx=0x7fd86c009040 comp rx=0 tx=0).stop 2023-11-26T07:19:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c143ac0 msgr2=0x7fd87c15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c143ac0 0x7fd87c15d000 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd8740b0040 tx=0x7fd8740196f0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 shutdown_connections 2023-11-26T07:19:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd868066470 0x7fd868068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd87c143ac0 0x7fd87c15d000 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd87c0cf280 0x7fd87c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 --2- 172.21.15.70:0/3092159734 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87c0cd1b0 0x7fd87c13bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 >> 172.21.15.70:0/3092159734 conn(0x7fd87c06a890 msgr2=0x7fd87c0acdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:06.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 shutdown_connections 2023-11-26T07:19:06.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.777+0000 7fd881d1d640 1 -- 172.21.15.70:0/3092159734 wait complete. 2023-11-26T07:19:06.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:19:06.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c9db01640 1 Processor -- start 2023-11-26T07:19:06.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c9db01640 1 -- start start 2023-11-26T07:19:06.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c9db01640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 0x7f4c980d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c9db01640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c980cf0e0 con 0x7f4c9815d6e0 2023-11-26T07:19:06.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c9db01640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c980ceb20 con 0x7f4c980b2160 2023-11-26T07:19:06.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c9db01640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9815dac0 con 0x7f4c980d1bc0 2023-11-26T07:19:06.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c977fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4c9815d6e0 0x7f4c980d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55842/0 (socket says 172.21.15.70:55842) 2023-11-26T07:19:06.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c977fe640 1 -- 172.21.15.70:0/2135206445 learned_addr learned my addr 172.21.15.70:0/2135206445 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:06.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c96ffd640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 0x7f4c980d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104197432 0 0) 0x7f4c980cf0e0 con 0x7f4c9815d6e0 2023-11-26T07:19:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c80003530 con 0x7f4c9815d6e0 2023-11-26T07:19:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838806865 0 0) 0x7f4c80003530 con 0x7f4c9815d6e0 2023-11-26T07:19:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 msgr2=0x7f4c980d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 0x7f4c980d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 >> v1:172.21.15.120:6789/0 conn(0x7f4c980b2160 legacy=0x7f4c980b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980cee00 con 0x7f4c9815d6e0 2023-11-26T07:19:06.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f4c88001680 con 0x7f4c9815d6e0 2023-11-26T07:19:06.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 >> v1:172.21.15.70:6789/0 conn(0x7f4c9815d6e0 legacy=0x7f4c980d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 0x7f4c800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c80003f80 0x7f4c800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c80004d10 0x7f4c80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9815dac0 con 0x7f4c80004d10 2023-11-26T07:19:06.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8000bad0 con 0x7f4c80003f80 2023-11-26T07:19:06.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8000bc90 con 0x7f4c980d1bc0 2023-11-26T07:19:06.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c97fff640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c80004d10 0x7f4c80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c977fe640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 0x7f4c800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c96ffd640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c80003f80 0x7f4c800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c97fff640 1 -- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 msgr2=0x7f4c800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:06.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c97fff640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c980d1bc0 0x7f4c800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c97fff640 1 -- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c80003f80 msgr2=0x7f4c800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:06.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c97fff640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c80003f80 0x7f4c800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.933+0000 7f4c97fff640 1 -- 172.21.15.70:0/2135206445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c80003530 con 0x7f4c80004d10 2023-11-26T07:19:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c97fff640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c80004d10 0x7f4c80005190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4c90001e40 tx=0x7f4c9001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b6b9d83dec3b74 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90003b80 con 0x7f4c80004d10 2023-11-26T07:19:06.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90003ce0 con 0x7f4c80004d10 2023-11-26T07:19:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c967fc640 1 -- 172.21.15.70:0/2135206445 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900052c0 con 0x7f4c80004d10 2023-11-26T07:19:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c9db01640 1 -- 172.21.15.70:0/2135206445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c80004d10 msgr2=0x7f4c80005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c9db01640 1 --2- 172.21.15.70:0/2135206445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c80004d10 0x7f4c80005190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4c90001e40 tx=0x7f4c9001c740 comp rx=0 tx=0).stop 2023-11-26T07:19:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c97fff640 1 -- 172.21.15.70:0/2135206445 reap_dead start 2023-11-26T07:19:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c9db01640 1 -- 172.21.15.70:0/2135206445 shutdown_connections 2023-11-26T07:19:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c9db01640 1 -- 172.21.15.70:0/2135206445 >> 172.21.15.70:0/2135206445 conn(0x7f4c9809c550 msgr2=0x7f4c980d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c9db01640 1 -- 172.21.15.70:0/2135206445 shutdown_connections 2023-11-26T07:19:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.937+0000 7f4c9db01640 1 -- 172.21.15.70:0/2135206445 wait complete. 2023-11-26T07:19:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 Processor -- start 2023-11-26T07:19:06.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 -- start start 2023-11-26T07:19:06.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c80004d10 0x7f4c9815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c9815e880 0x7f4c9815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c9815f810 0x7f4c980b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98160bc0 con 0x7f4c9815e880 2023-11-26T07:19:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c981608e0 con 0x7f4c9815f810 2023-11-26T07:19:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9815dda0 con 0x7f4c80004d10 2023-11-26T07:19:06.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c9815e880 0x7f4c9815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c9815e880 0x7f4c9815ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33446/0 (socket says 172.21.15.70:33446) 2023-11-26T07:19:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 -- 172.21.15.70:0/2744351350 learned_addr learned my addr 172.21.15.70:0/2744351350 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c977fe640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c80004d10 0x7f4c9815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c97fff640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c9815f810 0x7f4c980b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 -- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c80004d10 msgr2=0x7f4c9815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c80004d10 0x7f4c9815a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 -- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c9815f810 msgr2=0x7f4c980b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:06.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c9815f810 0x7f4c980b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:06.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 -- 172.21.15.70:0/2744351350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9815e080 con 0x7f4c9815e880 2023-11-26T07:19:06.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c97fff640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c9815f810 0x7f4c980b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:06.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c96ffd640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c9815e880 0x7f4c9815ffe0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0119d0 tx=0x7f4c8c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c7ffff640 1 -- 172.21.15.70:0/2744351350 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00fb50 con 0x7f4c9815e880 2023-11-26T07:19:06.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c7ffff640 1 -- 172.21.15.70:0/2744351350 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c00fcb0 con 0x7f4c9815e880 2023-11-26T07:19:06.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c7ffff640 1 -- 172.21.15.70:0/2744351350 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c014440 con 0x7f4c9815e880 2023-11-26T07:19:06.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9815e360 con 0x7f4c9815e880 2023-11-26T07:19:06.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.941+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c98160520 con 0x7f4c9815e880 2023-11-26T07:19:06.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.945+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9815dc00 con 0x7f4c9815e880 2023-11-26T07:19:06.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.945+0000 7f4c7ffff640 1 -- 172.21.15.70:0/2744351350 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c8c0145a0 con 0x7f4c9815e880 2023-11-26T07:19:06.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.945+0000 7f4c7ffff640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c84066470 0x7f4c84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:06.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.945+0000 7f4c7ffff640 1 -- 172.21.15.70:0/2744351350 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c8c084400 con 0x7f4c9815e880 2023-11-26T07:19:06.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.945+0000 7f4c977fe640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c84066470 0x7f4c84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:06.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.945+0000 7f4c977fe640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c84066470 0x7f4c84068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c88001bf0 tx=0x7f4c88001dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:06.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:06.949+0000 7f4c7ffff640 1 -- 172.21.15.70:0/2744351350 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c9815dc00 con 0x7f4c9815e880 2023-11-26T07:19:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c9815dc00 con 0x7f4c9815e880 2023-11-26T07:19:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c7ffff640 1 -- 172.21.15.70:0/2744351350 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f4c9815dc00 con 0x7f4c9815e880 2023-11-26T07:19:07.105 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:07.105 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":31,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:19:04.089128+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:19:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c84066470 msgr2=0x7f4c84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c84066470 0x7f4c84068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c88001bf0 tx=0x7f4c88001dd0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c9815e880 msgr2=0x7f4c9815ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c9815e880 0x7f4c9815ffe0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0119d0 tx=0x7f4c8c011e90 comp rx=0 tx=0).stop 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 shutdown_connections 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c84066470 0x7f4c84068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c9815e880 0x7f4c9815ffe0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c9815f810 0x7f4c980b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.101+0000 7f4c9db01640 1 --2- 172.21.15.70:0/2744351350 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c80004d10 0x7f4c9815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.105+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 >> 172.21.15.70:0/2744351350 conn(0x7f4c9809c550 msgr2=0x7f4c9806c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.105+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 shutdown_connections 2023-11-26T07:19:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.105+0000 7f4c9db01640 1 -- 172.21.15.70:0/2744351350 wait complete. 2023-11-26T07:19:07.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:19:07.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:19:07.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.261+0000 7f6da1701640 1 Processor -- start 2023-11-26T07:19:07.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.261+0000 7f6da1701640 1 -- start start 2023-11-26T07:19:07.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6da1701640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d9c0cf280 0x7f6d9c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6da1701640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c0cc730 con 0x7f6d9c143ac0 2023-11-26T07:19:07.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6da1701640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c070ee0 con 0x7f6d9c0cd1b0 2023-11-26T07:19:07.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6da1701640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c143ea0 con 0x7f6d9c0cf280 2023-11-26T07:19:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d927fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d9c0cf280 0x7f6d9c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d9affd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6d9c143ac0 0x7f6d9c070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55848/0 (socket says 172.21.15.70:55848) 2023-11-26T07:19:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d9affd640 1 -- 172.21.15.70:0/3970251891 learned_addr learned my addr 172.21.15.70:0/3970251891 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d9a7fc640 1 -- 172.21.15.70:0/3970251891 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857303593 0 0) 0x7f6d9c0cc730 con 0x7f6d9c143ac0 2023-11-26T07:19:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d9a7fc640 1 -- 172.21.15.70:0/3970251891 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d88003530 con 0x7f6d9c143ac0 2023-11-26T07:19:07.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d927fc640 1 -- 172.21.15.70:0/3970251891 >> v1:172.21.15.120:6789/0 conn(0x7f6d9c0cd1b0 legacy=0x7f6d9c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d927fc640 1 -- 172.21.15.70:0/3970251891 >> v1:172.21.15.70:6789/0 conn(0x7f6d9c143ac0 legacy=0x7f6d9c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.265+0000 7f6d927fc640 1 -- 172.21.15.70:0/3970251891 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0711c0 con 0x7f6d9c0cf280 2023-11-26T07:19:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6d927fc640 1 --2- 172.21.15.70:0/3970251891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c0cf710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400ba60 tx=0x7f6d8401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8136641caef5d5d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6d9a7fc640 1 -- 172.21.15.70:0/3970251891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840a7b30 con 0x7f6d9c0cf280 2023-11-26T07:19:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6d9a7fc640 1 -- 172.21.15.70:0/3970251891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840a7c90 con 0x7f6d9c0cf280 2023-11-26T07:19:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6d9a7fc640 1 -- 172.21.15.70:0/3970251891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840af440 con 0x7f6d9c0cf280 2023-11-26T07:19:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 -- 172.21.15.70:0/3970251891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 msgr2=0x7f6d9c0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 --2- 172.21.15.70:0/3970251891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c0cf710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400ba60 tx=0x7f6d8401eb50 comp rx=0 tx=0).stop 2023-11-26T07:19:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 -- 172.21.15.70:0/3970251891 shutdown_connections 2023-11-26T07:19:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 --2- 172.21.15.70:0/3970251891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c0cf710 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 -- 172.21.15.70:0/3970251891 >> 172.21.15.70:0/3970251891 conn(0x7f6d9c06a890 msgr2=0x7f6d9c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:07.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 -- 172.21.15.70:0/3970251891 shutdown_connections 2023-11-26T07:19:07.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 -- 172.21.15.70:0/3970251891 wait complete. 2023-11-26T07:19:07.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 Processor -- start 2023-11-26T07:19:07.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.269+0000 7f6da1701640 1 -- start start 2023-11-26T07:19:07.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d9c0cd1b0 0x7f6d9c13fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d9c143ac0 0x7f6d9c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c140d50 con 0x7f6d9c0cf280 2023-11-26T07:19:07.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c1393c0 con 0x7f6d9c0cd1b0 2023-11-26T07:19:07.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c1400d0 con 0x7f6d9c143ac0 2023-11-26T07:19:07.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33462/0 (socket says 172.21.15.70:33462) 2023-11-26T07:19:07.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 -- 172.21.15.70:0/338487434 learned_addr learned my addr 172.21.15.70:0/338487434 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:07.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d9b7fe640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d9c143ac0 0x7f6d9c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d9affd640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d9c0cd1b0 0x7f6d9c13fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 -- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d9c143ac0 msgr2=0x7f6d9c157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d9c143ac0 0x7f6d9c157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 -- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d9c0cd1b0 msgr2=0x7f6d9c13fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d9c0cd1b0 0x7f6d9c13fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 -- 172.21.15.70:0/338487434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8400b6c0 con 0x7f6d9c0cf280 2023-11-26T07:19:07.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d9b7fe640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d9c143ac0 0x7f6d9c157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:07.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d9affd640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d9c0cd1b0 0x7f6d9c13fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:07.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d927fc640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c138e80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6d8401b760 tx=0x7f6d8401d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d93fff640 1 -- 172.21.15.70:0/338487434 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84006e20 con 0x7f6d9c0cf280 2023-11-26T07:19:07.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d93fff640 1 -- 172.21.15.70:0/338487434 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d840b0c00 con 0x7f6d9c0cf280 2023-11-26T07:19:07.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6d93fff640 1 -- 172.21.15.70:0/338487434 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84004030 con 0x7f6d9c0cf280 2023-11-26T07:19:07.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c1403b0 con 0x7f6d9c0cf280 2023-11-26T07:19:07.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c140970 con 0x7f6d9c0cf280 2023-11-26T07:19:07.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.273+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c140e90 con 0x7f6d9c0cf280 2023-11-26T07:19:07.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.277+0000 7f6d93fff640 1 -- 172.21.15.70:0/338487434 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d840b6040 con 0x7f6d9c0cf280 2023-11-26T07:19:07.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.277+0000 7f6d93fff640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6d7c066470 0x7f6d7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.277+0000 7f6d93fff640 1 -- 172.21.15.70:0/338487434 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d8411e5c0 con 0x7f6d9c0cf280 2023-11-26T07:19:07.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.277+0000 7f6d9affd640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6d7c066470 0x7f6d7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.277+0000 7f6d9affd640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6d7c066470 0x7f6d7c068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0011f0 tx=0x7f6d8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.281+0000 7f6d93fff640 1 -- 172.21.15.70:0/338487434 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d9c140e90 con 0x7f6d9c0cf280 2023-11-26T07:19:07.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d9c0ce4e0 con 0x7f6d9c0cf280 2023-11-26T07:19:07.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6d93fff640 1 -- 172.21.15.70:0/338487434 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d9c0ce4e0 con 0x7f6d9c0cf280 2023-11-26T07:19:07.437 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:19:07.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6d7c066470 msgr2=0x7f6d7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6d7c066470 0x7f6d7c068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0011f0 tx=0x7f6d8c009040 comp rx=0 tx=0).stop 2023-11-26T07:19:07.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 msgr2=0x7f6d9c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c138e80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6d8401b760 tx=0x7f6d8401d390 comp rx=0 tx=0).stop 2023-11-26T07:19:07.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 shutdown_connections 2023-11-26T07:19:07.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6d7c066470 0x7f6d7c068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d9c0cf280 0x7f6d9c138e80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d9c143ac0 0x7f6d9c157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 --2- 172.21.15.70:0/338487434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d9c0cd1b0 0x7f6d9c13fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 >> 172.21.15.70:0/338487434 conn(0x7f6d9c06a890 msgr2=0x7f6d9c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:07.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 shutdown_connections 2023-11-26T07:19:07.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.433+0000 7f6da1701640 1 -- 172.21.15.70:0/338487434 wait complete. 2023-11-26T07:19:07.457 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:19:07.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.589+0000 7f1ed638d640 1 Processor -- start 2023-11-26T07:19:07.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.589+0000 7f1ed638d640 1 -- start start 2023-11-26T07:19:07.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed638d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cf280 0x7f1ed00cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed638d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1ed00cd1b0 0x7f1ed00cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed638d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed00cfc20 con 0x7f1ed0143ac0 2023-11-26T07:19:07.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed638d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed0143ea0 con 0x7f1ed00cd1b0 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed638d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00cc730 con 0x7f1ed00cf280 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed492a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1ed00cd1b0 0x7f1ed00cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ecffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1ed0143ac0 0x7f1ed0070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55854/0 (socket says 172.21.15.70:55854) 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ecffff640 1 -- 172.21.15.70:0/935381791 learned_addr learned my addr 172.21.15.70:0/935381791 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ecf7fe640 1 --2- 172.21.15.70:0/935381791 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cf280 0x7f1ed00cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1eceffd640 1 -- 172.21.15.70:0/935381791 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329457082 0 0) 0x7f1ed00cfc20 con 0x7f1ed0143ac0 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed492a640 1 -- 172.21.15.70:0/935381791 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cf280 msgr2=0x7f1ed00cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed492a640 1 --2- 172.21.15.70:0/935381791 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cf280 0x7f1ed00cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed492a640 1 -- 172.21.15.70:0/935381791 >> v1:172.21.15.70:6789/0 conn(0x7f1ed0143ac0 legacy=0x7f1ed0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.593+0000 7f1ed492a640 1 -- 172.21.15.70:0/935381791 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0070ee0 con 0x7f1ed00cd1b0 2023-11-26T07:19:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed492a640 1 --2- 172.21.15.70:0/935381791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cd1b0 0x7f1ed00cd5e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10891abef079071 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1eceffd640 1 -- 172.21.15.70:0/935381791 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80a5a10 con 0x7f1ed00cd1b0 2023-11-26T07:19:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1eceffd640 1 -- 172.21.15.70:0/935381791 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80a5b70 con 0x7f1ed00cd1b0 2023-11-26T07:19:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1eceffd640 1 -- 172.21.15.70:0/935381791 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80ad440 con 0x7f1ed00cd1b0 2023-11-26T07:19:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 -- 172.21.15.70:0/935381791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cd1b0 msgr2=0x7f1ed00cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 --2- 172.21.15.70:0/935381791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cd1b0 0x7f1ed00cd5e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009d90 tx=0x7f1ec801c950 comp rx=0 tx=0).stop 2023-11-26T07:19:07.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 -- 172.21.15.70:0/935381791 shutdown_connections 2023-11-26T07:19:07.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 --2- 172.21.15.70:0/935381791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cd1b0 0x7f1ed00cd5e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 --2- 172.21.15.70:0/935381791 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cf280 0x7f1ed00cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 -- 172.21.15.70:0/935381791 >> 172.21.15.70:0/935381791 conn(0x7f1ed006a890 msgr2=0x7f1ed006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:07.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 -- 172.21.15.70:0/935381791 shutdown_connections 2023-11-26T07:19:07.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 -- 172.21.15.70:0/935381791 wait complete. 2023-11-26T07:19:07.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 Processor -- start 2023-11-26T07:19:07.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.597+0000 7f1ed638d640 1 -- start start 2023-11-26T07:19:07.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cd1b0 0x7f1ed00ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed00cf280 0x7f1ed0139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed0143ac0 0x7f1ed013ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00ad7e0 con 0x7f1ed0143ac0 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00ae270 con 0x7f1ed00cf280 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed015a750 con 0x7f1ed00cd1b0 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed0143ac0 0x7f1ed013ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed0143ac0 0x7f1ed013ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33472/0 (socket says 172.21.15.70:33472) 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 -- 172.21.15.70:0/2260680933 learned_addr learned my addr 172.21.15.70:0/2260680933 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ecf7fe640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed00cf280 0x7f1ed0139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ecffff640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cd1b0 0x7f1ed00ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 -- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cd1b0 msgr2=0x7f1ed00ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cd1b0 0x7f1ed00ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 -- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed00cf280 msgr2=0x7f1ed0139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed00cf280 0x7f1ed0139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 -- 172.21.15.70:0/2260680933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009a70 con 0x7f1ed0143ac0 2023-11-26T07:19:07.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed492a640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed0143ac0 0x7f1ed013ab90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ec801b000 tx=0x7f1ec80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1eccff9640 1 -- 172.21.15.70:0/2260680933 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80add10 con 0x7f1ed0143ac0 2023-11-26T07:19:07.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1eccff9640 1 -- 172.21.15.70:0/2260680933 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80ade70 con 0x7f1ed0143ac0 2023-11-26T07:19:07.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed013a110 con 0x7f1ed0143ac0 2023-11-26T07:19:07.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1eccff9640 1 -- 172.21.15.70:0/2260680933 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80b9650 con 0x7f1ed0143ac0 2023-11-26T07:19:07.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed00adcb0 con 0x7f1ed0143ac0 2023-11-26T07:19:07.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed015a8c0 con 0x7f1ed0143ac0 2023-11-26T07:19:07.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.601+0000 7f1eccff9640 1 -- 172.21.15.70:0/2260680933 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ec80b97b0 con 0x7f1ed0143ac0 2023-11-26T07:19:07.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.605+0000 7f1eccff9640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066470 0x7f1ebc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.605+0000 7f1eccff9640 1 -- 172.21.15.70:0/2260680933 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ec811f1c0 con 0x7f1ed0143ac0 2023-11-26T07:19:07.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.605+0000 7f1ecffff640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066470 0x7f1ebc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.605+0000 7f1ecffff640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066470 0x7f1ebc068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0000f70 tx=0x7f1ec0007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.609+0000 7f1eccff9640 1 -- 172.21.15.70:0/2260680933 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ec80ec980 con 0x7f1ed0143ac0 2023-11-26T07:19:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1ed0067680 con 0x7f1ed0143ac0 2023-11-26T07:19:07.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1eccff9640 1 -- 172.21.15.70:0/2260680933 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1ec8009450 con 0x7f1ed0143ac0 2023-11-26T07:19:07.764 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:07.764 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:19:07.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:07.765 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2023-11-26T07:19:07.765 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2023-11-26T07:19:07.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:07.765 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:19:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066470 msgr2=0x7f1ebc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066470 0x7f1ebc068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0000f70 tx=0x7f1ec0007b60 comp rx=0 tx=0).stop 2023-11-26T07:19:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed0143ac0 msgr2=0x7f1ed013ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed0143ac0 0x7f1ed013ab90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1ec801b000 tx=0x7f1ec80196f0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 shutdown_connections 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066470 0x7f1ebc068930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed0143ac0 0x7f1ed013ab90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed00cf280 0x7f1ed0139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 --2- 172.21.15.70:0/2260680933 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed00cd1b0 0x7f1ed00ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 >> 172.21.15.70:0/2260680933 conn(0x7f1ed006a890 msgr2=0x7f1ed00b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 shutdown_connections 2023-11-26T07:19:07.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.761+0000 7f1ed638d640 1 -- 172.21.15.70:0/2260680933 wait complete. 2023-11-26T07:19:07.785 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:19:07.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:19:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.921+0000 7f320150e640 1 Processor -- start 2023-11-26T07:19:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f320150e640 1 -- start start 2023-11-26T07:19:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f320150e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc1607c0 0x7f31fc06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f320150e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f31fc0cfb30 0x7f31fc06bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f320150e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f31fc06c230 0x7f31fc0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f320150e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc06c670 con 0x7f31fc0cfb30 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f320150e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc0d1ce0 con 0x7f31fc06c230 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f320150e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0cffd0 con 0x7f31fc1607c0 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f31fc0cfb30 0x7f31fc06bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f31fc0cfb30 0x7f31fc06bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33486/0 (socket says 172.21.15.70:33486) 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 -- 172.21.15.70:0/2342911125 learned_addr learned my addr 172.21.15.70:0/2342911125 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31fb7fe640 1 --2- 172.21.15.70:0/2342911125 >> v2:172.21.15.120:3300/0 conn(0x7f31fc06c230 0x7f31fc0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31faffd640 1 --2- 172.21.15.70:0/2342911125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc1607c0 0x7f31fc06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 -- 172.21.15.70:0/2342911125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc1607c0 msgr2=0x7f31fc06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 --2- 172.21.15.70:0/2342911125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc1607c0 0x7f31fc06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 -- 172.21.15.70:0/2342911125 >> v2:172.21.15.120:3300/0 conn(0x7f31fc06c230 msgr2=0x7f31fc0cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 --2- 172.21.15.70:0/2342911125 >> v2:172.21.15.120:3300/0 conn(0x7f31fc06c230 0x7f31fc0cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.925+0000 7f31f27fc640 1 -- 172.21.15.70:0/2342911125 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0d02b0 con 0x7f31fc0cfb30 2023-11-26T07:19:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f31f27fc640 1 --2- 172.21.15.70:0/2342911125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0cfb30 0x7f31fc06bcf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0d0590 tx=0x7f31ec01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c74d16a0112d14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f31fa7fc640 1 -- 172.21.15.70:0/2342911125 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0a89b0 con 0x7f31fc0cfb30 2023-11-26T07:19:07.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f31fa7fc640 1 -- 172.21.15.70:0/2342911125 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0a8b10 con 0x7f31fc0cfb30 2023-11-26T07:19:07.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f31fa7fc640 1 -- 172.21.15.70:0/2342911125 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0a8ea0 con 0x7f31fc0cfb30 2023-11-26T07:19:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 -- 172.21.15.70:0/2342911125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0cfb30 msgr2=0x7f31fc06bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 --2- 172.21.15.70:0/2342911125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0cfb30 0x7f31fc06bcf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0d0590 tx=0x7f31ec01ecf0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 -- 172.21.15.70:0/2342911125 shutdown_connections 2023-11-26T07:19:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 --2- 172.21.15.70:0/2342911125 >> v2:172.21.15.120:3300/0 conn(0x7f31fc06c230 0x7f31fc0cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 --2- 172.21.15.70:0/2342911125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc0cfb30 0x7f31fc06bcf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 --2- 172.21.15.70:0/2342911125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc1607c0 0x7f31fc06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 -- 172.21.15.70:0/2342911125 >> 172.21.15.70:0/2342911125 conn(0x7f31fc0d0e20 msgr2=0x7f31fc0d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:07.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 -- 172.21.15.70:0/2342911125 shutdown_connections 2023-11-26T07:19:07.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 -- 172.21.15.70:0/2342911125 wait complete. 2023-11-26T07:19:07.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.929+0000 7f320150e640 1 Processor -- start 2023-11-26T07:19:07.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 -- start start 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc06c230 0x7f31fc0ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31fc0cfb30 0x7f31fc0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc1607c0 0x7f31fc0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0c7ef0 con 0x7f31fc1607c0 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0c8140 con 0x7f31fc0cfb30 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0c8420 con 0x7f31fc06c230 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc1607c0 0x7f31fc0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc1607c0 0x7f31fc0cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33494/0 (socket says 172.21.15.70:33494) 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 -- 172.21.15.70:0/2032208523 learned_addr learned my addr 172.21.15.70:0/2032208523 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31faffd640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc06c230 0x7f31fc0ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31f27fc640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31fc0cfb30 0x7f31fc0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 -- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc06c230 msgr2=0x7f31fc0ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc06c230 0x7f31fc0ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 -- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31fc0cfb30 msgr2=0x7f31fc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31fc0cfb30 0x7f31fc0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 -- 172.21.15.70:0/2032208523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0094d0 con 0x7f31fc1607c0 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31fb7fe640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc1607c0 0x7f31fc0cd2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f31f400eed0 tx=0x7f31f400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31f3fff640 1 -- 172.21.15.70:0/2032208523 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4010040 con 0x7f31fc1607c0 2023-11-26T07:19:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31f3fff640 1 -- 172.21.15.70:0/2032208523 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4014400 con 0x7f31fc1607c0 2023-11-26T07:19:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc0c8700 con 0x7f31fc1607c0 2023-11-26T07:19:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f31f3fff640 1 -- 172.21.15.70:0/2032208523 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4009ea0 con 0x7f31fc1607c0 2023-11-26T07:19:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc0cada0 con 0x7f31fc1607c0 2023-11-26T07:19:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.933+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc06d4b0 con 0x7f31fc1607c0 2023-11-26T07:19:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.937+0000 7f31f3fff640 1 -- 172.21.15.70:0/2032208523 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31f40147b0 con 0x7f31fc1607c0 2023-11-26T07:19:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.937+0000 7f31f3fff640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31dc066470 0x7f31dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.937+0000 7f31f3fff640 1 -- 172.21.15.70:0/2032208523 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31f4084100 con 0x7f31fc1607c0 2023-11-26T07:19:07.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.937+0000 7f31faffd640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31dc066470 0x7f31dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:07.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.937+0000 7f31faffd640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31dc066470 0x7f31dc068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31e40079c0 tx=0x7f31e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:07.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:07.941+0000 7f31f3fff640 1 -- 172.21.15.70:0/2032208523 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31f4051970 con 0x7f31fc1607c0 2023-11-26T07:19:08.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.093+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f31fc067500 con 0x7f31fc1607c0 2023-11-26T07:19:08.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f31f3fff640 1 -- 172.21.15.70:0/2032208523 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f31f4054f90 con 0x7f31fc1607c0 2023-11-26T07:19:08.192 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2023-11-26T07:19:08.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31dc066470 msgr2=0x7f31dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:08.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31dc066470 0x7f31dc068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31e40079c0 tx=0x7f31e4008040 comp rx=0 tx=0).stop 2023-11-26T07:19:08.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc1607c0 msgr2=0x7f31fc0cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc1607c0 0x7f31fc0cd2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f31f400eed0 tx=0x7f31f400b480 comp rx=0 tx=0).stop 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 shutdown_connections 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31dc066470 0x7f31dc068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31fc1607c0 0x7f31fc0cd2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31fc0cfb30 0x7f31fc0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 --2- 172.21.15.70:0/2032208523 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31fc06c230 0x7f31fc0ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 >> 172.21.15.70:0/2032208523 conn(0x7f31fc0d0e20 msgr2=0x7f31fc15f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 shutdown_connections 2023-11-26T07:19:08.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.189+0000 7f320150e640 1 -- 172.21.15.70:0/2032208523 wait complete. 2023-11-26T07:19:08.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:19:08.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.357+0000 7f768923a640 1 Processor -- start 2023-11-26T07:19:08.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.357+0000 7f768923a640 1 -- start start 2023-11-26T07:19:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.357+0000 7f768923a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 0x7f7684071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f768923a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7684071e80 con 0x7f7684144720 2023-11-26T07:19:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f768923a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768406e3f0 con 0x7f768415bde0 2023-11-26T07:19:08.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f768923a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76840722f0 con 0x7f76840714e0 2023-11-26T07:19:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7684144720 0x7f768406d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55864/0 (socket says 172.21.15.70:55864) 2023-11-26T07:19:08.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 -- 172.21.15.70:0/1833167276 learned_addr learned my addr 172.21.15.70:0/1833167276 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:08.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f76837fe640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 0x7f7684071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416821668 0 0) 0x7f7684071e80 con 0x7f7684144720 2023-11-26T07:19:08.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f766c003530 con 0x7f7684144720 2023-11-26T07:19:08.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1881878756 0 0) 0x7f766c003530 con 0x7f7684144720 2023-11-26T07:19:08.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 msgr2=0x7f7684071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:08.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 0x7f7684071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 >> v1:172.21.15.120:6789/0 conn(0x7f768415bde0 legacy=0x7f768415c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768406de30 con 0x7f7684144720 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f7674001680 con 0x7f7684144720 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 >> v1:172.21.15.70:6789/0 conn(0x7f7684144720 legacy=0x7f768406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f766c0039b0 0x7f766c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 0x7f766c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c004d10 0x7f766c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840722f0 con 0x7f766c0039b0 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c00b990 con 0x7f766c004d10 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c00bb50 con 0x7f76840714e0 2023-11-26T07:19:08.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f766c0039b0 0x7f766c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7688a39640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c004d10 0x7f766c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f76837fe640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 0x7f766c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 -- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 msgr2=0x7f766c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 0x7f766c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 -- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c004d10 msgr2=0x7f766c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c004d10 0x7f766c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f7683fff640 1 -- 172.21.15.70:0/1833167276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c003530 con 0x7f766c0039b0 2023-11-26T07:19:08.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.361+0000 7f76837fe640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840714e0 0x7f766c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:08.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f7683fff640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f766c0039b0 0x7f766c003d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76740050a0 tx=0x7f767401d190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c643e15b8bf452cf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:08.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674005ae0 con 0x7f766c0039b0 2023-11-26T07:19:08.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76740a8070 con 0x7f766c0039b0 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f7682ffd640 1 -- 172.21.15.70:0/1833167276 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674005e80 con 0x7f766c0039b0 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 -- 172.21.15.70:0/1833167276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f766c0039b0 msgr2=0x7f766c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 --2- 172.21.15.70:0/1833167276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f766c0039b0 0x7f766c003d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76740050a0 tx=0x7f767401d190 comp rx=0 tx=0).stop 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f7688a39640 1 -- 172.21.15.70:0/1833167276 reap_dead start 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 -- 172.21.15.70:0/1833167276 shutdown_connections 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 -- 172.21.15.70:0/1833167276 >> 172.21.15.70:0/1833167276 conn(0x7f768406a890 msgr2=0x7f768406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 -- 172.21.15.70:0/1833167276 shutdown_connections 2023-11-26T07:19:08.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 -- 172.21.15.70:0/1833167276 wait complete. 2023-11-26T07:19:08.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 Processor -- start 2023-11-26T07:19:08.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.365+0000 7f768923a640 1 -- start start 2023-11-26T07:19:08.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c0039b0 0x7f768415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f768413e730 0x7f76840b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840b34a0 0x7f768415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840b3920 con 0x7f768413e730 2023-11-26T07:19:08.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76841604d0 con 0x7f766c0039b0 2023-11-26T07:19:08.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768415e210 con 0x7f76840b34a0 2023-11-26T07:19:08.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f768413e730 0x7f76840b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f768413e730 0x7f76840b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33520/0 (socket says 172.21.15.70:33520) 2023-11-26T07:19:08.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 -- 172.21.15.70:0/3668247307 learned_addr learned my addr 172.21.15.70:0/3668247307 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:08.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f7683fff640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c0039b0 0x7f768415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f7688a39640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840b34a0 0x7f768415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 -- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840b34a0 msgr2=0x7f768415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:08.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840b34a0 0x7f768415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 -- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c0039b0 msgr2=0x7f768415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c0039b0 0x7f768415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 -- 172.21.15.70:0/3668247307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768415e460 con 0x7f768413e730 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f7688a39640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840b34a0 0x7f768415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f76837fe640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f768413e730 0x7f76840b2f60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f76780116a0 tx=0x7f7678011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f7680ff9640 1 -- 172.21.15.70:0/3668247307 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678004220 con 0x7f768413e730 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f7680ff9640 1 -- 172.21.15.70:0/3668247307 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7678004380 con 0x7f768413e730 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768415e740 con 0x7f768413e730 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f7680ff9640 1 -- 172.21.15.70:0/3668247307 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800f9e0 con 0x7f768413e730 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768415ed00 con 0x7f768413e730 2023-11-26T07:19:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.369+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7684067500 con 0x7f768413e730 2023-11-26T07:19:08.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.373+0000 7f7680ff9640 1 -- 172.21.15.70:0/3668247307 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f767800fb40 con 0x7f768413e730 2023-11-26T07:19:08.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.373+0000 7f7680ff9640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7670066470 0x7f7670068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:08.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.373+0000 7f7680ff9640 1 -- 172.21.15.70:0/3668247307 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7678084560 con 0x7f768413e730 2023-11-26T07:19:08.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.373+0000 7f7683fff640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7670066470 0x7f7670068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:08.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.373+0000 7f7683fff640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7670066470 0x7f7670068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f767400a000 tx=0x7f76740af040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:08.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.377+0000 7f7680ff9640 1 -- 172.21.15.70:0/3668247307 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7678051ce0 con 0x7f768413e730 2023-11-26T07:19:08.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:08.529+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f768415c3f0 con 0x7f768413e730 2023-11-26T07:19:09.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.189+0000 7f7680ff9640 1 -- 172.21.15.70:0/3668247307 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f76780220d0 con 0x7f768413e730 2023-11-26T07:19:09.195 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2023-11-26T07:19:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7670066470 msgr2=0x7f7670068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7670066470 0x7f7670068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f767400a000 tx=0x7f76740af040 comp rx=0 tx=0).stop 2023-11-26T07:19:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f768413e730 msgr2=0x7f76840b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f768413e730 0x7f76840b2f60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f76780116a0 tx=0x7f7678011b60 comp rx=0 tx=0).stop 2023-11-26T07:19:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 shutdown_connections 2023-11-26T07:19:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7670066470 0x7f7670068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f768413e730 0x7f76840b2f60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f76840b34a0 0x7f768415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 --2- 172.21.15.70:0/3668247307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f766c0039b0 0x7f768415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.193+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 >> 172.21.15.70:0/3668247307 conn(0x7f768406a890 msgr2=0x7f76840b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:09.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.197+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 shutdown_connections 2023-11-26T07:19:09.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.197+0000 7f768923a640 1 -- 172.21.15.70:0/3668247307 wait complete. 2023-11-26T07:19:09.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:19:09.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513ffdf640 1 Processor -- start 2023-11-26T07:19:09.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513ffdf640 1 -- start start 2023-11-26T07:19:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513ffdf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51380cf990 0x7f513815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513ffdf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513806c520 con 0x7f513813e290 2023-11-26T07:19:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513ffdf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513806c800 con 0x7f513815f4e0 2023-11-26T07:19:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513ffdf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513806cae0 con 0x7f51380cf990 2023-11-26T07:19:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513dd7b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f513813e290 0x7f51380cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55872/0 (socket says 172.21.15.70:55872) 2023-11-26T07:19:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513dd7b640 1 -- 172.21.15.70:0/3981885512 learned_addr learned my addr 172.21.15.70:0/3981885512 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513d57a640 1 --2- 172.21.15.70:0/3981885512 >> v2:172.21.15.120:3300/0 conn(0x7f51380cf990 0x7f513815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689685491 0 0) 0x7f513806c520 con 0x7f513813e290 2023-11-26T07:19:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5124003530 con 0x7f513813e290 2023-11-26T07:19:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2471819378 0 0) 0x7f5124003530 con 0x7f513813e290 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 >> v2:172.21.15.120:3300/0 conn(0x7f51380cf990 msgr2=0x7f513815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 --2- 172.21.15.70:0/3981885512 >> v2:172.21.15.120:3300/0 conn(0x7f51380cf990 0x7f513815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 >> v1:172.21.15.120:6789/0 conn(0x7f513815f4e0 legacy=0x7f51380cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513806cdc0 con 0x7f513813e290 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f5134001680 con 0x7f513813e290 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 >> v1:172.21.15.70:6789/0 conn(0x7f513813e290 legacy=0x7f51380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5124003980 0x7f5124003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.381+0000 7f513cd79640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51240047d0 0x7f5124004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513cd79640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5124005190 0x7f512400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513806cae0 con 0x7f5124003980 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512400c030 con 0x7f51240047d0 2023-11-26T07:19:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512400c1f0 con 0x7f5124005190 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513dd7b640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5124003980 0x7f5124003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513d57a640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51240047d0 0x7f5124004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513e57c640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5124005190 0x7f512400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513dd7b640 1 -- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5124005190 msgr2=0x7f512400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513dd7b640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5124005190 0x7f512400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513dd7b640 1 -- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51240047d0 msgr2=0x7f5124004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513dd7b640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51240047d0 0x7f5124004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513dd7b640 1 -- 172.21.15.70:0/3981885512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124003530 con 0x7f5124003980 2023-11-26T07:19:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513e57c640 1 -- 172.21.15.70:0/3981885512 reap_dead start 2023-11-26T07:19:09.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513dd7b640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5124003980 0x7f5124003da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f513400c1c0 tx=0x7f513401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff813a247c1f5445 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:09.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340a5b80 con 0x7f5124003980 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340a5ce0 con 0x7f5124003980 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.385+0000 7f513cd79640 1 -- 172.21.15.70:0/3981885512 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134005b20 con 0x7f5124003980 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- 172.21.15.70:0/3981885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5124003980 msgr2=0x7f5124003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5124003980 0x7f5124003da0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f513400c1c0 tx=0x7f513401cbf0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- 172.21.15.70:0/3981885512 shutdown_connections 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 --2- 172.21.15.70:0/3981885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5124003980 0x7f5124003da0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- 172.21.15.70:0/3981885512 >> 172.21.15.70:0/3981885512 conn(0x7f513806a890 msgr2=0x7f513806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- 172.21.15.70:0/3981885512 shutdown_connections 2023-11-26T07:19:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- 172.21.15.70:0/3981885512 wait complete. 2023-11-26T07:19:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 Processor -- start 2023-11-26T07:19:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- start start 2023-11-26T07:19:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5124003980 0x7f51381f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51380ab7e0 0x7f5138071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51380abc60 0x7f5138071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380a84d0 con 0x7f51380abc60 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51380a87b0 con 0x7f5124003980 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513ffdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380a8a90 con 0x7f51380ab7e0 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51380abc60 0x7f5138071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51380abc60 0x7f5138071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33538/0 (socket says 172.21.15.70:33538) 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 -- 172.21.15.70:0/4137849452 learned_addr learned my addr 172.21.15.70:0/4137849452 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513dd7b640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5124003980 0x7f51381f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513d57a640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51380ab7e0 0x7f5138071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 -- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51380ab7e0 msgr2=0x7f5138071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51380ab7e0 0x7f5138071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 -- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5124003980 msgr2=0x7f51381f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5124003980 0x7f51381f8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.389+0000 7f513e57c640 1 -- 172.21.15.70:0/4137849452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380a8d70 con 0x7f51380abc60 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f513e57c640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51380abc60 0x7f5138071670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f513815f8c0 tx=0x7f513000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f512e7fc640 1 -- 172.21.15.70:0/4137849452 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5130003980 con 0x7f51380abc60 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f512e7fc640 1 -- 172.21.15.70:0/4137849452 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5130003ae0 con 0x7f51380abc60 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51380a9050 con 0x7f51380abc60 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f512e7fc640 1 -- 172.21.15.70:0/4137849452 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51300050d0 con 0x7f51380abc60 2023-11-26T07:19:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513815d8d0 con 0x7f51380abc60 2023-11-26T07:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5138067680 con 0x7f51380abc60 2023-11-26T07:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f512e7fc640 1 -- 172.21.15.70:0/4137849452 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5130005230 con 0x7f51380abc60 2023-11-26T07:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f512e7fc640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f511c0664a0 0x7f511c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f512e7fc640 1 -- 172.21.15.70:0/4137849452 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5130083a70 con 0x7f51380abc60 2023-11-26T07:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.393+0000 7f513dd7b640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f511c0664a0 0x7f511c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.397+0000 7f513dd7b640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f511c0664a0 0x7f511c068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51340ab000 tx=0x7f51340a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:09.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.397+0000 7f512e7fc640 1 -- 172.21.15.70:0/4137849452 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5130050f60 con 0x7f51380abc60 2023-11-26T07:19:09.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:09.581+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5138072360 con 0x7f51380abc60 2023-11-26T07:19:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.213+0000 7f512e7fc640 1 -- 172.21.15.70:0/4137849452 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5130054580 con 0x7f51380abc60 2023-11-26T07:19:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 4 and data pool 5 2023-11-26T07:19:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f511c0664a0 msgr2=0x7f511c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f511c0664a0 0x7f511c068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51340ab000 tx=0x7f51340a7070 comp rx=0 tx=0).stop 2023-11-26T07:19:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51380abc60 msgr2=0x7f5138071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51380abc60 0x7f5138071670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f513815f8c0 tx=0x7f513000ec10 comp rx=0 tx=0).stop 2023-11-26T07:19:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 shutdown_connections 2023-11-26T07:19:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f511c0664a0 0x7f511c068960 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51340ab000 tx=0x7f51340a7070 comp rx=0 tx=0).stop 2023-11-26T07:19:10.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51380abc60 0x7f5138071670 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51380ab7e0 0x7f5138071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 --2- 172.21.15.70:0/4137849452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5124003980 0x7f51381f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.217+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 >> 172.21.15.70:0/4137849452 conn(0x7f513806a890 msgr2=0x7f51381397e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:10.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.225+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 shutdown_connections 2023-11-26T07:19:10.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.229+0000 7f513ffdf640 1 -- 172.21.15.70:0/4137849452 wait complete. 2023-11-26T07:19:10.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:19:10.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f3198f01640 1 Processor -- start 2023-11-26T07:19:10.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f3198f01640 1 -- start start 2023-11-26T07:19:10.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f3198f01640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3194143ac0 0x7f3194070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f3198f01640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940708b0 0x7f31940cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f3198f01640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31940cfbf0 con 0x7f31940cf7c0 2023-11-26T07:19:10.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f3198f01640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3194143ea0 con 0x7f3194143ac0 2023-11-26T07:19:10.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f3198f01640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31940cc730 con 0x7f31940708b0 2023-11-26T07:19:10.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.401+0000 7f319259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3194143ac0 0x7f3194070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f319259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3194143ac0 0x7f3194070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33550/0 (socket says 172.21.15.70:33550) 2023-11-26T07:19:10.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f319259c640 1 -- 172.21.15.70:0/1965759842 learned_addr learned my addr 172.21.15.70:0/1965759842 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:10.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f3189d9b640 1 --2- 172.21.15.70:0/1965759842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940708b0 0x7f31940cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f319259c640 1 -- 172.21.15.70:0/1965759842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940708b0 msgr2=0x7f31940cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:10.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f319259c640 1 --2- 172.21.15.70:0/1965759842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940708b0 0x7f31940cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f319259c640 1 -- 172.21.15.70:0/1965759842 >> v1:172.21.15.120:6789/0 conn(0x7f31940cf7c0 legacy=0x7f31940b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:10.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f319259c640 1 -- 172.21.15.70:0/1965759842 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194070ee0 con 0x7f3194143ac0 2023-11-26T07:19:10.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f319259c640 1 --2- 172.21.15.70:0/1965759842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f3194070370 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f318401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21491de689703d92 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:10.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f3191d9b640 1 -- 172.21.15.70:0/1965759842 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840ab650 con 0x7f3194143ac0 2023-11-26T07:19:10.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f3191d9b640 1 -- 172.21.15.70:0/1965759842 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840ab7b0 con 0x7f3194143ac0 2023-11-26T07:19:10.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.405+0000 7f3191d9b640 1 -- 172.21.15.70:0/1965759842 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840abb40 con 0x7f3194143ac0 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- 172.21.15.70:0/1965759842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 msgr2=0x7f3194070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 --2- 172.21.15.70:0/1965759842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f3194070370 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f318401c540 comp rx=0 tx=0).stop 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- 172.21.15.70:0/1965759842 shutdown_connections 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 --2- 172.21.15.70:0/1965759842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940708b0 0x7f31940cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 --2- 172.21.15.70:0/1965759842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f3194070370 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- 172.21.15.70:0/1965759842 >> 172.21.15.70:0/1965759842 conn(0x7f319406a890 msgr2=0x7f319406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- 172.21.15.70:0/1965759842 shutdown_connections 2023-11-26T07:19:10.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- 172.21.15.70:0/1965759842 wait complete. 2023-11-26T07:19:10.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 Processor -- start 2023-11-26T07:19:10.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- start start 2023-11-26T07:19:10.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31940708b0 0x7f3194155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940cf7c0 0x7f3194134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f319413cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319406c650 con 0x7f3194143ac0 2023-11-26T07:19:10.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319406c930 con 0x7f31940708b0 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3198f01640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319406cc10 con 0x7f31940cf7c0 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3192d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f319413cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3192d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f319413cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33566/0 (socket says 172.21.15.70:33566) 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3192d9d640 1 -- 172.21.15.70:0/237189317 learned_addr learned my addr 172.21.15.70:0/237189317 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f3189d9b640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940cf7c0 0x7f3194134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.409+0000 7f319259c640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31940708b0 0x7f3194155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3192d9d640 1 -- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940cf7c0 msgr2=0x7f3194134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3192d9d640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940cf7c0 0x7f3194134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3192d9d640 1 -- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31940708b0 msgr2=0x7f3194155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3192d9d640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31940708b0 0x7f3194155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3192d9d640 1 -- 172.21.15.70:0/237189317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840094d0 con 0x7f3194143ac0 2023-11-26T07:19:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3192d9d640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f319413cc40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f318c00c730 tx=0x7f318c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:10.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f318b7fe640 1 -- 172.21.15.70:0/237189317 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c003ba0 con 0x7f3194143ac0 2023-11-26T07:19:10.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f318b7fe640 1 -- 172.21.15.70:0/237189317 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c003d00 con 0x7f3194143ac0 2023-11-26T07:19:10.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319406cef0 con 0x7f3194143ac0 2023-11-26T07:19:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f318b7fe640 1 -- 172.21.15.70:0/237189317 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c005310 con 0x7f3194143ac0 2023-11-26T07:19:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31941560b0 con 0x7f3194143ac0 2023-11-26T07:19:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319406d130 con 0x7f3194143ac0 2023-11-26T07:19:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f318b7fe640 1 -- 172.21.15.70:0/237189317 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f318c005470 con 0x7f3194143ac0 2023-11-26T07:19:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.413+0000 7f318b7fe640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31740664a0 0x7f3174068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.417+0000 7f318b7fe640 1 -- 172.21.15.70:0/237189317 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f318c083af0 con 0x7f3194143ac0 2023-11-26T07:19:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.417+0000 7f319259c640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31740664a0 0x7f3174068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.417+0000 7f319259c640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31740664a0 0x7f3174068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f31840af000 tx=0x7f31840b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:10.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.421+0000 7f318b7fe640 1 -- 172.21.15.70:0/237189317 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f319406d130 con 0x7f3194143ac0 2023-11-26T07:19:10.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.569+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f319406c790 con 0x7f3194143ac0 2023-11-26T07:19:10.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f318b7fe640 1 -- 172.21.15.70:0/237189317 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f319406c790 con 0x7f3194143ac0 2023-11-26T07:19:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:10.577 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:19:09.584668+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:19:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31740664a0 msgr2=0x7f3174068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31740664a0 0x7f3174068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f31840af000 tx=0x7f31840b6040 comp rx=0 tx=0).stop 2023-11-26T07:19:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 msgr2=0x7f319413cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f319413cc40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f318c00c730 tx=0x7f318c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 shutdown_connections 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f31740664a0 0x7f3174068960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3194143ac0 0x7f319413cc40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f31940cf7c0 0x7f3194134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 --2- 172.21.15.70:0/237189317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31940708b0 0x7f3194155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 >> 172.21.15.70:0/237189317 conn(0x7f319406a890 msgr2=0x7f31940b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 shutdown_connections 2023-11-26T07:19:10.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.573+0000 7f3198f01640 1 -- 172.21.15.70:0/237189317 wait complete. 2023-11-26T07:19:10.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:19:10.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.729+0000 7f0b4e135640 1 Processor -- start 2023-11-26T07:19:10.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b4e135640 1 -- start start 2023-11-26T07:19:10.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b4e135640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b4813e290 0x7f0b480cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b4e135640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0b4815f6b0 0x7f0b480cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b4e135640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4815fb20 con 0x7f0b480cf7c0 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b4e135640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b480cfc40 con 0x7f0b4815f6b0 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b4e135640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4806c520 con 0x7f0b4813e290 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b47fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0b4815f6b0 0x7f0b480cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b46ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0b480cf7c0 0x7f0b4815efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55882/0 (socket says 172.21.15.70:55882) 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b46ffd640 1 -- 172.21.15.70:0/1275053925 learned_addr learned my addr 172.21.15.70:0/1275053925 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:10.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b477fe640 1 --2- 172.21.15.70:0/1275053925 >> v2:172.21.15.120:3300/0 conn(0x7f0b4813e290 0x7f0b480cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b47fff640 1 -- 172.21.15.70:0/1275053925 >> v2:172.21.15.120:3300/0 conn(0x7f0b4813e290 msgr2=0x7f0b480cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:10.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b47fff640 1 --2- 172.21.15.70:0/1275053925 >> v2:172.21.15.120:3300/0 conn(0x7f0b4813e290 0x7f0b480cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b47fff640 1 -- 172.21.15.70:0/1275053925 >> v1:172.21.15.70:6789/0 conn(0x7f0b480cf7c0 legacy=0x7f0b4815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b47fff640 1 -- 172.21.15.70:0/1275053925 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4806c800 con 0x7f0b4815f6b0 2023-11-26T07:19:10.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.733+0000 7f0b467fc640 1 -- 172.21.15.70:0/1275053925 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128930802 0 0) 0x7f0b3c001120 con 0x7f0b480cf7c0 2023-11-26T07:19:10.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b47fff640 1 --2- 172.21.15.70:0/1275053925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480cd7b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0b480725a0 tx=0x7f0b4001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a89939ab261281 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:10.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b467fc640 1 -- 172.21.15.70:0/1275053925 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400a59a0 con 0x7f0b4815f6b0 2023-11-26T07:19:10.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b467fc640 1 -- 172.21.15.70:0/1275053925 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b400a5b00 con 0x7f0b4815f6b0 2023-11-26T07:19:10.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b467fc640 1 -- 172.21.15.70:0/1275053925 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400a5e90 con 0x7f0b4815f6b0 2023-11-26T07:19:10.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 -- 172.21.15.70:0/1275053925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 msgr2=0x7f0b480cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 --2- 172.21.15.70:0/1275053925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480cd7b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0b480725a0 tx=0x7f0b4001c8e0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 -- 172.21.15.70:0/1275053925 shutdown_connections 2023-11-26T07:19:10.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 --2- 172.21.15.70:0/1275053925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480cd7b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 --2- 172.21.15.70:0/1275053925 >> v2:172.21.15.120:3300/0 conn(0x7f0b4813e290 0x7f0b480cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 -- 172.21.15.70:0/1275053925 >> 172.21.15.70:0/1275053925 conn(0x7f0b4806a890 msgr2=0x7f0b4806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:10.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 -- 172.21.15.70:0/1275053925 shutdown_connections 2023-11-26T07:19:10.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 -- 172.21.15.70:0/1275053925 wait complete. 2023-11-26T07:19:10.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 Processor -- start 2023-11-26T07:19:10.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.737+0000 7f0b4e135640 1 -- start start 2023-11-26T07:19:10.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b480cf7c0 0x7f0b4815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b4813e290 0x7f0b4815d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b48138150 con 0x7f0b4815f6b0 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b481f5950 con 0x7f0b480cf7c0 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b48071710 con 0x7f0b4813e290 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33576/0 (socket says 172.21.15.70:33576) 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 -- 172.21.15.70:0/2679671164 learned_addr learned my addr 172.21.15.70:0/2679671164 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b46ffd640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b4813e290 0x7f0b4815d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b477fe640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b480cf7c0 0x7f0b4815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 -- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b4813e290 msgr2=0x7f0b4815d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b4813e290 0x7f0b4815d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 -- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b480cf7c0 msgr2=0x7f0b4815bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b480cf7c0 0x7f0b4815bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 -- 172.21.15.70:0/2679671164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40009a70 con 0x7f0b4815f6b0 2023-11-26T07:19:10.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b47fff640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480b30c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0b400984c0 tx=0x7f0b40019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:10.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b2ffff640 1 -- 172.21.15.70:0/2679671164 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400aedc0 con 0x7f0b4815f6b0 2023-11-26T07:19:10.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b2ffff640 1 -- 172.21.15.70:0/2679671164 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40009450 con 0x7f0b4815f6b0 2023-11-26T07:19:10.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b2ffff640 1 -- 172.21.15.70:0/2679671164 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b400b7650 con 0x7f0b4815f6b0 2023-11-26T07:19:10.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b48070b90 con 0x7f0b4815f6b0 2023-11-26T07:19:10.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b48071150 con 0x7f0b4815f6b0 2023-11-26T07:19:10.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b48067680 con 0x7f0b4815f6b0 2023-11-26T07:19:10.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.741+0000 7f0b2ffff640 1 -- 172.21.15.70:0/2679671164 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b400b4050 con 0x7f0b4815f6b0 2023-11-26T07:19:10.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.745+0000 7f0b2ffff640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b34066470 0x7f0b34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:10.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.745+0000 7f0b2ffff640 1 -- 172.21.15.70:0/2679671164 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b4011e9f0 con 0x7f0b4815f6b0 2023-11-26T07:19:10.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.745+0000 7f0b477fe640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b34066470 0x7f0b34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:10.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.745+0000 7f0b477fe640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b34066470 0x7f0b34068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009b60 tx=0x7f0b38009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:10.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.749+0000 7f0b2ffff640 1 -- 172.21.15.70:0/2679671164 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b400ebf10 con 0x7f0b4815f6b0 2023-11-26T07:19:10.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.897+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b481f5ac0 con 0x7f0b4815f6b0 2023-11-26T07:19:10.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b2ffff640 1 -- 172.21.15.70:0/2679671164 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f0b400ef530 con 0x7f0b4815f6b0 2023-11-26T07:19:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:10.904 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:19:09.584668+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:19:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b34066470 msgr2=0x7f0b34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b34066470 0x7f0b34068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009b60 tx=0x7f0b38009190 comp rx=0 tx=0).stop 2023-11-26T07:19:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 msgr2=0x7f0b480b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480b30c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0b400984c0 tx=0x7f0b40019680 comp rx=0 tx=0).stop 2023-11-26T07:19:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 shutdown_connections 2023-11-26T07:19:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b34066470 0x7f0b34068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b4815f6b0 0x7f0b480b30c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b4813e290 0x7f0b4815d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 --2- 172.21.15.70:0/2679671164 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b480cf7c0 0x7f0b4815bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:10.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 >> 172.21.15.70:0/2679671164 conn(0x7f0b4806a890 msgr2=0x7f0b48139fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:10.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 shutdown_connections 2023-11-26T07:19:10.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:10.901+0000 7f0b4e135640 1 -- 172.21.15.70:0/2679671164 wait complete. 2023-11-26T07:19:10.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:19:11.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.061+0000 7f723ba91640 1 Processor -- start 2023-11-26T07:19:11.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.061+0000 7f723ba91640 1 -- start start 2023-11-26T07:19:11.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.061+0000 7f723ba91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72340cf990 0x7f72340708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:11.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.061+0000 7f723ba91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7234070e00 0x7f7234162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:11.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.061+0000 7f723ba91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7234162080 con 0x7f723414b1e0 2023-11-26T07:19:11.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.061+0000 7f723ba91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7234161d70 con 0x7f72340cf990 2023-11-26T07:19:11.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.061+0000 7f723ba91640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723414b5c0 con 0x7f7234070e00 2023-11-26T07:19:11.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723a02e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7234070e00 0x7f7234162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:11.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723902c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f72340cf990 0x7f72340708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:11.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723982d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f723414b1e0 0x7f72340cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:33348/0 (socket says 172.21.15.70:33348) 2023-11-26T07:19:11.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723982d640 1 -- 172.21.15.70:0/1697389932 learned_addr learned my addr 172.21.15.70:0/1697389932 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:11.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723a02e640 1 -- 172.21.15.70:0/1697389932 >> v2:172.21.15.120:3300/0 conn(0x7f72340cf990 msgr2=0x7f72340708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:11.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723a02e640 1 --2- 172.21.15.70:0/1697389932 >> v2:172.21.15.120:3300/0 conn(0x7f72340cf990 0x7f72340708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:11.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723a02e640 1 -- 172.21.15.70:0/1697389932 >> v1:172.21.15.120:6789/0 conn(0x7f723414b1e0 legacy=0x7f72340cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:11.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723a02e640 1 -- 172.21.15.70:0/1697389932 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7234071580 con 0x7f7234070e00 2023-11-26T07:19:11.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.065+0000 7f723a02e640 1 --2- 172.21.15.70:0/1697389932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7234070e00 0x7f7234162510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f722c009d90 tx=0x7f722c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc6261ad6c88ca0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:11.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723882b640 1 -- 172.21.15.70:0/1697389932 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0a59e0 con 0x7f7234070e00 2023-11-26T07:19:11.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723882b640 1 -- 172.21.15.70:0/1697389932 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c0a5b40 con 0x7f7234070e00 2023-11-26T07:19:11.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723882b640 1 -- 172.21.15.70:0/1697389932 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0ad440 con 0x7f7234070e00 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- 172.21.15.70:0/1697389932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7234070e00 msgr2=0x7f7234162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 --2- 172.21.15.70:0/1697389932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7234070e00 0x7f7234162510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f722c009d90 tx=0x7f722c01c920 comp rx=0 tx=0).stop 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- 172.21.15.70:0/1697389932 shutdown_connections 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 --2- 172.21.15.70:0/1697389932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7234070e00 0x7f7234162510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 --2- 172.21.15.70:0/1697389932 >> v2:172.21.15.120:3300/0 conn(0x7f72340cf990 0x7f72340708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- 172.21.15.70:0/1697389932 >> 172.21.15.70:0/1697389932 conn(0x7f723406a890 msgr2=0x7f723406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- 172.21.15.70:0/1697389932 shutdown_connections 2023-11-26T07:19:11.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- 172.21.15.70:0/1697389932 wait complete. 2023-11-26T07:19:11.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 Processor -- start 2023-11-26T07:19:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- start start 2023-11-26T07:19:11.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7234070e00 0x7f7234144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:11.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72340cf990 0x7f723415f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:11.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f723414b1e0 0x7f7234160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723415fac0 con 0x7f723414b1e0 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723415fda0 con 0x7f7234070e00 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723ba91640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7234160080 con 0x7f72340cf990 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.069+0000 7f723a02e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f723414b1e0 0x7f7234160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723982d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7234070e00 0x7f7234144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f723414b1e0 0x7f7234160b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33586/0 (socket says 172.21.15.70:33586) 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 -- 172.21.15.70:0/4087546842 learned_addr learned my addr 172.21.15.70:0/4087546842 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723902c640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72340cf990 0x7f723415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 -- 172.21.15.70:0/4087546842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72340cf990 msgr2=0x7f723415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72340cf990 0x7f723415f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 -- 172.21.15.70:0/4087546842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7234070e00 msgr2=0x7f7234144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7234070e00 0x7f7234144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:11.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 -- 172.21.15.70:0/4087546842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c009a70 con 0x7f723414b1e0 2023-11-26T07:19:11.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723a02e640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f723414b1e0 0x7f7234160b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f722c01afd0 tx=0x7f722c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f722a7fc640 1 -- 172.21.15.70:0/4087546842 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0add90 con 0x7f723414b1e0 2023-11-26T07:19:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f722a7fc640 1 -- 172.21.15.70:0/4087546842 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c009450 con 0x7f723414b1e0 2023-11-26T07:19:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7234160360 con 0x7f723414b1e0 2023-11-26T07:19:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f722a7fc640 1 -- 172.21.15.70:0/4087546842 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0b9670 con 0x7f723414b1e0 2023-11-26T07:19:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723415f6c0 con 0x7f723414b1e0 2023-11-26T07:19:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7234160880 con 0x7f723414b1e0 2023-11-26T07:19:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.073+0000 7f722a7fc640 1 -- 172.21.15.70:0/4087546842 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f722c0b97d0 con 0x7f723414b1e0 2023-11-26T07:19:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.077+0000 7f722a7fc640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7218066470 0x7f7218068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.077+0000 7f722a7fc640 1 -- 172.21.15.70:0/4087546842 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f722c11f530 con 0x7f723414b1e0 2023-11-26T07:19:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.077+0000 7f723982d640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7218066470 0x7f7218068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.077+0000 7f723982d640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7218066470 0x7f7218068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7230005890 tx=0x7f7230009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:11.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.081+0000 7f722a7fc640 1 -- 172.21.15.70:0/4087546842 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7234160880 con 0x7f723414b1e0 2023-11-26T07:19:11.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:11.265+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7234160880 con 0x7f723414b1e0 2023-11-26T07:19:12.181 INFO:tasks.ceph.mds.a.smithi070.stderr:2023-11-26T07:19:12.177+0000 7f9956006640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:19:12.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.225+0000 7f722a7fc640 1 -- 172.21.15.70:0/4087546842 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7234160880 con 0x7f723414b1e0 2023-11-26T07:19:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7218066470 msgr2=0x7f7218068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7218066470 0x7f7218068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7230005890 tx=0x7f7230009040 comp rx=0 tx=0).stop 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f723414b1e0 msgr2=0x7f7234160b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f723414b1e0 0x7f7234160b60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f722c01afd0 tx=0x7f722c0196c0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 shutdown_connections 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7218066470 0x7f7218068930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f723414b1e0 0x7f7234160b60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72340cf990 0x7f723415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 --2- 172.21.15.70:0/4087546842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7234070e00 0x7f7234144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 >> 172.21.15.70:0/4087546842 conn(0x7f723406a890 msgr2=0x7f723406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 shutdown_connections 2023-11-26T07:19:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.229+0000 7f723ba91640 1 -- 172.21.15.70:0/4087546842 wait complete. 2023-11-26T07:19:12.253 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:19:12.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:19:12.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.389+0000 7f1c6b357640 1 Processor -- start 2023-11-26T07:19:12.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.389+0000 7f1c6b357640 1 -- start start 2023-11-26T07:19:12.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c6b357640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c6413e290 0x7f1c640cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:12.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c6b357640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c640cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:12.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c6b357640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6406c520 con 0x7f1c640cf7c0 2023-11-26T07:19:12.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c6b357640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c640cfc40 con 0x7f1c6413e290 2023-11-26T07:19:12.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c6b357640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6415fb40 con 0x7f1c6415f6b0 2023-11-26T07:19:12.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c690f3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c6413e290 0x7f1c640cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c688f2640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1c640cf7c0 0x7f1c6415efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:33356/0 (socket says 172.21.15.70:33356) 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c698f4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c640cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c688f2640 1 -- 172.21.15.70:0/127538466 learned_addr learned my addr 172.21.15.70:0/127538466 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c690f3640 1 -- 172.21.15.70:0/127538466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 msgr2=0x7f1c640cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c690f3640 1 --2- 172.21.15.70:0/127538466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c640cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c690f3640 1 -- 172.21.15.70:0/127538466 >> v1:172.21.15.120:6789/0 conn(0x7f1c640cf7c0 legacy=0x7f1c6415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c690f3640 1 -- 172.21.15.70:0/127538466 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6406c800 con 0x7f1c6413e290 2023-11-26T07:19:12.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.393+0000 7f1c5bfff640 1 -- 172.21.15.70:0/127538466 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981009374 0 0) 0x7f1c6406c520 con 0x7f1c640cf7c0 2023-11-26T07:19:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c690f3640 1 --2- 172.21.15.70:0/127538466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 0x7f1c640cf280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c600097c0 tx=0x7f1c6001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bec504297617415e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c5bfff640 1 -- 172.21.15.70:0/127538466 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600ab650 con 0x7f1c6413e290 2023-11-26T07:19:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c5bfff640 1 -- 172.21.15.70:0/127538466 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c600ab7b0 con 0x7f1c6413e290 2023-11-26T07:19:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c5bfff640 1 -- 172.21.15.70:0/127538466 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600abb40 con 0x7f1c6413e290 2023-11-26T07:19:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 -- 172.21.15.70:0/127538466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 msgr2=0x7f1c640cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 --2- 172.21.15.70:0/127538466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 0x7f1c640cf280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c600097c0 tx=0x7f1c6001c450 comp rx=0 tx=0).stop 2023-11-26T07:19:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 -- 172.21.15.70:0/127538466 shutdown_connections 2023-11-26T07:19:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 --2- 172.21.15.70:0/127538466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c640cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 --2- 172.21.15.70:0/127538466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 0x7f1c640cf280 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 -- 172.21.15.70:0/127538466 >> 172.21.15.70:0/127538466 conn(0x7f1c6406a890 msgr2=0x7f1c6406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 -- 172.21.15.70:0/127538466 shutdown_connections 2023-11-26T07:19:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 -- 172.21.15.70:0/127538466 wait complete. 2023-11-26T07:19:12.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.397+0000 7f1c6b357640 1 Processor -- start 2023-11-26T07:19:12.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 -- start start 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c640cf7c0 0x7f1c641511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 0x7f1c6415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c6415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641373e0 con 0x7f1c640cf7c0 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641376c0 con 0x7f1c6413e290 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641379a0 con 0x7f1c6415f6b0 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c640cf7c0 0x7f1c641511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c640cf7c0 0x7f1c641511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33600/0 (socket says 172.21.15.70:33600) 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 -- 172.21.15.70:0/2540429451 learned_addr learned my addr 172.21.15.70:0/2540429451 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c688f2640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 0x7f1c6415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:12.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c698f4640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c6415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:12.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 -- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 msgr2=0x7f1c6415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:12.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c6415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 -- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 msgr2=0x7f1c6415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:12.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 0x7f1c6415a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:12.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 -- 172.21.15.70:0/2540429451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60009420 con 0x7f1c640cf7c0 2023-11-26T07:19:12.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c690f3640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c640cf7c0 0x7f1c641511c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1c600ad040 tx=0x7f1c6001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:12.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c59ffb640 1 -- 172.21.15.70:0/2540429451 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600bf610 con 0x7f1c640cf7c0 2023-11-26T07:19:12.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c59ffb640 1 -- 172.21.15.70:0/2540429451 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c600bf790 con 0x7f1c640cf7c0 2023-11-26T07:19:12.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c64138db0 con 0x7f1c640cf7c0 2023-11-26T07:19:12.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c59ffb640 1 -- 172.21.15.70:0/2540429451 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600bfb40 con 0x7f1c640cf7c0 2023-11-26T07:19:12.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c64151700 con 0x7f1c640cf7c0 2023-11-26T07:19:12.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.401+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c641518f0 con 0x7f1c640cf7c0 2023-11-26T07:19:12.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.405+0000 7f1c59ffb640 1 -- 172.21.15.70:0/2540429451 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c600b5400 con 0x7f1c640cf7c0 2023-11-26T07:19:12.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.405+0000 7f1c59ffb640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1c48066470 0x7f1c48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:12.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.405+0000 7f1c59ffb640 1 -- 172.21.15.70:0/2540429451 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c6011ef50 con 0x7f1c640cf7c0 2023-11-26T07:19:12.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.405+0000 7f1c688f2640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1c48066470 0x7f1c48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:12.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.405+0000 7f1c688f2640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1c48066470 0x7f1c48068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c6415ad20 tx=0x7f1c54007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:12.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.409+0000 7f1c59ffb640 1 -- 172.21.15.70:0/2540429451 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c600ec350 con 0x7f1c640cf7c0 2023-11-26T07:19:12.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:12.589+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1c64067680 con 0x7f1c640cf7c0 2023-11-26T07:19:13.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c59ffb640 1 -- 172.21.15.70:0/2540429451 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c600ef970 con 0x7f1c640cf7c0 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1c48066470 msgr2=0x7f1c48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1c48066470 0x7f1c48068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c6415ad20 tx=0x7f1c54007d60 comp rx=0 tx=0).stop 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c640cf7c0 msgr2=0x7f1c641511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c640cf7c0 0x7f1c641511c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1c600ad040 tx=0x7f1c6001ac90 comp rx=0 tx=0).stop 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 shutdown_connections 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1c6415f6b0 0x7f1c6415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c6413e290 0x7f1c6415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1c48066470 0x7f1c48068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 --2- 172.21.15.70:0/2540429451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c640cf7c0 0x7f1c641511c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 >> 172.21.15.70:0/2540429451 conn(0x7f1c6406a890 msgr2=0x7f1c6415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:13.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 shutdown_connections 2023-11-26T07:19:13.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.233+0000 7f1c6b357640 1 -- 172.21.15.70:0/2540429451 wait complete. 2023-11-26T07:19:13.260 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:19:13.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:19:13.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b41d3e640 1 Processor -- start 2023-11-26T07:19:13.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b41d3e640 1 -- start start 2023-11-26T07:19:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b41d3e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 0x7f1b3c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b41d3e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0cf0e0 con 0x7f1b3c15d6e0 2023-11-26T07:19:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b41d3e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0ceb20 con 0x7f1b3c0d1bc0 2023-11-26T07:19:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b41d3e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c15dac0 con 0x7f1b3c0b2160 2023-11-26T07:19:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3b7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1b3c15d6e0 0x7f1b3c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:55884/0 (socket says 172.21.15.70:55884) 2023-11-26T07:19:13.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/51376670 learned_addr learned my addr 172.21.15.70:0/51376670 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:13.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017258477 0 0) 0x7f1b3c0cf0e0 con 0x7f1b3c15d6e0 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3bfff640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 0x7f1b3c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b24003530 con 0x7f1b3c15d6e0 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950567827 0 0) 0x7f1b24003530 con 0x7f1b3c15d6e0 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 msgr2=0x7f1b3c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 0x7f1b3c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 >> v1:172.21.15.120:6789/0 conn(0x7f1b3c0d1bc0 legacy=0x7f1b3c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0cee00 con 0x7f1b3c15d6e0 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f1b2c001680 con 0x7f1b3c15d6e0 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 >> v1:172.21.15.70:6789/0 conn(0x7f1b3c15d6e0 legacy=0x7f1b3c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 0x7f1b240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b24004d10 0x7f1b24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c15dac0 con 0x7f1b240039b0 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2400b990 con 0x7f1b24004d10 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2400bb50 con 0x7f1b3c0b2160 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3b7fe640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.397+0000 7f1b3affd640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 0x7f1b240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3bfff640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b24004d10 0x7f1b24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 msgr2=0x7f1b240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3b7fe640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c0b2160 0x7f1b240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b24004d10 msgr2=0x7f1b24005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3b7fe640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b24004d10 0x7f1b24005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/51376670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24003530 con 0x7f1b240039b0 2023-11-26T07:19:13.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3b7fe640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b24003d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c210 tx=0x7f1b2c01cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccce74f2d9af7dd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:13.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c005ae0 con 0x7f1b240039b0 2023-11-26T07:19:13.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c005c60 con 0x7f1b240039b0 2023-11-26T07:19:13.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3a7fc640 1 -- 172.21.15.70:0/51376670 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0a5850 con 0x7f1b240039b0 2023-11-26T07:19:13.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b41d3e640 1 -- 172.21.15.70:0/51376670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 msgr2=0x7f1b24003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b41d3e640 1 --2- 172.21.15.70:0/51376670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b24003d90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c210 tx=0x7f1b2c01cb70 comp rx=0 tx=0).stop 2023-11-26T07:19:13.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b3bfff640 1 -- 172.21.15.70:0/51376670 reap_dead start 2023-11-26T07:19:13.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b41d3e640 1 -- 172.21.15.70:0/51376670 shutdown_connections 2023-11-26T07:19:13.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b41d3e640 1 -- 172.21.15.70:0/51376670 >> 172.21.15.70:0/51376670 conn(0x7f1b3c09c550 msgr2=0x7f1b3c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:13.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b41d3e640 1 -- 172.21.15.70:0/51376670 shutdown_connections 2023-11-26T07:19:13.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.401+0000 7f1b41d3e640 1 -- 172.21.15.70:0/51376670 wait complete. 2023-11-26T07:19:13.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 Processor -- start 2023-11-26T07:19:13.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 -- start start 2023-11-26T07:19:13.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b3c0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b3c156200 0x7f1b3c155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c1f6090 0x7f1b3c1f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b72b0 con 0x7f1b240039b0 2023-11-26T07:19:13.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0cc540 con 0x7f1b3c156200 2023-11-26T07:19:13.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b41d3e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0cc7c0 con 0x7f1b3c1f6090 2023-11-26T07:19:13.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b3c0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b3c0cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33622/0 (socket says 172.21.15.70:33622) 2023-11-26T07:19:13.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/3768889573 learned_addr learned my addr 172.21.15.70:0/3768889573 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:13.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3bfff640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c1f6090 0x7f1b3c1f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3affd640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b3c156200 0x7f1b3c155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c1f6090 msgr2=0x7f1b3c1f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c1f6090 0x7f1b3c1f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b3c156200 msgr2=0x7f1b3c155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b3c156200 0x7f1b3c155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 -- 172.21.15.70:0/3768889573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0b6980 con 0x7f1b240039b0 2023-11-26T07:19:13.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.405+0000 7f1b3b7fe640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b3c0cc000 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c01c5e0 tx=0x7f1b24005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:13.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b23fff640 1 -- 172.21.15.70:0/3768889573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0b4070 con 0x7f1b240039b0 2023-11-26T07:19:13.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b23fff640 1 -- 172.21.15.70:0/3768889573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c001440 con 0x7f1b240039b0 2023-11-26T07:19:13.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b23fff640 1 -- 172.21.15.70:0/3768889573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0017b0 con 0x7f1b240039b0 2023-11-26T07:19:13.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c0b6c60 con 0x7f1b240039b0 2023-11-26T07:19:13.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c155ec0 con 0x7f1b240039b0 2023-11-26T07:19:13.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c067680 con 0x7f1b240039b0 2023-11-26T07:19:13.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b23fff640 1 -- 172.21.15.70:0/3768889573 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b2c0a5850 con 0x7f1b240039b0 2023-11-26T07:19:13.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b23fff640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b280664a0 0x7f1b28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b23fff640 1 -- 172.21.15.70:0/3768889573 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b2c11d820 con 0x7f1b240039b0 2023-11-26T07:19:13.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.409+0000 7f1b3affd640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b280664a0 0x7f1b28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.413+0000 7f1b3affd640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b280664a0 0x7f1b28068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c068140 tx=0x7f1b300014c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.413+0000 7f1b23fff640 1 -- 172.21.15.70:0/3768889573 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b2c0eacc0 con 0x7f1b240039b0 2023-11-26T07:19:13.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.593+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b3c0d08e0 con 0x7f1b240039b0 2023-11-26T07:19:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.593+0000 7f1b23fff640 1 -- 172.21.15.70:0/3768889573 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f1b2c0ee2e0 con 0x7f1b240039b0 2023-11-26T07:19:13.599 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:13.599 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3437884487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3437884487},{"type":"v1","addr":"172.21.15.70:6837","nonce":3437884487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1405314765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1405314765},{"type":"v1","addr":"172.21.15.120:6833","nonce":1405314765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2357317721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2357317721},{"type":"v1","addr":"172.21.15.120:6835","nonce":2357317721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:19:09.585008+0000","modified":"2023-11-26T07:19:12.594028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.70:6836/4160736209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4160736209},{"type":"v1","addr":"172.21.15.70:6836","nonce":4160736209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:19:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 18 2023-11-26T07:19:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b280664a0 msgr2=0x7f1b28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b280664a0 0x7f1b28068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c068140 tx=0x7f1b300014c0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 msgr2=0x7f1b3c0cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b3c0cc000 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c01c5e0 tx=0x7f1b24005800 comp rx=0 tx=0).stop 2023-11-26T07:19:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 shutdown_connections 2023-11-26T07:19:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b3c1f6090 0x7f1b3c1f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b3c156200 0x7f1b3c155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b280664a0 0x7f1b28068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 --2- 172.21.15.70:0/3768889573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b240039b0 0x7f1b3c0cc000 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 >> 172.21.15.70:0/3768889573 conn(0x7f1b3c09c550 msgr2=0x7f1b3c0cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 shutdown_connections 2023-11-26T07:19:13.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.597+0000 7f1b41d3e640 1 -- 172.21.15.70:0/3768889573 wait complete. 2023-11-26T07:19:13.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:19:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.753+0000 7f953109c640 1 Processor -- start 2023-11-26T07:19:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.753+0000 7f953109c640 1 -- start start 2023-11-26T07:19:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f953109c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f953109c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c06c520 con 0x7f952c15f6b0 2023-11-26T07:19:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f953109c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c06c800 con 0x7f952c0cf7c0 2023-11-26T07:19:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f953109c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0cfc40 con 0x7f952c13e290 2023-11-26T07:19:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952b59e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f952c15f6b0 0x7f952c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39914/0 (socket says 172.21.15.70:39914) 2023-11-26T07:19:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952b59e640 1 -- 172.21.15.70:0/25425093 learned_addr learned my addr 172.21.15.70:0/25425093 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952ad9d640 1 --2- 172.21.15.70:0/25425093 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331642186 0 0) 0x7f952c06c520 con 0x7f952c15f6b0 2023-11-26T07:19:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9518003530 con 0x7f952c15f6b0 2023-11-26T07:19:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612278143 0 0) 0x7f952c06c800 con 0x7f952c0cf7c0 2023-11-26T07:19:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f952c06c520 con 0x7f952c0cf7c0 2023-11-26T07:19:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952ad9d640 1 -- 172.21.15.70:0/25425093 >> v1:172.21.15.120:6789/0 conn(0x7f952c0cf7c0 legacy=0x7f952c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952ad9d640 1 -- 172.21.15.70:0/25425093 >> v1:172.21.15.70:6789/0 conn(0x7f952c15f6b0 legacy=0x7f952c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277708918 0 0) 0x7f9518003530 con 0x7f952c15f6b0 2023-11-26T07:19:13.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.757+0000 7f952ad9d640 1 -- 172.21.15.70:0/25425093 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c06cae0 con 0x7f952c13e290 2023-11-26T07:19:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f952ad9d640 1 --2- 172.21.15.70:0/25425093 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c0cf280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f951c009dc0 tx=0x7f951c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b9857ceef19c18 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:13.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0a5920 con 0x7f952c13e290 2023-11-26T07:19:13.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0a5a80 con 0x7f952c13e290 2023-11-26T07:19:13.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f952a59c640 1 -- 172.21.15.70:0/25425093 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0a5df0 con 0x7f952c13e290 2023-11-26T07:19:13.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- 172.21.15.70:0/25425093 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 msgr2=0x7f952c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 --2- 172.21.15.70:0/25425093 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c0cf280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f951c009dc0 tx=0x7f951c01c970 comp rx=0 tx=0).stop 2023-11-26T07:19:13.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- 172.21.15.70:0/25425093 shutdown_connections 2023-11-26T07:19:13.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 --2- 172.21.15.70:0/25425093 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c0cf280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- 172.21.15.70:0/25425093 >> 172.21.15.70:0/25425093 conn(0x7f952c06a890 msgr2=0x7f952c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:13.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- 172.21.15.70:0/25425093 shutdown_connections 2023-11-26T07:19:13.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- 172.21.15.70:0/25425093 wait complete. 2023-11-26T07:19:13.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 Processor -- start 2023-11-26T07:19:13.766 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- start start 2023-11-26T07:19:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f952c0cf7c0 0x7f952c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f952c15f6b0 0x7f952c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0affc0 con 0x7f952c15f6b0 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c154780 con 0x7f952c0cf7c0 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.761+0000 7f953109c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0b0260 con 0x7f952c13e290 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f952c15f6b0 0x7f952c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f952c0cf7c0 0x7f952c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952259c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f952c15f6b0 0x7f952c1536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49892/0 (socket says 172.21.15.70:49892) 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952259c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c133780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:46150/0 (socket says 172.21.15.70:46150) 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f952c0cf7c0 0x7f952c15c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:48842/0 (socket says 172.21.15.70:48842) 2023-11-26T07:19:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 -- 172.21.15.70:0/3206242495 learned_addr learned my addr 172.21.15.70:0/3206242495 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 -- 172.21.15.70:0/3206242495 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 msgr2=0x7f952c133780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c133780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 -- 172.21.15.70:0/3206242495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f952c0cf7c0 msgr2=0x7f952c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f952c0cf7c0 0x7f952c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 -- 172.21.15.70:0/3206242495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009a70 con 0x7f952c15f6b0 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f952b59e640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f952c15f6b0 0x7f952c1536d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f952400c3e0 tx=0x7f9524001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f9523fff640 1 -- 172.21.15.70:0/3206242495 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524005cf0 con 0x7f952c15f6b0 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f9523fff640 1 -- 172.21.15.70:0/3206242495 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9524005e70 con 0x7f952c15f6b0 2023-11-26T07:19:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f9523fff640 1 -- 172.21.15.70:0/3206242495 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95240072d0 con 0x7f952c15f6b0 2023-11-26T07:19:13.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0b0540 con 0x7f952c15f6b0 2023-11-26T07:19:13.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c153c10 con 0x7f952c15f6b0 2023-11-26T07:19:13.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c067680 con 0x7f952c15f6b0 2023-11-26T07:19:13.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.765+0000 7f9523fff640 1 -- 172.21.15.70:0/3206242495 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9524007430 con 0x7f952c15f6b0 2023-11-26T07:19:13.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.769+0000 7f9523fff640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f950c066470 0x7f950c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:13.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.769+0000 7f9523fff640 1 -- 172.21.15.70:0/3206242495 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95240833f0 con 0x7f952c15f6b0 2023-11-26T07:19:13.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.769+0000 7f952ad9d640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f950c066470 0x7f950c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:13.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.769+0000 7f952ad9d640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f950c066470 0x7f950c068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f951c0af000 tx=0x7f951c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.769+0000 7f9523fff640 1 -- 172.21.15.70:0/3206242495 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9524050910 con 0x7f952c15f6b0 2023-11-26T07:19:13.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.921+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f952c0b09f0 con 0x7f952c15f6b0 2023-11-26T07:19:13.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f9523fff640 1 -- 172.21.15.70:0/3206242495 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f9524053f30 con 0x7f952c15f6b0 2023-11-26T07:19:13.928 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:13.929 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":35,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:19:11.215507+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:19:13.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f950c066470 msgr2=0x7f950c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f950c066470 0x7f950c068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f951c0af000 tx=0x7f951c0a7070 comp rx=0 tx=0).stop 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f952c15f6b0 msgr2=0x7f952c1536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f952c15f6b0 0x7f952c1536d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f952400c3e0 tx=0x7f9524001e80 comp rx=0 tx=0).stop 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 shutdown_connections 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f950c066470 0x7f950c068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f952c15f6b0 0x7f952c1536d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f952c13e290 0x7f952c133780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 --2- 172.21.15.70:0/3206242495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f952c0cf7c0 0x7f952c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:13.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 >> 172.21.15.70:0/3206242495 conn(0x7f952c06a890 msgr2=0x7f952c15ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 shutdown_connections 2023-11-26T07:19:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:13.925+0000 7f953109c640 1 -- 172.21.15.70:0/3206242495 wait complete. 2023-11-26T07:19:13.950 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:19:13.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:19:14.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f36015a1640 1 Processor -- start 2023-11-26T07:19:14.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f36015a1640 1 -- start start 2023-11-26T07:19:14.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f36015a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0b2f80 0x7f35fc071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f36015a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f35fc0ce680 0x7f35fc06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f36015a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc06c750 con 0x7f35fc1596d0 2023-11-26T07:19:14.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f36015a1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0cbe00 con 0x7f35fc0ce680 2023-11-26T07:19:14.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f36015a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0b3550 con 0x7f35fc0b2f80 2023-11-26T07:19:14.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f35fa7fc640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0b2f80 0x7f35fc071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f35faffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f35fc1596d0 0x7f35fc0b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:48062/0 (socket says 172.21.15.70:48062) 2023-11-26T07:19:14.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f35fb7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f35fc0ce680 0x7f35fc06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.085+0000 7f35faffd640 1 -- 172.21.15.70:0/2564280807 learned_addr learned my addr 172.21.15.70:0/2564280807 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:14.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35fa7fc640 1 -- 172.21.15.70:0/2564280807 >> v2:172.21.15.120:3300/0 conn(0x7f35fc0ce680 msgr2=0x7f35fc06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:14.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35fa7fc640 1 --2- 172.21.15.70:0/2564280807 >> v2:172.21.15.120:3300/0 conn(0x7f35fc0ce680 0x7f35fc06cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35fa7fc640 1 -- 172.21.15.70:0/2564280807 >> v1:172.21.15.120:6789/0 conn(0x7f35fc1596d0 legacy=0x7f35fc0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35f9ffb640 1 -- 172.21.15.70:0/2564280807 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801776357 0 0) 0x7f35fc06c750 con 0x7f35fc1596d0 2023-11-26T07:19:14.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35fa7fc640 1 -- 172.21.15.70:0/2564280807 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc071e80 con 0x7f35fc0b2f80 2023-11-26T07:19:14.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35fa7fc640 1 --2- 172.21.15.70:0/2564280807 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0b2f80 0x7f35fc071850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35f00097c0 tx=0x7f35f001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e36a8c7b42b347f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35f9ffb640 1 -- 172.21.15.70:0/2564280807 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00ab600 con 0x7f35fc0b2f80 2023-11-26T07:19:14.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35f9ffb640 1 -- 172.21.15.70:0/2564280807 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f00a7050 con 0x7f35fc0b2f80 2023-11-26T07:19:14.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f35f9ffb640 1 -- 172.21.15.70:0/2564280807 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00ab980 con 0x7f35fc0b2f80 2023-11-26T07:19:14.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 -- 172.21.15.70:0/2564280807 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0b2f80 msgr2=0x7f35fc071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 --2- 172.21.15.70:0/2564280807 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0b2f80 0x7f35fc071850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35f00097c0 tx=0x7f35f001c480 comp rx=0 tx=0).stop 2023-11-26T07:19:14.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 -- 172.21.15.70:0/2564280807 shutdown_connections 2023-11-26T07:19:14.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 --2- 172.21.15.70:0/2564280807 >> v2:172.21.15.120:3300/0 conn(0x7f35fc0ce680 0x7f35fc06cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 --2- 172.21.15.70:0/2564280807 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0b2f80 0x7f35fc071850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 -- 172.21.15.70:0/2564280807 >> 172.21.15.70:0/2564280807 conn(0x7f35fc06a890 msgr2=0x7f35fc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:14.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 -- 172.21.15.70:0/2564280807 shutdown_connections 2023-11-26T07:19:14.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.089+0000 7f36015a1640 1 -- 172.21.15.70:0/2564280807 wait complete. 2023-11-26T07:19:14.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 Processor -- start 2023-11-26T07:19:14.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 -- start start 2023-11-26T07:19:14.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35fc0b2f80 0x7f35fc13d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0ce680 0x7f35fc159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35fc1596d0 0x7f35fc15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc13d950 con 0x7f35fc1596d0 2023-11-26T07:19:14.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc15a510 con 0x7f35fc0b2f80 2023-11-26T07:19:14.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f36015a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc15a7f0 con 0x7f35fc0ce680 2023-11-26T07:19:14.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35fc1596d0 0x7f35fc15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35fc1596d0 0x7f35fc15b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49908/0 (socket says 172.21.15.70:49908) 2023-11-26T07:19:14.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 -- 172.21.15.70:0/1799898135 learned_addr learned my addr 172.21.15.70:0/1799898135 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:14.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35faffd640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35fc0b2f80 0x7f35fc13d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fa7fc640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0ce680 0x7f35fc159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 -- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0ce680 msgr2=0x7f35fc159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0ce680 0x7f35fc159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 -- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35fc0b2f80 msgr2=0x7f35fc13d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35fc0b2f80 0x7f35fc13d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.100 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 -- 172.21.15.70:0/1799898135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009420 con 0x7f35fc1596d0 2023-11-26T07:19:14.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35fb7fe640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35fc1596d0 0x7f35fc15b5b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f35f400efc0 tx=0x7f35f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35e37fe640 1 -- 172.21.15.70:0/1799898135 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4014480 con 0x7f35fc1596d0 2023-11-26T07:19:14.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35e37fe640 1 -- 172.21.15.70:0/1799898135 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f400f040 con 0x7f35fc1596d0 2023-11-26T07:19:14.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.093+0000 7f35e37fe640 1 -- 172.21.15.70:0/1799898135 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4014820 con 0x7f35fc1596d0 2023-11-26T07:19:14.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc15aad0 con 0x7f35fc1596d0 2023-11-26T07:19:14.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc15b090 con 0x7f35fc1596d0 2023-11-26T07:19:14.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc15b280 con 0x7f35fc1596d0 2023-11-26T07:19:14.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f35e37fe640 1 -- 172.21.15.70:0/1799898135 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35f4014980 con 0x7f35fc1596d0 2023-11-26T07:19:14.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f35e37fe640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e80664a0 0x7f35e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f35e37fe640 1 -- 172.21.15.70:0/1799898135 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35f4084910 con 0x7f35fc1596d0 2023-11-26T07:19:14.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f35faffd640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e80664a0 0x7f35e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.097+0000 7f35faffd640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e80664a0 0x7f35e8068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000f70 tx=0x7f35ec007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.101+0000 7f35e37fe640 1 -- 172.21.15.70:0/1799898135 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35f4051da0 con 0x7f35fc1596d0 2023-11-26T07:19:14.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.249+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35fc0cb6e0 con 0x7f35e80664a0 2023-11-26T07:19:14.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.261+0000 7f35e37fe640 1 -- 172.21.15.70:0/1799898135 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288513 (secure 0 0 0) 0x7f35fc0cb6e0 con 0x7f35e80664a0 2023-11-26T07:19:14.266 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:14.268 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:19:14.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e80664a0 msgr2=0x7f35e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e80664a0 0x7f35e8068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000f70 tx=0x7f35ec007df0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35fc1596d0 msgr2=0x7f35fc15b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35fc1596d0 0x7f35fc15b5b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f35f400efc0 tx=0x7f35f400c490 comp rx=0 tx=0).stop 2023-11-26T07:19:14.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 shutdown_connections 2023-11-26T07:19:14.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e80664a0 0x7f35e8068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35fc1596d0 0x7f35fc15b5b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35fc0ce680 0x7f35fc159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 --2- 172.21.15.70:0/1799898135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35fc0b2f80 0x7f35fc13d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 >> 172.21.15.70:0/1799898135 conn(0x7f35fc06a890 msgr2=0x7f35fc0b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:14.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 shutdown_connections 2023-11-26T07:19:14.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.265+0000 7f36015a1640 1 -- 172.21.15.70:0/1799898135 wait complete. 2023-11-26T07:19:14.286 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-26T07:19:14.007611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236948,"kb_used_data":4120,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737772,"statfs":{"total":773094113280,"available":772851478528,"internally_reserved":0,"allocated":4218880,"data_stored":2349763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.814886"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239281+0000","last_change":"2023-11-26T07:19:10.229590+0000","last_active":"2023-11-26T07:19:10.239281+0000","last_peered":"2023-11-26T07:19:10.239281+0000","last_clean":"2023-11-26T07:19:10.239281+0000","last_became_active":"2023-11-26T07:19:10.229284+0000","last_became_peered":"2023-11-26T07:19:10.229284+0000","last_unstale":"2023-11-26T07:19:10.239281+0000","last_undegraded":"2023-11-26T07:19:10.239281+0000","last_fullsized":"2023-11-26T07:19:10.239281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:23.633080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242680+0000","last_change":"2023-11-26T07:19:10.233245+0000","last_active":"2023-11-26T07:19:10.242680+0000","last_peered":"2023-11-26T07:19:10.242680+0000","last_clean":"2023-11-26T07:19:10.242680+0000","last_became_active":"2023-11-26T07:19:10.232965+0000","last_became_peered":"2023-11-26T07:19:10.232965+0000","last_unstale":"2023-11-26T07:19:10.242680+0000","last_undegraded":"2023-11-26T07:19:10.242680+0000","last_fullsized":"2023-11-26T07:19:10.242680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:28.328937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243127+0000","last_change":"2023-11-26T07:19:10.238312+0000","last_active":"2023-11-26T07:19:10.243127+0000","last_peered":"2023-11-26T07:19:10.243127+0000","last_clean":"2023-11-26T07:19:10.243127+0000","last_became_active":"2023-11-26T07:19:10.237979+0000","last_became_peered":"2023-11-26T07:19:10.237979+0000","last_unstale":"2023-11-26T07:19:10.243127+0000","last_undegraded":"2023-11-26T07:19:10.243127+0000","last_fullsized":"2023-11-26T07:19:10.243127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:01.090350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248555+0000","last_change":"2023-11-26T07:19:10.237375+0000","last_active":"2023-11-26T07:19:10.248555+0000","last_peered":"2023-11-26T07:19:10.248555+0000","last_clean":"2023-11-26T07:19:10.248555+0000","last_became_active":"2023-11-26T07:19:10.237107+0000","last_became_peered":"2023-11-26T07:19:10.237107+0000","last_unstale":"2023-11-26T07:19:10.248555+0000","last_undegraded":"2023-11-26T07:19:10.248555+0000","last_fullsized":"2023-11-26T07:19:10.248555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:44.673568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.231862+0000","last_change":"2023-11-26T07:19:10.215549+0000","last_active":"2023-11-26T07:19:10.231862+0000","last_peered":"2023-11-26T07:19:10.231862+0000","last_clean":"2023-11-26T07:19:10.231862+0000","last_became_active":"2023-11-26T07:19:10.215134+0000","last_became_peered":"2023-11-26T07:19:10.215134+0000","last_unstale":"2023-11-26T07:19:10.231862+0000","last_undegraded":"2023-11-26T07:19:10.231862+0000","last_fullsized":"2023-11-26T07:19:10.231862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:07:57.529242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.236449+0000","last_change":"2023-11-26T07:19:10.226891+0000","last_active":"2023-11-26T07:19:10.236449+0000","last_peered":"2023-11-26T07:19:10.236449+0000","last_clean":"2023-11-26T07:19:10.236449+0000","last_became_active":"2023-11-26T07:19:10.226632+0000","last_became_peered":"2023-11-26T07:19:10.226632+0000","last_unstale":"2023-11-26T07:19:10.236449+0000","last_undegraded":"2023-11-26T07:19:10.236449+0000","last_fullsized":"2023-11-26T07:19:10.236449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.234487+0000","last_change":"2023-11-26T07:19:10.224640+0000","last_active":"2023-11-26T07:19:10.234487+0000","last_peered":"2023-11-26T07:19:10.234487+0000","last_clean":"2023-11-26T07:19:10.234487+0000","last_became_active":"2023-11-26T07:19:10.224098+0000","last_became_peered":"2023-11-26T07:19:10.224098+0000","last_unstale":"2023-11-26T07:19:10.234487+0000","last_undegraded":"2023-11-26T07:19:10.234487+0000","last_fullsized":"2023-11-26T07:19:10.234487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:32.664322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248899+0000","last_change":"2023-11-26T07:19:10.242401+0000","last_active":"2023-11-26T07:19:10.248899+0000","last_peered":"2023-11-26T07:19:10.248899+0000","last_clean":"2023-11-26T07:19:10.248899+0000","last_became_active":"2023-11-26T07:19:10.242076+0000","last_became_peered":"2023-11-26T07:19:10.242076+0000","last_unstale":"2023-11-26T07:19:10.248899+0000","last_undegraded":"2023-11-26T07:19:10.248899+0000","last_fullsized":"2023-11-26T07:19:10.248899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:01.090350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243086+0000","last_change":"2023-11-26T07:19:10.239719+0000","last_active":"2023-11-26T07:19:10.243086+0000","last_peered":"2023-11-26T07:19:10.243086+0000","last_clean":"2023-11-26T07:19:10.243086+0000","last_became_active":"2023-11-26T07:19:10.239231+0000","last_became_peered":"2023-11-26T07:19:10.239231+0000","last_unstale":"2023-11-26T07:19:10.243086+0000","last_undegraded":"2023-11-26T07:19:10.243086+0000","last_fullsized":"2023-11-26T07:19:10.243086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248585+0000","last_change":"2023-11-26T07:19:10.239218+0000","last_active":"2023-11-26T07:19:10.248585+0000","last_peered":"2023-11-26T07:19:10.248585+0000","last_clean":"2023-11-26T07:19:10.248585+0000","last_became_active":"2023-11-26T07:19:10.238873+0000","last_became_peered":"2023-11-26T07:19:10.238873+0000","last_unstale":"2023-11-26T07:19:10.248585+0000","last_undegraded":"2023-11-26T07:19:10.248585+0000","last_fullsized":"2023-11-26T07:19:10.248585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:49.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248631+0000","last_change":"2023-11-26T07:19:10.240593+0000","last_active":"2023-11-26T07:19:10.248631+0000","last_peered":"2023-11-26T07:19:10.248631+0000","last_clean":"2023-11-26T07:19:10.248631+0000","last_became_active":"2023-11-26T07:19:10.237105+0000","last_became_peered":"2023-11-26T07:19:10.237105+0000","last_unstale":"2023-11-26T07:19:10.248631+0000","last_undegraded":"2023-11-26T07:19:10.248631+0000","last_fullsized":"2023-11-26T07:19:10.248631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:30.517944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240865+0000","last_change":"2023-11-26T07:19:10.236768+0000","last_active":"2023-11-26T07:19:10.240865+0000","last_peered":"2023-11-26T07:19:10.240865+0000","last_clean":"2023-11-26T07:19:10.240865+0000","last_became_active":"2023-11-26T07:19:10.236397+0000","last_became_peered":"2023-11-26T07:19:10.236397+0000","last_unstale":"2023-11-26T07:19:10.240865+0000","last_undegraded":"2023-11-26T07:19:10.240865+0000","last_fullsized":"2023-11-26T07:19:10.240865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:08.908774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238807+0000","last_change":"2023-11-26T07:19:10.226945+0000","last_active":"2023-11-26T07:19:10.238807+0000","last_peered":"2023-11-26T07:19:10.238807+0000","last_clean":"2023-11-26T07:19:10.238807+0000","last_became_active":"2023-11-26T07:19:10.226653+0000","last_became_peered":"2023-11-26T07:19:10.226653+0000","last_unstale":"2023-11-26T07:19:10.238807+0000","last_undegraded":"2023-11-26T07:19:10.238807+0000","last_fullsized":"2023-11-26T07:19:10.238807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:27.022325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.226979+0000","last_change":"2023-11-26T07:19:10.221639+0000","last_active":"2023-11-26T07:19:10.226979+0000","last_peered":"2023-11-26T07:19:10.226979+0000","last_clean":"2023-11-26T07:19:10.226979+0000","last_became_active":"2023-11-26T07:19:10.221293+0000","last_became_peered":"2023-11-26T07:19:10.221293+0000","last_unstale":"2023-11-26T07:19:10.226979+0000","last_undegraded":"2023-11-26T07:19:10.226979+0000","last_fullsized":"2023-11-26T07:19:10.226979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:40.974840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.235343+0000","last_change":"2023-11-26T07:19:10.228844+0000","last_active":"2023-11-26T07:19:10.235343+0000","last_peered":"2023-11-26T07:19:10.235343+0000","last_clean":"2023-11-26T07:19:10.235343+0000","last_became_active":"2023-11-26T07:19:10.227998+0000","last_became_peered":"2023-11-26T07:19:10.227998+0000","last_unstale":"2023-11-26T07:19:10.235343+0000","last_undegraded":"2023-11-26T07:19:10.235343+0000","last_fullsized":"2023-11-26T07:19:10.235343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:31.273757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240953+0000","last_change":"2023-11-26T07:19:10.231501+0000","last_active":"2023-11-26T07:19:10.240953+0000","last_peered":"2023-11-26T07:19:10.240953+0000","last_clean":"2023-11-26T07:19:10.240953+0000","last_became_active":"2023-11-26T07:19:10.231225+0000","last_became_peered":"2023-11-26T07:19:10.231225+0000","last_unstale":"2023-11-26T07:19:10.240953+0000","last_undegraded":"2023-11-26T07:19:10.240953+0000","last_fullsized":"2023-11-26T07:19:10.240953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:53:17.509456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248977+0000","last_change":"2023-11-26T07:19:10.241594+0000","last_active":"2023-11-26T07:19:10.248977+0000","last_peered":"2023-11-26T07:19:10.248977+0000","last_clean":"2023-11-26T07:19:10.248977+0000","last_became_active":"2023-11-26T07:19:10.241311+0000","last_became_peered":"2023-11-26T07:19:10.241311+0000","last_unstale":"2023-11-26T07:19:10.248977+0000","last_undegraded":"2023-11-26T07:19:10.248977+0000","last_fullsized":"2023-11-26T07:19:10.248977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:42:05.846637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.249037+0000","last_change":"2023-11-26T07:19:10.242999+0000","last_active":"2023-11-26T07:19:10.249037+0000","last_peered":"2023-11-26T07:19:10.249037+0000","last_clean":"2023-11-26T07:19:10.249037+0000","last_became_active":"2023-11-26T07:19:10.242690+0000","last_became_peered":"2023-11-26T07:19:10.242690+0000","last_unstale":"2023-11-26T07:19:10.249037+0000","last_undegraded":"2023-11-26T07:19:10.249037+0000","last_fullsized":"2023-11-26T07:19:10.249037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:32.664322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242554+0000","last_change":"2023-11-26T07:19:10.234645+0000","last_active":"2023-11-26T07:19:10.242554+0000","last_peered":"2023-11-26T07:19:10.242554+0000","last_clean":"2023-11-26T07:19:10.242554+0000","last_became_active":"2023-11-26T07:19:10.234357+0000","last_became_peered":"2023-11-26T07:19:10.234357+0000","last_unstale":"2023-11-26T07:19:10.242554+0000","last_undegraded":"2023-11-26T07:19:10.242554+0000","last_fullsized":"2023-11-26T07:19:10.242554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:31.273757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239908+0000","last_change":"2023-11-26T07:19:10.231749+0000","last_active":"2023-11-26T07:19:10.239908+0000","last_peered":"2023-11-26T07:19:10.239908+0000","last_clean":"2023-11-26T07:19:10.239908+0000","last_became_active":"2023-11-26T07:19:10.231474+0000","last_became_peered":"2023-11-26T07:19:10.231474+0000","last_unstale":"2023-11-26T07:19:10.239908+0000","last_undegraded":"2023-11-26T07:19:10.239908+0000","last_fullsized":"2023-11-26T07:19:10.239908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:58:49.344208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.237316+0000","last_change":"2023-11-26T07:19:10.234307+0000","last_active":"2023-11-26T07:19:10.237316+0000","last_peered":"2023-11-26T07:19:10.237316+0000","last_clean":"2023-11-26T07:19:10.237316+0000","last_became_active":"2023-11-26T07:19:10.233961+0000","last_became_peered":"2023-11-26T07:19:10.233961+0000","last_unstale":"2023-11-26T07:19:10.237316+0000","last_undegraded":"2023-11-26T07:19:10.237316+0000","last_fullsized":"2023-11-26T07:19:10.237316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:50.784948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242082+0000","last_change":"2023-11-26T07:19:10.235937+0000","last_active":"2023-11-26T07:19:10.242082+0000","last_peered":"2023-11-26T07:19:10.242082+0000","last_clean":"2023-11-26T07:19:10.242082+0000","last_became_active":"2023-11-26T07:19:10.235621+0000","last_became_peered":"2023-11-26T07:19:10.235621+0000","last_unstale":"2023-11-26T07:19:10.242082+0000","last_undegraded":"2023-11-26T07:19:10.242082+0000","last_fullsized":"2023-11-26T07:19:10.242082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:31.273757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238783+0000","last_change":"2023-11-26T07:19:10.235986+0000","last_active":"2023-11-26T07:19:10.238783+0000","last_peered":"2023-11-26T07:19:10.238783+0000","last_clean":"2023-11-26T07:19:10.238783+0000","last_became_active":"2023-11-26T07:19:10.235662+0000","last_became_peered":"2023-11-26T07:19:10.235662+0000","last_unstale":"2023-11-26T07:19:10.238783+0000","last_undegraded":"2023-11-26T07:19:10.238783+0000","last_fullsized":"2023-11-26T07:19:10.238783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243537+0000","last_change":"2023-11-26T07:19:10.238625+0000","last_active":"2023-11-26T07:19:10.243537+0000","last_peered":"2023-11-26T07:19:10.243537+0000","last_clean":"2023-11-26T07:19:10.243537+0000","last_became_active":"2023-11-26T07:19:10.238404+0000","last_became_peered":"2023-11-26T07:19:10.238404+0000","last_unstale":"2023-11-26T07:19:10.243537+0000","last_undegraded":"2023-11-26T07:19:10.243537+0000","last_fullsized":"2023-11-26T07:19:10.243537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:01.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.253450+0000","last_change":"2023-11-26T07:19:10.246953+0000","last_active":"2023-11-26T07:19:10.253450+0000","last_peered":"2023-11-26T07:19:10.253450+0000","last_clean":"2023-11-26T07:19:10.253450+0000","last_became_active":"2023-11-26T07:19:10.246646+0000","last_became_peered":"2023-11-26T07:19:10.246646+0000","last_unstale":"2023-11-26T07:19:10.253450+0000","last_undegraded":"2023-11-26T07:19:10.253450+0000","last_fullsized":"2023-11-26T07:19:10.253450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:40.974840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242660+0000","last_change":"2023-11-26T07:19:10.233308+0000","last_active":"2023-11-26T07:19:10.242660+0000","last_peered":"2023-11-26T07:19:10.242660+0000","last_clean":"2023-11-26T07:19:10.242660+0000","last_became_active":"2023-11-26T07:19:10.228890+0000","last_became_peered":"2023-11-26T07:19:10.228890+0000","last_unstale":"2023-11-26T07:19:10.242660+0000","last_undegraded":"2023-11-26T07:19:10.242660+0000","last_fullsized":"2023-11-26T07:19:10.242660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:52.369060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.256645+0000","last_change":"2023-11-26T07:19:10.254483+0000","last_active":"2023-11-26T07:19:10.256645+0000","last_peered":"2023-11-26T07:19:10.256645+0000","last_clean":"2023-11-26T07:19:10.256645+0000","last_became_active":"2023-11-26T07:19:10.237730+0000","last_became_peered":"2023-11-26T07:19:10.237730+0000","last_unstale":"2023-11-26T07:19:10.256645+0000","last_undegraded":"2023-11-26T07:19:10.256645+0000","last_fullsized":"2023-11-26T07:19:10.256645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:12.976500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.236451+0000","last_change":"2023-11-26T07:19:10.231295+0000","last_active":"2023-11-26T07:19:10.236451+0000","last_peered":"2023-11-26T07:19:10.236451+0000","last_clean":"2023-11-26T07:19:10.236451+0000","last_became_active":"2023-11-26T07:19:10.231001+0000","last_became_peered":"2023-11-26T07:19:10.231001+0000","last_unstale":"2023-11-26T07:19:10.236451+0000","last_undegraded":"2023-11-26T07:19:10.236451+0000","last_fullsized":"2023-11-26T07:19:10.236451+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.233407+0000","last_change":"2023-11-26T07:19:10.227139+0000","last_active":"2023-11-26T07:19:10.233407+0000","last_peered":"2023-11-26T07:19:10.233407+0000","last_clean":"2023-11-26T07:19:10.233407+0000","last_became_active":"2023-11-26T07:19:10.226765+0000","last_became_peered":"2023-11-26T07:19:10.226765+0000","last_unstale":"2023-11-26T07:19:10.233407+0000","last_undegraded":"2023-11-26T07:19:10.233407+0000","last_fullsized":"2023-11-26T07:19:10.233407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:58:49.344208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.236142+0000","last_change":"2023-11-26T07:19:10.226865+0000","last_active":"2023-11-26T07:19:10.236142+0000","last_peered":"2023-11-26T07:19:10.236142+0000","last_clean":"2023-11-26T07:19:10.236142+0000","last_became_active":"2023-11-26T07:19:10.226574+0000","last_became_peered":"2023-11-26T07:19:10.226574+0000","last_unstale":"2023-11-26T07:19:10.236142+0000","last_undegraded":"2023-11-26T07:19:10.236142+0000","last_fullsized":"2023-11-26T07:19:10.236142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:28.328937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239774+0000","last_change":"2023-11-26T07:19:10.231746+0000","last_active":"2023-11-26T07:19:10.239774+0000","last_peered":"2023-11-26T07:19:10.239774+0000","last_clean":"2023-11-26T07:19:10.239774+0000","last_became_active":"2023-11-26T07:19:10.231296+0000","last_became_peered":"2023-11-26T07:19:10.231296+0000","last_unstale":"2023-11-26T07:19:10.239774+0000","last_undegraded":"2023-11-26T07:19:10.239774+0000","last_fullsized":"2023-11-26T07:19:10.239774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:03:33.714549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240277+0000","last_change":"2023-11-26T07:19:10.228005+0000","last_active":"2023-11-26T07:19:10.240277+0000","last_peered":"2023-11-26T07:19:10.240277+0000","last_clean":"2023-11-26T07:19:10.240277+0000","last_became_active":"2023-11-26T07:19:10.227733+0000","last_became_peered":"2023-11-26T07:19:10.227733+0000","last_unstale":"2023-11-26T07:19:10.240277+0000","last_undegraded":"2023-11-26T07:19:10.240277+0000","last_fullsized":"2023-11-26T07:19:10.240277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:24:17.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240658+0000","last_change":"2023-11-26T07:19:10.238622+0000","last_active":"2023-11-26T07:19:10.240658+0000","last_peered":"2023-11-26T07:19:10.240658+0000","last_clean":"2023-11-26T07:19:10.240658+0000","last_became_active":"2023-11-26T07:19:10.238340+0000","last_became_peered":"2023-11-26T07:19:10.238340+0000","last_unstale":"2023-11-26T07:19:10.240658+0000","last_undegraded":"2023-11-26T07:19:10.240658+0000","last_fullsized":"2023-11-26T07:19:10.240658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:12.976500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.257001+0000","last_change":"2023-11-26T07:19:09.226069+0000","last_active":"2023-11-26T07:19:10.257001+0000","last_peered":"2023-11-26T07:19:10.257001+0000","last_clean":"2023-11-26T07:19:10.257001+0000","last_became_active":"2023-11-26T07:19:09.225738+0000","last_became_peered":"2023-11-26T07:19:09.225738+0000","last_unstale":"2023-11-26T07:19:10.257001+0000","last_undegraded":"2023-11-26T07:19:10.257001+0000","last_fullsized":"2023-11-26T07:19:10.257001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:36.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243068+0000","last_change":"2023-11-26T07:19:10.239779+0000","last_active":"2023-11-26T07:19:10.243068+0000","last_peered":"2023-11-26T07:19:10.243068+0000","last_clean":"2023-11-26T07:19:10.243068+0000","last_became_active":"2023-11-26T07:19:10.239468+0000","last_became_peered":"2023-11-26T07:19:10.239468+0000","last_unstale":"2023-11-26T07:19:10.243068+0000","last_undegraded":"2023-11-26T07:19:10.243068+0000","last_fullsized":"2023-11-26T07:19:10.243068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:20.444921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255782+0000","last_change":"2023-11-26T07:19:09.217137+0000","last_active":"2023-11-26T07:19:10.255782+0000","last_peered":"2023-11-26T07:19:10.255782+0000","last_clean":"2023-11-26T07:19:10.255782+0000","last_became_active":"2023-11-26T07:19:09.216886+0000","last_became_peered":"2023-11-26T07:19:09.216886+0000","last_unstale":"2023-11-26T07:19:10.255782+0000","last_undegraded":"2023-11-26T07:19:10.255782+0000","last_fullsized":"2023-11-26T07:19:10.255782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:36.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.234301+0000","last_change":"2023-11-26T07:19:10.227053+0000","last_active":"2023-11-26T07:19:10.234301+0000","last_peered":"2023-11-26T07:19:10.234301+0000","last_clean":"2023-11-26T07:19:10.234301+0000","last_became_active":"2023-11-26T07:19:10.226708+0000","last_became_peered":"2023-11-26T07:19:10.226708+0000","last_unstale":"2023-11-26T07:19:10.234301+0000","last_undegraded":"2023-11-26T07:19:10.234301+0000","last_fullsized":"2023-11-26T07:19:10.234301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:49.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.259025+0000","last_change":"2023-11-26T07:19:09.221288+0000","last_active":"2023-11-26T07:19:10.259025+0000","last_peered":"2023-11-26T07:19:10.259025+0000","last_clean":"2023-11-26T07:19:10.259025+0000","last_became_active":"2023-11-26T07:19:09.221018+0000","last_became_peered":"2023-11-26T07:19:09.221018+0000","last_unstale":"2023-11-26T07:19:10.259025+0000","last_undegraded":"2023-11-26T07:19:10.259025+0000","last_fullsized":"2023-11-26T07:19:10.259025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:39:21.630872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.254613+0000","last_change":"2023-11-26T07:19:10.238626+0000","last_active":"2023-11-26T07:19:10.254613+0000","last_peered":"2023-11-26T07:19:10.254613+0000","last_clean":"2023-11-26T07:19:10.254613+0000","last_became_active":"2023-11-26T07:19:10.237294+0000","last_became_peered":"2023-11-26T07:19:10.237294+0000","last_unstale":"2023-11-26T07:19:10.254613+0000","last_undegraded":"2023-11-26T07:19:10.254613+0000","last_fullsized":"2023-11-26T07:19:10.254613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:20.444921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.259846+0000","last_change":"2023-11-26T07:19:09.221933+0000","last_active":"2023-11-26T07:19:10.259846+0000","last_peered":"2023-11-26T07:19:10.259846+0000","last_clean":"2023-11-26T07:19:10.259846+0000","last_became_active":"2023-11-26T07:19:09.221592+0000","last_became_peered":"2023-11-26T07:19:09.221592+0000","last_unstale":"2023-11-26T07:19:10.259846+0000","last_undegraded":"2023-11-26T07:19:10.259846+0000","last_fullsized":"2023-11-26T07:19:10.259846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:22:05.886188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.245504+0000","last_change":"2023-11-26T07:19:10.237943+0000","last_active":"2023-11-26T07:19:10.245504+0000","last_peered":"2023-11-26T07:19:10.245504+0000","last_clean":"2023-11-26T07:19:10.245504+0000","last_became_active":"2023-11-26T07:19:10.237614+0000","last_became_peered":"2023-11-26T07:19:10.237614+0000","last_unstale":"2023-11-26T07:19:10.245504+0000","last_undegraded":"2023-11-26T07:19:10.245504+0000","last_fullsized":"2023-11-26T07:19:10.245504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:08.908774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.253401+0000","last_change":"2023-11-26T07:19:09.216954+0000","last_active":"2023-11-26T07:19:10.253401+0000","last_peered":"2023-11-26T07:19:10.253401+0000","last_clean":"2023-11-26T07:19:10.253401+0000","last_became_active":"2023-11-26T07:19:09.216650+0000","last_became_peered":"2023-11-26T07:19:09.216650+0000","last_unstale":"2023-11-26T07:19:10.253401+0000","last_undegraded":"2023-11-26T07:19:10.253401+0000","last_fullsized":"2023-11-26T07:19:10.253401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:38.397967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243610+0000","last_change":"2023-11-26T07:19:10.240078+0000","last_active":"2023-11-26T07:19:10.243610+0000","last_peered":"2023-11-26T07:19:10.243610+0000","last_clean":"2023-11-26T07:19:10.243610+0000","last_became_active":"2023-11-26T07:19:10.237150+0000","last_became_peered":"2023-11-26T07:19:10.237150+0000","last_unstale":"2023-11-26T07:19:10.243610+0000","last_undegraded":"2023-11-26T07:19:10.243610+0000","last_fullsized":"2023-11-26T07:19:10.243610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:30.517944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.253247+0000","last_change":"2023-11-26T07:19:09.216354+0000","last_active":"2023-11-26T07:19:10.253247+0000","last_peered":"2023-11-26T07:19:10.253247+0000","last_clean":"2023-11-26T07:19:10.253247+0000","last_became_active":"2023-11-26T07:19:09.216047+0000","last_became_peered":"2023-11-26T07:19:09.216047+0000","last_unstale":"2023-11-26T07:19:10.253247+0000","last_undegraded":"2023-11-26T07:19:10.253247+0000","last_fullsized":"2023-11-26T07:19:10.253247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:51.366613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.234442+0000","last_change":"2023-11-26T07:19:10.232330+0000","last_active":"2023-11-26T07:19:10.234442+0000","last_peered":"2023-11-26T07:19:10.234442+0000","last_clean":"2023-11-26T07:19:10.234442+0000","last_became_active":"2023-11-26T07:19:10.232040+0000","last_became_peered":"2023-11-26T07:19:10.232040+0000","last_unstale":"2023-11-26T07:19:10.234442+0000","last_undegraded":"2023-11-26T07:19:10.234442+0000","last_fullsized":"2023-11-26T07:19:10.234442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:22:06.888635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.214212+0000","last_change":"2023-11-26T07:19:09.213095+0000","last_active":"2023-11-26T07:19:10.214212+0000","last_peered":"2023-11-26T07:19:10.214212+0000","last_clean":"2023-11-26T07:19:10.214212+0000","last_became_active":"2023-11-26T07:19:09.212540+0000","last_became_peered":"2023-11-26T07:19:09.212540+0000","last_unstale":"2023-11-26T07:19:10.214212+0000","last_undegraded":"2023-11-26T07:19:10.214212+0000","last_fullsized":"2023-11-26T07:19:10.214212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:53:16.507009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.249259+0000","last_change":"2023-11-26T07:19:10.245965+0000","last_active":"2023-11-26T07:19:10.249259+0000","last_peered":"2023-11-26T07:19:10.249259+0000","last_clean":"2023-11-26T07:19:10.249259+0000","last_became_active":"2023-11-26T07:19:10.245632+0000","last_became_peered":"2023-11-26T07:19:10.245632+0000","last_unstale":"2023-11-26T07:19:10.249259+0000","last_undegraded":"2023-11-26T07:19:10.249259+0000","last_fullsized":"2023-11-26T07:19:10.249259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:03:33.714549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.221594+0000","last_change":"2023-11-26T07:19:09.217931+0000","last_active":"2023-11-26T07:19:10.221594+0000","last_peered":"2023-11-26T07:19:10.221594+0000","last_clean":"2023-11-26T07:19:10.221594+0000","last_became_active":"2023-11-26T07:19:09.215424+0000","last_became_peered":"2023-11-26T07:19:09.215424+0000","last_unstale":"2023-11-26T07:19:10.221594+0000","last_undegraded":"2023-11-26T07:19:10.221594+0000","last_fullsized":"2023-11-26T07:19:10.221594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:31.661875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243068+0000","last_change":"2023-11-26T07:19:10.238053+0000","last_active":"2023-11-26T07:19:10.243068+0000","last_peered":"2023-11-26T07:19:10.243068+0000","last_clean":"2023-11-26T07:19:10.243068+0000","last_became_active":"2023-11-26T07:19:10.237730+0000","last_became_peered":"2023-11-26T07:19:10.237730+0000","last_unstale":"2023-11-26T07:19:10.243068+0000","last_undegraded":"2023-11-26T07:19:10.243068+0000","last_fullsized":"2023-11-26T07:19:10.243068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:52.369060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.215548+0000","last_change":"2023-11-26T07:19:09.225458+0000","last_active":"2023-11-26T07:19:10.215548+0000","last_peered":"2023-11-26T07:19:10.215548+0000","last_clean":"2023-11-26T07:19:10.215548+0000","last_became_active":"2023-11-26T07:19:09.225192+0000","last_became_peered":"2023-11-26T07:19:09.225192+0000","last_unstale":"2023-11-26T07:19:10.215548+0000","last_undegraded":"2023-11-26T07:19:10.215548+0000","last_fullsized":"2023-11-26T07:19:10.215548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:47.345781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243856+0000","last_change":"2023-11-26T07:19:10.230088+0000","last_active":"2023-11-26T07:19:10.243856+0000","last_peered":"2023-11-26T07:19:10.243856+0000","last_clean":"2023-11-26T07:19:10.243856+0000","last_became_active":"2023-11-26T07:19:10.229770+0000","last_became_peered":"2023-11-26T07:19:10.229770+0000","last_unstale":"2023-11-26T07:19:10.243856+0000","last_undegraded":"2023-11-26T07:19:10.243856+0000","last_fullsized":"2023-11-26T07:19:10.243856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:24:17.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.222251+0000","last_change":"2023-11-26T07:19:09.222447+0000","last_active":"2023-11-26T07:19:10.222251+0000","last_peered":"2023-11-26T07:19:10.222251+0000","last_clean":"2023-11-26T07:19:10.222251+0000","last_became_active":"2023-11-26T07:19:09.222149+0000","last_became_peered":"2023-11-26T07:19:09.222149+0000","last_unstale":"2023-11-26T07:19:10.222251+0000","last_undegraded":"2023-11-26T07:19:10.222251+0000","last_fullsized":"2023-11-26T07:19:10.222251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:48.987686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.230709+0000","last_change":"2023-11-26T07:19:10.226589+0000","last_active":"2023-11-26T07:19:10.230709+0000","last_peered":"2023-11-26T07:19:10.230709+0000","last_clean":"2023-11-26T07:19:10.230709+0000","last_became_active":"2023-11-26T07:19:10.226294+0000","last_became_peered":"2023-11-26T07:19:10.226294+0000","last_unstale":"2023-11-26T07:19:10.230709+0000","last_undegraded":"2023-11-26T07:19:10.230709+0000","last_fullsized":"2023-11-26T07:19:10.230709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:01.090350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255250+0000","last_change":"2023-11-26T07:19:09.223710+0000","last_active":"2023-11-26T07:19:10.255250+0000","last_peered":"2023-11-26T07:19:10.255250+0000","last_clean":"2023-11-26T07:19:10.255250+0000","last_became_active":"2023-11-26T07:19:09.223408+0000","last_became_peered":"2023-11-26T07:19:09.223408+0000","last_unstale":"2023-11-26T07:19:10.255250+0000","last_undegraded":"2023-11-26T07:19:10.255250+0000","last_fullsized":"2023-11-26T07:19:10.255250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:53:16.507009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243147+0000","last_change":"2023-11-26T07:19:10.238610+0000","last_active":"2023-11-26T07:19:10.243147+0000","last_peered":"2023-11-26T07:19:10.243147+0000","last_clean":"2023-11-26T07:19:10.243147+0000","last_became_active":"2023-11-26T07:19:10.238370+0000","last_became_peered":"2023-11-26T07:19:10.238370+0000","last_unstale":"2023-11-26T07:19:10.243147+0000","last_undegraded":"2023-11-26T07:19:10.243147+0000","last_fullsized":"2023-11-26T07:19:10.243147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:36.493937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.262080+0000","last_change":"2023-11-26T07:19:09.229671+0000","last_active":"2023-11-26T07:19:10.262080+0000","last_peered":"2023-11-26T07:19:10.262080+0000","last_clean":"2023-11-26T07:19:10.262080+0000","last_became_active":"2023-11-26T07:19:09.229344+0000","last_became_peered":"2023-11-26T07:19:09.229344+0000","last_unstale":"2023-11-26T07:19:10.262080+0000","last_undegraded":"2023-11-26T07:19:10.262080+0000","last_fullsized":"2023-11-26T07:19:10.262080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:42:04.844189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248614+0000","last_change":"2023-11-26T07:19:10.244503+0000","last_active":"2023-11-26T07:19:10.248614+0000","last_peered":"2023-11-26T07:19:10.248614+0000","last_clean":"2023-11-26T07:19:10.248614+0000","last_became_active":"2023-11-26T07:19:10.244200+0000","last_became_peered":"2023-11-26T07:19:10.244200+0000","last_unstale":"2023-11-26T07:19:10.248614+0000","last_undegraded":"2023-11-26T07:19:10.248614+0000","last_fullsized":"2023-11-26T07:19:10.248614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:37.090264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.256384+0000","last_change":"2023-11-26T07:19:09.219489+0000","last_active":"2023-11-26T07:19:10.256384+0000","last_peered":"2023-11-26T07:19:10.256384+0000","last_clean":"2023-11-26T07:19:10.256384+0000","last_became_active":"2023-11-26T07:19:09.219222+0000","last_became_peered":"2023-11-26T07:19:09.219222+0000","last_unstale":"2023-11-26T07:19:10.256384+0000","last_undegraded":"2023-11-26T07:19:10.256384+0000","last_fullsized":"2023-11-26T07:19:10.256384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:19.442473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243094+0000","last_change":"2023-11-26T07:19:10.232561+0000","last_active":"2023-11-26T07:19:10.243094+0000","last_peered":"2023-11-26T07:19:10.243094+0000","last_clean":"2023-11-26T07:19:10.243094+0000","last_became_active":"2023-11-26T07:19:10.231791+0000","last_became_peered":"2023-11-26T07:19:10.231791+0000","last_unstale":"2023-11-26T07:19:10.243094+0000","last_undegraded":"2023-11-26T07:19:10.243094+0000","last_fullsized":"2023-11-26T07:19:10.243094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:01.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.229873+0000","last_change":"2023-11-26T07:19:09.226934+0000","last_active":"2023-11-26T07:19:10.229873+0000","last_peered":"2023-11-26T07:19:10.229873+0000","last_clean":"2023-11-26T07:19:10.229873+0000","last_became_active":"2023-11-26T07:19:09.226659+0000","last_became_peered":"2023-11-26T07:19:09.226659+0000","last_unstale":"2023-11-26T07:19:10.229873+0000","last_undegraded":"2023-11-26T07:19:10.229873+0000","last_fullsized":"2023-11-26T07:19:10.229873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.736385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239975+0000","last_change":"2023-11-26T07:19:10.227246+0000","last_active":"2023-11-26T07:19:10.239975+0000","last_peered":"2023-11-26T07:19:10.239975+0000","last_clean":"2023-11-26T07:19:10.239975+0000","last_became_active":"2023-11-26T07:19:10.226975+0000","last_became_peered":"2023-11-26T07:19:10.226975+0000","last_unstale":"2023-11-26T07:19:10.239975+0000","last_undegraded":"2023-11-26T07:19:10.239975+0000","last_fullsized":"2023-11-26T07:19:10.239975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:36.493937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.214239+0000","last_change":"2023-11-26T07:19:09.222399+0000","last_active":"2023-11-26T07:19:10.214239+0000","last_peered":"2023-11-26T07:19:10.214239+0000","last_clean":"2023-11-26T07:19:10.214239+0000","last_became_active":"2023-11-26T07:19:09.222138+0000","last_became_peered":"2023-11-26T07:19:09.222138+0000","last_unstale":"2023-11-26T07:19:10.214239+0000","last_undegraded":"2023-11-26T07:19:10.214239+0000","last_fullsized":"2023-11-26T07:19:10.214239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:29.515497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239755+0000","last_change":"2023-11-26T07:19:10.231570+0000","last_active":"2023-11-26T07:19:10.239755+0000","last_peered":"2023-11-26T07:19:10.239755+0000","last_clean":"2023-11-26T07:19:10.239755+0000","last_became_active":"2023-11-26T07:19:10.230918+0000","last_became_peered":"2023-11-26T07:19:10.230918+0000","last_unstale":"2023-11-26T07:19:10.239755+0000","last_undegraded":"2023-11-26T07:19:10.239755+0000","last_fullsized":"2023-11-26T07:19:10.239755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:39.400415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.260805+0000","last_change":"2023-11-26T07:19:09.218895+0000","last_active":"2023-11-26T07:19:10.260805+0000","last_peered":"2023-11-26T07:19:10.260805+0000","last_clean":"2023-11-26T07:19:10.260805+0000","last_became_active":"2023-11-26T07:19:09.218512+0000","last_became_peered":"2023-11-26T07:19:09.218512+0000","last_unstale":"2023-11-26T07:19:10.260805+0000","last_undegraded":"2023-11-26T07:19:10.260805+0000","last_fullsized":"2023-11-26T07:19:10.260805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:07.906326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.235086+0000","last_change":"2023-11-26T07:19:10.225254+0000","last_active":"2023-11-26T07:19:10.235086+0000","last_peered":"2023-11-26T07:19:10.235086+0000","last_clean":"2023-11-26T07:19:10.235086+0000","last_became_active":"2023-11-26T07:19:10.224943+0000","last_became_peered":"2023-11-26T07:19:10.224943+0000","last_unstale":"2023-11-26T07:19:10.235086+0000","last_undegraded":"2023-11-26T07:19:10.235086+0000","last_fullsized":"2023-11-26T07:19:10.235086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:03:33.714549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.261064+0000","last_change":"2023-11-26T07:19:09.229526+0000","last_active":"2023-11-26T07:19:10.261064+0000","last_peered":"2023-11-26T07:19:10.261064+0000","last_clean":"2023-11-26T07:19:10.261064+0000","last_became_active":"2023-11-26T07:19:09.229239+0000","last_became_peered":"2023-11-26T07:19:09.229239+0000","last_unstale":"2023-11-26T07:19:10.261064+0000","last_undegraded":"2023-11-26T07:19:10.261064+0000","last_fullsized":"2023-11-26T07:19:10.261064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:51.366613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243592+0000","last_change":"2023-11-26T07:19:10.239895+0000","last_active":"2023-11-26T07:19:10.243592+0000","last_peered":"2023-11-26T07:19:10.243592+0000","last_clean":"2023-11-26T07:19:10.243592+0000","last_became_active":"2023-11-26T07:19:10.237069+0000","last_became_peered":"2023-11-26T07:19:10.237069+0000","last_unstale":"2023-11-26T07:19:10.243592+0000","last_undegraded":"2023-11-26T07:19:10.243592+0000","last_fullsized":"2023-11-26T07:19:10.243592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:24:17.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.254801+0000","last_change":"2023-11-26T07:19:09.218220+0000","last_active":"2023-11-26T07:19:10.254801+0000","last_peered":"2023-11-26T07:19:10.254801+0000","last_clean":"2023-11-26T07:19:10.254801+0000","last_became_active":"2023-11-26T07:19:09.215740+0000","last_became_peered":"2023-11-26T07:19:09.215740+0000","last_unstale":"2023-11-26T07:19:10.254801+0000","last_undegraded":"2023-11-26T07:19:10.254801+0000","last_fullsized":"2023-11-26T07:19:10.254801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:36.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248534+0000","last_change":"2023-11-26T07:19:10.237323+0000","last_active":"2023-11-26T07:19:10.248534+0000","last_peered":"2023-11-26T07:19:10.248534+0000","last_clean":"2023-11-26T07:19:10.248534+0000","last_became_active":"2023-11-26T07:19:10.237027+0000","last_became_peered":"2023-11-26T07:19:10.237027+0000","last_unstale":"2023-11-26T07:19:10.248534+0000","last_undegraded":"2023-11-26T07:19:10.248534+0000","last_fullsized":"2023-11-26T07:19:10.248534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:39.400415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.256353+0000","last_change":"2023-11-26T07:19:09.214402+0000","last_active":"2023-11-26T07:19:10.256353+0000","last_peered":"2023-11-26T07:19:10.256353+0000","last_clean":"2023-11-26T07:19:10.256353+0000","last_became_active":"2023-11-26T07:19:09.213871+0000","last_became_peered":"2023-11-26T07:19:09.213871+0000","last_unstale":"2023-11-26T07:19:10.256353+0000","last_undegraded":"2023-11-26T07:19:10.256353+0000","last_fullsized":"2023-11-26T07:19:10.256353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:43.671120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238065+0000","last_change":"2023-11-26T07:19:10.225643+0000","last_active":"2023-11-26T07:19:10.238065+0000","last_peered":"2023-11-26T07:19:10.238065+0000","last_clean":"2023-11-26T07:19:10.238065+0000","last_became_active":"2023-11-26T07:19:10.225090+0000","last_became_peered":"2023-11-26T07:19:10.225090+0000","last_unstale":"2023-11-26T07:19:10.238065+0000","last_undegraded":"2023-11-26T07:19:10.238065+0000","last_fullsized":"2023-11-26T07:19:10.238065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:16.190665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.215931+0000","last_change":"2023-11-26T07:19:09.218137+0000","last_active":"2023-11-26T07:19:10.215931+0000","last_peered":"2023-11-26T07:19:10.215931+0000","last_clean":"2023-11-26T07:19:10.215931+0000","last_became_active":"2023-11-26T07:19:09.217800+0000","last_became_peered":"2023-11-26T07:19:09.217800+0000","last_unstale":"2023-11-26T07:19:10.215931+0000","last_undegraded":"2023-11-26T07:19:10.215931+0000","last_fullsized":"2023-11-26T07:19:10.215931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:39.972393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.244173+0000","last_change":"2023-11-26T07:19:10.242244+0000","last_active":"2023-11-26T07:19:10.244173+0000","last_peered":"2023-11-26T07:19:10.244173+0000","last_clean":"2023-11-26T07:19:10.244173+0000","last_became_active":"2023-11-26T07:19:10.241949+0000","last_became_peered":"2023-11-26T07:19:10.241949+0000","last_unstale":"2023-11-26T07:19:10.244173+0000","last_undegraded":"2023-11-26T07:19:10.244173+0000","last_fullsized":"2023-11-26T07:19:10.244173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:01:36.052554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255427+0000","last_change":"2023-11-26T07:19:09.216126+0000","last_active":"2023-11-26T07:19:10.255427+0000","last_peered":"2023-11-26T07:19:10.255427+0000","last_clean":"2023-11-26T07:19:10.255427+0000","last_became_active":"2023-11-26T07:19:09.215833+0000","last_became_peered":"2023-11-26T07:19:09.215833+0000","last_unstale":"2023-11-26T07:19:10.255427+0000","last_undegraded":"2023-11-26T07:19:10.255427+0000","last_fullsized":"2023-11-26T07:19:10.255427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:43.671120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238829+0000","last_change":"2023-11-26T07:19:10.237641+0000","last_active":"2023-11-26T07:19:10.238829+0000","last_peered":"2023-11-26T07:19:10.238829+0000","last_clean":"2023-11-26T07:19:10.238829+0000","last_became_active":"2023-11-26T07:19:10.237339+0000","last_became_peered":"2023-11-26T07:19:10.237339+0000","last_unstale":"2023-11-26T07:19:10.238829+0000","last_undegraded":"2023-11-26T07:19:10.238829+0000","last_fullsized":"2023-11-26T07:19:10.238829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:17.383871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.211154+0000","last_change":"2023-11-26T07:19:09.227375+0000","last_active":"2023-11-26T07:19:10.211154+0000","last_peered":"2023-11-26T07:19:10.211154+0000","last_clean":"2023-11-26T07:19:10.211154+0000","last_became_active":"2023-11-26T07:19:09.226757+0000","last_became_peered":"2023-11-26T07:19:09.226757+0000","last_unstale":"2023-11-26T07:19:10.211154+0000","last_undegraded":"2023-11-26T07:19:10.211154+0000","last_fullsized":"2023-11-26T07:19:10.211154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:43.671120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.237717+0000","last_change":"2023-11-26T07:19:10.231259+0000","last_active":"2023-11-26T07:19:10.237717+0000","last_peered":"2023-11-26T07:19:10.237717+0000","last_clean":"2023-11-26T07:19:10.237717+0000","last_became_active":"2023-11-26T07:19:10.230238+0000","last_became_peered":"2023-11-26T07:19:10.230238+0000","last_unstale":"2023-11-26T07:19:10.237717+0000","last_undegraded":"2023-11-26T07:19:10.237717+0000","last_fullsized":"2023-11-26T07:19:10.237717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:54:55.331444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.215209+0000","last_change":"2023-11-26T07:19:09.220896+0000","last_active":"2023-11-26T07:19:10.215209+0000","last_peered":"2023-11-26T07:19:10.215209+0000","last_clean":"2023-11-26T07:19:10.215209+0000","last_became_active":"2023-11-26T07:19:09.220653+0000","last_became_peered":"2023-11-26T07:19:09.220653+0000","last_unstale":"2023-11-26T07:19:10.215209+0000","last_undegraded":"2023-11-26T07:19:10.215209+0000","last_fullsized":"2023-11-26T07:19:10.215209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:11.974052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.231688+0000","last_change":"2023-11-26T07:19:10.224436+0000","last_active":"2023-11-26T07:19:10.231688+0000","last_peered":"2023-11-26T07:19:10.231688+0000","last_clean":"2023-11-26T07:19:10.231688+0000","last_became_active":"2023-11-26T07:19:10.223737+0000","last_became_peered":"2023-11-26T07:19:10.223737+0000","last_unstale":"2023-11-26T07:19:10.231688+0000","last_undegraded":"2023-11-26T07:19:10.231688+0000","last_fullsized":"2023-11-26T07:19:10.231688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:52.369060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.220141+0000","last_change":"2023-11-26T07:19:09.223037+0000","last_active":"2023-11-26T07:19:10.220141+0000","last_peered":"2023-11-26T07:19:10.220141+0000","last_clean":"2023-11-26T07:19:10.220141+0000","last_became_active":"2023-11-26T07:19:09.222729+0000","last_became_peered":"2023-11-26T07:19:09.222729+0000","last_unstale":"2023-11-26T07:19:10.220141+0000","last_undegraded":"2023-11-26T07:19:10.220141+0000","last_fullsized":"2023-11-26T07:19:10.220141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:27.326490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.237684+0000","last_change":"2023-11-26T07:19:10.231295+0000","last_active":"2023-11-26T07:19:10.237684+0000","last_peered":"2023-11-26T07:19:10.237684+0000","last_clean":"2023-11-26T07:19:10.237684+0000","last_became_active":"2023-11-26T07:19:10.230974+0000","last_became_peered":"2023-11-26T07:19:10.230974+0000","last_unstale":"2023-11-26T07:19:10.237684+0000","last_undegraded":"2023-11-26T07:19:10.237684+0000","last_fullsized":"2023-11-26T07:19:10.237684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:49:05.748637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.258715+0000","last_change":"2023-11-26T07:19:09.228954+0000","last_active":"2023-11-26T07:19:10.258715+0000","last_peered":"2023-11-26T07:19:10.258715+0000","last_clean":"2023-11-26T07:19:10.258715+0000","last_became_active":"2023-11-26T07:19:09.228696+0000","last_became_peered":"2023-11-26T07:19:09.228696+0000","last_unstale":"2023-11-26T07:19:10.258715+0000","last_undegraded":"2023-11-26T07:19:10.258715+0000","last_fullsized":"2023-11-26T07:19:10.258715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:31.661875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243571+0000","last_change":"2023-11-26T07:19:10.239600+0000","last_active":"2023-11-26T07:19:10.243571+0000","last_peered":"2023-11-26T07:19:10.243571+0000","last_clean":"2023-11-26T07:19:10.243571+0000","last_became_active":"2023-11-26T07:19:10.239269+0000","last_became_peered":"2023-11-26T07:19:10.239269+0000","last_unstale":"2023-11-26T07:19:10.243571+0000","last_undegraded":"2023-11-26T07:19:10.243571+0000","last_fullsized":"2023-11-26T07:19:10.243571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:32.664322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.222441+0000","last_change":"2023-11-26T07:19:09.225212+0000","last_active":"2023-11-26T07:19:10.222441+0000","last_peered":"2023-11-26T07:19:10.222441+0000","last_clean":"2023-11-26T07:19:10.222441+0000","last_became_active":"2023-11-26T07:19:09.224884+0000","last_became_peered":"2023-11-26T07:19:09.224884+0000","last_unstale":"2023-11-26T07:19:10.222441+0000","last_undegraded":"2023-11-26T07:19:10.222441+0000","last_fullsized":"2023-11-26T07:19:10.222441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:39.972393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.249971+0000","last_change":"2023-11-26T07:19:10.243388+0000","last_active":"2023-11-26T07:19:10.249971+0000","last_peered":"2023-11-26T07:19:10.249971+0000","last_clean":"2023-11-26T07:19:10.249971+0000","last_became_active":"2023-11-26T07:19:10.243099+0000","last_became_peered":"2023-11-26T07:19:10.243099+0000","last_unstale":"2023-11-26T07:19:10.249971+0000","last_undegraded":"2023-11-26T07:19:10.249971+0000","last_fullsized":"2023-11-26T07:19:10.249971+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:01.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.230622+0000","last_change":"2023-11-26T07:19:09.228011+0000","last_active":"2023-11-26T07:19:10.230622+0000","last_peered":"2023-11-26T07:19:10.230622+0000","last_clean":"2023-11-26T07:19:10.230622+0000","last_became_active":"2023-11-26T07:19:09.227747+0000","last_became_peered":"2023-11-26T07:19:09.227747+0000","last_unstale":"2023-11-26T07:19:10.230622+0000","last_undegraded":"2023-11-26T07:19:10.230622+0000","last_fullsized":"2023-11-26T07:19:10.230622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:30.271310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239870+0000","last_change":"2023-11-26T07:19:10.230855+0000","last_active":"2023-11-26T07:19:10.239870+0000","last_peered":"2023-11-26T07:19:10.239870+0000","last_clean":"2023-11-26T07:19:10.239870+0000","last_became_active":"2023-11-26T07:19:10.230395+0000","last_became_peered":"2023-11-26T07:19:10.230395+0000","last_unstale":"2023-11-26T07:19:10.239870+0000","last_undegraded":"2023-11-26T07:19:10.239870+0000","last_fullsized":"2023-11-26T07:19:10.239870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:50.784948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.219098+0000","last_change":"2023-11-26T07:19:09.219267+0000","last_active":"2023-11-26T07:19:10.219098+0000","last_peered":"2023-11-26T07:19:10.219098+0000","last_clean":"2023-11-26T07:19:10.219098+0000","last_became_active":"2023-11-26T07:19:09.218957+0000","last_became_peered":"2023-11-26T07:19:09.218957+0000","last_unstale":"2023-11-26T07:19:10.219098+0000","last_undegraded":"2023-11-26T07:19:10.219098+0000","last_fullsized":"2023-11-26T07:19:10.219098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:19.442473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255264+0000","last_change":"2023-11-26T07:19:10.245624+0000","last_active":"2023-11-26T07:19:10.255264+0000","last_peered":"2023-11-26T07:19:10.255264+0000","last_clean":"2023-11-26T07:19:10.255264+0000","last_became_active":"2023-11-26T07:19:10.245351+0000","last_became_peered":"2023-11-26T07:19:10.245351+0000","last_unstale":"2023-11-26T07:19:10.255264+0000","last_undegraded":"2023-11-26T07:19:10.255264+0000","last_fullsized":"2023-11-26T07:19:10.255264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:39.400415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.230001+0000","last_change":"2023-11-26T07:19:09.227671+0000","last_active":"2023-11-26T07:19:10.230001+0000","last_peered":"2023-11-26T07:19:10.230001+0000","last_clean":"2023-11-26T07:19:10.230001+0000","last_became_active":"2023-11-26T07:19:09.227253+0000","last_became_peered":"2023-11-26T07:19:09.227253+0000","last_unstale":"2023-11-26T07:19:10.230001+0000","last_undegraded":"2023-11-26T07:19:10.230001+0000","last_fullsized":"2023-11-26T07:19:10.230001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:43.382092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.226742+0000","last_change":"2023-11-26T07:19:10.222322+0000","last_active":"2023-11-26T07:19:10.226742+0000","last_peered":"2023-11-26T07:19:10.226742+0000","last_clean":"2023-11-26T07:19:10.226742+0000","last_became_active":"2023-11-26T07:19:10.222040+0000","last_became_peered":"2023-11-26T07:19:10.222040+0000","last_unstale":"2023-11-26T07:19:10.226742+0000","last_undegraded":"2023-11-26T07:19:10.226742+0000","last_fullsized":"2023-11-26T07:19:10.226742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:49.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.216374+0000","last_change":"2023-11-26T07:19:09.216312+0000","last_active":"2023-11-26T07:19:10.216374+0000","last_peered":"2023-11-26T07:19:10.216374+0000","last_clean":"2023-11-26T07:19:10.216374+0000","last_became_active":"2023-11-26T07:19:09.215990+0000","last_became_peered":"2023-11-26T07:19:09.215990+0000","last_unstale":"2023-11-26T07:19:10.216374+0000","last_undegraded":"2023-11-26T07:19:10.216374+0000","last_fullsized":"2023-11-26T07:19:10.216374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.736385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.233482+0000","last_change":"2023-11-26T07:19:10.227193+0000","last_active":"2023-11-26T07:19:10.233482+0000","last_peered":"2023-11-26T07:19:10.233482+0000","last_clean":"2023-11-26T07:19:10.233482+0000","last_became_active":"2023-11-26T07:19:10.226910+0000","last_became_peered":"2023-11-26T07:19:10.226910+0000","last_unstale":"2023-11-26T07:19:10.233482+0000","last_undegraded":"2023-11-26T07:19:10.233482+0000","last_fullsized":"2023-11-26T07:19:10.233482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:23.633080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.214084+0000","last_change":"2023-11-26T07:19:09.226832+0000","last_active":"2023-11-26T07:19:10.214084+0000","last_peered":"2023-11-26T07:19:10.214084+0000","last_clean":"2023-11-26T07:19:10.214084+0000","last_became_active":"2023-11-26T07:19:09.226493+0000","last_became_peered":"2023-11-26T07:19:09.226493+0000","last_unstale":"2023-11-26T07:19:10.214084+0000","last_undegraded":"2023-11-26T07:19:10.214084+0000","last_fullsized":"2023-11-26T07:19:10.214084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:35.491489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.245765+0000","last_change":"2023-11-26T07:19:10.238133+0000","last_active":"2023-11-26T07:19:10.245765+0000","last_peered":"2023-11-26T07:19:10.245765+0000","last_clean":"2023-11-26T07:19:10.245765+0000","last_became_active":"2023-11-26T07:19:10.237787+0000","last_became_peered":"2023-11-26T07:19:10.237787+0000","last_unstale":"2023-11-26T07:19:10.245765+0000","last_undegraded":"2023-11-26T07:19:10.245765+0000","last_fullsized":"2023-11-26T07:19:10.245765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:39:22.633319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.211382+0000","last_change":"2023-11-26T07:19:09.219760+0000","last_active":"2023-11-26T07:19:10.211382+0000","last_peered":"2023-11-26T07:19:10.211382+0000","last_clean":"2023-11-26T07:19:10.211382+0000","last_became_active":"2023-11-26T07:19:09.219471+0000","last_became_peered":"2023-11-26T07:19:09.219471+0000","last_unstale":"2023-11-26T07:19:10.211382+0000","last_undegraded":"2023-11-26T07:19:10.211382+0000","last_fullsized":"2023-11-26T07:19:10.211382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:11.974052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:19:09.202880+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:19:09.202880+0000","last_peered":"2023-11-26T07:19:09.202880+0000","last_clean":"2023-11-26T07:19:09.202880+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:19:09.202880+0000","last_undegraded":"2023-11-26T07:19:09.202880+0000","last_fullsized":"2023-11-26T07:19:09.202880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":733863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47299999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68300000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.434},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.58499999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.73599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.495},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.42099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.629}]},{"osd":7,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":150942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.8019999999999996,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.2329999999999997,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.82099999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":7.5640000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.752},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":6.7530000000000001,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":7.7789999999999999,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.7530000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.83599999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":6.6879999999999997,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":7.1680000000000001,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.63200000000000001},{"interface":"front","average":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":24.623000000000001,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":7.6390000000000002,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":7.2869999999999999,"5min":7.2869999999999999,"15min":7.2869999999999999},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.749},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.497}]},{"osd":1,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65800000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.44800000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.435},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.371}]},{"osd":4,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47699999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.49199999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":150340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.374}]},{"osd":1,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.315},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.441},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.0820000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.88},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.002}]},{"osd":7,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1.052},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.03}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.311},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.439}]},{"osd":2,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.54900000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.503}]},{"osd":4,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.623},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.73299999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.70599999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":740638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.38800000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":5.234,"5min":5.234,"15min":5.234},"last":0.501}]},{"osd":3,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.726,"5min":3.726,"15min":3.726},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.1639999999999997,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.75},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.7530000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.81599999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.73599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:19:14.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:19:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984904d640 1 Processor -- start 2023-11-26T07:19:14.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984904d640 1 -- start start 2023-11-26T07:19:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984904d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f98440cf280 0x7f98440cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984904d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cd1b0 0x7f98440cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984904d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98440cc730 con 0x7f9844143ac0 2023-11-26T07:19:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984904d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9844143ea0 con 0x7f98440cf280 2023-11-26T07:19:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984904d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98440cfc50 con 0x7f98440cd1b0 2023-11-26T07:19:14.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f9842d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9844143ac0 0x7f9844070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39926/0 (socket says 172.21.15.70:39926) 2023-11-26T07:19:14.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f9842d9d640 1 -- 172.21.15.70:0/3554442053 learned_addr learned my addr 172.21.15.70:0/3554442053 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:14.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984259c640 1 --2- 172.21.15.70:0/3554442053 >> v2:172.21.15.120:3300/0 conn(0x7f98440cf280 0x7f98440cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984359e640 1 --2- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cd1b0 0x7f98440cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f9841d9b640 1 -- 172.21.15.70:0/3554442053 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233047511 0 0) 0x7f98440cc730 con 0x7f9844143ac0 2023-11-26T07:19:14.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f9841d9b640 1 -- 172.21.15.70:0/3554442053 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f982c003530 con 0x7f9844143ac0 2023-11-26T07:19:14.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984259c640 1 -- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cd1b0 msgr2=0x7f98440cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:14.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984259c640 1 --2- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cd1b0 0x7f98440cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f9841d9b640 1 -- 172.21.15.70:0/3554442053 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023705495 0 0) 0x7f982c003530 con 0x7f9844143ac0 2023-11-26T07:19:14.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984259c640 1 -- 172.21.15.70:0/3554442053 >> v1:172.21.15.70:6789/0 conn(0x7f9844143ac0 legacy=0x7f9844070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.461+0000 7f984259c640 1 -- 172.21.15.70:0/3554442053 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844070ee0 con 0x7f98440cf280 2023-11-26T07:19:14.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984259c640 1 --2- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cf280 0x7f98440cf710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98380097c0 tx=0x7f983801e5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e09fa718a25e7b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f9841d9b640 1 -- 172.21.15.70:0/3554442053 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98340016a0 con 0x7f98440cf280 2023-11-26T07:19:14.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f9841d9b640 1 -- 172.21.15.70:0/3554442053 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98380ac460 con 0x7f98440cf280 2023-11-26T07:19:14.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f9841d9b640 1 -- 172.21.15.70:0/3554442053 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380ac7f0 con 0x7f98440cf280 2023-11-26T07:19:14.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 -- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cf280 msgr2=0x7f98440cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 --2- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cf280 0x7f98440cf710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98380097c0 tx=0x7f983801e5b0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 -- 172.21.15.70:0/3554442053 shutdown_connections 2023-11-26T07:19:14.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 --2- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cd1b0 0x7f98440cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 --2- 172.21.15.70:0/3554442053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cf280 0x7f98440cf710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 -- 172.21.15.70:0/3554442053 >> 172.21.15.70:0/3554442053 conn(0x7f984406a890 msgr2=0x7f984406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:14.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 -- 172.21.15.70:0/3554442053 shutdown_connections 2023-11-26T07:19:14.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.465+0000 7f984904d640 1 -- 172.21.15.70:0/3554442053 wait complete. 2023-11-26T07:19:14.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 Processor -- start 2023-11-26T07:19:14.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 -- start start 2023-11-26T07:19:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cd1b0 0x7f984414da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cf280 0x7f9844139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9844143ac0 0x7f98440af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98440b1800 con 0x7f9844143ac0 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9844138150 con 0x7f98440cd1b0 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9844138e00 con 0x7f98440cf280 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9844143ac0 0x7f98440af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9844143ac0 0x7f98440af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49914/0 (socket says 172.21.15.70:49914) 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 -- 172.21.15.70:0/792382443 learned_addr learned my addr 172.21.15.70:0/792382443 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f9842d9d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cd1b0 0x7f984414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984259c640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cf280 0x7f9844139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 -- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cf280 msgr2=0x7f9844139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cf280 0x7f9844139ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 -- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cd1b0 msgr2=0x7f984414da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cd1b0 0x7f984414da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 -- 172.21.15.70:0/792382443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009420 con 0x7f9844143ac0 2023-11-26T07:19:14.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f9842d9d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cd1b0 0x7f984414da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984359e640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9844143ac0 0x7f98440af600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f983c009d30 tx=0x7f983c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f982b7fe640 1 -- 172.21.15.70:0/792382443 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c009ba0 con 0x7f9844143ac0 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f982b7fe640 1 -- 172.21.15.70:0/792382443 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c00f040 con 0x7f9844143ac0 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98441390e0 con 0x7f9844143ac0 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f982b7fe640 1 -- 172.21.15.70:0/792382443 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c0146c0 con 0x7f9844143ac0 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.469+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98441396a0 con 0x7f9844143ac0 2023-11-26T07:19:14.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.473+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9844067660 con 0x7f9844143ac0 2023-11-26T07:19:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.473+0000 7f982b7fe640 1 -- 172.21.15.70:0/792382443 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f983c014820 con 0x7f9844143ac0 2023-11-26T07:19:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.473+0000 7f982b7fe640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9830066470 0x7f9830068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.473+0000 7f982b7fe640 1 -- 172.21.15.70:0/792382443 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f983c084c20 con 0x7f9844143ac0 2023-11-26T07:19:14.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.473+0000 7f9842d9d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9830066470 0x7f9830068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.473+0000 7f9842d9d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9830066470 0x7f9830068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f98340017d0 tx=0x7f9834001700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.477+0000 7f982b7fe640 1 -- 172.21.15.70:0/792382443 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f983c052010 con 0x7f9844143ac0 2023-11-26T07:19:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.621+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9844071c30 con 0x7f9830066470 2023-11-26T07:19:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.629+0000 7f982b7fe640 1 -- 172.21.15.70:0/792382443 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288513 (secure 0 0 0) 0x7f98340019e0 con 0x7f9830066470 2023-11-26T07:19:14.637 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:19:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9830066470 msgr2=0x7f9830068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9830066470 0x7f9830068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f98340017d0 tx=0x7f9834001700 comp rx=0 tx=0).stop 2023-11-26T07:19:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9844143ac0 msgr2=0x7f98440af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9844143ac0 0x7f98440af600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f983c009d30 tx=0x7f983c00c490 comp rx=0 tx=0).stop 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 shutdown_connections 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9830066470 0x7f9830068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9844143ac0 0x7f98440af600 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f98440cf280 0x7f9844139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 --2- 172.21.15.70:0/792382443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98440cd1b0 0x7f984414da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 >> 172.21.15.70:0/792382443 conn(0x7f984406a890 msgr2=0x7f984415a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 shutdown_connections 2023-11-26T07:19:14.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.633+0000 7f984904d640 1 -- 172.21.15.70:0/792382443 wait complete. 2023-11-26T07:19:14.657 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-26T07:19:14.007611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236948,"kb_used_data":4120,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737772,"statfs":{"total":773094113280,"available":772851478528,"internally_reserved":0,"allocated":4218880,"data_stored":2349763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.814886"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239281+0000","last_change":"2023-11-26T07:19:10.229590+0000","last_active":"2023-11-26T07:19:10.239281+0000","last_peered":"2023-11-26T07:19:10.239281+0000","last_clean":"2023-11-26T07:19:10.239281+0000","last_became_active":"2023-11-26T07:19:10.229284+0000","last_became_peered":"2023-11-26T07:19:10.229284+0000","last_unstale":"2023-11-26T07:19:10.239281+0000","last_undegraded":"2023-11-26T07:19:10.239281+0000","last_fullsized":"2023-11-26T07:19:10.239281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:23.633080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242680+0000","last_change":"2023-11-26T07:19:10.233245+0000","last_active":"2023-11-26T07:19:10.242680+0000","last_peered":"2023-11-26T07:19:10.242680+0000","last_clean":"2023-11-26T07:19:10.242680+0000","last_became_active":"2023-11-26T07:19:10.232965+0000","last_became_peered":"2023-11-26T07:19:10.232965+0000","last_unstale":"2023-11-26T07:19:10.242680+0000","last_undegraded":"2023-11-26T07:19:10.242680+0000","last_fullsized":"2023-11-26T07:19:10.242680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:28.328937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243127+0000","last_change":"2023-11-26T07:19:10.238312+0000","last_active":"2023-11-26T07:19:10.243127+0000","last_peered":"2023-11-26T07:19:10.243127+0000","last_clean":"2023-11-26T07:19:10.243127+0000","last_became_active":"2023-11-26T07:19:10.237979+0000","last_became_peered":"2023-11-26T07:19:10.237979+0000","last_unstale":"2023-11-26T07:19:10.243127+0000","last_undegraded":"2023-11-26T07:19:10.243127+0000","last_fullsized":"2023-11-26T07:19:10.243127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:01.090350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248555+0000","last_change":"2023-11-26T07:19:10.237375+0000","last_active":"2023-11-26T07:19:10.248555+0000","last_peered":"2023-11-26T07:19:10.248555+0000","last_clean":"2023-11-26T07:19:10.248555+0000","last_became_active":"2023-11-26T07:19:10.237107+0000","last_became_peered":"2023-11-26T07:19:10.237107+0000","last_unstale":"2023-11-26T07:19:10.248555+0000","last_undegraded":"2023-11-26T07:19:10.248555+0000","last_fullsized":"2023-11-26T07:19:10.248555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:44.673568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.231862+0000","last_change":"2023-11-26T07:19:10.215549+0000","last_active":"2023-11-26T07:19:10.231862+0000","last_peered":"2023-11-26T07:19:10.231862+0000","last_clean":"2023-11-26T07:19:10.231862+0000","last_became_active":"2023-11-26T07:19:10.215134+0000","last_became_peered":"2023-11-26T07:19:10.215134+0000","last_unstale":"2023-11-26T07:19:10.231862+0000","last_undegraded":"2023-11-26T07:19:10.231862+0000","last_fullsized":"2023-11-26T07:19:10.231862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:07:57.529242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.236449+0000","last_change":"2023-11-26T07:19:10.226891+0000","last_active":"2023-11-26T07:19:10.236449+0000","last_peered":"2023-11-26T07:19:10.236449+0000","last_clean":"2023-11-26T07:19:10.236449+0000","last_became_active":"2023-11-26T07:19:10.226632+0000","last_became_peered":"2023-11-26T07:19:10.226632+0000","last_unstale":"2023-11-26T07:19:10.236449+0000","last_undegraded":"2023-11-26T07:19:10.236449+0000","last_fullsized":"2023-11-26T07:19:10.236449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.234487+0000","last_change":"2023-11-26T07:19:10.224640+0000","last_active":"2023-11-26T07:19:10.234487+0000","last_peered":"2023-11-26T07:19:10.234487+0000","last_clean":"2023-11-26T07:19:10.234487+0000","last_became_active":"2023-11-26T07:19:10.224098+0000","last_became_peered":"2023-11-26T07:19:10.224098+0000","last_unstale":"2023-11-26T07:19:10.234487+0000","last_undegraded":"2023-11-26T07:19:10.234487+0000","last_fullsized":"2023-11-26T07:19:10.234487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:32.664322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248899+0000","last_change":"2023-11-26T07:19:10.242401+0000","last_active":"2023-11-26T07:19:10.248899+0000","last_peered":"2023-11-26T07:19:10.248899+0000","last_clean":"2023-11-26T07:19:10.248899+0000","last_became_active":"2023-11-26T07:19:10.242076+0000","last_became_peered":"2023-11-26T07:19:10.242076+0000","last_unstale":"2023-11-26T07:19:10.248899+0000","last_undegraded":"2023-11-26T07:19:10.248899+0000","last_fullsized":"2023-11-26T07:19:10.248899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:01.090350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243086+0000","last_change":"2023-11-26T07:19:10.239719+0000","last_active":"2023-11-26T07:19:10.243086+0000","last_peered":"2023-11-26T07:19:10.243086+0000","last_clean":"2023-11-26T07:19:10.243086+0000","last_became_active":"2023-11-26T07:19:10.239231+0000","last_became_peered":"2023-11-26T07:19:10.239231+0000","last_unstale":"2023-11-26T07:19:10.243086+0000","last_undegraded":"2023-11-26T07:19:10.243086+0000","last_fullsized":"2023-11-26T07:19:10.243086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248585+0000","last_change":"2023-11-26T07:19:10.239218+0000","last_active":"2023-11-26T07:19:10.248585+0000","last_peered":"2023-11-26T07:19:10.248585+0000","last_clean":"2023-11-26T07:19:10.248585+0000","last_became_active":"2023-11-26T07:19:10.238873+0000","last_became_peered":"2023-11-26T07:19:10.238873+0000","last_unstale":"2023-11-26T07:19:10.248585+0000","last_undegraded":"2023-11-26T07:19:10.248585+0000","last_fullsized":"2023-11-26T07:19:10.248585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:49.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248631+0000","last_change":"2023-11-26T07:19:10.240593+0000","last_active":"2023-11-26T07:19:10.248631+0000","last_peered":"2023-11-26T07:19:10.248631+0000","last_clean":"2023-11-26T07:19:10.248631+0000","last_became_active":"2023-11-26T07:19:10.237105+0000","last_became_peered":"2023-11-26T07:19:10.237105+0000","last_unstale":"2023-11-26T07:19:10.248631+0000","last_undegraded":"2023-11-26T07:19:10.248631+0000","last_fullsized":"2023-11-26T07:19:10.248631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:30.517944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240865+0000","last_change":"2023-11-26T07:19:10.236768+0000","last_active":"2023-11-26T07:19:10.240865+0000","last_peered":"2023-11-26T07:19:10.240865+0000","last_clean":"2023-11-26T07:19:10.240865+0000","last_became_active":"2023-11-26T07:19:10.236397+0000","last_became_peered":"2023-11-26T07:19:10.236397+0000","last_unstale":"2023-11-26T07:19:10.240865+0000","last_undegraded":"2023-11-26T07:19:10.240865+0000","last_fullsized":"2023-11-26T07:19:10.240865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:08.908774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238807+0000","last_change":"2023-11-26T07:19:10.226945+0000","last_active":"2023-11-26T07:19:10.238807+0000","last_peered":"2023-11-26T07:19:10.238807+0000","last_clean":"2023-11-26T07:19:10.238807+0000","last_became_active":"2023-11-26T07:19:10.226653+0000","last_became_peered":"2023-11-26T07:19:10.226653+0000","last_unstale":"2023-11-26T07:19:10.238807+0000","last_undegraded":"2023-11-26T07:19:10.238807+0000","last_fullsized":"2023-11-26T07:19:10.238807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:21:27.022325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.226979+0000","last_change":"2023-11-26T07:19:10.221639+0000","last_active":"2023-11-26T07:19:10.226979+0000","last_peered":"2023-11-26T07:19:10.226979+0000","last_clean":"2023-11-26T07:19:10.226979+0000","last_became_active":"2023-11-26T07:19:10.221293+0000","last_became_peered":"2023-11-26T07:19:10.221293+0000","last_unstale":"2023-11-26T07:19:10.226979+0000","last_undegraded":"2023-11-26T07:19:10.226979+0000","last_fullsized":"2023-11-26T07:19:10.226979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:40.974840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.235343+0000","last_change":"2023-11-26T07:19:10.228844+0000","last_active":"2023-11-26T07:19:10.235343+0000","last_peered":"2023-11-26T07:19:10.235343+0000","last_clean":"2023-11-26T07:19:10.235343+0000","last_became_active":"2023-11-26T07:19:10.227998+0000","last_became_peered":"2023-11-26T07:19:10.227998+0000","last_unstale":"2023-11-26T07:19:10.235343+0000","last_undegraded":"2023-11-26T07:19:10.235343+0000","last_fullsized":"2023-11-26T07:19:10.235343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:31.273757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240953+0000","last_change":"2023-11-26T07:19:10.231501+0000","last_active":"2023-11-26T07:19:10.240953+0000","last_peered":"2023-11-26T07:19:10.240953+0000","last_clean":"2023-11-26T07:19:10.240953+0000","last_became_active":"2023-11-26T07:19:10.231225+0000","last_became_peered":"2023-11-26T07:19:10.231225+0000","last_unstale":"2023-11-26T07:19:10.240953+0000","last_undegraded":"2023-11-26T07:19:10.240953+0000","last_fullsized":"2023-11-26T07:19:10.240953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:53:17.509456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248977+0000","last_change":"2023-11-26T07:19:10.241594+0000","last_active":"2023-11-26T07:19:10.248977+0000","last_peered":"2023-11-26T07:19:10.248977+0000","last_clean":"2023-11-26T07:19:10.248977+0000","last_became_active":"2023-11-26T07:19:10.241311+0000","last_became_peered":"2023-11-26T07:19:10.241311+0000","last_unstale":"2023-11-26T07:19:10.248977+0000","last_undegraded":"2023-11-26T07:19:10.248977+0000","last_fullsized":"2023-11-26T07:19:10.248977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:42:05.846637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.249037+0000","last_change":"2023-11-26T07:19:10.242999+0000","last_active":"2023-11-26T07:19:10.249037+0000","last_peered":"2023-11-26T07:19:10.249037+0000","last_clean":"2023-11-26T07:19:10.249037+0000","last_became_active":"2023-11-26T07:19:10.242690+0000","last_became_peered":"2023-11-26T07:19:10.242690+0000","last_unstale":"2023-11-26T07:19:10.249037+0000","last_undegraded":"2023-11-26T07:19:10.249037+0000","last_fullsized":"2023-11-26T07:19:10.249037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:32.664322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242554+0000","last_change":"2023-11-26T07:19:10.234645+0000","last_active":"2023-11-26T07:19:10.242554+0000","last_peered":"2023-11-26T07:19:10.242554+0000","last_clean":"2023-11-26T07:19:10.242554+0000","last_became_active":"2023-11-26T07:19:10.234357+0000","last_became_peered":"2023-11-26T07:19:10.234357+0000","last_unstale":"2023-11-26T07:19:10.242554+0000","last_undegraded":"2023-11-26T07:19:10.242554+0000","last_fullsized":"2023-11-26T07:19:10.242554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:31.273757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239908+0000","last_change":"2023-11-26T07:19:10.231749+0000","last_active":"2023-11-26T07:19:10.239908+0000","last_peered":"2023-11-26T07:19:10.239908+0000","last_clean":"2023-11-26T07:19:10.239908+0000","last_became_active":"2023-11-26T07:19:10.231474+0000","last_became_peered":"2023-11-26T07:19:10.231474+0000","last_unstale":"2023-11-26T07:19:10.239908+0000","last_undegraded":"2023-11-26T07:19:10.239908+0000","last_fullsized":"2023-11-26T07:19:10.239908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:58:49.344208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.237316+0000","last_change":"2023-11-26T07:19:10.234307+0000","last_active":"2023-11-26T07:19:10.237316+0000","last_peered":"2023-11-26T07:19:10.237316+0000","last_clean":"2023-11-26T07:19:10.237316+0000","last_became_active":"2023-11-26T07:19:10.233961+0000","last_became_peered":"2023-11-26T07:19:10.233961+0000","last_unstale":"2023-11-26T07:19:10.237316+0000","last_undegraded":"2023-11-26T07:19:10.237316+0000","last_fullsized":"2023-11-26T07:19:10.237316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:50.784948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242082+0000","last_change":"2023-11-26T07:19:10.235937+0000","last_active":"2023-11-26T07:19:10.242082+0000","last_peered":"2023-11-26T07:19:10.242082+0000","last_clean":"2023-11-26T07:19:10.242082+0000","last_became_active":"2023-11-26T07:19:10.235621+0000","last_became_peered":"2023-11-26T07:19:10.235621+0000","last_unstale":"2023-11-26T07:19:10.242082+0000","last_undegraded":"2023-11-26T07:19:10.242082+0000","last_fullsized":"2023-11-26T07:19:10.242082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:31.273757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238783+0000","last_change":"2023-11-26T07:19:10.235986+0000","last_active":"2023-11-26T07:19:10.238783+0000","last_peered":"2023-11-26T07:19:10.238783+0000","last_clean":"2023-11-26T07:19:10.238783+0000","last_became_active":"2023-11-26T07:19:10.235662+0000","last_became_peered":"2023-11-26T07:19:10.235662+0000","last_unstale":"2023-11-26T07:19:10.238783+0000","last_undegraded":"2023-11-26T07:19:10.238783+0000","last_fullsized":"2023-11-26T07:19:10.238783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243537+0000","last_change":"2023-11-26T07:19:10.238625+0000","last_active":"2023-11-26T07:19:10.243537+0000","last_peered":"2023-11-26T07:19:10.243537+0000","last_clean":"2023-11-26T07:19:10.243537+0000","last_became_active":"2023-11-26T07:19:10.238404+0000","last_became_peered":"2023-11-26T07:19:10.238404+0000","last_unstale":"2023-11-26T07:19:10.243537+0000","last_undegraded":"2023-11-26T07:19:10.243537+0000","last_fullsized":"2023-11-26T07:19:10.243537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:01.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.253450+0000","last_change":"2023-11-26T07:19:10.246953+0000","last_active":"2023-11-26T07:19:10.253450+0000","last_peered":"2023-11-26T07:19:10.253450+0000","last_clean":"2023-11-26T07:19:10.253450+0000","last_became_active":"2023-11-26T07:19:10.246646+0000","last_became_peered":"2023-11-26T07:19:10.246646+0000","last_unstale":"2023-11-26T07:19:10.253450+0000","last_undegraded":"2023-11-26T07:19:10.253450+0000","last_fullsized":"2023-11-26T07:19:10.253450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:40.974840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.242660+0000","last_change":"2023-11-26T07:19:10.233308+0000","last_active":"2023-11-26T07:19:10.242660+0000","last_peered":"2023-11-26T07:19:10.242660+0000","last_clean":"2023-11-26T07:19:10.242660+0000","last_became_active":"2023-11-26T07:19:10.228890+0000","last_became_peered":"2023-11-26T07:19:10.228890+0000","last_unstale":"2023-11-26T07:19:10.242660+0000","last_undegraded":"2023-11-26T07:19:10.242660+0000","last_fullsized":"2023-11-26T07:19:10.242660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:52.369060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.256645+0000","last_change":"2023-11-26T07:19:10.254483+0000","last_active":"2023-11-26T07:19:10.256645+0000","last_peered":"2023-11-26T07:19:10.256645+0000","last_clean":"2023-11-26T07:19:10.256645+0000","last_became_active":"2023-11-26T07:19:10.237730+0000","last_became_peered":"2023-11-26T07:19:10.237730+0000","last_unstale":"2023-11-26T07:19:10.256645+0000","last_undegraded":"2023-11-26T07:19:10.256645+0000","last_fullsized":"2023-11-26T07:19:10.256645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:12.976500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.236451+0000","last_change":"2023-11-26T07:19:10.231295+0000","last_active":"2023-11-26T07:19:10.236451+0000","last_peered":"2023-11-26T07:19:10.236451+0000","last_clean":"2023-11-26T07:19:10.236451+0000","last_became_active":"2023-11-26T07:19:10.231001+0000","last_became_peered":"2023-11-26T07:19:10.231001+0000","last_unstale":"2023-11-26T07:19:10.236451+0000","last_undegraded":"2023-11-26T07:19:10.236451+0000","last_fullsized":"2023-11-26T07:19:10.236451+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:44.384539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.233407+0000","last_change":"2023-11-26T07:19:10.227139+0000","last_active":"2023-11-26T07:19:10.233407+0000","last_peered":"2023-11-26T07:19:10.233407+0000","last_clean":"2023-11-26T07:19:10.233407+0000","last_became_active":"2023-11-26T07:19:10.226765+0000","last_became_peered":"2023-11-26T07:19:10.226765+0000","last_unstale":"2023-11-26T07:19:10.233407+0000","last_undegraded":"2023-11-26T07:19:10.233407+0000","last_fullsized":"2023-11-26T07:19:10.233407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:58:49.344208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.236142+0000","last_change":"2023-11-26T07:19:10.226865+0000","last_active":"2023-11-26T07:19:10.236142+0000","last_peered":"2023-11-26T07:19:10.236142+0000","last_clean":"2023-11-26T07:19:10.236142+0000","last_became_active":"2023-11-26T07:19:10.226574+0000","last_became_peered":"2023-11-26T07:19:10.226574+0000","last_unstale":"2023-11-26T07:19:10.236142+0000","last_undegraded":"2023-11-26T07:19:10.236142+0000","last_fullsized":"2023-11-26T07:19:10.236142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:28.328937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239774+0000","last_change":"2023-11-26T07:19:10.231746+0000","last_active":"2023-11-26T07:19:10.239774+0000","last_peered":"2023-11-26T07:19:10.239774+0000","last_clean":"2023-11-26T07:19:10.239774+0000","last_became_active":"2023-11-26T07:19:10.231296+0000","last_became_peered":"2023-11-26T07:19:10.231296+0000","last_unstale":"2023-11-26T07:19:10.239774+0000","last_undegraded":"2023-11-26T07:19:10.239774+0000","last_fullsized":"2023-11-26T07:19:10.239774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:03:33.714549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240277+0000","last_change":"2023-11-26T07:19:10.228005+0000","last_active":"2023-11-26T07:19:10.240277+0000","last_peered":"2023-11-26T07:19:10.240277+0000","last_clean":"2023-11-26T07:19:10.240277+0000","last_became_active":"2023-11-26T07:19:10.227733+0000","last_became_peered":"2023-11-26T07:19:10.227733+0000","last_unstale":"2023-11-26T07:19:10.240277+0000","last_undegraded":"2023-11-26T07:19:10.240277+0000","last_fullsized":"2023-11-26T07:19:10.240277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:24:17.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.240658+0000","last_change":"2023-11-26T07:19:10.238622+0000","last_active":"2023-11-26T07:19:10.240658+0000","last_peered":"2023-11-26T07:19:10.240658+0000","last_clean":"2023-11-26T07:19:10.240658+0000","last_became_active":"2023-11-26T07:19:10.238340+0000","last_became_peered":"2023-11-26T07:19:10.238340+0000","last_unstale":"2023-11-26T07:19:10.240658+0000","last_undegraded":"2023-11-26T07:19:10.240658+0000","last_fullsized":"2023-11-26T07:19:10.240658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:12.976500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.257001+0000","last_change":"2023-11-26T07:19:09.226069+0000","last_active":"2023-11-26T07:19:10.257001+0000","last_peered":"2023-11-26T07:19:10.257001+0000","last_clean":"2023-11-26T07:19:10.257001+0000","last_became_active":"2023-11-26T07:19:09.225738+0000","last_became_peered":"2023-11-26T07:19:09.225738+0000","last_unstale":"2023-11-26T07:19:10.257001+0000","last_undegraded":"2023-11-26T07:19:10.257001+0000","last_fullsized":"2023-11-26T07:19:10.257001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:36.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243068+0000","last_change":"2023-11-26T07:19:10.239779+0000","last_active":"2023-11-26T07:19:10.243068+0000","last_peered":"2023-11-26T07:19:10.243068+0000","last_clean":"2023-11-26T07:19:10.243068+0000","last_became_active":"2023-11-26T07:19:10.239468+0000","last_became_peered":"2023-11-26T07:19:10.239468+0000","last_unstale":"2023-11-26T07:19:10.243068+0000","last_undegraded":"2023-11-26T07:19:10.243068+0000","last_fullsized":"2023-11-26T07:19:10.243068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:20.444921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255782+0000","last_change":"2023-11-26T07:19:09.217137+0000","last_active":"2023-11-26T07:19:10.255782+0000","last_peered":"2023-11-26T07:19:10.255782+0000","last_clean":"2023-11-26T07:19:10.255782+0000","last_became_active":"2023-11-26T07:19:09.216886+0000","last_became_peered":"2023-11-26T07:19:09.216886+0000","last_unstale":"2023-11-26T07:19:10.255782+0000","last_undegraded":"2023-11-26T07:19:10.255782+0000","last_fullsized":"2023-11-26T07:19:10.255782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:36.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.234301+0000","last_change":"2023-11-26T07:19:10.227053+0000","last_active":"2023-11-26T07:19:10.234301+0000","last_peered":"2023-11-26T07:19:10.234301+0000","last_clean":"2023-11-26T07:19:10.234301+0000","last_became_active":"2023-11-26T07:19:10.226708+0000","last_became_peered":"2023-11-26T07:19:10.226708+0000","last_unstale":"2023-11-26T07:19:10.234301+0000","last_undegraded":"2023-11-26T07:19:10.234301+0000","last_fullsized":"2023-11-26T07:19:10.234301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:49.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.259025+0000","last_change":"2023-11-26T07:19:09.221288+0000","last_active":"2023-11-26T07:19:10.259025+0000","last_peered":"2023-11-26T07:19:10.259025+0000","last_clean":"2023-11-26T07:19:10.259025+0000","last_became_active":"2023-11-26T07:19:09.221018+0000","last_became_peered":"2023-11-26T07:19:09.221018+0000","last_unstale":"2023-11-26T07:19:10.259025+0000","last_undegraded":"2023-11-26T07:19:10.259025+0000","last_fullsized":"2023-11-26T07:19:10.259025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:39:21.630872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.254613+0000","last_change":"2023-11-26T07:19:10.238626+0000","last_active":"2023-11-26T07:19:10.254613+0000","last_peered":"2023-11-26T07:19:10.254613+0000","last_clean":"2023-11-26T07:19:10.254613+0000","last_became_active":"2023-11-26T07:19:10.237294+0000","last_became_peered":"2023-11-26T07:19:10.237294+0000","last_unstale":"2023-11-26T07:19:10.254613+0000","last_undegraded":"2023-11-26T07:19:10.254613+0000","last_fullsized":"2023-11-26T07:19:10.254613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:20.444921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.259846+0000","last_change":"2023-11-26T07:19:09.221933+0000","last_active":"2023-11-26T07:19:10.259846+0000","last_peered":"2023-11-26T07:19:10.259846+0000","last_clean":"2023-11-26T07:19:10.259846+0000","last_became_active":"2023-11-26T07:19:09.221592+0000","last_became_peered":"2023-11-26T07:19:09.221592+0000","last_unstale":"2023-11-26T07:19:10.259846+0000","last_undegraded":"2023-11-26T07:19:10.259846+0000","last_fullsized":"2023-11-26T07:19:10.259846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:22:05.886188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.245504+0000","last_change":"2023-11-26T07:19:10.237943+0000","last_active":"2023-11-26T07:19:10.245504+0000","last_peered":"2023-11-26T07:19:10.245504+0000","last_clean":"2023-11-26T07:19:10.245504+0000","last_became_active":"2023-11-26T07:19:10.237614+0000","last_became_peered":"2023-11-26T07:19:10.237614+0000","last_unstale":"2023-11-26T07:19:10.245504+0000","last_undegraded":"2023-11-26T07:19:10.245504+0000","last_fullsized":"2023-11-26T07:19:10.245504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:08.908774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.253401+0000","last_change":"2023-11-26T07:19:09.216954+0000","last_active":"2023-11-26T07:19:10.253401+0000","last_peered":"2023-11-26T07:19:10.253401+0000","last_clean":"2023-11-26T07:19:10.253401+0000","last_became_active":"2023-11-26T07:19:09.216650+0000","last_became_peered":"2023-11-26T07:19:09.216650+0000","last_unstale":"2023-11-26T07:19:10.253401+0000","last_undegraded":"2023-11-26T07:19:10.253401+0000","last_fullsized":"2023-11-26T07:19:10.253401+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:38.397967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243610+0000","last_change":"2023-11-26T07:19:10.240078+0000","last_active":"2023-11-26T07:19:10.243610+0000","last_peered":"2023-11-26T07:19:10.243610+0000","last_clean":"2023-11-26T07:19:10.243610+0000","last_became_active":"2023-11-26T07:19:10.237150+0000","last_became_peered":"2023-11-26T07:19:10.237150+0000","last_unstale":"2023-11-26T07:19:10.243610+0000","last_undegraded":"2023-11-26T07:19:10.243610+0000","last_fullsized":"2023-11-26T07:19:10.243610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:30.517944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.253247+0000","last_change":"2023-11-26T07:19:09.216354+0000","last_active":"2023-11-26T07:19:10.253247+0000","last_peered":"2023-11-26T07:19:10.253247+0000","last_clean":"2023-11-26T07:19:10.253247+0000","last_became_active":"2023-11-26T07:19:09.216047+0000","last_became_peered":"2023-11-26T07:19:09.216047+0000","last_unstale":"2023-11-26T07:19:10.253247+0000","last_undegraded":"2023-11-26T07:19:10.253247+0000","last_fullsized":"2023-11-26T07:19:10.253247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:51.366613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.234442+0000","last_change":"2023-11-26T07:19:10.232330+0000","last_active":"2023-11-26T07:19:10.234442+0000","last_peered":"2023-11-26T07:19:10.234442+0000","last_clean":"2023-11-26T07:19:10.234442+0000","last_became_active":"2023-11-26T07:19:10.232040+0000","last_became_peered":"2023-11-26T07:19:10.232040+0000","last_unstale":"2023-11-26T07:19:10.234442+0000","last_undegraded":"2023-11-26T07:19:10.234442+0000","last_fullsized":"2023-11-26T07:19:10.234442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:22:06.888635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.214212+0000","last_change":"2023-11-26T07:19:09.213095+0000","last_active":"2023-11-26T07:19:10.214212+0000","last_peered":"2023-11-26T07:19:10.214212+0000","last_clean":"2023-11-26T07:19:10.214212+0000","last_became_active":"2023-11-26T07:19:09.212540+0000","last_became_peered":"2023-11-26T07:19:09.212540+0000","last_unstale":"2023-11-26T07:19:10.214212+0000","last_undegraded":"2023-11-26T07:19:10.214212+0000","last_fullsized":"2023-11-26T07:19:10.214212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:53:16.507009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.249259+0000","last_change":"2023-11-26T07:19:10.245965+0000","last_active":"2023-11-26T07:19:10.249259+0000","last_peered":"2023-11-26T07:19:10.249259+0000","last_clean":"2023-11-26T07:19:10.249259+0000","last_became_active":"2023-11-26T07:19:10.245632+0000","last_became_peered":"2023-11-26T07:19:10.245632+0000","last_unstale":"2023-11-26T07:19:10.249259+0000","last_undegraded":"2023-11-26T07:19:10.249259+0000","last_fullsized":"2023-11-26T07:19:10.249259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:03:33.714549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.221594+0000","last_change":"2023-11-26T07:19:09.217931+0000","last_active":"2023-11-26T07:19:10.221594+0000","last_peered":"2023-11-26T07:19:10.221594+0000","last_clean":"2023-11-26T07:19:10.221594+0000","last_became_active":"2023-11-26T07:19:09.215424+0000","last_became_peered":"2023-11-26T07:19:09.215424+0000","last_unstale":"2023-11-26T07:19:10.221594+0000","last_undegraded":"2023-11-26T07:19:10.221594+0000","last_fullsized":"2023-11-26T07:19:10.221594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:31.661875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243068+0000","last_change":"2023-11-26T07:19:10.238053+0000","last_active":"2023-11-26T07:19:10.243068+0000","last_peered":"2023-11-26T07:19:10.243068+0000","last_clean":"2023-11-26T07:19:10.243068+0000","last_became_active":"2023-11-26T07:19:10.237730+0000","last_became_peered":"2023-11-26T07:19:10.237730+0000","last_unstale":"2023-11-26T07:19:10.243068+0000","last_undegraded":"2023-11-26T07:19:10.243068+0000","last_fullsized":"2023-11-26T07:19:10.243068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:52.369060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.215548+0000","last_change":"2023-11-26T07:19:09.225458+0000","last_active":"2023-11-26T07:19:10.215548+0000","last_peered":"2023-11-26T07:19:10.215548+0000","last_clean":"2023-11-26T07:19:10.215548+0000","last_became_active":"2023-11-26T07:19:09.225192+0000","last_became_peered":"2023-11-26T07:19:09.225192+0000","last_unstale":"2023-11-26T07:19:10.215548+0000","last_undegraded":"2023-11-26T07:19:10.215548+0000","last_fullsized":"2023-11-26T07:19:10.215548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:47.345781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243856+0000","last_change":"2023-11-26T07:19:10.230088+0000","last_active":"2023-11-26T07:19:10.243856+0000","last_peered":"2023-11-26T07:19:10.243856+0000","last_clean":"2023-11-26T07:19:10.243856+0000","last_became_active":"2023-11-26T07:19:10.229770+0000","last_became_peered":"2023-11-26T07:19:10.229770+0000","last_unstale":"2023-11-26T07:19:10.243856+0000","last_undegraded":"2023-11-26T07:19:10.243856+0000","last_fullsized":"2023-11-26T07:19:10.243856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:24:17.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.222251+0000","last_change":"2023-11-26T07:19:09.222447+0000","last_active":"2023-11-26T07:19:10.222251+0000","last_peered":"2023-11-26T07:19:10.222251+0000","last_clean":"2023-11-26T07:19:10.222251+0000","last_became_active":"2023-11-26T07:19:09.222149+0000","last_became_peered":"2023-11-26T07:19:09.222149+0000","last_unstale":"2023-11-26T07:19:10.222251+0000","last_undegraded":"2023-11-26T07:19:10.222251+0000","last_fullsized":"2023-11-26T07:19:10.222251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:48.987686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.230709+0000","last_change":"2023-11-26T07:19:10.226589+0000","last_active":"2023-11-26T07:19:10.230709+0000","last_peered":"2023-11-26T07:19:10.230709+0000","last_clean":"2023-11-26T07:19:10.230709+0000","last_became_active":"2023-11-26T07:19:10.226294+0000","last_became_peered":"2023-11-26T07:19:10.226294+0000","last_unstale":"2023-11-26T07:19:10.230709+0000","last_undegraded":"2023-11-26T07:19:10.230709+0000","last_fullsized":"2023-11-26T07:19:10.230709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:12:01.090350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255250+0000","last_change":"2023-11-26T07:19:09.223710+0000","last_active":"2023-11-26T07:19:10.255250+0000","last_peered":"2023-11-26T07:19:10.255250+0000","last_clean":"2023-11-26T07:19:10.255250+0000","last_became_active":"2023-11-26T07:19:09.223408+0000","last_became_peered":"2023-11-26T07:19:09.223408+0000","last_unstale":"2023-11-26T07:19:10.255250+0000","last_undegraded":"2023-11-26T07:19:10.255250+0000","last_fullsized":"2023-11-26T07:19:10.255250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:53:16.507009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243147+0000","last_change":"2023-11-26T07:19:10.238610+0000","last_active":"2023-11-26T07:19:10.243147+0000","last_peered":"2023-11-26T07:19:10.243147+0000","last_clean":"2023-11-26T07:19:10.243147+0000","last_became_active":"2023-11-26T07:19:10.238370+0000","last_became_peered":"2023-11-26T07:19:10.238370+0000","last_unstale":"2023-11-26T07:19:10.243147+0000","last_undegraded":"2023-11-26T07:19:10.243147+0000","last_fullsized":"2023-11-26T07:19:10.243147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:36.493937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.262080+0000","last_change":"2023-11-26T07:19:09.229671+0000","last_active":"2023-11-26T07:19:10.262080+0000","last_peered":"2023-11-26T07:19:10.262080+0000","last_clean":"2023-11-26T07:19:10.262080+0000","last_became_active":"2023-11-26T07:19:09.229344+0000","last_became_peered":"2023-11-26T07:19:09.229344+0000","last_unstale":"2023-11-26T07:19:10.262080+0000","last_undegraded":"2023-11-26T07:19:10.262080+0000","last_fullsized":"2023-11-26T07:19:10.262080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:42:04.844189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248614+0000","last_change":"2023-11-26T07:19:10.244503+0000","last_active":"2023-11-26T07:19:10.248614+0000","last_peered":"2023-11-26T07:19:10.248614+0000","last_clean":"2023-11-26T07:19:10.248614+0000","last_became_active":"2023-11-26T07:19:10.244200+0000","last_became_peered":"2023-11-26T07:19:10.244200+0000","last_unstale":"2023-11-26T07:19:10.248614+0000","last_undegraded":"2023-11-26T07:19:10.248614+0000","last_fullsized":"2023-11-26T07:19:10.248614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:37.090264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.256384+0000","last_change":"2023-11-26T07:19:09.219489+0000","last_active":"2023-11-26T07:19:10.256384+0000","last_peered":"2023-11-26T07:19:10.256384+0000","last_clean":"2023-11-26T07:19:10.256384+0000","last_became_active":"2023-11-26T07:19:09.219222+0000","last_became_peered":"2023-11-26T07:19:09.219222+0000","last_unstale":"2023-11-26T07:19:10.256384+0000","last_undegraded":"2023-11-26T07:19:10.256384+0000","last_fullsized":"2023-11-26T07:19:10.256384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:19.442473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243094+0000","last_change":"2023-11-26T07:19:10.232561+0000","last_active":"2023-11-26T07:19:10.243094+0000","last_peered":"2023-11-26T07:19:10.243094+0000","last_clean":"2023-11-26T07:19:10.243094+0000","last_became_active":"2023-11-26T07:19:10.231791+0000","last_became_peered":"2023-11-26T07:19:10.231791+0000","last_unstale":"2023-11-26T07:19:10.243094+0000","last_undegraded":"2023-11-26T07:19:10.243094+0000","last_fullsized":"2023-11-26T07:19:10.243094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:01.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.229873+0000","last_change":"2023-11-26T07:19:09.226934+0000","last_active":"2023-11-26T07:19:10.229873+0000","last_peered":"2023-11-26T07:19:10.229873+0000","last_clean":"2023-11-26T07:19:10.229873+0000","last_became_active":"2023-11-26T07:19:09.226659+0000","last_became_peered":"2023-11-26T07:19:09.226659+0000","last_unstale":"2023-11-26T07:19:10.229873+0000","last_undegraded":"2023-11-26T07:19:10.229873+0000","last_fullsized":"2023-11-26T07:19:10.229873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.736385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239975+0000","last_change":"2023-11-26T07:19:10.227246+0000","last_active":"2023-11-26T07:19:10.239975+0000","last_peered":"2023-11-26T07:19:10.239975+0000","last_clean":"2023-11-26T07:19:10.239975+0000","last_became_active":"2023-11-26T07:19:10.226975+0000","last_became_peered":"2023-11-26T07:19:10.226975+0000","last_unstale":"2023-11-26T07:19:10.239975+0000","last_undegraded":"2023-11-26T07:19:10.239975+0000","last_fullsized":"2023-11-26T07:19:10.239975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:36.493937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.214239+0000","last_change":"2023-11-26T07:19:09.222399+0000","last_active":"2023-11-26T07:19:10.214239+0000","last_peered":"2023-11-26T07:19:10.214239+0000","last_clean":"2023-11-26T07:19:10.214239+0000","last_became_active":"2023-11-26T07:19:09.222138+0000","last_became_peered":"2023-11-26T07:19:09.222138+0000","last_unstale":"2023-11-26T07:19:10.214239+0000","last_undegraded":"2023-11-26T07:19:10.214239+0000","last_fullsized":"2023-11-26T07:19:10.214239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:29.515497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239755+0000","last_change":"2023-11-26T07:19:10.231570+0000","last_active":"2023-11-26T07:19:10.239755+0000","last_peered":"2023-11-26T07:19:10.239755+0000","last_clean":"2023-11-26T07:19:10.239755+0000","last_became_active":"2023-11-26T07:19:10.230918+0000","last_became_peered":"2023-11-26T07:19:10.230918+0000","last_unstale":"2023-11-26T07:19:10.239755+0000","last_undegraded":"2023-11-26T07:19:10.239755+0000","last_fullsized":"2023-11-26T07:19:10.239755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:39.400415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.260805+0000","last_change":"2023-11-26T07:19:09.218895+0000","last_active":"2023-11-26T07:19:10.260805+0000","last_peered":"2023-11-26T07:19:10.260805+0000","last_clean":"2023-11-26T07:19:10.260805+0000","last_became_active":"2023-11-26T07:19:09.218512+0000","last_became_peered":"2023-11-26T07:19:09.218512+0000","last_unstale":"2023-11-26T07:19:10.260805+0000","last_undegraded":"2023-11-26T07:19:10.260805+0000","last_fullsized":"2023-11-26T07:19:10.260805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:07.906326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.235086+0000","last_change":"2023-11-26T07:19:10.225254+0000","last_active":"2023-11-26T07:19:10.235086+0000","last_peered":"2023-11-26T07:19:10.235086+0000","last_clean":"2023-11-26T07:19:10.235086+0000","last_became_active":"2023-11-26T07:19:10.224943+0000","last_became_peered":"2023-11-26T07:19:10.224943+0000","last_unstale":"2023-11-26T07:19:10.235086+0000","last_undegraded":"2023-11-26T07:19:10.235086+0000","last_fullsized":"2023-11-26T07:19:10.235086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:03:33.714549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.261064+0000","last_change":"2023-11-26T07:19:09.229526+0000","last_active":"2023-11-26T07:19:10.261064+0000","last_peered":"2023-11-26T07:19:10.261064+0000","last_clean":"2023-11-26T07:19:10.261064+0000","last_became_active":"2023-11-26T07:19:09.229239+0000","last_became_peered":"2023-11-26T07:19:09.229239+0000","last_unstale":"2023-11-26T07:19:10.261064+0000","last_undegraded":"2023-11-26T07:19:10.261064+0000","last_fullsized":"2023-11-26T07:19:10.261064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:51.366613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243592+0000","last_change":"2023-11-26T07:19:10.239895+0000","last_active":"2023-11-26T07:19:10.243592+0000","last_peered":"2023-11-26T07:19:10.243592+0000","last_clean":"2023-11-26T07:19:10.243592+0000","last_became_active":"2023-11-26T07:19:10.237069+0000","last_became_peered":"2023-11-26T07:19:10.237069+0000","last_unstale":"2023-11-26T07:19:10.243592+0000","last_undegraded":"2023-11-26T07:19:10.243592+0000","last_fullsized":"2023-11-26T07:19:10.243592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:24:17.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.254801+0000","last_change":"2023-11-26T07:19:09.218220+0000","last_active":"2023-11-26T07:19:10.254801+0000","last_peered":"2023-11-26T07:19:10.254801+0000","last_clean":"2023-11-26T07:19:10.254801+0000","last_became_active":"2023-11-26T07:19:09.215740+0000","last_became_peered":"2023-11-26T07:19:09.215740+0000","last_unstale":"2023-11-26T07:19:10.254801+0000","last_undegraded":"2023-11-26T07:19:10.254801+0000","last_fullsized":"2023-11-26T07:19:10.254801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:36.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.248534+0000","last_change":"2023-11-26T07:19:10.237323+0000","last_active":"2023-11-26T07:19:10.248534+0000","last_peered":"2023-11-26T07:19:10.248534+0000","last_clean":"2023-11-26T07:19:10.248534+0000","last_became_active":"2023-11-26T07:19:10.237027+0000","last_became_peered":"2023-11-26T07:19:10.237027+0000","last_unstale":"2023-11-26T07:19:10.248534+0000","last_undegraded":"2023-11-26T07:19:10.248534+0000","last_fullsized":"2023-11-26T07:19:10.248534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:39.400415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.256353+0000","last_change":"2023-11-26T07:19:09.214402+0000","last_active":"2023-11-26T07:19:10.256353+0000","last_peered":"2023-11-26T07:19:10.256353+0000","last_clean":"2023-11-26T07:19:10.256353+0000","last_became_active":"2023-11-26T07:19:09.213871+0000","last_became_peered":"2023-11-26T07:19:09.213871+0000","last_unstale":"2023-11-26T07:19:10.256353+0000","last_undegraded":"2023-11-26T07:19:10.256353+0000","last_fullsized":"2023-11-26T07:19:10.256353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:43.671120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238065+0000","last_change":"2023-11-26T07:19:10.225643+0000","last_active":"2023-11-26T07:19:10.238065+0000","last_peered":"2023-11-26T07:19:10.238065+0000","last_clean":"2023-11-26T07:19:10.238065+0000","last_became_active":"2023-11-26T07:19:10.225090+0000","last_became_peered":"2023-11-26T07:19:10.225090+0000","last_unstale":"2023-11-26T07:19:10.238065+0000","last_undegraded":"2023-11-26T07:19:10.238065+0000","last_fullsized":"2023-11-26T07:19:10.238065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:29:16.190665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.215931+0000","last_change":"2023-11-26T07:19:09.218137+0000","last_active":"2023-11-26T07:19:10.215931+0000","last_peered":"2023-11-26T07:19:10.215931+0000","last_clean":"2023-11-26T07:19:10.215931+0000","last_became_active":"2023-11-26T07:19:09.217800+0000","last_became_peered":"2023-11-26T07:19:09.217800+0000","last_unstale":"2023-11-26T07:19:10.215931+0000","last_undegraded":"2023-11-26T07:19:10.215931+0000","last_fullsized":"2023-11-26T07:19:10.215931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:39.972393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.244173+0000","last_change":"2023-11-26T07:19:10.242244+0000","last_active":"2023-11-26T07:19:10.244173+0000","last_peered":"2023-11-26T07:19:10.244173+0000","last_clean":"2023-11-26T07:19:10.244173+0000","last_became_active":"2023-11-26T07:19:10.241949+0000","last_became_peered":"2023-11-26T07:19:10.241949+0000","last_unstale":"2023-11-26T07:19:10.244173+0000","last_undegraded":"2023-11-26T07:19:10.244173+0000","last_fullsized":"2023-11-26T07:19:10.244173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:01:36.052554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255427+0000","last_change":"2023-11-26T07:19:09.216126+0000","last_active":"2023-11-26T07:19:10.255427+0000","last_peered":"2023-11-26T07:19:10.255427+0000","last_clean":"2023-11-26T07:19:10.255427+0000","last_became_active":"2023-11-26T07:19:09.215833+0000","last_became_peered":"2023-11-26T07:19:09.215833+0000","last_unstale":"2023-11-26T07:19:10.255427+0000","last_undegraded":"2023-11-26T07:19:10.255427+0000","last_fullsized":"2023-11-26T07:19:10.255427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:43.671120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.238829+0000","last_change":"2023-11-26T07:19:10.237641+0000","last_active":"2023-11-26T07:19:10.238829+0000","last_peered":"2023-11-26T07:19:10.238829+0000","last_clean":"2023-11-26T07:19:10.238829+0000","last_became_active":"2023-11-26T07:19:10.237339+0000","last_became_peered":"2023-11-26T07:19:10.237339+0000","last_unstale":"2023-11-26T07:19:10.238829+0000","last_undegraded":"2023-11-26T07:19:10.238829+0000","last_fullsized":"2023-11-26T07:19:10.238829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:31:17.383871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.211154+0000","last_change":"2023-11-26T07:19:09.227375+0000","last_active":"2023-11-26T07:19:10.211154+0000","last_peered":"2023-11-26T07:19:10.211154+0000","last_clean":"2023-11-26T07:19:10.211154+0000","last_became_active":"2023-11-26T07:19:09.226757+0000","last_became_peered":"2023-11-26T07:19:09.226757+0000","last_unstale":"2023-11-26T07:19:10.211154+0000","last_undegraded":"2023-11-26T07:19:10.211154+0000","last_fullsized":"2023-11-26T07:19:10.211154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:03:43.671120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.237717+0000","last_change":"2023-11-26T07:19:10.231259+0000","last_active":"2023-11-26T07:19:10.237717+0000","last_peered":"2023-11-26T07:19:10.237717+0000","last_clean":"2023-11-26T07:19:10.237717+0000","last_became_active":"2023-11-26T07:19:10.230238+0000","last_became_peered":"2023-11-26T07:19:10.230238+0000","last_unstale":"2023-11-26T07:19:10.237717+0000","last_undegraded":"2023-11-26T07:19:10.237717+0000","last_fullsized":"2023-11-26T07:19:10.237717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:54:55.331444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.215209+0000","last_change":"2023-11-26T07:19:09.220896+0000","last_active":"2023-11-26T07:19:10.215209+0000","last_peered":"2023-11-26T07:19:10.215209+0000","last_clean":"2023-11-26T07:19:10.215209+0000","last_became_active":"2023-11-26T07:19:09.220653+0000","last_became_peered":"2023-11-26T07:19:09.220653+0000","last_unstale":"2023-11-26T07:19:10.215209+0000","last_undegraded":"2023-11-26T07:19:10.215209+0000","last_fullsized":"2023-11-26T07:19:10.215209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:11.974052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.231688+0000","last_change":"2023-11-26T07:19:10.224436+0000","last_active":"2023-11-26T07:19:10.231688+0000","last_peered":"2023-11-26T07:19:10.231688+0000","last_clean":"2023-11-26T07:19:10.231688+0000","last_became_active":"2023-11-26T07:19:10.223737+0000","last_became_peered":"2023-11-26T07:19:10.223737+0000","last_unstale":"2023-11-26T07:19:10.231688+0000","last_undegraded":"2023-11-26T07:19:10.231688+0000","last_fullsized":"2023-11-26T07:19:10.231688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:20:52.369060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.220141+0000","last_change":"2023-11-26T07:19:09.223037+0000","last_active":"2023-11-26T07:19:10.220141+0000","last_peered":"2023-11-26T07:19:10.220141+0000","last_clean":"2023-11-26T07:19:10.220141+0000","last_became_active":"2023-11-26T07:19:09.222729+0000","last_became_peered":"2023-11-26T07:19:09.222729+0000","last_unstale":"2023-11-26T07:19:10.220141+0000","last_undegraded":"2023-11-26T07:19:10.220141+0000","last_fullsized":"2023-11-26T07:19:10.220141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:27.326490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.237684+0000","last_change":"2023-11-26T07:19:10.231295+0000","last_active":"2023-11-26T07:19:10.237684+0000","last_peered":"2023-11-26T07:19:10.237684+0000","last_clean":"2023-11-26T07:19:10.237684+0000","last_became_active":"2023-11-26T07:19:10.230974+0000","last_became_peered":"2023-11-26T07:19:10.230974+0000","last_unstale":"2023-11-26T07:19:10.237684+0000","last_undegraded":"2023-11-26T07:19:10.237684+0000","last_fullsized":"2023-11-26T07:19:10.237684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:49:05.748637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.258715+0000","last_change":"2023-11-26T07:19:09.228954+0000","last_active":"2023-11-26T07:19:10.258715+0000","last_peered":"2023-11-26T07:19:10.258715+0000","last_clean":"2023-11-26T07:19:10.258715+0000","last_became_active":"2023-11-26T07:19:09.228696+0000","last_became_peered":"2023-11-26T07:19:09.228696+0000","last_unstale":"2023-11-26T07:19:10.258715+0000","last_undegraded":"2023-11-26T07:19:10.258715+0000","last_fullsized":"2023-11-26T07:19:10.258715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:31.661875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.243571+0000","last_change":"2023-11-26T07:19:10.239600+0000","last_active":"2023-11-26T07:19:10.243571+0000","last_peered":"2023-11-26T07:19:10.243571+0000","last_clean":"2023-11-26T07:19:10.243571+0000","last_became_active":"2023-11-26T07:19:10.239269+0000","last_became_peered":"2023-11-26T07:19:10.239269+0000","last_unstale":"2023-11-26T07:19:10.243571+0000","last_undegraded":"2023-11-26T07:19:10.243571+0000","last_fullsized":"2023-11-26T07:19:10.243571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:32.664322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.222441+0000","last_change":"2023-11-26T07:19:09.225212+0000","last_active":"2023-11-26T07:19:10.222441+0000","last_peered":"2023-11-26T07:19:10.222441+0000","last_clean":"2023-11-26T07:19:10.222441+0000","last_became_active":"2023-11-26T07:19:09.224884+0000","last_became_peered":"2023-11-26T07:19:09.224884+0000","last_unstale":"2023-11-26T07:19:10.222441+0000","last_undegraded":"2023-11-26T07:19:10.222441+0000","last_fullsized":"2023-11-26T07:19:10.222441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:53:39.972393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.249971+0000","last_change":"2023-11-26T07:19:10.243388+0000","last_active":"2023-11-26T07:19:10.249971+0000","last_peered":"2023-11-26T07:19:10.249971+0000","last_clean":"2023-11-26T07:19:10.249971+0000","last_became_active":"2023-11-26T07:19:10.243099+0000","last_became_peered":"2023-11-26T07:19:10.243099+0000","last_unstale":"2023-11-26T07:19:10.249971+0000","last_undegraded":"2023-11-26T07:19:10.249971+0000","last_fullsized":"2023-11-26T07:19:10.249971+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:01.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.230622+0000","last_change":"2023-11-26T07:19:09.228011+0000","last_active":"2023-11-26T07:19:10.230622+0000","last_peered":"2023-11-26T07:19:10.230622+0000","last_clean":"2023-11-26T07:19:10.230622+0000","last_became_active":"2023-11-26T07:19:09.227747+0000","last_became_peered":"2023-11-26T07:19:09.227747+0000","last_unstale":"2023-11-26T07:19:10.230622+0000","last_undegraded":"2023-11-26T07:19:10.230622+0000","last_fullsized":"2023-11-26T07:19:10.230622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:57:30.271310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.239870+0000","last_change":"2023-11-26T07:19:10.230855+0000","last_active":"2023-11-26T07:19:10.239870+0000","last_peered":"2023-11-26T07:19:10.239870+0000","last_clean":"2023-11-26T07:19:10.239870+0000","last_became_active":"2023-11-26T07:19:10.230395+0000","last_became_peered":"2023-11-26T07:19:10.230395+0000","last_unstale":"2023-11-26T07:19:10.239870+0000","last_undegraded":"2023-11-26T07:19:10.239870+0000","last_fullsized":"2023-11-26T07:19:10.239870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:58:50.784948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.219098+0000","last_change":"2023-11-26T07:19:09.219267+0000","last_active":"2023-11-26T07:19:10.219098+0000","last_peered":"2023-11-26T07:19:10.219098+0000","last_clean":"2023-11-26T07:19:10.219098+0000","last_became_active":"2023-11-26T07:19:09.218957+0000","last_became_peered":"2023-11-26T07:19:09.218957+0000","last_unstale":"2023-11-26T07:19:10.219098+0000","last_undegraded":"2023-11-26T07:19:10.219098+0000","last_fullsized":"2023-11-26T07:19:10.219098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:19.442473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.255264+0000","last_change":"2023-11-26T07:19:10.245624+0000","last_active":"2023-11-26T07:19:10.255264+0000","last_peered":"2023-11-26T07:19:10.255264+0000","last_clean":"2023-11-26T07:19:10.255264+0000","last_became_active":"2023-11-26T07:19:10.245351+0000","last_became_peered":"2023-11-26T07:19:10.245351+0000","last_unstale":"2023-11-26T07:19:10.255264+0000","last_undegraded":"2023-11-26T07:19:10.255264+0000","last_fullsized":"2023-11-26T07:19:10.255264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:23:39.400415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.230001+0000","last_change":"2023-11-26T07:19:09.227671+0000","last_active":"2023-11-26T07:19:10.230001+0000","last_peered":"2023-11-26T07:19:10.230001+0000","last_clean":"2023-11-26T07:19:10.230001+0000","last_became_active":"2023-11-26T07:19:09.227253+0000","last_became_peered":"2023-11-26T07:19:09.227253+0000","last_unstale":"2023-11-26T07:19:10.230001+0000","last_undegraded":"2023-11-26T07:19:10.230001+0000","last_fullsized":"2023-11-26T07:19:10.230001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:43.382092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.226742+0000","last_change":"2023-11-26T07:19:10.222322+0000","last_active":"2023-11-26T07:19:10.226742+0000","last_peered":"2023-11-26T07:19:10.226742+0000","last_clean":"2023-11-26T07:19:10.226742+0000","last_became_active":"2023-11-26T07:19:10.222040+0000","last_became_peered":"2023-11-26T07:19:10.222040+0000","last_unstale":"2023-11-26T07:19:10.226742+0000","last_undegraded":"2023-11-26T07:19:10.226742+0000","last_fullsized":"2023-11-26T07:19:10.226742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:21:49.990133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.216374+0000","last_change":"2023-11-26T07:19:09.216312+0000","last_active":"2023-11-26T07:19:10.216374+0000","last_peered":"2023-11-26T07:19:10.216374+0000","last_clean":"2023-11-26T07:19:10.216374+0000","last_became_active":"2023-11-26T07:19:09.215990+0000","last_became_peered":"2023-11-26T07:19:09.215990+0000","last_unstale":"2023-11-26T07:19:10.216374+0000","last_undegraded":"2023-11-26T07:19:10.216374+0000","last_fullsized":"2023-11-26T07:19:10.216374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:00.736385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.233482+0000","last_change":"2023-11-26T07:19:10.227193+0000","last_active":"2023-11-26T07:19:10.233482+0000","last_peered":"2023-11-26T07:19:10.233482+0000","last_clean":"2023-11-26T07:19:10.233482+0000","last_became_active":"2023-11-26T07:19:10.226910+0000","last_became_peered":"2023-11-26T07:19:10.226910+0000","last_unstale":"2023-11-26T07:19:10.233482+0000","last_undegraded":"2023-11-26T07:19:10.233482+0000","last_fullsized":"2023-11-26T07:19:10.233482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:55:23.633080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.214084+0000","last_change":"2023-11-26T07:19:09.226832+0000","last_active":"2023-11-26T07:19:10.214084+0000","last_peered":"2023-11-26T07:19:10.214084+0000","last_clean":"2023-11-26T07:19:10.214084+0000","last_became_active":"2023-11-26T07:19:09.226493+0000","last_became_peered":"2023-11-26T07:19:09.226493+0000","last_unstale":"2023-11-26T07:19:10.214084+0000","last_undegraded":"2023-11-26T07:19:10.214084+0000","last_fullsized":"2023-11-26T07:19:10.214084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:35.491489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.245765+0000","last_change":"2023-11-26T07:19:10.238133+0000","last_active":"2023-11-26T07:19:10.245765+0000","last_peered":"2023-11-26T07:19:10.245765+0000","last_clean":"2023-11-26T07:19:10.245765+0000","last_became_active":"2023-11-26T07:19:10.237787+0000","last_became_peered":"2023-11-26T07:19:10.237787+0000","last_unstale":"2023-11-26T07:19:10.245765+0000","last_undegraded":"2023-11-26T07:19:10.245765+0000","last_fullsized":"2023-11-26T07:19:10.245765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:09.192041+0000","last_clean_scrub_stamp":"2023-11-26T07:19:09.192041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:39:22.633319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-26T07:19:10.211382+0000","last_change":"2023-11-26T07:19:09.219760+0000","last_active":"2023-11-26T07:19:10.211382+0000","last_peered":"2023-11-26T07:19:10.211382+0000","last_clean":"2023-11-26T07:19:10.211382+0000","last_became_active":"2023-11-26T07:19:09.219471+0000","last_became_peered":"2023-11-26T07:19:09.219471+0000","last_unstale":"2023-11-26T07:19:10.211382+0000","last_undegraded":"2023-11-26T07:19:10.211382+0000","last_fullsized":"2023-11-26T07:19:10.211382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:19:08.189594+0000","last_clean_scrub_stamp":"2023-11-26T07:19:08.189594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:11.974052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-26T07:19:09.202880+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:19:09.202880+0000","last_peered":"2023-11-26T07:19:09.202880+0000","last_clean":"2023-11-26T07:19:09.202880+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:19:09.202880+0000","last_undegraded":"2023-11-26T07:19:09.202880+0000","last_fullsized":"2023-11-26T07:19:09.202880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":733863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47299999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68300000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.434},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.58499999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.73599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.495},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.42099999999999999}]},{"osd":5,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.629}]},{"osd":7,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":150942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.8019999999999996,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":7.2329999999999997,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.82099999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":7.5640000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.752},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":6.7530000000000001,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":7.7789999999999999,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.7530000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.83599999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":6.6879999999999997,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":7.1680000000000001,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.63200000000000001},{"interface":"front","average":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":24.623000000000001,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":7.6390000000000002,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":7.2869999999999999,"5min":7.2869999999999999,"15min":7.2869999999999999},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.749},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.497}]},{"osd":1,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65800000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.44800000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.435},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.371}]},{"osd":4,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.3210000000000002,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47699999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.49199999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.476,"5min":3.476,"15min":3.476},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.57199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":150340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.374}]},{"osd":1,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.315},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.441},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.0820000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.88},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.002}]},{"osd":7,"last update":"Sun Nov 26 07:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1.052},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.03}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":372736,"data_stored":143495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.311},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.439}]},{"osd":2,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.54900000000000004}]},{"osd":3,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.503}]},{"osd":4,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.623},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.73299999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.70599999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":978944,"data_stored":740638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.38800000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":5.234,"5min":5.234,"15min":5.234},"last":0.501}]},{"osd":3,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.726,"5min":3.726,"15min":3.726},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.1639999999999997,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.75},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.7530000000000001,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.3679999999999999,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.81599999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":3.3300000000000001,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.73599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:19:14.662 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:19:14.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:19:14.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.837+0000 7fb3f2616640 1 Processor -- start 2023-11-26T07:19:14.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.837+0000 7fb3f2616640 1 -- start start 2023-11-26T07:19:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3f2616640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3ec143c00 0x7fb3ec0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3f2616640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb3ec070390 0x7fb3ec0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3f2616640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec0b25f0 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3f2616640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec0b28d0 con 0x7fb3ec070390 2023-11-26T07:19:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3f2616640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec0b2bb0 con 0x7fb3ec143c00 2023-11-26T07:19:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3eb7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb3ec070390 0x7fb3ec0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3eb7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb3ec070390 0x7fb3ec0cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49916/0 (socket says 172.21.15.70:49916) 2023-11-26T07:19:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/2024313895 learned_addr learned my addr 172.21.15.70:0/2024313895 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/2024313895 >> v2:172.21.15.120:3300/0 conn(0x7fb3ec143c00 msgr2=0x7fb3ec0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3ebfff640 1 --2- 172.21.15.70:0/2024313895 >> v2:172.21.15.120:3300/0 conn(0x7fb3ec143c00 0x7fb3ec0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3eb7fe640 1 --2- 172.21.15.70:0/2024313895 >> v2:172.21.15.120:3300/0 conn(0x7fb3ec143c00 0x7fb3ec0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/2024313895 >> v1:172.21.15.120:6789/0 conn(0x7fb3ec0ccce0 legacy=0x7fb3ec071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/2024313895 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0b2e90 con 0x7fb3ec070390 2023-11-26T07:19:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.841+0000 7fb3ebfff640 1 --2- 172.21.15.70:0/2024313895 >> v2:172.21.15.120:3300/0 conn(0x7fb3ec143c00 0x7fb3ec0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:14.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3eb7fe640 1 --2- 172.21.15.70:0/2024313895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec070390 0x7fb3ec0cc7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0cfef0 tx=0x7fb3e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ef2964ed515275 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3eaffd640 1 -- 172.21.15.70:0/2024313895 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00ab650 con 0x7fb3ec070390 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3eaffd640 1 -- 172.21.15.70:0/2024313895 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e00ab7b0 con 0x7fb3ec070390 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3eaffd640 1 -- 172.21.15.70:0/2024313895 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00abb40 con 0x7fb3ec070390 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 -- 172.21.15.70:0/2024313895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec070390 msgr2=0x7fb3ec0cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 --2- 172.21.15.70:0/2024313895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec070390 0x7fb3ec0cc7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0cfef0 tx=0x7fb3e001c430 comp rx=0 tx=0).stop 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 -- 172.21.15.70:0/2024313895 shutdown_connections 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 --2- 172.21.15.70:0/2024313895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec070390 0x7fb3ec0cc7a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 --2- 172.21.15.70:0/2024313895 >> v2:172.21.15.120:3300/0 conn(0x7fb3ec143c00 0x7fb3ec0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 -- 172.21.15.70:0/2024313895 >> 172.21.15.70:0/2024313895 conn(0x7fb3ec0b0bf0 msgr2=0x7fb3ec0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 -- 172.21.15.70:0/2024313895 shutdown_connections 2023-11-26T07:19:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 -- 172.21.15.70:0/2024313895 wait complete. 2023-11-26T07:19:14.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 Processor -- start 2023-11-26T07:19:14.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.845+0000 7fb3f2616640 1 -- start start 2023-11-26T07:19:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ec070390 0x7fb3ec136ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec0ccce0 0x7fb3ec13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb3ec143c00 0x7fb3ec13ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec15c1a0 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec153f50 con 0x7fb3ec070390 2023-11-26T07:19:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec154230 con 0x7fb3ec143c00 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec0ccce0 0x7fb3ec13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec0ccce0 0x7fb3ec13fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49930/0 (socket says 172.21.15.70:49930) 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/3411367328 learned_addr learned my addr 172.21.15.70:0/3411367328 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3ebfff640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ec070390 0x7fb3ec136ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f0bb3640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb3ec143c00 0x7fb3ec13ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb3ec143c00 msgr2=0x7fb3ec13ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb3ec143c00 0x7fb3ec13ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ec070390 msgr2=0x7fb3ec136ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ec070390 0x7fb3ec136ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 -- 172.21.15.70:0/3411367328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00094d0 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3eb7fe640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec0ccce0 0x7fb3ec13fa30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00ad040 tx=0x7fb3e001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3e8ff9640 1 -- 172.21.15.70:0/3411367328 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00b4800 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3e8ff9640 1 -- 172.21.15.70:0/3411367328 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e00b4980 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3e8ff9640 1 -- 172.21.15.70:0/3411367328 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00b4d30 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec154510 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec15aae0 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.849+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec067720 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.853+0000 7fb3e8ff9640 1 -- 172.21.15.70:0/3411367328 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3e00b3380 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.853+0000 7fb3e8ff9640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb3d8066470 0x7fb3d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.853+0000 7fb3e8ff9640 1 -- 172.21.15.70:0/3411367328 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3e011e680 con 0x7fb3ec0ccce0 2023-11-26T07:19:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.853+0000 7fb3ebfff640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb3d8066470 0x7fb3d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.853+0000 7fb3ebfff640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb3d8066470 0x7fb3d8068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc006fd0 tx=0x7fb3dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:14.857+0000 7fb3e8ff9640 1 -- 172.21.15.70:0/3411367328 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3e00ebcd0 con 0x7fb3ec0ccce0 2023-11-26T07:19:15.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.057+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb3ec0b17a0 con 0x7fb3ec0ccce0 2023-11-26T07:19:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.061+0000 7fb3e8ff9640 1 -- 172.21.15.70:0/3411367328 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb3e00ef2f0 con 0x7fb3ec0ccce0 2023-11-26T07:19:15.065 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-11-26T07:19:15.065 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA== 2023-11-26T07:19:15.065 INFO:teuthology.orchestra.run.smithi070.stdout: caps mds = "allow" 2023-11-26T07:19:15.065 INFO:teuthology.orchestra.run.smithi070.stdout: caps mon = "allow r" 2023-11-26T07:19:15.065 INFO:teuthology.orchestra.run.smithi070.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:19:15.066 INFO:teuthology.orchestra.run.smithi070.stderr:updated caps for client.0 2023-11-26T07:19:15.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.061+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb3d8066470 msgr2=0x7fb3d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.061+0000 7fb3f2616640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb3d8066470 0x7fb3d8068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc006fd0 tx=0x7fb3dc008040 comp rx=0 tx=0).stop 2023-11-26T07:19:15.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.061+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec0ccce0 msgr2=0x7fb3ec13fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.061+0000 7fb3f2616640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec0ccce0 0x7fb3ec13fa30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00ad040 tx=0x7fb3e001ac70 comp rx=0 tx=0).stop 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.061+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 shutdown_connections 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.065+0000 7fb3f2616640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb3d8066470 0x7fb3d8068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.065+0000 7fb3f2616640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3ec0ccce0 0x7fb3ec13fa30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.065+0000 7fb3f2616640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb3ec143c00 0x7fb3ec13ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.065+0000 7fb3f2616640 1 --2- 172.21.15.70:0/3411367328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ec070390 0x7fb3ec136ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.065+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 >> 172.21.15.70:0/3411367328 conn(0x7fb3ec0b0bf0 msgr2=0x7fb3ec06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.065+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 shutdown_connections 2023-11-26T07:19:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.065+0000 7fb3f2616640 1 -- 172.21.15.70:0/3411367328 wait complete. 2023-11-26T07:19:15.086 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:19:15.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7b0bdf640 1 Processor -- start 2023-11-26T07:19:15.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7b0bdf640 1 -- start start 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7b0bdf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7ac0cf280 0x7fa7ac0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7b0bdf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa7ac0cd1b0 0x7fa7ac0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7b0bdf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0cc730 con 0x7fa7ac143ac0 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7b0bdf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac143ea0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7b0bdf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac0cfc50 con 0x7fa7ac0cf280 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7aad9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa7ac0cd1b0 0x7fa7ac0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7aad9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa7ac0cd1b0 0x7fa7ac0cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49936/0 (socket says 172.21.15.70:49936) 2023-11-26T07:19:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7aad9d640 1 -- 172.21.15.70:0/787732633 learned_addr learned my addr 172.21.15.70:0/787732633 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:15.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7aad9d640 1 -- 172.21.15.70:0/787732633 >> v2:172.21.15.120:3300/0 conn(0x7fa7ac0cf280 msgr2=0x7fa7ac0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:15.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7a1d9b640 1 --2- 172.21.15.70:0/787732633 >> v2:172.21.15.120:3300/0 conn(0x7fa7ac0cf280 0x7fa7ac0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7aad9d640 1 --2- 172.21.15.70:0/787732633 >> v2:172.21.15.120:3300/0 conn(0x7fa7ac0cf280 0x7fa7ac0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7aad9d640 1 -- 172.21.15.70:0/787732633 >> v1:172.21.15.120:6789/0 conn(0x7fa7ac143ac0 legacy=0x7fa7ac070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:15.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7aad9d640 1 -- 172.21.15.70:0/787732633 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac070ee0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.221+0000 7fa7a1d9b640 1 --2- 172.21.15.70:0/787732633 >> v2:172.21.15.120:3300/0 conn(0x7fa7ac0cf280 0x7fa7ac0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7aad9d640 1 --2- 172.21.15.70:0/787732633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac0cd5c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0aeb10 tx=0x7fa7a401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc58915103faed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7a9d9b640 1 -- 172.21.15.70:0/787732633 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40a5890 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7a9d9b640 1 -- 172.21.15.70:0/787732633 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a40a59f0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7a9d9b640 1 -- 172.21.15.70:0/787732633 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40a5d80 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/787732633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 msgr2=0x7fa7ac0cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/787732633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac0cd5c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac0aeb10 tx=0x7fa7a401c9d0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/787732633 shutdown_connections 2023-11-26T07:19:15.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/787732633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac0cd5c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/787732633 >> v2:172.21.15.120:3300/0 conn(0x7fa7ac0cf280 0x7fa7ac0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/787732633 >> 172.21.15.70:0/787732633 conn(0x7fa7ac06a890 msgr2=0x7fa7ac06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:15.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/787732633 shutdown_connections 2023-11-26T07:19:15.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.225+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/787732633 wait complete. 2023-11-26T07:19:15.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 Processor -- start 2023-11-26T07:19:15.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 -- start start 2023-11-26T07:19:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac133310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7ac0cf280 0x7fa7ac142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7ac143ac0 0x7fa7ac142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b0dc0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b10a0 con 0x7fa7ac0cf280 2023-11-26T07:19:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b1380 con 0x7fa7ac143ac0 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac133310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac133310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49938/0 (socket says 172.21.15.70:49938) 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 -- 172.21.15.70:0/1443687997 learned_addr learned my addr 172.21.15.70:0/1443687997 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7a1d9b640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7ac0cf280 0x7fa7ac142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aad9d640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7ac143ac0 0x7fa7ac142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 -- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7ac143ac0 msgr2=0x7fa7ac142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7ac143ac0 0x7fa7ac142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 -- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7ac0cf280 msgr2=0x7fa7ac142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7ac0cf280 0x7fa7ac142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 -- 172.21.15.70:0/1443687997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4009b30 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7aa59c640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac133310 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c3c0 tx=0x7fa79400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:15.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7a37fe640 1 -- 172.21.15.70:0/1443687997 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7940052d0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7a37fe640 1 -- 172.21.15.70:0/1443687997 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794005430 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac0b1660 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7a37fe640 1 -- 172.21.15.70:0/1443687997 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794003840 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.229+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac0b0a70 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.233+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac0af660 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.233+0000 7fa7a37fe640 1 -- 172.21.15.70:0/1443687997 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7940039a0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.233+0000 7fa7a37fe640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa78c066470 0x7fa78c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.233+0000 7fa7a37fe640 1 -- 172.21.15.70:0/1443687997 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa794083330 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.233+0000 7fa7a1d9b640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa78c066470 0x7fa78c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.233+0000 7fa7a1d9b640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa78c066470 0x7fa78c068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa79c006fd0 tx=0x7fa79c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:15.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.237+0000 7fa7a37fe640 1 -- 172.21.15.70:0/1443687997 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa794050820 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.417+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7ac0b18a0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7a37fe640 1 -- 172.21.15.70:0/1443687997 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fa7ac0b18a0 con 0x7fa7ac0cd1b0 2023-11-26T07:19:15.424 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:19:15.424 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3437884487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3437884487},{"type":"v1","addr":"172.21.15.70:6837","nonce":3437884487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1405314765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1405314765},{"type":"v1","addr":"172.21.15.120:6833","nonce":1405314765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2357317721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2357317721},{"type":"v1","addr":"172.21.15.120:6835","nonce":2357317721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:19:09.585008+0000","modified":"2023-11-26T07:19:12.594028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.70:6836/4160736209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4160736209},{"type":"v1","addr":"172.21.15.70:6836","nonce":4160736209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:19:15.424 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 18 2023-11-26T07:19:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa78c066470 msgr2=0x7fa78c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa78c066470 0x7fa78c068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa79c006fd0 tx=0x7fa79c008040 comp rx=0 tx=0).stop 2023-11-26T07:19:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 msgr2=0x7fa7ac133310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac133310 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa79400c3c0 tx=0x7fa79400c880 comp rx=0 tx=0).stop 2023-11-26T07:19:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 shutdown_connections 2023-11-26T07:19:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7ac143ac0 0x7fa7ac142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7ac0cf280 0x7fa7ac142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa78c066470 0x7fa78c068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 --2- 172.21.15.70:0/1443687997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7ac0cd1b0 0x7fa7ac133310 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 >> 172.21.15.70:0/1443687997 conn(0x7fa7ac06a890 msgr2=0x7fa7ac0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 shutdown_connections 2023-11-26T07:19:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.421+0000 7fa7b0bdf640 1 -- 172.21.15.70:0/1443687997 wait complete. 2023-11-26T07:19:15.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:19:09.585008+0000', 'modified': '2023-11-26T07:19:12.594028+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5199': {'gid': 5199, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.70:6836/4160736209', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6834', 'nonce': 4160736209}, {'type': 'v1', 'addr': '172.21.15.70:6836', 'nonce': 4160736209}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:19:15.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:19:15.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-26T07:19:15.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4e632640 1 Processor -- start 2023-11-26T07:19:15.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4e632640 1 -- start start 2023-11-26T07:19:15.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4e632640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4806b190 0x7f4c48146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4e632640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c48146380 con 0x7f4c4806a490 2023-11-26T07:19:15.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4e632640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c48071660 con 0x7f4c48145fa0 2023-11-26T07:19:15.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4e632640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48071480 con 0x7f4c4806b190 2023-11-26T07:19:15.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4c4806a490 0x7f4c4806e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39928/0 (socket says 172.21.15.70:39928) 2023-11-26T07:19:15.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/1881689706 learned_addr learned my addr 172.21.15.70:0/1881689706 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:15.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c477fe640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4806b190 0x7f4c48146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137633557 0 0) 0x7f4c48146380 con 0x7f4c4806a490 2023-11-26T07:19:15.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c30003530 con 0x7f4c4806a490 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2392338739 0 0) 0x7f4c30003530 con 0x7f4c4806a490 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4806b190 msgr2=0x7f4c48146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4806b190 0x7f4c48146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 >> v1:172.21.15.120:6789/0 conn(0x7f4c48145fa0 legacy=0x7f4c48072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48071940 con 0x7f4c4806a490 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f4c40001a00 con 0x7f4c4806a490 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 >> v1:172.21.15.70:6789/0 conn(0x7f4c4806a490 legacy=0x7f4c4806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c300039b0 0x7f4c30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004310 0x7f4c300047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30004ff0 0x7f4c3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48071480 con 0x7f4c30004ff0 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3000bf00 con 0x7f4c30004310 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3000c0c0 con 0x7f4c300039b0 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30004ff0 0x7f4c3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c47fff640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c300039b0 0x7f4c30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c477fe640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004310 0x7f4c300047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c300039b0 msgr2=0x7f4c30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c300039b0 0x7f4c30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004310 msgr2=0x7f4c300047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004310 0x7f4c300047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.985+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/1881689706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30003530 con 0x7f4c30004ff0 2023-11-26T07:19:15.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30004ff0 0x7f4c3000b990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a830 tx=0x7f4c4001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573e249884b1fdab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:15.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400aa6d0 con 0x7f4c30004ff0 2023-11-26T07:19:15.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c400aa850 con 0x7f4c30004ff0 2023-11-26T07:19:15.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c46ffd640 1 -- 172.21.15.70:0/1881689706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400aac40 con 0x7f4c30004ff0 2023-11-26T07:19:15.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4e632640 1 -- 172.21.15.70:0/1881689706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30004ff0 msgr2=0x7f4c3000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:15.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4e632640 1 --2- 172.21.15.70:0/1881689706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c30004ff0 0x7f4c3000b990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a830 tx=0x7f4c4001faa0 comp rx=0 tx=0).stop 2023-11-26T07:19:15.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/1881689706 reap_dead start 2023-11-26T07:19:15.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4e632640 1 -- 172.21.15.70:0/1881689706 shutdown_connections 2023-11-26T07:19:15.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4e632640 1 -- 172.21.15.70:0/1881689706 >> 172.21.15.70:0/1881689706 conn(0x7f4c480cff00 msgr2=0x7f4c480d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:15.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4e632640 1 -- 172.21.15.70:0/1881689706 shutdown_connections 2023-11-26T07:19:15.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.989+0000 7f4c4e632640 1 -- 172.21.15.70:0/1881689706 wait complete. 2023-11-26T07:19:15.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 Processor -- start 2023-11-26T07:19:15.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 -- start start 2023-11-26T07:19:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004ff0 0x7f4c48142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c481f2a00 0x7f4c48140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4813f510 0x7f4c4806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48072000 con 0x7f4c481f2a00 2023-11-26T07:19:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48141830 con 0x7f4c30004ff0 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48141550 con 0x7f4c4813f510 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c481f2a00 0x7f4c48140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c481f2a00 0x7f4c48140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49962/0 (socket says 172.21.15.70:49962) 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 -- 172.21.15.70:0/36838207 learned_addr learned my addr 172.21.15.70:0/36838207 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c47fff640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004ff0 0x7f4c48142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4813f510 0x7f4c4806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 -- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4813f510 msgr2=0x7f4c4806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4813f510 0x7f4c4806d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 -- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004ff0 msgr2=0x7f4c48142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004ff0 0x7f4c48142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 -- 172.21.15.70:0/36838207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480cdcf0 con 0x7f4c481f2a00 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4813f510 0x7f4c4806d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c477fe640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c481f2a00 0x7f4c48140d00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c011890 tx=0x7f4c3c011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c44ff9640 1 -- 172.21.15.70:0/36838207 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c004240 con 0x7f4c481f2a00 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c44ff9640 1 -- 172.21.15.70:0/36838207 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c0043a0 con 0x7f4c481f2a00 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c480cdfd0 con 0x7f4c481f2a00 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.993+0000 7f4c44ff9640 1 -- 172.21.15.70:0/36838207 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00fa40 con 0x7f4c481f2a00 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.997+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c48141240 con 0x7f4c481f2a00 2023-11-26T07:19:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.997+0000 7f4c44ff9640 1 -- 172.21.15.70:0/36838207 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c3c00fba0 con 0x7f4c481f2a00 2023-11-26T07:19:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.997+0000 7f4c44ff9640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c34066470 0x7f4c34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.997+0000 7f4c44ff9640 1 -- 172.21.15.70:0/36838207 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c3c084270 con 0x7f4c481f2a00 2023-11-26T07:19:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.997+0000 7f4c47fff640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c34066470 0x7f4c34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:15.997+0000 7f4c51992000 1 Processor -- start 2023-11-26T07:19:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- start start 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c47fff640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c34066470 0x7f4c34068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4c38007fd0 tx=0x7f4c38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877760de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877761700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588775cb130 con 0x5588777ab5b0 2023-11-26T07:19:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588775b89a0 con 0x558877761320 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588775b5ed0 con 0x5588777aac90 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877760de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877760de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49966/0 (socket says 172.21.15.70:49966) 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 -- 172.21.15.70:0/1686670413 learned_addr learned my addr 172.21.15.70:0/1686670413 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c47fff640 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877761700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 -- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 msgr2=0x5588777ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 -- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 msgr2=0x558877761700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877761700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 -- 172.21.15.70:0/1686670413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588772a9890 con 0x5588777ab5b0 2023-11-26T07:19:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c477fe640 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877760de0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c082850 tx=0x7f4c3c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20d1c44cd43cbf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c2dffb640 1 -- 172.21.15.70:0/1686670413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0840d0 con 0x5588777ab5b0 2023-11-26T07:19:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c2dffb640 1 -- 172.21.15.70:0/1686670413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c05d740 con 0x5588777ab5b0 2023-11-26T07:19:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c2dffb640 1 -- 172.21.15.70:0/1686670413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00fe50 con 0x5588777ab5b0 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- 172.21.15.70:0/1686670413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 msgr2=0x558877760de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877760de0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c082850 tx=0x7f4c3c0045c0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- 172.21.15.70:0/1686670413 shutdown_connections 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877760de0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877761700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 --2- 172.21.15.70:0/1686670413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- 172.21.15.70:0/1686670413 >> 172.21.15.70:0/1686670413 conn(0x55887775d2d0 msgr2=0x55887775f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- 172.21.15.70:0/1686670413 shutdown_connections 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- 172.21.15.70:0/1686670413 wait complete. 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 -- start start 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.001+0000 7f4c51992000 1 Processor -- start 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877765d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x558877766280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 0x558877779910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588775b17c0 con 0x5588777aac90 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x558877569bf0 con 0x558877761320 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55887756fa90 con 0x5588777ab5b0 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 10 client.0 _ll_register_callbacks cb 0x55887774c3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x558877766280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x558877766280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49972/0 (socket says 172.21.15.70:49972) 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 -- 172.21.15.70:0/3403501301 learned_addr learned my addr 172.21.15.70:0/3403501301 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 0x558877779910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c47fff640 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877765d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 -- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 msgr2=0x558877779910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 0x558877779910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 -- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 msgr2=0x558877765d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877765d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 -- 172.21.15.70:0/3403501301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c48141240 con 0x5588777aac90 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c477fe640 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x558877766280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c082800 tx=0x7f4c3c016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff24a0bb7effb14 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c26ffd640 1 -- 172.21.15.70:0/3403501301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c05d740 con 0x5588777aac90 2023-11-26T07:19:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c26ffd640 1 -- 172.21.15.70:0/3403501301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c3c06a020 con 0x5588777aac90 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558877573470 con 0x5588777aac90 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c26ffd640 1 -- 172.21.15.70:0/3403501301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c3c00fe50 con 0x5588777aac90 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 10 client.5376 fetch_fsmap learned FSMap version 18 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558877572190 con 0x5588777aac90 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c26ffd640 1 -- 172.21.15.70:0/3403501301 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558877573470 con 0x5588777aac90 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c26ffd640 1 -- 172.21.15.70:0/3403501301 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4c3c059120 con 0x5588777aac90 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 10 client.5376 fetch_fsmap finished waiting for FSMap version 18 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 10 client.5376 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 20 client.5376 populate_metadata read hostname 'smithi070' 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x55887777a320 0x5588777bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 4 client.5376 mds_command: new command op to 5199 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:19:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 --> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558877576b50 con 0x55887777a320 2023-11-26T07:19:16.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c47fff640 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x55887777a320 0x5588777bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c47fff640 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x55887777a320 0x5588777bcf50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57aae89ecc71fb7c server_cookie=4988f0de54d88c32 in_seq=0 out_seq=0 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.005+0000 7f4c26ffd640 10 client.5376 ms_handle_connect on v2:172.21.15.70:6834/4160736209 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c26ffd640 1 -- 172.21.15.70:0/3403501301 <== mds.0 v2:172.21.15.70:6834/4160736209 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558877576b50 con 0x55887777a320 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c26ffd640 10 client.5376 handle_command_reply: tid=0 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 client.5376 shutdown 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 msgr2=0x558877766280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x558877766280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c082800 tx=0x7f4c3c016070 comp rx=0 tx=0).stop 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 shutdown_connections 2023-11-26T07:19:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x55887777a320 0x5588777bcf50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x558877766280 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 0x558877779910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 --2- 172.21.15.70:0/3403501301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x558877765d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c26ffd640 0 client.5376 ms_handle_reset on v2:172.21.15.70:6834/4160736209 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 >> 172.21.15.70:0/3403501301 conn(0x55887775d2d0 msgr2=0x55887775f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 shutdown_connections 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 1 -- 172.21.15.70:0/3403501301 wait complete. 2023-11-26T07:19:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.009+0000 7f4c51992000 20 client.5376 trim_cache size 0 max 16384 2023-11-26T07:19:16.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 Processor -- start 2023-11-26T07:19:16.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- start start 2023-11-26T07:19:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x5588777a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x5588777a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 0x5588777a9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55887726a940 con 0x5588777aac90 2023-11-26T07:19:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588775b04e0 con 0x558877761320 2023-11-26T07:19:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588775abca0 con 0x5588777ab5b0 2023-11-26T07:19:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x5588777a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x5588777a8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49988/0 (socket says 172.21.15.70:49988) 2023-11-26T07:19:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 -- 172.21.15.70:0/719023579 learned_addr learned my addr 172.21.15.70:0/719023579 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 -- 172.21.15.70:0/719023579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 msgr2=0x5588777a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 --2- 172.21.15.70:0/719023579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 0x5588777a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 -- 172.21.15.70:0/719023579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 msgr2=0x5588777a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 --2- 172.21.15.70:0/719023579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x5588777a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 -- 172.21.15.70:0/719023579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558877558490 con 0x5588777aac90 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c477fe640 1 --2- 172.21.15.70:0/719023579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x5588777a8b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c084550 tx=0x7f4c3c07e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bda00cf9b746d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c2e7fc640 1 -- 172.21.15.70:0/719023579 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c051830 con 0x5588777aac90 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c2e7fc640 1 -- 172.21.15.70:0/719023579 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c073310 con 0x5588777aac90 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c2e7fc640 1 -- 172.21.15.70:0/719023579 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0824e0 con 0x5588777aac90 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- 172.21.15.70:0/719023579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 msgr2=0x5588777a8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 --2- 172.21.15.70:0/719023579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x5588777a8b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c084550 tx=0x7f4c3c07e040 comp rx=0 tx=0).stop 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- 172.21.15.70:0/719023579 shutdown_connections 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 --2- 172.21.15.70:0/719023579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777aac90 0x5588777a8b30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 --2- 172.21.15.70:0/719023579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777ab5b0 0x5588777a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 --2- 172.21.15.70:0/719023579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x5588777a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- 172.21.15.70:0/719023579 >> 172.21.15.70:0/719023579 conn(0x55887775d2d0 msgr2=0x5588777b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- 172.21.15.70:0/719023579 shutdown_connections 2023-11-26T07:19:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- 172.21.15.70:0/719023579 wait complete. 2023-11-26T07:19:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 -- start start 2023-11-26T07:19:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.025+0000 7f4c51992000 1 Processor -- start 2023-11-26T07:19:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x55887778dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877762be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x558877638fa0 con 0x5588777ab5b0 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x558877535a00 con 0x558877761320 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55887757b2e0 con 0x5588777aac90 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 10 client.0 _ll_register_callbacks cb 0x5588775ffc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877762be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877762be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49998/0 (socket says 172.21.15.70:49998) 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/592003324 learned_addr learned my addr 172.21.15.70:0/592003324 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c47fff640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x55887778dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c477fe640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 msgr2=0x5588777626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 msgr2=0x55887778dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x55887778dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 -- 172.21.15.70:0/592003324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558877572190 con 0x5588777ab5b0 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c477fe640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c4cbcf640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877762be0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a830 tx=0x7f4c30005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df601c59404d73fd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 1 -- 172.21.15.70:0/592003324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400aa6d0 con 0x5588777ab5b0 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 1 -- 172.21.15.70:0/592003324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c400b9070 con 0x5588777ab5b0 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588775b0110 con 0x5588777ab5b0 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 1 -- 172.21.15.70:0/592003324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c40001fd0 con 0x5588777ab5b0 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 10 client.5382 fetch_fsmap learned FSMap version 18 2023-11-26T07:19:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5588772a9cc0 con 0x5588777ab5b0 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 1 -- 172.21.15.70:0/592003324 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588775b0110 con 0x5588777ab5b0 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 1 -- 172.21.15.70:0/592003324 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4c400b0020 con 0x5588777ab5b0 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 10 client.5382 fetch_fsmap finished waiting for FSMap version 18 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 10 client.5382 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 20 client.5382 populate_metadata read hostname 'smithi070' 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x558877811e30 0x558877814220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 4 client.5382 mds_command: new command op to 5199 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 --> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5588775df9a0 con 0x558877811e30 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c47fff640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x558877811e30 0x558877814220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c47fff640 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x558877811e30 0x558877814220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea96ec7f0aa91c7a server_cookie=be9ae797dd4c8aa4 in_seq=0 out_seq=0 2023-11-26T07:19:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 10 client.5382 ms_handle_connect on v2:172.21.15.70:6834/4160736209 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 1 -- 172.21.15.70:0/592003324 <== mds.0 v2:172.21.15.70:6834/4160736209 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5588775df9a0 con 0x558877811e30 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 10 client.5382 handle_command_reply: tid=0 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 client.5382 shutdown 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 msgr2=0x558877762be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877762be0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a830 tx=0x7f4c30005800 comp rx=0 tx=0).stop 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 shutdown_connections 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:6834/4160736209,v1:172.21.15.70:6836/4160736209] conn(0x558877811e30 0x558877814220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588777ab5b0 0x558877762be0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x5588777aac90 0x5588777626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c26ffd640 0 client.5382 ms_handle_reset on v2:172.21.15.70:6834/4160736209 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 --2- 172.21.15.70:0/592003324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558877761320 0x55887778dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.029+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 >> 172.21.15.70:0/592003324 conn(0x55887775d2d0 msgr2=0x55887775f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 shutdown_connections 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c51992000 1 -- 172.21.15.70:0/592003324 wait complete. 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c51992000 20 client.5382 trim_cache size 0 max 16384 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "35961970-1319-4bbb-b3aa-e783ca1e0d4a", 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 5199, 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-11-26T07:19:16.040 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-11-26T07:19:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-11-26T07:19:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 5.8187654469999996, 2023-11-26T07:19:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 18, 2023-11-26T07:19:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 35, 2023-11-26T07:19:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 35, 2023-11-26T07:19:16.041 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 19.688157031999999 2023-11-26T07:19:16.041 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c34066470 msgr2=0x7f4c34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c34066470 0x7f4c34068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4c38007fd0 tx=0x7f4c38009040 comp rx=0 tx=0).stop 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c481f2a00 msgr2=0x7f4c48140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c481f2a00 0x7f4c48140d00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c011890 tx=0x7f4c3c011d50 comp rx=0 tx=0).stop 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 shutdown_connections 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4c34066470 0x7f4c34068930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c481f2a00 0x7f4c48140d00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4c4813f510 0x7f4c4806d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 --2- 172.21.15.70:0/36838207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c30004ff0 0x7f4c48142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 >> 172.21.15.70:0/36838207 conn(0x7f4c480cff00 msgr2=0x7f4c480ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 shutdown_connections 2023-11-26T07:19:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.033+0000 7f4c4e632640 1 -- 172.21.15.70:0/36838207 wait complete. 2023-11-26T07:19:16.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:19:16.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1823279640 1 Processor -- start 2023-11-26T07:19:16.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1823279640 1 -- start start 2023-11-26T07:19:16.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1823279640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f181c13e290 0x7f181c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1823279640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c15fb20 con 0x7f181c0cf7c0 2023-11-26T07:19:16.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1823279640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c06c520 con 0x7f181c15f6b0 2023-11-26T07:19:16.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1823279640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c0cfc40 con 0x7f181c13e290 2023-11-26T07:19:16.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1821015640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f181c13e290 0x7f181c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1821015640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f181c13e290 0x7f181c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50000/0 (socket says 172.21.15.70:50000) 2023-11-26T07:19:16.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1821015640 1 -- 172.21.15.70:0/3080860122 learned_addr learned my addr 172.21.15.70:0/3080860122 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:16.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1821015640 1 -- 172.21.15.70:0/3080860122 >> v1:172.21.15.120:6789/0 conn(0x7f181c15f6b0 legacy=0x7f181c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1821015640 1 -- 172.21.15.70:0/3080860122 >> v1:172.21.15.70:6789/0 conn(0x7f181c0cf7c0 legacy=0x7f181c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.189+0000 7f1821015640 1 -- 172.21.15.70:0/3080860122 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c06c800 con 0x7f181c13e290 2023-11-26T07:19:16.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1821015640 1 --2- 172.21.15.70:0/3080860122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c13e290 0x7f181c0cf280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f181801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc7cbddf9174e36 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1813fff640 1 -- 172.21.15.70:0/3080860122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180aa670 con 0x7f181c13e290 2023-11-26T07:19:16.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1813fff640 1 -- 172.21.15.70:0/3080860122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180aa7d0 con 0x7f181c13e290 2023-11-26T07:19:16.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1813fff640 1 -- 172.21.15.70:0/3080860122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180aab60 con 0x7f181c13e290 2023-11-26T07:19:16.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1823279640 1 -- 172.21.15.70:0/3080860122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c13e290 msgr2=0x7f181c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1823279640 1 --2- 172.21.15.70:0/3080860122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c13e290 0x7f181c0cf280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f181801c510 comp rx=0 tx=0).stop 2023-11-26T07:19:16.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1823279640 1 -- 172.21.15.70:0/3080860122 shutdown_connections 2023-11-26T07:19:16.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1823279640 1 --2- 172.21.15.70:0/3080860122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c13e290 0x7f181c0cf280 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1823279640 1 -- 172.21.15.70:0/3080860122 >> 172.21.15.70:0/3080860122 conn(0x7f181c06a890 msgr2=0x7f181c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:16.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1823279640 1 -- 172.21.15.70:0/3080860122 shutdown_connections 2023-11-26T07:19:16.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.193+0000 7f1823279640 1 -- 172.21.15.70:0/3080860122 wait complete. 2023-11-26T07:19:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 Processor -- start 2023-11-26T07:19:16.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 -- start start 2023-11-26T07:19:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c0cf7c0 0x7f181c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f181c13e290 0x7f181c137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181c15f6b0 0x7f181c1379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c156240 con 0x7f181c0cf7c0 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1554f0 con 0x7f181c15f6b0 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c13cc50 con 0x7f181c13e290 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c0cf7c0 0x7f181c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c0cf7c0 0x7f181c1582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50006/0 (socket says 172.21.15.70:50006) 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 -- 172.21.15.70:0/1739420597 learned_addr learned my addr 172.21.15.70:0/1739420597 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821816640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181c15f6b0 0x7f181c1379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 -- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f181c13e290 msgr2=0x7f181c137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f181c13e290 0x7f181c137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 -- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181c15f6b0 msgr2=0x7f181c1379b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181c15f6b0 0x7f181c1379b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 -- 172.21.15.70:0/1739420597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180094d0 con 0x7f181c0cf7c0 2023-11-26T07:19:16.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821816640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181c15f6b0 0x7f181c1379b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:16.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1821015640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c0cf7c0 0x7f181c1582a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1818019120 tx=0x7f181801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1811ffb640 1 -- 172.21.15.70:0/1739420597 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180b3800 con 0x7f181c0cf7c0 2023-11-26T07:19:16.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1811ffb640 1 -- 172.21.15.70:0/1739420597 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180b3980 con 0x7f181c0cf7c0 2023-11-26T07:19:16.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1811ffb640 1 -- 172.21.15.70:0/1739420597 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180b3d30 con 0x7f181c0cf7c0 2023-11-26T07:19:16.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c13cf30 con 0x7f181c0cf7c0 2023-11-26T07:19:16.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.197+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c155e60 con 0x7f181c0cf7c0 2023-11-26T07:19:16.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.201+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c156380 con 0x7f181c0cf7c0 2023-11-26T07:19:16.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.201+0000 7f1811ffb640 1 -- 172.21.15.70:0/1739420597 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18180b2380 con 0x7f181c0cf7c0 2023-11-26T07:19:16.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.201+0000 7f1811ffb640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1800066470 0x7f1800068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:16.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.201+0000 7f1811ffb640 1 -- 172.21.15.70:0/1739420597 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f181811e930 con 0x7f181c0cf7c0 2023-11-26T07:19:16.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.201+0000 7f1820814640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1800066470 0x7f1800068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:16.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.201+0000 7f1820814640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1800066470 0x7f1800068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f180c007fd0 tx=0x7f180c007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:16.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.205+0000 7f1811ffb640 1 -- 172.21.15.70:0/1739420597 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f181c156380 con 0x7f181c0cf7c0 2023-11-26T07:19:16.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f181c067680 con 0x7f181c0cf7c0 2023-11-26T07:19:16.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1811ffb640 1 -- 172.21.15.70:0/1739420597 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f18180ebe50 con 0x7f181c0cf7c0 2023-11-26T07:19:16.392 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:19:16.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1800066470 msgr2=0x7f1800068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1800066470 0x7f1800068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f180c007fd0 tx=0x7f180c007960 comp rx=0 tx=0).stop 2023-11-26T07:19:16.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c0cf7c0 msgr2=0x7f181c1582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:16.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c0cf7c0 0x7f181c1582a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1818019120 tx=0x7f181801ad50 comp rx=0 tx=0).stop 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 shutdown_connections 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181c15f6b0 0x7f181c1379b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f181c13e290 0x7f181c137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1800066470 0x7f1800068930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 --2- 172.21.15.70:0/1739420597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f181c0cf7c0 0x7f181c1582a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 >> 172.21.15.70:0/1739420597 conn(0x7f181c06a890 msgr2=0x7f181c15d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 shutdown_connections 2023-11-26T07:19:16.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:16.389+0000 7f1823279640 1 -- 172.21.15.70:0/1739420597 wait complete. 2023-11-26T07:19:16.412 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:19:16.412 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:19:16.412 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-11-26T07:19:16.412 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:19:16.413 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:19:16.413 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:19:16.413 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:19:16.413 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:19:16.413 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:19:16.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.413 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-11-26T07:19:16.422 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:19:16.422 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2023-11-26T07:19:16.423 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42336sec preferred_lft 42336sec 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 02:42:99:81:d5:52 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:19:16.425 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:16.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.426 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:19:16.488 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-11-26T07:19:16.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.491 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-11-26T07:19:16.549 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-11-26T07:19:16.549 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:19:16.549 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:19:16.549 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:19:16.549 INFO:teuthology.orchestra.run.smithi070.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:19:16.550 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:19:16.550 INFO:teuthology.orchestra.run.smithi070.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:19:16.550 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:19:16.550 INFO:teuthology.orchestra.run.smithi070.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:19:16.550 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:19:16.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.550 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:19:16.550 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:19:16.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:19:16.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:19:16.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:19:16.551 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:19:16.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.641 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:19:16.650 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:19:16.650 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:19:16.650 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:19:16.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2023-11-26T07:19:16.712 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-26T07:19:16.712 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:19:16.712 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:19:16.763 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:19:16.763 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:19:16.763 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:19:16.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:19:16.883 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:19:16.937 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:19:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:19:16.939 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:19:16.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:16.940 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:19:16.990 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:19:16.991 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-26T07:19:17.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:19:17.058 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:19:17.112 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:19:17.113 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:19:17.114 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:19:17.115 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:19:17.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.116 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:19:17.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2023-11-26T07:19:17.129+0000 7f34c6b6c580 -1 init, newargv = 0x5648df01f550 newargc=15 2023-11-26T07:19:17.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[47434]: starting ceph client 2023-11-26T07:19:17.140 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[47434]: starting fuse 2023-11-26T07:19:17.143 INFO:teuthology.orchestra.run.smithi070.stdout:43 2023-11-26T07:19:17.143 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:19:17.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:19:17.143 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> import re 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> import os 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2023-11-26T07:19:17.144 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> return f 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2023-11-26T07:19:17.145 DEBUG:teuthology.orchestra.run.smithi070:> ' 2023-11-26T07:19:17.273 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.47434.asok 2023-11-26T07:19:17.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:19:17.284 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47434.asok 2023-11-26T07:19:17.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47434.asok status 2023-11-26T07:19:17.458 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "47434", 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2023-11-26T07:19:17.459 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 5397, 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 5397 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 211731602 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:17.460 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 211731602 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.5397 192.168.0.1:0/211731602", 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/211731602", 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 18, 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 35, 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2023-11-26T07:19:17.461 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:17.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.473 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2023-11-26T07:19:17.473 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-26T07:19:17.483 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2023-11-26T07:19:17.483 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-26T07:19:17.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:19:17.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:19:17.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.725+0000 7f063c7df640 1 Processor -- start 2023-11-26T07:19:17.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.725+0000 7f063c7df640 1 -- start start 2023-11-26T07:19:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063c7df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0634070ba0 0x7f063406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:17.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063c7df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f06340cdd10 0x7f063406d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063c7df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340cd610 con 0x7f0634161cf0 2023-11-26T07:19:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063c7df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340cd8f0 con 0x7f0634070ba0 2023-11-26T07:19:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063c7df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0634161210 con 0x7f06340cdd10 2023-11-26T07:19:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063a57b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0634070ba0 0x7f063406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063a57b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0634070ba0 0x7f063406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50014/0 (socket says 172.21.15.70:50014) 2023-11-26T07:19:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063a57b640 1 -- 172.21.15.70:0/673444170 learned_addr learned my addr 172.21.15.70:0/673444170 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:17.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063ad7c640 1 --2- 172.21.15.70:0/673444170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f06340cdd10 0x7f063406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063a57b640 1 -- 172.21.15.70:0/673444170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f06340cdd10 msgr2=0x7f063406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063a57b640 1 --2- 172.21.15.70:0/673444170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f06340cdd10 0x7f063406d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063a57b640 1 -- 172.21.15.70:0/673444170 >> v1:172.21.15.120:6789/0 conn(0x7f0634161cf0 legacy=0x7f0634070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:17.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.729+0000 7f063a57b640 1 -- 172.21.15.70:0/673444170 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06341614f0 con 0x7f0634070ba0 2023-11-26T07:19:17.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063a57b640 1 --2- 172.21.15.70:0/673444170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0634070ba0 0x7f063406bae0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0630009870 tx=0x7f063001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99d3e2e3e48e297 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:17.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f0639579640 1 -- 172.21.15.70:0/673444170 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300a9620 con 0x7f0634070ba0 2023-11-26T07:19:17.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f0639579640 1 -- 172.21.15.70:0/673444170 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06300a9780 con 0x7f0634070ba0 2023-11-26T07:19:17.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f0639579640 1 -- 172.21.15.70:0/673444170 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300a9b10 con 0x7f0634070ba0 2023-11-26T07:19:17.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 -- 172.21.15.70:0/673444170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0634070ba0 msgr2=0x7f063406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:17.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 --2- 172.21.15.70:0/673444170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0634070ba0 0x7f063406bae0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0630009870 tx=0x7f063001c540 comp rx=0 tx=0).stop 2023-11-26T07:19:17.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 -- 172.21.15.70:0/673444170 shutdown_connections 2023-11-26T07:19:17.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 --2- 172.21.15.70:0/673444170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f06340cdd10 0x7f063406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 --2- 172.21.15.70:0/673444170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0634070ba0 0x7f063406bae0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 -- 172.21.15.70:0/673444170 >> 172.21.15.70:0/673444170 conn(0x7f06340cf710 msgr2=0x7f06340cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:17.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 -- 172.21.15.70:0/673444170 shutdown_connections 2023-11-26T07:19:17.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 -- 172.21.15.70:0/673444170 wait complete. 2023-11-26T07:19:17.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 Processor -- start 2023-11-26T07:19:17.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.733+0000 7f063c7df640 1 -- start start 2023-11-26T07:19:17.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0634070ba0 0x7f063414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06340cdd10 0x7f063414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0634161cf0 0x7f0634149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063414d7d0 con 0x7f06340cdd10 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063414d480 con 0x7f0634161cf0 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06341567e0 con 0x7f0634070ba0 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06340cdd10 0x7f063414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06340cdd10 0x7f063414dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50026/0 (socket says 172.21.15.70:50026) 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 -- 172.21.15.70:0/494667584 learned_addr learned my addr 172.21.15.70:0/494667584 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063ad7c640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0634161cf0 0x7f0634149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063a57b640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0634070ba0 0x7f063414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 -- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0634070ba0 msgr2=0x7f063414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:17.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0634070ba0 0x7f063414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 -- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0634161cf0 msgr2=0x7f0634149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0634161cf0 0x7f0634149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 -- 172.21.15.70:0/494667584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300094d0 con 0x7f06340cdd10 2023-11-26T07:19:17.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f0639d7a640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06340cdd10 0x7f063414dbf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f062400c3c0 tx=0x7f062400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f062affd640 1 -- 172.21.15.70:0/494667584 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240052d0 con 0x7f06340cdd10 2023-11-26T07:19:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f062affd640 1 -- 172.21.15.70:0/494667584 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624005430 con 0x7f06340cdd10 2023-11-26T07:19:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f062affd640 1 -- 172.21.15.70:0/494667584 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624003840 con 0x7f06340cdd10 2023-11-26T07:19:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0634156ac0 con 0x7f06340cdd10 2023-11-26T07:19:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063414a3b0 con 0x7f06340cdd10 2023-11-26T07:19:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.737+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063414e130 con 0x7f06340cdd10 2023-11-26T07:19:17.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.741+0000 7f062affd640 1 -- 172.21.15.70:0/494667584 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06240039a0 con 0x7f06340cdd10 2023-11-26T07:19:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.741+0000 7f062affd640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0618066470 0x7f0618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.741+0000 7f062affd640 1 -- 172.21.15.70:0/494667584 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0624083300 con 0x7f06340cdd10 2023-11-26T07:19:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.741+0000 7f063a57b640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0618066470 0x7f0618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:17.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.741+0000 7f063a57b640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0618066470 0x7f0618068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06300ae000 tx=0x7f06300b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:17.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.745+0000 7f062affd640 1 -- 172.21.15.70:0/494667584 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0624050820 con 0x7f06340cdd10 2023-11-26T07:19:17.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.925+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f063414d910 con 0x7f06340cdd10 2023-11-26T07:19:17.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.925+0000 7f062affd640 1 -- 172.21.15.70:0/494667584 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f063414d910 con 0x7f06340cdd10 2023-11-26T07:19:17.930 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0618066470 msgr2=0x7f0618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0618066470 0x7f0618068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06300ae000 tx=0x7f06300b3040 comp rx=0 tx=0).stop 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06340cdd10 msgr2=0x7f063414dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06340cdd10 0x7f063414dbf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f062400c3c0 tx=0x7f062400c880 comp rx=0 tx=0).stop 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 shutdown_connections 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0618066470 0x7f0618068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06340cdd10 0x7f063414dbf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0634161cf0 0x7f0634149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 --2- 172.21.15.70:0/494667584 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0634070ba0 0x7f063414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 >> 172.21.15.70:0/494667584 conn(0x7f06340cf710 msgr2=0x7f0634160450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 shutdown_connections 2023-11-26T07:19:17.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:17.929+0000 7f063c7df640 1 -- 172.21.15.70:0/494667584 wait complete. 2023-11-26T07:19:17.950 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:19:17.950 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:19:17.950 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2023-11-26T07:19:17.950 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:19:17.951 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:19:17.951 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:19:17.951 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:19:17.951 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:19:17.951 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:19:17.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.951 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:19:17.962 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42331sec preferred_lft 42331sec 2023-11-26T07:19:17.963 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:29:fb:62:88 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.964 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:19:17.965 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:19:17.965 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:19:17.965 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.965 INFO:teuthology.orchestra.run.smithi120.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:19:17.965 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:19:17.965 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:19:17.965 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:19:17.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:17.966 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:19:18.028 INFO:teuthology.orchestra.run.smithi120.stdout:1 2023-11-26T07:19:18.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.030 DEBUG:teuthology.orchestra.run.smithi120:> route 2023-11-26T07:19:18.083 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2023-11-26T07:19:18.083 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:19:18.083 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:19:18.083 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:19:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:19:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:19:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:19:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:19:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:19:18.084 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:19:18.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.084 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:19:18.084 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:19:18.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:19:18.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:19:18.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:19:18.085 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:19:18.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.180 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:19:18.189 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:19:18.189 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:19:18.190 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:19:18.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.190 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2023-11-26T07:19:18.253 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-26T07:19:18.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:19:18.253 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:19:18.303 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:19:18.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:19:18.303 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:19:18.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:19:18.416 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:19:18.468 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:19:18.468 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:19:18.468 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:19:18.468 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:19:18.470 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:19:18.471 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:19:18.471 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:19:18.471 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:19:18.471 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:19:18.471 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:19:18.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.472 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:19:18.522 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:19:18.522 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-26T07:19:18.565 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:19:18.587 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:19:18.641 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:19:18.642 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:19:18.643 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:19:18.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.644 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:19:18.661 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:2023-11-26T07:19:18.656+0000 7fc376df6580 -1 init, newargv = 0x5611dec094a0 newargc=15 2023-11-26T07:19:18.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44175]: starting ceph client 2023-11-26T07:19:18.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44175]: starting fuse 2023-11-26T07:19:18.670 INFO:teuthology.orchestra.run.smithi120.stdout:43 2023-11-26T07:19:18.670 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> import re 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> import os 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2023-11-26T07:19:18.671 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> return f 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.1")) 2023-11-26T07:19:18.672 DEBUG:teuthology.orchestra.run.smithi120:> ' 2023-11-26T07:19:18.795 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.1.44175.asok 2023-11-26T07:19:18.799 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:19:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:19:18.807 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44175.asok 2023-11-26T07:19:18.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44175.asok status 2023-11-26T07:19:18.979 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-11-26T07:19:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2023-11-26T07:19:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:19:18.979 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "1", 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "44175", 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5347, 2023-11-26T07:19:18.980 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 5347 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 780470602 2023-11-26T07:19:18.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 780470602 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.5347 192.168.0.1:0/780470602", 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/780470602", 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 18, 2023-11-26T07:19:18.982 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 35, 2023-11-26T07:19:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:19:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2023-11-26T07:19:18.983 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2023-11-26T07:19:18.983 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-11-26T07:19:18.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:18.996 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2023-11-26T07:19:18.996 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-26T07:19:19.005 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2023-11-26T07:19:19.006 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-26T07:19:19.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:19.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:19:19.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:19:19.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.217+0000 7f5046268640 1 Processor -- start 2023-11-26T07:19:19.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.217+0000 7f5046268640 1 -- start start 2023-11-26T07:19:19.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f5046268640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50400cf990 0x7f504015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:19.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f5046268640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504006c520 con 0x7f504013e290 2023-11-26T07:19:19.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f5046268640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504006c800 con 0x7f504015f4e0 2023-11-26T07:19:19.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f5046268640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504006cae0 con 0x7f50400cf990 2023-11-26T07:19:19.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503ffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f504013e290 0x7f50400cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39944/0 (socket says 172.21.15.70:39944) 2023-11-26T07:19:19.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503ffff640 1 -- 172.21.15.70:0/3267024739 learned_addr learned my addr 172.21.15.70:0/3267024739 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:19.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503f7fe640 1 --2- 172.21.15.70:0/3267024739 >> v2:172.21.15.70:3300/0 conn(0x7f50400cf990 0x7f504015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:19.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503effd640 1 -- 172.21.15.70:0/3267024739 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230408068 0 0) 0x7f504006c520 con 0x7f504013e290 2023-11-26T07:19:19.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503effd640 1 -- 172.21.15.70:0/3267024739 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5028003530 con 0x7f504013e290 2023-11-26T07:19:19.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503f7fe640 1 -- 172.21.15.70:0/3267024739 >> v1:172.21.15.120:6789/0 conn(0x7f504015f4e0 legacy=0x7f50400cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:19.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503f7fe640 1 -- 172.21.15.70:0/3267024739 >> v1:172.21.15.70:6789/0 conn(0x7f504013e290 legacy=0x7f50400cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:19.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503effd640 1 -- 172.21.15.70:0/3267024739 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424623390 0 0) 0x7f504006c800 con 0x7f504015f4e0 2023-11-26T07:19:19.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503f7fe640 1 -- 172.21.15.70:0/3267024739 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504006cdc0 con 0x7f50400cf990 2023-11-26T07:19:19.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503f7fe640 1 --2- 172.21.15.70:0/3267024739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50400cf990 0x7f504015efa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f50340097c0 tx=0x7f503401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266382900494184d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:19.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.221+0000 7f503effd640 1 -- 172.21.15.70:0/3267024739 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340ab670 con 0x7f50400cf990 2023-11-26T07:19:19.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f503effd640 1 -- 172.21.15.70:0/3267024739 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340ab7d0 con 0x7f50400cf990 2023-11-26T07:19:19.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f503effd640 1 -- 172.21.15.70:0/3267024739 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340abb40 con 0x7f50400cf990 2023-11-26T07:19:19.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- 172.21.15.70:0/3267024739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50400cf990 msgr2=0x7f504015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:19.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 --2- 172.21.15.70:0/3267024739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50400cf990 0x7f504015efa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f50340097c0 tx=0x7f503401c450 comp rx=0 tx=0).stop 2023-11-26T07:19:19.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- 172.21.15.70:0/3267024739 shutdown_connections 2023-11-26T07:19:19.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 --2- 172.21.15.70:0/3267024739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50400cf990 0x7f504015efa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:19.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- 172.21.15.70:0/3267024739 >> 172.21.15.70:0/3267024739 conn(0x7f504006a890 msgr2=0x7f504006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:19.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- 172.21.15.70:0/3267024739 shutdown_connections 2023-11-26T07:19:19.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- 172.21.15.70:0/3267024739 wait complete. 2023-11-26T07:19:19.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 Processor -- start 2023-11-26T07:19:19.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- start start 2023-11-26T07:19:19.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50400cf990 0x7f5040137b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504013e290 0x7f50400b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f504015f4e0 0x7f50400b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040150360 con 0x7f504013e290 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400b1820 con 0x7f50400cf990 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f5046268640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504014f2c0 con 0x7f504015f4e0 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f503f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504013e290 0x7f50400b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f503f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504013e290 0x7f50400b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50044/0 (socket says 172.21.15.70:50044) 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.225+0000 7f503f7fe640 1 -- 172.21.15.70:0/3095714037 learned_addr learned my addr 172.21.15.70:0/3095714037 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503ffff640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50400cf990 0x7f5040137b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f5044805640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f504015f4e0 0x7f50400b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503f7fe640 1 -- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f504015f4e0 msgr2=0x7f50400b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:19.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503f7fe640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f504015f4e0 0x7f50400b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:19.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503f7fe640 1 -- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50400cf990 msgr2=0x7f5040137b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:19.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503f7fe640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50400cf990 0x7f5040137b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:19.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503f7fe640 1 -- 172.21.15.70:0/3095714037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034009420 con 0x7f504013e290 2023-11-26T07:19:19.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503f7fe640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504013e290 0x7f50400b2830 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5034019060 tx=0x7f503401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:19.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503cff9640 1 -- 172.21.15.70:0/3095714037 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340b5810 con 0x7f504013e290 2023-11-26T07:19:19.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503cff9640 1 -- 172.21.15.70:0/3095714037 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340b5970 con 0x7f504013e290 2023-11-26T07:19:19.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503cff9640 1 -- 172.21.15.70:0/3095714037 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340b5ce0 con 0x7f504013e290 2023-11-26T07:19:19.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504014f5a0 con 0x7f504013e290 2023-11-26T07:19:19.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504014fb60 con 0x7f504013e290 2023-11-26T07:19:19.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5040067680 con 0x7f504013e290 2023-11-26T07:19:19.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503cff9640 1 -- 172.21.15.70:0/3095714037 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50340bf410 con 0x7f504013e290 2023-11-26T07:19:19.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.229+0000 7f503cff9640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f502c066470 0x7f502c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:19.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.233+0000 7f503cff9640 1 -- 172.21.15.70:0/3095714037 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f503411eb70 con 0x7f504013e290 2023-11-26T07:19:19.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.233+0000 7f503ffff640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f502c066470 0x7f502c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:19.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.233+0000 7f503ffff640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f502c066470 0x7f502c068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5030007fd0 tx=0x7f5030009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:19.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.237+0000 7f503cff9640 1 -- 172.21.15.70:0/3095714037 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50340ec090 con 0x7f504013e290 2023-11-26T07:19:19.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.417+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f504015fb20 con 0x7f504013e290 2023-11-26T07:19:19.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f503cff9640 1 -- 172.21.15.70:0/3095714037 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 136+0+0 (secure 0 0 0) 0x7f504015fb20 con 0x7f504013e290 2023-11-26T07:19:19.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f502c066470 msgr2=0x7f502c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f502c066470 0x7f502c068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5030007fd0 tx=0x7f5030009040 comp rx=0 tx=0).stop 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504013e290 msgr2=0x7f50400b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504013e290 0x7f50400b2830 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5034019060 tx=0x7f503401ac90 comp rx=0 tx=0).stop 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 shutdown_connections 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f502c066470 0x7f502c068930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504013e290 0x7f50400b2830 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f504015f4e0 0x7f50400b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 --2- 172.21.15.70:0/3095714037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50400cf990 0x7f5040137b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 >> 172.21.15.70:0/3095714037 conn(0x7f504006a890 msgr2=0x7f5040139be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:19.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 shutdown_connections 2023-11-26T07:19:20.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:19.993+0000 7f5046268640 1 -- 172.21.15.70:0/3095714037 wait complete. 2023-11-26T07:19:20.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:19:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.153+0000 7fcb94279640 1 Processor -- start 2023-11-26T07:19:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.153+0000 7fcb94279640 1 -- start start 2023-11-26T07:19:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb94279640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcb8c0ce7c0 0x7fcb8c15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb94279640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c06c520 con 0x7fcb8c0cf990 2023-11-26T07:19:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb94279640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c06c800 con 0x7fcb8c13e290 2023-11-26T07:19:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb94279640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c06cae0 con 0x7fcb8c0ce7c0 2023-11-26T07:19:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91814640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcb8c0cf990 0x7fcb8c15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39952/0 (socket says 172.21.15.70:39952) 2023-11-26T07:19:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91814640 1 -- 172.21.15.70:0/2497595690 learned_addr learned my addr 172.21.15.70:0/2497595690 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92816640 1 --2- 172.21.15.70:0/2497595690 >> v2:172.21.15.120:3300/0 conn(0x7fcb8c0ce7c0 0x7fcb8c15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066339516 0 0) 0x7fcb8c06c520 con 0x7fcb8c0cf990 2023-11-26T07:19:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb78003530 con 0x7fcb8c0cf990 2023-11-26T07:19:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 648838557 0 0) 0x7fcb78003530 con 0x7fcb8c0cf990 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 >> v2:172.21.15.120:3300/0 conn(0x7fcb8c0ce7c0 msgr2=0x7fcb8c15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 --2- 172.21.15.70:0/2497595690 >> v2:172.21.15.120:3300/0 conn(0x7fcb8c0ce7c0 0x7fcb8c15f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 >> v1:172.21.15.120:6789/0 conn(0x7fcb8c13e290 legacy=0x7fcb8c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c06cdc0 con 0x7fcb8c0cf990 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fcb7c001680 con 0x7fcb8c0cf990 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 >> v1:172.21.15.70:6789/0 conn(0x7fcb8c0cf990 legacy=0x7fcb8c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78003980 0x7fcb78003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb780047d0 0x7fcb78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb78005190 0x7fcb7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c06cae0 con 0x7fcb78005190 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7800c130 con 0x7fcb780047d0 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7800c2f0 con 0x7fcb78003980 2023-11-26T07:19:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92816640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb78005190 0x7fcb7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92015640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78003980 0x7fcb78003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb91814640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb780047d0 0x7fcb78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92816640 1 -- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78003980 msgr2=0x7fcb78003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92816640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78003980 0x7fcb78003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92816640 1 -- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb780047d0 msgr2=0x7fcb78004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92816640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb780047d0 0x7fcb78004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.157+0000 7fcb92816640 1 -- 172.21.15.70:0/2497595690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78003530 con 0x7fcb78005190 2023-11-26T07:19:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb92816640 1 -- 172.21.15.70:0/2497595690 reap_dead start 2023-11-26T07:19:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb92816640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb78005190 0x7fcb7800b990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009fc0 tx=0x7fcb8401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e1b667a9996d54 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb840a5bb0 con 0x7fcb78005190 2023-11-26T07:19:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400f040 con 0x7fcb78005190 2023-11-26T07:19:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb91013640 1 -- 172.21.15.70:0/2497595690 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb840039a0 con 0x7fcb78005190 2023-11-26T07:19:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb94279640 1 -- 172.21.15.70:0/2497595690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb78005190 msgr2=0x7fcb7800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb94279640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb78005190 0x7fcb7800b990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009fc0 tx=0x7fcb8401cca0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb94279640 1 -- 172.21.15.70:0/2497595690 shutdown_connections 2023-11-26T07:19:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb94279640 1 --2- 172.21.15.70:0/2497595690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb78005190 0x7fcb7800b990 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb94279640 1 -- 172.21.15.70:0/2497595690 >> 172.21.15.70:0/2497595690 conn(0x7fcb8c06a890 msgr2=0x7fcb8c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb94279640 1 -- 172.21.15.70:0/2497595690 shutdown_connections 2023-11-26T07:19:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.161+0000 7fcb94279640 1 -- 172.21.15.70:0/2497595690 wait complete. 2023-11-26T07:19:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 Processor -- start 2023-11-26T07:19:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 -- start start 2023-11-26T07:19:20.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78005190 0x7fcb8c1393d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb8c0a84d0 0x7fcb8c0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8c0b3730 0x7fcb8c0a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0b2d60 con 0x7fcb8c0b3730 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c15ce30 con 0x7fcb8c0a84d0 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c15c870 con 0x7fcb78005190 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8c0b3730 0x7fcb8c0a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8c0b3730 0x7fcb8c0a8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50066/0 (socket says 172.21.15.70:50066) 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 -- 172.21.15.70:0/2121955355 learned_addr learned my addr 172.21.15.70:0/2121955355 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb91814640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb8c0a84d0 0x7fcb8c0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92015640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78005190 0x7fcb8c1393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 -- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78005190 msgr2=0x7fcb8c1393d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78005190 0x7fcb8c1393d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 -- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb8c0a84d0 msgr2=0x7fcb8c0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb8c0a84d0 0x7fcb8c0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 -- 172.21.15.70:0/2121955355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c15cb50 con 0x7fcb8c0b3730 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb92816640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8c0b3730 0x7fcb8c0a8ce0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcb840987d0 tx=0x7fcb84009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb82ffd640 1 -- 172.21.15.70:0/2121955355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb840a5dc0 con 0x7fcb8c0b3730 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb82ffd640 1 -- 172.21.15.70:0/2121955355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb840039a0 con 0x7fcb8c0b3730 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0b29f0 con 0x7fcb8c0b3730 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb82ffd640 1 -- 172.21.15.70:0/2121955355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84003d90 con 0x7fcb8c0b3730 2023-11-26T07:19:20.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c0a9220 con 0x7fcb8c0b3730 2023-11-26T07:19:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.165+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0ccba0 con 0x7fcb8c0b3730 2023-11-26T07:19:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.169+0000 7fcb82ffd640 1 -- 172.21.15.70:0/2121955355 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb840ae8a0 con 0x7fcb8c0b3730 2023-11-26T07:19:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.169+0000 7fcb82ffd640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb700664a0 0x7fcb70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.169+0000 7fcb82ffd640 1 -- 172.21.15.70:0/2121955355 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb8411ec30 con 0x7fcb8c0b3730 2023-11-26T07:19:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.169+0000 7fcb92015640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb700664a0 0x7fcb70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.169+0000 7fcb92015640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb700664a0 0x7fcb70068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000c10 tx=0x7fcb88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.173+0000 7fcb82ffd640 1 -- 172.21.15.70:0/2121955355 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb840ec010 con 0x7fcb8c0b3730 2023-11-26T07:19:20.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.341+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb8c067680 con 0x7fcb700664a0 2023-11-26T07:19:20.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.341+0000 7fcb82ffd640 1 -- 172.21.15.70:0/2121955355 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcb8c067680 con 0x7fcb700664a0 2023-11-26T07:19:20.347 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:19:20.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:19:20.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephfs" 2023-11-26T07:19:20.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:20.347 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:19:20.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb700664a0 msgr2=0x7fcb70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb700664a0 0x7fcb70068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000c10 tx=0x7fcb88009040 comp rx=0 tx=0).stop 2023-11-26T07:19:20.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8c0b3730 msgr2=0x7fcb8c0a8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8c0b3730 0x7fcb8c0a8ce0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcb840987d0 tx=0x7fcb84009750 comp rx=0 tx=0).stop 2023-11-26T07:19:20.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 shutdown_connections 2023-11-26T07:19:20.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb700664a0 0x7fcb70068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb8c0b3730 0x7fcb8c0a8ce0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb8c0a84d0 0x7fcb8c0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 --2- 172.21.15.70:0/2121955355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb78005190 0x7fcb8c1393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 >> 172.21.15.70:0/2121955355 conn(0x7fcb8c06a890 msgr2=0x7fcb8c0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:20.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 shutdown_connections 2023-11-26T07:19:20.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.345+0000 7fcb94279640 1 -- 172.21.15.70:0/2121955355 wait complete. 2023-11-26T07:19:20.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:19:20.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 Processor -- start 2023-11-26T07:19:20.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 -- start start 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f704415d580 0x7f70440d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d3e60 0x7f70440d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f70440d1d30 0x7f70440cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70440d21e0 con 0x7f70440d1d30 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70440d0bc0 con 0x7f704415d580 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7049632640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440d0320 con 0x7f70440d3e60 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f70440d1d30 0x7f70440cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f70440d1d30 0x7f70440cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50082/0 (socket says 172.21.15.70:50082) 2023-11-26T07:19:20.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 -- 172.21.15.70:0/1277144735 learned_addr learned my addr 172.21.15.70:0/1277144735 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:20.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70427fc640 1 --2- 172.21.15.70:0/1277144735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d3e60 0x7f70440d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 -- 172.21.15.70:0/1277144735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d3e60 msgr2=0x7f70440d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:20.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7042ffd640 1 --2- 172.21.15.70:0/1277144735 >> v2:172.21.15.120:3300/0 conn(0x7f704415d580 0x7f70440d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 --2- 172.21.15.70:0/1277144735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d3e60 0x7f70440d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 -- 172.21.15.70:0/1277144735 >> v2:172.21.15.120:3300/0 conn(0x7f704415d580 msgr2=0x7f70440d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:20.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 --2- 172.21.15.70:0/1277144735 >> v2:172.21.15.120:3300/0 conn(0x7f704415d580 0x7f70440d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70437fe640 1 -- 172.21.15.70:0/1277144735 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440d0600 con 0x7f70440d1d30 2023-11-26T07:19:20.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f7042ffd640 1 --2- 172.21.15.70:0/1277144735 >> v2:172.21.15.120:3300/0 conn(0x7f704415d580 0x7f70440d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:20.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.505+0000 7f70427fc640 1 --2- 172.21.15.70:0/1277144735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d3e60 0x7f70440d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:20.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f70437fe640 1 --2- 172.21.15.70:0/1277144735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70440d1d30 0x7f70440cdce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f704408bab0 tx=0x7f703c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bedb4dcb643bd2f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7041ffb640 1 -- 172.21.15.70:0/1277144735 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0a5820 con 0x7f70440d1d30 2023-11-26T07:19:20.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7041ffb640 1 -- 172.21.15.70:0/1277144735 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c0a5980 con 0x7f70440d1d30 2023-11-26T07:19:20.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7041ffb640 1 -- 172.21.15.70:0/1277144735 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0a5d10 con 0x7f70440d1d30 2023-11-26T07:19:20.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 -- 172.21.15.70:0/1277144735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70440d1d30 msgr2=0x7f70440cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 --2- 172.21.15.70:0/1277144735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70440d1d30 0x7f70440cdce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f704408bab0 tx=0x7f703c01c9a0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 -- 172.21.15.70:0/1277144735 shutdown_connections 2023-11-26T07:19:20.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 --2- 172.21.15.70:0/1277144735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70440d1d30 0x7f70440cdce0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 --2- 172.21.15.70:0/1277144735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d3e60 0x7f70440d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 --2- 172.21.15.70:0/1277144735 >> v2:172.21.15.120:3300/0 conn(0x7f704415d580 0x7f70440d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 -- 172.21.15.70:0/1277144735 >> 172.21.15.70:0/1277144735 conn(0x7f704409c550 msgr2=0x7f70440d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:20.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 -- 172.21.15.70:0/1277144735 shutdown_connections 2023-11-26T07:19:20.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 -- 172.21.15.70:0/1277144735 wait complete. 2023-11-26T07:19:20.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.509+0000 7f7049632640 1 Processor -- start 2023-11-26T07:19:20.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 -- start start 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d1d30 0x7f70440cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440d3e60 0x7f704415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f704415d580 0x7f70441573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044159880 con 0x7f704415d580 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70441595a0 con 0x7f70440d3e60 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440ca410 con 0x7f70440d1d30 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f704415d580 0x7f70441573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f704415d580 0x7f70441573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50096/0 (socket says 172.21.15.70:50096) 2023-11-26T07:19:20.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 -- 172.21.15.70:0/1530188111 learned_addr learned my addr 172.21.15.70:0/1530188111 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:20.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 -- 172.21.15.70:0/1530188111 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d1d30 msgr2=0x7f70440cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d1d30 0x7f70440cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 -- 172.21.15.70:0/1530188111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440d3e60 msgr2=0x7f704415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440d3e60 0x7f704415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 -- 172.21.15.70:0/1530188111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c009b30 con 0x7f704415d580 2023-11-26T07:19:20.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f70437fe640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f704415d580 0x7f70441573f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f703c0af040 tx=0x7f703c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f702b7fe640 1 -- 172.21.15.70:0/1530188111 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0b8670 con 0x7f704415d580 2023-11-26T07:19:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f702b7fe640 1 -- 172.21.15.70:0/1530188111 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c0b87f0 con 0x7f704415d580 2023-11-26T07:19:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70440ca6f0 con 0x7f704415d580 2023-11-26T07:19:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f702b7fe640 1 -- 172.21.15.70:0/1530188111 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0b8ba0 con 0x7f704415d580 2023-11-26T07:19:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704415c3c0 con 0x7f704415d580 2023-11-26T07:19:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.513+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704415c550 con 0x7f704415d580 2023-11-26T07:19:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.517+0000 7f702b7fe640 1 -- 172.21.15.70:0/1530188111 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f703c0b8d00 con 0x7f704415d580 2023-11-26T07:19:20.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.517+0000 7f702b7fe640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7030066470 0x7f7030068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.517+0000 7f702b7fe640 1 -- 172.21.15.70:0/1530188111 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f703c11f6b0 con 0x7f704415d580 2023-11-26T07:19:20.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.517+0000 7f7042ffd640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7030066470 0x7f7030068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.517+0000 7f7042ffd640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7030066470 0x7f7030068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7034006b20 tx=0x7f7034008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.521+0000 7f702b7fe640 1 -- 172.21.15.70:0/1530188111 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f703c0ecd00 con 0x7f704415d580 2023-11-26T07:19:20.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.669+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7044067680 con 0x7f704415d580 2023-11-26T07:19:20.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.669+0000 7f702b7fe640 1 -- 172.21.15.70:0/1530188111 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f703c0f0320 con 0x7f704415d580 2023-11-26T07:19:20.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7030066470 msgr2=0x7f7030068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7030066470 0x7f7030068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7034006b20 tx=0x7f7034008040 comp rx=0 tx=0).stop 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f704415d580 msgr2=0x7f70441573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f704415d580 0x7f70441573f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f703c0af040 tx=0x7f703c019740 comp rx=0 tx=0).stop 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 shutdown_connections 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7030066470 0x7f7030068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f704415d580 0x7f70441573f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f70440d3e60 0x7f704415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 --2- 172.21.15.70:0/1530188111 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f70440d1d30 0x7f70440cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 >> 172.21.15.70:0/1530188111 conn(0x7f704409c550 msgr2=0x7f7044160110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 shutdown_connections 2023-11-26T07:19:20.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.673+0000 7f7049632640 1 -- 172.21.15.70:0/1530188111 wait complete. 2023-11-26T07:19:20.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol33110 --mode=777 2023-11-26T07:19:20.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.833+0000 7f7df4357640 1 Processor -- start 2023-11-26T07:19:20.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.833+0000 7f7df4357640 1 -- start start 2023-11-26T07:19:20.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df4357640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7dec13e290 0x7f7dec0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df4357640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec15fb20 con 0x7f7dec0cf7c0 2023-11-26T07:19:20.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df4357640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec06c520 con 0x7f7dec15f6b0 2023-11-26T07:19:20.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df4357640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0cfc40 con 0x7f7dec13e290 2023-11-26T07:19:20.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df18f2640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7dec0cf7c0 0x7f7dec15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39968/0 (socket says 172.21.15.70:39968) 2023-11-26T07:19:20.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df18f2640 1 -- 172.21.15.70:0/1774720612 learned_addr learned my addr 172.21.15.70:0/1774720612 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df20f3640 1 --2- 172.21.15.70:0/1774720612 >> v2:172.21.15.120:3300/0 conn(0x7f7dec13e290 0x7f7dec0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646130253 0 0) 0x7f7ddc001120 con 0x7f7dec0cf7c0 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd8003530 con 0x7f7dec0cf7c0 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804585411 0 0) 0x7f7dec06c520 con 0x7f7dec15f6b0 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ddc001120 con 0x7f7dec15f6b0 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656719512 0 0) 0x7f7dd8003530 con 0x7f7dec0cf7c0 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df20f3640 1 -- 172.21.15.70:0/1774720612 >> v1:172.21.15.120:6789/0 conn(0x7f7dec15f6b0 legacy=0x7f7dec0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df20f3640 1 -- 172.21.15.70:0/1774720612 >> v1:172.21.15.70:6789/0 conn(0x7f7dec0cf7c0 legacy=0x7f7dec15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.837+0000 7f7df20f3640 1 -- 172.21.15.70:0/1774720612 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec06c800 con 0x7f7dec13e290 2023-11-26T07:19:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df20f3640 1 --2- 172.21.15.70:0/1774720612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec13e290 0x7f7dec0cf280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7de80097c0 tx=0x7f7de801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d63ae3d18f9d7b4b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc001830 con 0x7f7dec13e290 2023-11-26T07:19:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de80a7050 con 0x7f7dec13e290 2023-11-26T07:19:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df10f1640 1 -- 172.21.15.70:0/1774720612 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80ab600 con 0x7f7dec13e290 2023-11-26T07:19:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 -- 172.21.15.70:0/1774720612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec13e290 msgr2=0x7f7dec0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 --2- 172.21.15.70:0/1774720612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec13e290 0x7f7dec0cf280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7de80097c0 tx=0x7f7de801c370 comp rx=0 tx=0).stop 2023-11-26T07:19:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 -- 172.21.15.70:0/1774720612 shutdown_connections 2023-11-26T07:19:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 --2- 172.21.15.70:0/1774720612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec13e290 0x7f7dec0cf280 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 -- 172.21.15.70:0/1774720612 >> 172.21.15.70:0/1774720612 conn(0x7f7dec06a890 msgr2=0x7f7dec06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 -- 172.21.15.70:0/1774720612 shutdown_connections 2023-11-26T07:19:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 -- 172.21.15.70:0/1774720612 wait complete. 2023-11-26T07:19:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 Processor -- start 2023-11-26T07:19:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.841+0000 7f7df4357640 1 -- start start 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7dec0cf7c0 0x7f7dec13c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dec13e290 0x7f7dec0a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec15f6b0 0x7f7dec139630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0a89d0 con 0x7f7dec13e290 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0a8cb0 con 0x7f7dec15f6b0 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec0a8f90 con 0x7f7dec0cf7c0 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dec13e290 0x7f7dec0a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dec13e290 0x7f7dec0a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50104/0 (socket says 172.21.15.70:50104) 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 -- 172.21.15.70:0/1223229433 learned_addr learned my addr 172.21.15.70:0/1223229433 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df28f4640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec15f6b0 0x7f7dec139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df20f3640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7dec0cf7c0 0x7f7dec13c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 -- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7dec0cf7c0 msgr2=0x7f7dec13c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7dec0cf7c0 0x7f7dec13c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 -- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec15f6b0 msgr2=0x7f7dec139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec15f6b0 0x7f7dec139630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 -- 172.21.15.70:0/1223229433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8009420 con 0x7f7dec13e290 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df18f2640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dec13e290 0x7f7dec0a9a70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c770 tx=0x7f7ddc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7de2ffd640 1 -- 172.21.15.70:0/1223229433 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0074e0 con 0x7f7dec13e290 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7de2ffd640 1 -- 172.21.15.70:0/1223229433 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc007660 con 0x7f7dec13e290 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7de2ffd640 1 -- 172.21.15.70:0/1223229433 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc004a30 con 0x7f7dec13e290 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec0a9270 con 0x7f7dec13e290 2023-11-26T07:19:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec13cca0 con 0x7f7dec13e290 2023-11-26T07:19:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec067680 con 0x7f7dec13e290 2023-11-26T07:19:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.845+0000 7f7de2ffd640 1 -- 172.21.15.70:0/1223229433 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ddc004b90 con 0x7f7dec13e290 2023-11-26T07:19:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.849+0000 7f7de2ffd640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7dd0066470 0x7f7dd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.849+0000 7f7de2ffd640 1 -- 172.21.15.70:0/1223229433 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ddc0830d0 con 0x7f7dec13e290 2023-11-26T07:19:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.849+0000 7f7df20f3640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7dd0066470 0x7f7dd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.849+0000 7f7df20f3640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7dd0066470 0x7f7dd0068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7de80ad000 tx=0x7f7de8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:20.853+0000 7f7de2ffd640 1 -- 172.21.15.70:0/1223229433 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ddc0505f0 con 0x7f7dec13e290 2023-11-26T07:19:21.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.025+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol33110", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dec15fb20 con 0x7f7dd0066470 2023-11-26T07:19:21.035 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:21.033+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:21.035 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:21.033+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:21.035 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:21.033+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:21.035 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:21.033+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:21.036 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:21.033+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:21.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7de2ffd640 1 -- 172.21.15.70:0/1223229433 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7dec15fb20 con 0x7f7dd0066470 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7dd0066470 msgr2=0x7f7dd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7dd0066470 0x7f7dd0068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7de80ad000 tx=0x7f7de8008040 comp rx=0 tx=0).stop 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dec13e290 msgr2=0x7f7dec0a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dec13e290 0x7f7dec0a9a70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c770 tx=0x7f7ddc00cc30 comp rx=0 tx=0).stop 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 shutdown_connections 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7dd0066470 0x7f7dd0068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dec13e290 0x7f7dec0a9a70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dec15f6b0 0x7f7dec139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 --2- 172.21.15.70:0/1223229433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7dec0cf7c0 0x7f7dec13c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 >> 172.21.15.70:0/1223229433 conn(0x7f7dec06a890 msgr2=0x7f7dec15b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 shutdown_connections 2023-11-26T07:19:21.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.157+0000 7f7df4357640 1 -- 172.21.15.70:0/1223229433 wait complete. 2023-11-26T07:19:21.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol33110 2023-11-26T07:19:21.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f6eaa640 1 Processor -- start 2023-11-26T07:19:21.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f6eaa640 1 -- start start 2023-11-26T07:19:21.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f6eaa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f015d6e0 0x7f34f00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:21.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f6eaa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f34f00b2160 0x7f34f00d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f6eaa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f00cf0e0 con 0x7f34f00d19f0 2023-11-26T07:19:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f6eaa640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f015dac0 con 0x7f34f00b2160 2023-11-26T07:19:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f6eaa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00d1e80 con 0x7f34f015d6e0 2023-11-26T07:19:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34f4c46640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f015d6e0 0x7f34f00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34e7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f34f00b2160 0x7f34f00d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34e7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f34f00b2160 0x7f34f00d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:49110/0 (socket says 172.21.15.70:49110) 2023-11-26T07:19:21.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34e7fff640 1 -- 172.21.15.70:0/2643712827 learned_addr learned my addr 172.21.15.70:0/2643712827 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:21.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34e7fff640 1 -- 172.21.15.70:0/2643712827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f015d6e0 msgr2=0x7f34f00d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:21.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34e7fff640 1 --2- 172.21.15.70:0/2643712827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f015d6e0 0x7f34f00d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34e7fff640 1 -- 172.21.15.70:0/2643712827 >> v1:172.21.15.120:6789/0 conn(0x7f34f00d19f0 legacy=0x7f34f00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.317+0000 7f34e7fff640 1 -- 172.21.15.70:0/2643712827 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00ceb20 con 0x7f34f00b2160 2023-11-26T07:19:21.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34e7fff640 1 --2- 172.21.15.70:0/2643712827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00b2160 0x7f34f00d14b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009870 tx=0x7f34e001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d76f8a765a2fd63 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:21.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34e77fe640 1 -- 172.21.15.70:0/2643712827 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00a7070 con 0x7f34f00b2160 2023-11-26T07:19:21.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34e77fe640 1 -- 172.21.15.70:0/2643712827 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e00ab430 con 0x7f34f00b2160 2023-11-26T07:19:21.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34e77fe640 1 -- 172.21.15.70:0/2643712827 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00ab7c0 con 0x7f34f00b2160 2023-11-26T07:19:21.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 -- 172.21.15.70:0/2643712827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00b2160 msgr2=0x7f34f00d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/2643712827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00b2160 0x7f34f00d14b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009870 tx=0x7f34e001c540 comp rx=0 tx=0).stop 2023-11-26T07:19:21.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 -- 172.21.15.70:0/2643712827 shutdown_connections 2023-11-26T07:19:21.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/2643712827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f00b2160 0x7f34f00d14b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/2643712827 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f015d6e0 0x7f34f00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 -- 172.21.15.70:0/2643712827 >> 172.21.15.70:0/2643712827 conn(0x7f34f009c550 msgr2=0x7f34f00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:21.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 -- 172.21.15.70:0/2643712827 shutdown_connections 2023-11-26T07:19:21.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.321+0000 7f34f6eaa640 1 -- 172.21.15.70:0/2643712827 wait complete. 2023-11-26T07:19:21.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 Processor -- start 2023-11-26T07:19:21.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 -- start start 2023-11-26T07:19:21.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f00b2160 0x7f34f00cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:21.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f00d19f0 0x7f34f00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:21.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f015d6e0 0x7f34f015a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:21.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00b2df0 con 0x7f34f00b2160 2023-11-26T07:19:21.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00cb240 con 0x7f34f015d6e0 2023-11-26T07:19:21.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f015ab10 con 0x7f34f00d19f0 2023-11-26T07:19:21.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f00b2160 0x7f34f00cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f00b2160 0x7f34f00cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50144/0 (socket says 172.21.15.70:50144) 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 -- 172.21.15.70:0/3765836664 learned_addr learned my addr 172.21.15.70:0/3765836664 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f5447640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f015d6e0 0x7f34f015a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34e7fff640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f00d19f0 0x7f34f00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 -- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f00d19f0 msgr2=0x7f34f00cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f00d19f0 0x7f34f00cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 -- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f015d6e0 msgr2=0x7f34f015a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f015d6e0 0x7f34f015a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 -- 172.21.15.70:0/3765836664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e00094d0 con 0x7f34f00b2160 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34e7fff640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f00d19f0 0x7f34f00cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f4c46640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f00b2160 0x7f34f00cc5e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00e870 tx=0x7f34ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34e57fa640 1 -- 172.21.15.70:0/3765836664 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec009510 con 0x7f34f00b2160 2023-11-26T07:19:21.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34e57fa640 1 -- 172.21.15.70:0/3765836664 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec00eec0 con 0x7f34f00b2160 2023-11-26T07:19:21.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34e57fa640 1 -- 172.21.15.70:0/3765836664 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00cb40 con 0x7f34f00b2160 2023-11-26T07:19:21.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.325+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f00cb4c0 con 0x7f34f00b2160 2023-11-26T07:19:21.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.329+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f00cba80 con 0x7f34f00b2160 2023-11-26T07:19:21.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.329+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f0067680 con 0x7f34f00b2160 2023-11-26T07:19:21.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.329+0000 7f34e57fa640 1 -- 172.21.15.70:0/3765836664 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f34ec00cca0 con 0x7f34f00b2160 2023-11-26T07:19:21.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.329+0000 7f34e57fa640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34dc066470 0x7f34dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:21.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.329+0000 7f34e57fa640 1 -- 172.21.15.70:0/3765836664 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34ec083f60 con 0x7f34f00b2160 2023-11-26T07:19:21.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.329+0000 7f34e7fff640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34dc066470 0x7f34dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:21.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.329+0000 7f34e7fff640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34dc066470 0x7f34dc068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f34e00af000 tx=0x7f34e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:21.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.333+0000 7f34e57fa640 1 -- 172.21.15.70:0/3765836664 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34ec051480 con 0x7f34f00b2160 2023-11-26T07:19:21.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.509+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol33110", "target": ["mon-mgr", ""]}) v1 -- 0x7f34f00ce810 con 0x7f34dc066470 2023-11-26T07:19:21.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34e57fa640 1 -- 172.21.15.70:0/3765836664 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f34e00bb0c0 con 0x7f34dc066470 2023-11-26T07:19:21.517 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96 2023-11-26T07:19:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34dc066470 msgr2=0x7f34dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34dc066470 0x7f34dc068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f34e00af000 tx=0x7f34e0008040 comp rx=0 tx=0).stop 2023-11-26T07:19:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f00b2160 msgr2=0x7f34f00cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f00b2160 0x7f34f00cc5e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00e870 tx=0x7f34ec00ec70 comp rx=0 tx=0).stop 2023-11-26T07:19:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 shutdown_connections 2023-11-26T07:19:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34f015d6e0 0x7f34f015a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34f00d19f0 0x7f34f00cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34dc066470 0x7f34dc068930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 --2- 172.21.15.70:0/3765836664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f00b2160 0x7f34f00cc5e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 >> 172.21.15.70:0/3765836664 conn(0x7f34f009c550 msgr2=0x7f34f015e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 shutdown_connections 2023-11-26T07:19:21.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:21.513+0000 7f34f6eaa640 1 -- 172.21.15.70:0/3765836664 wait complete. 2023-11-26T07:19:21.538 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol33110 with 200 files each 1MB size under directory volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96 2023-11-26T07:19:21.538 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:21.538 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.547 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.631 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:21.631 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:21.631 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218151 s, 48.1 MB/s 2023-11-26T07:19:21.632 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:21.632 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.683 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.761 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:21.761 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:21.761 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188808 s, 55.5 MB/s 2023-11-26T07:19:21.762 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:21.762 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.811 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180446 s, 58.1 MB/s 2023-11-26T07:19:21.888 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:21.888 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:21.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:21.939 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.012 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.012 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.012 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148813 s, 70.5 MB/s 2023-11-26T07:19:22.013 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.013 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.064 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.140 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.140 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.140 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188731 s, 55.6 MB/s 2023-11-26T07:19:22.141 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.141 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.192 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.264 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147176 s, 71.2 MB/s 2023-11-26T07:19:22.265 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.265 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.316 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.387 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.388 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147195 s, 71.2 MB/s 2023-11-26T07:19:22.388 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.389 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.439 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.514 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.514 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.514 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178572 s, 58.7 MB/s 2023-11-26T07:19:22.515 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.515 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.571 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.643 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.643 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.643 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149899 s, 70.0 MB/s 2023-11-26T07:19:22.644 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.644 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.699 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.773 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.773 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.773 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164701 s, 63.7 MB/s 2023-11-26T07:19:22.774 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.774 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.823 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:22.899 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:22.899 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:22.899 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018678 s, 56.1 MB/s 2023-11-26T07:19:22.900 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:22.900 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:22.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:22.952 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.031 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.031 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.031 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175783 s, 59.7 MB/s 2023-11-26T07:19:23.032 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.032 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.084 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.156 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.156 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.157 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149274 s, 70.2 MB/s 2023-11-26T07:19:23.157 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.158 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.208 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.281 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.281 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.281 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149056 s, 70.3 MB/s 2023-11-26T07:19:23.282 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.282 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.336 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.410 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164397 s, 63.8 MB/s 2023-11-26T07:19:23.411 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.411 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.464 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.537 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.537 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.537 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153512 s, 68.3 MB/s 2023-11-26T07:19:23.538 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.538 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.588 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.667 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.667 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170037 s, 61.7 MB/s 2023-11-26T07:19:23.668 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.668 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.719 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158929 s, 66.0 MB/s 2023-11-26T07:19:23.794 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.794 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.843 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163045 s, 64.3 MB/s 2023-11-26T07:19:23.918 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:23.918 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:23.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:23.967 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.042 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.042 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.042 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156942 s, 66.8 MB/s 2023-11-26T07:19:24.043 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.043 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.095 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.168 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.168 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.168 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155554 s, 67.4 MB/s 2023-11-26T07:19:24.169 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.169 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.223 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.298 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.298 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.299 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138136 s, 75.9 MB/s 2023-11-26T07:19:24.300 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.300 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.355 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.429 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.429 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.429 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158222 s, 66.3 MB/s 2023-11-26T07:19:24.430 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.430 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.483 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.554 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.554 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.554 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131167 s, 79.9 MB/s 2023-11-26T07:19:24.555 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.555 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.608 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.683 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178204 s, 58.8 MB/s 2023-11-26T07:19:24.684 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.684 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.735 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.807 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.807 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.807 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138902 s, 75.5 MB/s 2023-11-26T07:19:24.808 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.808 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.860 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:24.937 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:24.938 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:24.938 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165599 s, 63.3 MB/s 2023-11-26T07:19:24.939 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:24.939 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:24.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:24.987 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.058 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.058 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.058 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125386 s, 83.6 MB/s 2023-11-26T07:19:25.059 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.059 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.112 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.184 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158341 s, 66.2 MB/s 2023-11-26T07:19:25.185 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.186 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.236 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.306 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.306 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.306 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126672 s, 82.8 MB/s 2023-11-26T07:19:25.307 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.307 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.363 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.441 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.442 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162057 s, 64.7 MB/s 2023-11-26T07:19:25.442 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.442 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.495 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.570 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.570 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.570 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165394 s, 63.4 MB/s 2023-11-26T07:19:25.571 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.571 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.623 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.696 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.697 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.697 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157905 s, 66.4 MB/s 2023-11-26T07:19:25.697 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.698 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.748 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013994 s, 74.9 MB/s 2023-11-26T07:19:25.821 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.821 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:25.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:25.875 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:25.946 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:25.947 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:25.947 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137899 s, 76.0 MB/s 2023-11-26T07:19:25.947 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:25.948 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.003 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015612 s, 67.2 MB/s 2023-11-26T07:19:26.082 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.082 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.131 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.204 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.204 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.205 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153113 s, 68.5 MB/s 2023-11-26T07:19:26.205 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.206 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.255 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.326 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.326 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.326 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131613 s, 79.7 MB/s 2023-11-26T07:19:26.327 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.328 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.379 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166386 s, 63.0 MB/s 2023-11-26T07:19:26.452 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.452 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.507 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.580 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.581 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.581 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160094 s, 65.5 MB/s 2023-11-26T07:19:26.582 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.582 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.632 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.705 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.705 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.705 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156964 s, 66.8 MB/s 2023-11-26T07:19:26.706 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.706 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.756 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016269 s, 64.5 MB/s 2023-11-26T07:19:26.830 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.830 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:26.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:26.880 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:26.957 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152926 s, 68.6 MB/s 2023-11-26T07:19:26.958 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:26.958 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.011 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159132 s, 65.9 MB/s 2023-11-26T07:19:27.091 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.091 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.144 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.219 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.220 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139129 s, 75.4 MB/s 2023-11-26T07:19:27.221 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.221 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.272 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.346 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.346 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.346 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170281 s, 61.6 MB/s 2023-11-26T07:19:27.347 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.347 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.400 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.477 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.477 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.477 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150988 s, 69.4 MB/s 2023-11-26T07:19:27.478 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.478 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.528 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.602 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165271 s, 63.4 MB/s 2023-11-26T07:19:27.603 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.603 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.656 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.729 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015502 s, 67.6 MB/s 2023-11-26T07:19:27.730 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.730 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.780 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.852 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142796 s, 73.4 MB/s 2023-11-26T07:19:27.853 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.853 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:27.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:27.903 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:27.978 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:27.978 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:27.978 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168062 s, 62.4 MB/s 2023-11-26T07:19:27.979 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:27.980 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.032 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.104 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.105 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152449 s, 68.8 MB/s 2023-11-26T07:19:28.106 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.106 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.156 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.227 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.227 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.228 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132889 s, 78.9 MB/s 2023-11-26T07:19:28.228 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.229 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.279 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.351 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013454 s, 77.9 MB/s 2023-11-26T07:19:28.352 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.352 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.407 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.484 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.484 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.484 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148677 s, 70.5 MB/s 2023-11-26T07:19:28.485 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.485 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.539 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157464 s, 66.6 MB/s 2023-11-26T07:19:28.618 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.618 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.667 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.739 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.739 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.739 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141385 s, 74.2 MB/s 2023-11-26T07:19:28.740 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.740 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.792 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.871 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.871 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179653 s, 58.4 MB/s 2023-11-26T07:19:28.872 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.872 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:28.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:28.923 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:28.996 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:28.996 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:28.996 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149155 s, 70.3 MB/s 2023-11-26T07:19:28.997 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:28.997 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.047 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:29.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:29.126 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:29.126 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:29.126 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161066 s, 65.1 MB/s 2023-11-26T07:19:29.127 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:29.127 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.199 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.277 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:29.278 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:29.278 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154896 s, 67.7 MB/s 2023-11-26T07:19:29.278 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:29.279 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.327 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.404 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:29.404 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:29.404 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014339 s, 73.1 MB/s 2023-11-26T07:19:29.405 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:29.405 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.455 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.534 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:29.534 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:29.534 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161157 s, 65.1 MB/s 2023-11-26T07:19:29.535 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:29.535 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.587 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.668 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:29.668 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:29.668 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221992 s, 47.2 MB/s 2023-11-26T07:19:29.669 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:29.669 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.719 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.794 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:29.794 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:29.794 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166928 s, 62.8 MB/s 2023-11-26T07:19:29.795 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:29.795 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.847 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:29.921 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:29.921 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:29.921 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153602 s, 68.3 MB/s 2023-11-26T07:19:29.922 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:29.922 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:29.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:29.972 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.047 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139624 s, 75.1 MB/s 2023-11-26T07:19:30.048 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.048 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.099 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.172 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.172 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.172 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014369 s, 73.0 MB/s 2023-11-26T07:19:30.173 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.173 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.223 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.294 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.294 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.294 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132477 s, 79.2 MB/s 2023-11-26T07:19:30.295 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.295 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.347 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.423 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.423 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.423 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014305 s, 73.3 MB/s 2023-11-26T07:19:30.424 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.424 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.475 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.546 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125579 s, 83.5 MB/s 2023-11-26T07:19:30.547 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.547 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.600 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149618 s, 70.1 MB/s 2023-11-26T07:19:30.673 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.674 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.723 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146967 s, 71.3 MB/s 2023-11-26T07:19:30.796 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.796 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.847 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146783 s, 71.4 MB/s 2023-11-26T07:19:30.920 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:30.920 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:30.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:30.972 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.044 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.044 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.044 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144085 s, 72.8 MB/s 2023-11-26T07:19:31.045 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.045 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.095 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142209 s, 73.7 MB/s 2023-11-26T07:19:31.173 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.173 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.223 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.294 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.294 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.295 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138145 s, 75.9 MB/s 2023-11-26T07:19:31.295 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.295 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.352 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.422 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.422 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.422 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149109 s, 70.3 MB/s 2023-11-26T07:19:31.423 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.423 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.475 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.552 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.552 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.553 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151185 s, 69.4 MB/s 2023-11-26T07:19:31.553 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.553 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.603 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164586 s, 63.7 MB/s 2023-11-26T07:19:31.679 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.679 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.727 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.803 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177821 s, 59.0 MB/s 2023-11-26T07:19:31.804 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.804 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.855 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:31.929 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:31.929 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:31.929 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153843 s, 68.2 MB/s 2023-11-26T07:19:31.930 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:31.930 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:31.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:31.979 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153634 s, 68.3 MB/s 2023-11-26T07:19:32.055 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.055 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.107 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.181 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.181 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.181 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152026 s, 69.0 MB/s 2023-11-26T07:19:32.182 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.182 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.232 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152644 s, 68.7 MB/s 2023-11-26T07:19:32.305 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.305 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.356 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.432 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.433 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.433 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015289 s, 68.6 MB/s 2023-11-26T07:19:32.434 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.434 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.484 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.557 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.557 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.557 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156856 s, 66.8 MB/s 2023-11-26T07:19:32.558 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.558 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.607 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.682 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132219 s, 79.3 MB/s 2023-11-26T07:19:32.683 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.683 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.735 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140496 s, 74.6 MB/s 2023-11-26T07:19:32.808 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.808 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.860 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:32.932 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:32.933 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:32.933 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158201 s, 66.3 MB/s 2023-11-26T07:19:32.934 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:32.934 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:32.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:32.987 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.061 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.061 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.061 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157385 s, 66.6 MB/s 2023-11-26T07:19:33.062 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.062 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:33.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:33.112 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014769 s, 71.0 MB/s 2023-11-26T07:19:33.186 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.186 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:33.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:33.290 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.321 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.321 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.321 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148677 s, 70.5 MB/s 2023-11-26T07:19:33.325 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.325 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:33.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:33.377 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.455 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.455 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.455 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174202 s, 60.2 MB/s 2023-11-26T07:19:33.457 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.457 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:33.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:33.512 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.586 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.586 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.586 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153299 s, 68.4 MB/s 2023-11-26T07:19:33.587 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.587 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:33.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:33.643 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.718 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.718 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.718 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01565 s, 67.0 MB/s 2023-11-26T07:19:33.719 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.719 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:33.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:33.772 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.849 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.849 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.849 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145791 s, 71.9 MB/s 2023-11-26T07:19:33.850 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.850 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:33.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:33.909 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:33.982 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:33.982 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:33.982 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015397 s, 68.1 MB/s 2023-11-26T07:19:33.983 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:33.983 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.046 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:34.114 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:34.114 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:34.114 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124931 s, 83.9 MB/s 2023-11-26T07:19:34.116 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:34.116 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.172 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:34.252 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:34.252 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:34.252 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155353 s, 67.5 MB/s 2023-11-26T07:19:34.253 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:34.254 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.304 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:34.377 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:34.377 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:34.377 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140196 s, 74.8 MB/s 2023-11-26T07:19:34.379 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:34.379 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.432 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:34.505 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:34.505 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:34.506 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138357 s, 75.8 MB/s 2023-11-26T07:19:34.507 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:34.507 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.562 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:34.636 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:34.636 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:34.636 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171991 s, 61.0 MB/s 2023-11-26T07:19:34.637 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:34.637 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.689 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:34.764 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:34.764 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:34.764 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174862 s, 60.0 MB/s 2023-11-26T07:19:34.765 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:34.765 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.820 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:34.894 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:34.895 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:34.895 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017376 s, 60.3 MB/s 2023-11-26T07:19:34.896 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:34.896 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:34.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:34.947 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.019 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.019 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.019 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144101 s, 72.8 MB/s 2023-11-26T07:19:35.020 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.020 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.071 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.143 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142809 s, 73.4 MB/s 2023-11-26T07:19:35.144 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.144 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.196 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.269 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151817 s, 69.1 MB/s 2023-11-26T07:19:35.270 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.270 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.320 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.390 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.390 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.390 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137402 s, 76.3 MB/s 2023-11-26T07:19:35.391 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.391 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.443 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.516 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.516 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.516 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148029 s, 70.8 MB/s 2023-11-26T07:19:35.517 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.517 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.567 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167845 s, 62.5 MB/s 2023-11-26T07:19:35.646 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.646 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.695 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.768 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.768 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.768 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156946 s, 66.8 MB/s 2023-11-26T07:19:35.769 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.769 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.824 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:35.894 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:35.894 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:35.894 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128736 s, 81.5 MB/s 2023-11-26T07:19:35.895 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:35.895 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:35.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:35.948 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.023 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175002 s, 59.9 MB/s 2023-11-26T07:19:36.024 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.024 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.076 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.149 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.149 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.149 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159974 s, 65.5 MB/s 2023-11-26T07:19:36.150 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.150 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.200 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140074 s, 74.9 MB/s 2023-11-26T07:19:36.277 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.277 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.327 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.401 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.401 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.401 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140518 s, 74.6 MB/s 2023-11-26T07:19:36.402 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.402 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.451 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.523 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.523 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.523 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137998 s, 76.0 MB/s 2023-11-26T07:19:36.524 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.524 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.575 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.649 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.649 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.649 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164941 s, 63.6 MB/s 2023-11-26T07:19:36.650 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.650 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.704 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.775 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.775 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.775 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140936 s, 74.4 MB/s 2023-11-26T07:19:36.776 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.776 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.828 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:36.899 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:36.899 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:36.899 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143172 s, 73.2 MB/s 2023-11-26T07:19:36.900 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:36.900 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:36.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:36.952 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.026 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016072 s, 65.2 MB/s 2023-11-26T07:19:37.027 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.027 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.080 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.155 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.155 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.155 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180328 s, 58.1 MB/s 2023-11-26T07:19:37.156 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.156 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.207 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.280 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.280 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.280 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149814 s, 70.0 MB/s 2023-11-26T07:19:37.281 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.282 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.331 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.404 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.404 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.404 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151261 s, 69.3 MB/s 2023-11-26T07:19:37.405 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.405 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.460 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.534 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.535 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.535 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137002 s, 76.5 MB/s 2023-11-26T07:19:37.536 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.536 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.587 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.663 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.664 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.664 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150367 s, 69.7 MB/s 2023-11-26T07:19:37.665 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.665 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.715 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.793 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.793 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.793 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164022 s, 63.9 MB/s 2023-11-26T07:19:37.794 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.794 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.843 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:37.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:37.917 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:37.917 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158705 s, 66.1 MB/s 2023-11-26T07:19:37.918 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:37.918 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:37.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:37.968 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.040 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.041 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.041 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160417 s, 65.4 MB/s 2023-11-26T07:19:38.042 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.042 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.092 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147699 s, 71.0 MB/s 2023-11-26T07:19:38.167 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.167 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.216 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.291 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150026 s, 69.9 MB/s 2023-11-26T07:19:38.292 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.292 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.343 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.418 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.418 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.418 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125892 s, 83.3 MB/s 2023-11-26T07:19:38.419 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.419 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.476 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.549 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.549 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.549 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162437 s, 64.6 MB/s 2023-11-26T07:19:38.550 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.550 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.599 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182899 s, 57.3 MB/s 2023-11-26T07:19:38.676 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.676 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.727 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.800 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.800 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.800 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155168 s, 67.6 MB/s 2023-11-26T07:19:38.801 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.801 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.856 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:38.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:38.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:38.927 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141227 s, 74.2 MB/s 2023-11-26T07:19:38.928 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:38.928 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:38.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:38.979 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.057 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.057 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.057 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158423 s, 66.2 MB/s 2023-11-26T07:19:39.058 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.058 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.108 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149743 s, 70.0 MB/s 2023-11-26T07:19:39.182 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.182 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.236 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.306 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.306 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.306 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132685 s, 79.0 MB/s 2023-11-26T07:19:39.307 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.307 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.364 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158108 s, 66.3 MB/s 2023-11-26T07:19:39.437 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.437 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.487 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.562 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.562 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.563 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171135 s, 61.3 MB/s 2023-11-26T07:19:39.563 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.564 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.616 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.691 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.691 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.692 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145892 s, 71.9 MB/s 2023-11-26T07:19:39.692 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.692 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.744 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.817 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.817 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.817 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162853 s, 64.4 MB/s 2023-11-26T07:19:39.818 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.818 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.867 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:39.938 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:39.938 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:39.938 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135699 s, 77.3 MB/s 2023-11-26T07:19:39.939 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:39.939 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:39.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:39.991 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.068 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148629 s, 70.5 MB/s 2023-11-26T07:19:40.069 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.069 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:40.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:40.119 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.196 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.196 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.197 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146812 s, 71.4 MB/s 2023-11-26T07:19:40.197 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.198 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:40.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:40.248 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.319 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.319 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.319 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013444 s, 78.0 MB/s 2023-11-26T07:19:40.320 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.320 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:40.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:40.371 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.445 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.446 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.446 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168261 s, 62.3 MB/s 2023-11-26T07:19:40.447 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.447 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:40.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:40.499 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.574 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.574 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.575 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134461 s, 78.0 MB/s 2023-11-26T07:19:40.576 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.576 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:40.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:40.628 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154862 s, 67.7 MB/s 2023-11-26T07:19:40.705 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.706 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:40.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:40.756 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.828 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.828 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151748 s, 69.1 MB/s 2023-11-26T07:19:40.829 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.830 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:40.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:40.881 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:40.950 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:40.950 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:40.950 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133346 s, 78.6 MB/s 2023-11-26T07:19:40.951 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:40.951 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.008 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.081 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.081 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.081 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159412 s, 65.8 MB/s 2023-11-26T07:19:41.082 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.082 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.136 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.208 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.209 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.209 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149816 s, 70.0 MB/s 2023-11-26T07:19:41.210 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.210 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.260 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.335 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.335 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.335 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146019 s, 71.8 MB/s 2023-11-26T07:19:41.336 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.336 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.388 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162131 s, 64.7 MB/s 2023-11-26T07:19:41.461 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.461 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.512 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.584 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.585 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.585 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156067 s, 67.2 MB/s 2023-11-26T07:19:41.586 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.586 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.640 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.711 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.711 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.712 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147173 s, 71.2 MB/s 2023-11-26T07:19:41.712 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.713 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.764 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.836 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.836 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.836 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015216 s, 68.9 MB/s 2023-11-26T07:19:41.837 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.837 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:41.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:41.888 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:41.959 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138903 s, 75.5 MB/s 2023-11-26T07:19:41.960 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:41.960 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.016 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.089 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.089 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148624 s, 70.6 MB/s 2023-11-26T07:19:42.090 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.090 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.140 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169264 s, 61.9 MB/s 2023-11-26T07:19:42.215 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.215 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.268 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.343 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.344 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.344 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145816 s, 71.9 MB/s 2023-11-26T07:19:42.345 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.345 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.395 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.466 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.466 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.466 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013536 s, 77.5 MB/s 2023-11-26T07:19:42.467 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.467 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.519 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.596 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.597 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.597 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155772 s, 67.3 MB/s 2023-11-26T07:19:42.598 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.598 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.651 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.729 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159261 s, 65.8 MB/s 2023-11-26T07:19:42.730 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.730 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.780 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140702 s, 74.5 MB/s 2023-11-26T07:19:42.852 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.852 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:42.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:42.903 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:42.973 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:42.973 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:42.973 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125137 s, 83.8 MB/s 2023-11-26T07:19:42.974 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:42.975 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.024 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.097 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.097 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.097 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162367 s, 64.6 MB/s 2023-11-26T07:19:43.098 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.098 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.152 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.224 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.224 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.225 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145983 s, 71.8 MB/s 2023-11-26T07:19:43.226 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.226 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.276 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.351 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.352 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.352 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142202 s, 73.7 MB/s 2023-11-26T07:19:43.353 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.353 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.403 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.475 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.475 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.475 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143933 s, 72.9 MB/s 2023-11-26T07:19:43.476 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.477 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.527 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.601 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.601 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.601 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158124 s, 66.3 MB/s 2023-11-26T07:19:43.602 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.602 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.652 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.727 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.728 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.728 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147992 s, 70.9 MB/s 2023-11-26T07:19:43.729 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.729 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.779 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.852 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.852 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.852 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149178 s, 70.3 MB/s 2023-11-26T07:19:43.853 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.853 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:43.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:43.908 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149067 s, 70.3 MB/s 2023-11-26T07:19:43.981 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:43.981 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.036 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:44.107 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:44.108 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:44.108 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144052 s, 72.8 MB/s 2023-11-26T07:19:44.109 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:44.109 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.160 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:44.240 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:44.240 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:44.241 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179173 s, 58.5 MB/s 2023-11-26T07:19:44.241 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:44.242 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.296 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177693 s, 59.0 MB/s 2023-11-26T07:19:44.378 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:44.378 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.428 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:44.505 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:44.505 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:44.505 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150245 s, 69.8 MB/s 2023-11-26T07:19:44.506 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:44.506 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.556 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:44.634 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:44.635 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:44.635 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163409 s, 64.2 MB/s 2023-11-26T07:19:44.636 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:44.636 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.688 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154273 s, 68.0 MB/s 2023-11-26T07:19:44.762 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:44.762 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.812 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:44.887 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:44.888 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:44.888 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143614 s, 73.0 MB/s 2023-11-26T07:19:44.889 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:44.889 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:44.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:44.944 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.019 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.019 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.019 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175917 s, 59.6 MB/s 2023-11-26T07:19:45.020 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.020 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.072 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.150 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.151 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.151 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167891 s, 62.5 MB/s 2023-11-26T07:19:45.152 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.152 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.204 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.276 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.276 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.276 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144183 s, 72.7 MB/s 2023-11-26T07:19:45.278 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.278 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.329 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.400 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.401 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.401 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144845 s, 72.4 MB/s 2023-11-26T07:19:45.402 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.402 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.457 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.531 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.532 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144724 s, 72.5 MB/s 2023-11-26T07:19:45.533 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.533 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.586 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.658 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.659 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.659 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166862 s, 62.8 MB/s 2023-11-26T07:19:45.661 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.661 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.713 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.786 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.786 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.786 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161528 s, 64.9 MB/s 2023-11-26T07:19:45.788 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.788 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.841 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:45.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:45.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:45.917 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157192 s, 66.7 MB/s 2023-11-26T07:19:45.917 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:45.918 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:45.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:45.968 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.041 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.041 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.041 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157641 s, 66.5 MB/s 2023-11-26T07:19:46.042 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:46.042 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:46.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.091 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.166 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.166 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.167 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169274 s, 61.9 MB/s 2023-11-26T07:19:46.167 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:46.168 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:46.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.223 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143793 s, 72.9 MB/s 2023-11-26T07:19:46.301 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:46.301 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:46.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.357 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.425 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.425 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.425 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135137 s, 77.6 MB/s 2023-11-26T07:19:46.426 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:46.426 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:46.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.476 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.547 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.548 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.548 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146175 s, 71.7 MB/s 2023-11-26T07:19:46.548 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:46.549 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:46.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.604 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.675 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.675 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.675 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013876 s, 75.6 MB/s 2023-11-26T07:19:46.676 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:46.676 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:46.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.731 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152916 s, 68.6 MB/s 2023-11-26T07:19:46.805 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:19:46.805 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:19:46.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:46.856 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol33110/5e68a94f-6701-4225-b3db-572f149c7f96/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:19:46.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:19:46.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:19:46.927 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143021 s, 73.3 MB/s 2023-11-26T07:19:46.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol33110 subvol_snap86710 2023-11-26T07:19:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 Processor -- start 2023-11-26T07:19:47.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 -- start start 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1bd413e290 0x7f1bd40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1bd40cf7c0 0x7f1bd415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd415f4e0 0x7f1bd41408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40cfc40 con 0x7f1bd413e290 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406c520 con 0x7f1bd40cf7c0 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bdbb8d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd406c800 con 0x7f1bd415f4e0 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1bd413e290 0x7f1bd40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1bd413e290 0x7f1bd40cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36914/0 (socket says 172.21.15.70:36914) 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 -- 172.21.15.70:0/2575949717 learned_addr learned my addr 172.21.15.70:0/2575949717 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 -- 172.21.15.70:0/2575949717 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd415f4e0 msgr2=0x7f1bd41408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 --2- 172.21.15.70:0/2575949717 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd415f4e0 0x7f1bd41408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 -- 172.21.15.70:0/2575949717 >> v2:172.21.15.120:3300/0 conn(0x7f1bd40cf7c0 msgr2=0x7f1bd415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9128640 1 --2- 172.21.15.70:0/2575949717 >> v2:172.21.15.120:3300/0 conn(0x7f1bd40cf7c0 0x7f1bd415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 --2- 172.21.15.70:0/2575949717 >> v2:172.21.15.120:3300/0 conn(0x7f1bd40cf7c0 0x7f1bd415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9929640 1 -- 172.21.15.70:0/2575949717 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd406cae0 con 0x7f1bd413e290 2023-11-26T07:19:47.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.108+0000 7f1bd9128640 1 --2- 172.21.15.70:0/2575949717 >> v2:172.21.15.120:3300/0 conn(0x7f1bd40cf7c0 0x7f1bd415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:47.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bd9929640 1 --2- 172.21.15.70:0/2575949717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd40cf280 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40cfe40 tx=0x7f1bd001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1056cee724f8562f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bd8927640 1 -- 172.21.15.70:0/2575949717 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00ab600 con 0x7f1bd413e290 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bd8927640 1 -- 172.21.15.70:0/2575949717 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00a7050 con 0x7f1bd413e290 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bd8927640 1 -- 172.21.15.70:0/2575949717 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00ab980 con 0x7f1bd413e290 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/2575949717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 msgr2=0x7f1bd40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/2575949717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd40cf280 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40cfe40 tx=0x7f1bd001c210 comp rx=0 tx=0).stop 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/2575949717 shutdown_connections 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/2575949717 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd415f4e0 0x7f1bd41408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/2575949717 >> v2:172.21.15.120:3300/0 conn(0x7f1bd40cf7c0 0x7f1bd415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/2575949717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd40cf280 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/2575949717 >> 172.21.15.70:0/2575949717 conn(0x7f1bd406a890 msgr2=0x7f1bd406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/2575949717 shutdown_connections 2023-11-26T07:19:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.112+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/2575949717 wait complete. 2023-11-26T07:19:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 Processor -- start 2023-11-26T07:19:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 -- start start 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd40cf7c0 0x7f1bd415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd4137800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd415f4e0 0x7f1bd415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40b21b0 con 0x7f1bd413e290 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd413ff40 con 0x7f1bd415f4e0 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41401e0 con 0x7f1bd40cf7c0 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd4137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd4137800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36926/0 (socket says 172.21.15.70:36926) 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 -- 172.21.15.70:0/4083822025 learned_addr learned my addr 172.21.15.70:0/4083822025 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bda12a640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd415f4e0 0x7f1bd415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9929640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd40cf7c0 0x7f1bd415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 -- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd40cf7c0 msgr2=0x7f1bd415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd40cf7c0 0x7f1bd415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 -- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd415f4e0 msgr2=0x7f1bd415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd415f4e0 0x7f1bd415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 -- 172.21.15.70:0/4083822025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00094d0 con 0x7f1bd413e290 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bd9128640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd4137800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c7c0 tx=0x7f1bc400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bca7fc640 1 -- 172.21.15.70:0/4083822025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4007a30 con 0x7f1bd413e290 2023-11-26T07:19:47.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bca7fc640 1 -- 172.21.15.70:0/4083822025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4007b90 con 0x7f1bd413e290 2023-11-26T07:19:47.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bca7fc640 1 -- 172.21.15.70:0/4083822025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400ce70 con 0x7f1bd413e290 2023-11-26T07:19:47.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd41404c0 con 0x7f1bd413e290 2023-11-26T07:19:47.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.116+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd4140a80 con 0x7f1bd413e290 2023-11-26T07:19:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.120+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4067680 con 0x7f1bd413e290 2023-11-26T07:19:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.120+0000 7f1bca7fc640 1 -- 172.21.15.70:0/4083822025 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f1bc40113f0 con 0x7f1bd413e290 2023-11-26T07:19:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.120+0000 7f1bca7fc640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1bb8066500 0x7f1bb80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.120+0000 7f1bca7fc640 1 -- 172.21.15.70:0/4083822025 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bc4084470 con 0x7f1bd413e290 2023-11-26T07:19:47.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.120+0000 7f1bd9929640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1bb8066500 0x7f1bb80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.120+0000 7f1bd9929640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1bb8066500 0x7f1bb80689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ad000 tx=0x7f1bd00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.124+0000 7f1bca7fc640 1 -- 172.21.15.70:0/4083822025 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1bc4051830 con 0x7f1bd413e290 2023-11-26T07:19:47.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.300+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol33110", "snap_name": "subvol_snap86710", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bd406df50 con 0x7f1bb8066500 2023-11-26T07:19:47.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bca7fc640 1 -- 172.21.15.70:0/4083822025 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1bd406df50 con 0x7f1bb8066500 2023-11-26T07:19:47.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1bb8066500 msgr2=0x7f1bb80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1bb8066500 0x7f1bb80689c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ad000 tx=0x7f1bd00a6000 comp rx=0 tx=0).stop 2023-11-26T07:19:47.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 msgr2=0x7f1bd4137800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd4137800 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c7c0 tx=0x7f1bc400cc80 comp rx=0 tx=0).stop 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 shutdown_connections 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1bb8066500 0x7f1bb80689c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd413e290 0x7f1bd4137800 secure :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c7c0 tx=0x7f1bc400cc80 comp rx=0 tx=0).stop 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd415f4e0 0x7f1bd415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 --2- 172.21.15.70:0/4083822025 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1bd40cf7c0 0x7f1bd415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.316+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 >> 172.21.15.70:0/4083822025 conn(0x7f1bd406a890 msgr2=0x7f1bd40aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.320+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 shutdown_connections 2023-11-26T07:19:47.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.320+0000 7f1bdbb8d640 1 -- 172.21.15.70:0/4083822025 wait complete. 2023-11-26T07:19:47.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:19:47.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.480+0000 7f4e6c9ec640 1 Processor -- start 2023-11-26T07:19:47.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6c9ec640 1 -- start start 2023-11-26T07:19:47.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6c9ec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 0x7f4e6815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6c9ec640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6806c520 con 0x7f4e680cf990 2023-11-26T07:19:47.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6c9ec640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6806c800 con 0x7f4e6813e290 2023-11-26T07:19:47.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6c9ec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6806cae0 con 0x7f4e680ce7c0 2023-11-26T07:19:47.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e5dd9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4e680cf990 0x7f4e6815efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50638/0 (socket says 172.21.15.70:50638) 2023-11-26T07:19:47.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e5dd9b640 1 -- 172.21.15.70:0/1323388519 learned_addr learned my addr 172.21.15.70:0/1323388519 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:47.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e66d9d640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 0x7f4e6815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588109032 0 0) 0x7f4e6806c520 con 0x7f4e680cf990 2023-11-26T07:19:47.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e54003530 con 0x7f4e680cf990 2023-11-26T07:19:47.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1511147017 0 0) 0x7f4e54003530 con 0x7f4e680cf990 2023-11-26T07:19:47.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 msgr2=0x7f4e6815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:47.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 0x7f4e6815f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 >> v1:172.21.15.120:6789/0 conn(0x7f4e6813e290 legacy=0x7f4e680cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6806cdc0 con 0x7f4e680cf990 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f4e50001680 con 0x7f4e680cf990 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 >> v1:172.21.15.70:6789/0 conn(0x7f4e680cf990 legacy=0x7f4e6815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e540039b0 0x7f4e54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 0x7f4e540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e54004d10 0x7f4e54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6806cae0 con 0x7f4e540039b0 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5400b990 con 0x7f4e54004d10 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5400bb50 con 0x7f4e680ce7c0 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6659c640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e540039b0 0x7f4e54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e66d9d640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e54004d10 0x7f4e54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e5dd9b640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 0x7f4e540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6659c640 1 -- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 msgr2=0x7f4e540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:47.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6659c640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e680ce7c0 0x7f4e540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6659c640 1 -- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e54004d10 msgr2=0x7f4e54005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:47.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6659c640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e54004d10 0x7f4e54005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.484+0000 7f4e6659c640 1 -- 172.21.15.70:0/1323388519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54003530 con 0x7f4e540039b0 2023-11-26T07:19:47.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e6659c640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e540039b0 0x7f4e54003d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001f60 tx=0x7f4e5801c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b36a753356e3155 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580a9680 con 0x7f4e540039b0 2023-11-26T07:19:47.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e580a97e0 con 0x7f4e540039b0 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e65d9b640 1 -- 172.21.15.70:0/1323388519 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580a9b90 con 0x7f4e540039b0 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1323388519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e540039b0 msgr2=0x7f4e54003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e6c9ec640 1 --2- 172.21.15.70:0/1323388519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e540039b0 0x7f4e54003d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001f60 tx=0x7f4e5801c790 comp rx=0 tx=0).stop 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e66d9d640 1 -- 172.21.15.70:0/1323388519 reap_dead start 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1323388519 shutdown_connections 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1323388519 >> 172.21.15.70:0/1323388519 conn(0x7f4e6806a890 msgr2=0x7f4e6806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1323388519 shutdown_connections 2023-11-26T07:19:47.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.488+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1323388519 wait complete. 2023-11-26T07:19:47.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 Processor -- start 2023-11-26T07:19:47.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 -- start start 2023-11-26T07:19:47.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e540039b0 0x7f4e68162b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e681383c0 0x7f4e68163070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e681538a0 0x7f4e68153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6815ff30 con 0x7f4e681538a0 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68151600 con 0x7f4e681383c0 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68151bc0 con 0x7f4e540039b0 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e66d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e681538a0 0x7f4e68153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6659c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e540039b0 0x7f4e68162b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6659c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e540039b0 0x7f4e68162b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:37734/0 (socket says 172.21.15.70:37734) 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e5dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e681383c0 0x7f4e68163070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6659c640 1 -- 172.21.15.70:0/1668578069 learned_addr learned my addr 172.21.15.70:0/1668578069 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:47.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e66d9d640 1 -- 172.21.15.70:0/1668578069 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e540039b0 msgr2=0x7f4e68162b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e66d9d640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e540039b0 0x7f4e68162b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e66d9d640 1 -- 172.21.15.70:0/1668578069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e681383c0 msgr2=0x7f4e68163070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e66d9d640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e681383c0 0x7f4e68163070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e66d9d640 1 -- 172.21.15.70:0/1668578069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68160180 con 0x7f4e681538a0 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e5dd9b640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e681383c0 0x7f4e68163070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e66d9d640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e681538a0 0x7f4e68153d20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4e680cfec0 tx=0x7f4e60011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e5f7fe640 1 -- 172.21.15.70:0/1668578069 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011ee0 con 0x7f4e681538a0 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e5f7fe640 1 -- 172.21.15.70:0/1668578069 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60004240 con 0x7f4e681538a0 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e68160460 con 0x7f4e681538a0 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e5f7fe640 1 -- 172.21.15.70:0/1668578069 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000f770 con 0x7f4e681538a0 2023-11-26T07:19:47.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.492+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e68154260 con 0x7f4e681538a0 2023-11-26T07:19:47.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.496+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e68067680 con 0x7f4e681538a0 2023-11-26T07:19:47.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.496+0000 7f4e5f7fe640 1 -- 172.21.15.70:0/1668578069 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f4e6000f8d0 con 0x7f4e681538a0 2023-11-26T07:19:47.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.496+0000 7f4e5f7fe640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4e48066530 0x7f4e480689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.496+0000 7f4e5f7fe640 1 -- 172.21.15.70:0/1668578069 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e60083de0 con 0x7f4e681538a0 2023-11-26T07:19:47.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.496+0000 7f4e6659c640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4e48066530 0x7f4e480689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.496+0000 7f4e6659c640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4e48066530 0x7f4e480689f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e5801c7d0 tx=0x7f4e580b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.500+0000 7f4e5f7fe640 1 -- 172.21.15.70:0/1668578069 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e60051200 con 0x7f4e681538a0 2023-11-26T07:19:47.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.652+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f4e6806df50 con 0x7f4e681538a0 2023-11-26T07:19:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e5f7fe640 1 -- 172.21.15.70:0/1668578069 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v11)=0 v11) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4e60054820 con 0x7f4e681538a0 2023-11-26T07:19:47.662 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4e48066530 msgr2=0x7f4e480689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.662 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4e48066530 0x7f4e480689f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e5801c7d0 tx=0x7f4e580b3040 comp rx=0 tx=0).stop 2023-11-26T07:19:47.662 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e681538a0 msgr2=0x7f4e68153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.662 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e681538a0 0x7f4e68153d20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4e680cfec0 tx=0x7f4e60011c30 comp rx=0 tx=0).stop 2023-11-26T07:19:47.662 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 shutdown_connections 2023-11-26T07:19:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4e48066530 0x7f4e480689f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e681538a0 0x7f4e68153d20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e681383c0 0x7f4e68163070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 --2- 172.21.15.70:0/1668578069 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4e540039b0 0x7f4e68162b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 >> 172.21.15.70:0/1668578069 conn(0x7f4e6806a890 msgr2=0x7f4e680b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 shutdown_connections 2023-11-26T07:19:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.656+0000 7f4e6c9ec640 1 -- 172.21.15.70:0/1668578069 wait complete. 2023-11-26T07:19:47.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol33110 subvol_snap86710 subvol_clone82360 2023-11-26T07:19:47.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476985640 1 Processor -- start 2023-11-26T07:19:47.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476985640 1 -- start start 2023-11-26T07:19:47.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476985640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8470144720 0x7f847006d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476985640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847006e3f0 con 0x7f8470071bf0 2023-11-26T07:19:47.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476985640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700722f0 con 0x7f847006d840 2023-11-26T07:19:47.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476985640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847006de30 con 0x7f8470144720 2023-11-26T07:19:47.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8475983640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8470144720 0x7f847006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476184640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8470071bf0 0x7f847015bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50648/0 (socket says 172.21.15.70:50648) 2023-11-26T07:19:47.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.820+0000 7f8476184640 1 -- 172.21.15.70:0/3581740279 learned_addr learned my addr 172.21.15.70:0/3581740279 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:47.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8475983640 1 -- 172.21.15.70:0/3581740279 >> v1:172.21.15.120:6789/0 conn(0x7f847006d840 legacy=0x7f84700714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8475983640 1 -- 172.21.15.70:0/3581740279 >> v1:172.21.15.70:6789/0 conn(0x7f8470071bf0 legacy=0x7f847015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8475983640 1 -- 172.21.15.70:0/3581740279 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847006e110 con 0x7f8470144720 2023-11-26T07:19:47.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8475983640 1 --2- 172.21.15.70:0/3581740279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470144720 0x7f847006d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f846c0097c0 tx=0x7f846c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582c70adba82fd57 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8474981640 1 -- 172.21.15.70:0/3581740279 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0ad660 con 0x7f8470144720 2023-11-26T07:19:47.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8474981640 1 -- 172.21.15.70:0/3581740279 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c0ad7c0 con 0x7f8470144720 2023-11-26T07:19:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8474981640 1 -- 172.21.15.70:0/3581740279 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0adb50 con 0x7f8470144720 2023-11-26T07:19:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8476985640 1 -- 172.21.15.70:0/3581740279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470144720 msgr2=0x7f847006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8476985640 1 --2- 172.21.15.70:0/3581740279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470144720 0x7f847006d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f846c0097c0 tx=0x7f846c01c450 comp rx=0 tx=0).stop 2023-11-26T07:19:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8476985640 1 -- 172.21.15.70:0/3581740279 shutdown_connections 2023-11-26T07:19:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8476985640 1 --2- 172.21.15.70:0/3581740279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470144720 0x7f847006d300 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.824+0000 7f8476985640 1 -- 172.21.15.70:0/3581740279 >> 172.21.15.70:0/3581740279 conn(0x7f847006a890 msgr2=0x7f847006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 -- 172.21.15.70:0/3581740279 shutdown_connections 2023-11-26T07:19:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 -- 172.21.15.70:0/3581740279 wait complete. 2023-11-26T07:19:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 Processor -- start 2023-11-26T07:19:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 -- start start 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f847006d840 0x7f847015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8470071bf0 0x7f84700b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8470144720 0x7f84700cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847015adc0 con 0x7f847006d840 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847015b120 con 0x7f8470144720 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476985640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84700b3170 con 0x7f8470071bf0 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f847006d840 0x7f847015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f847006d840 0x7f847015a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36960/0 (socket says 172.21.15.70:36960) 2023-11-26T07:19:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 -- 172.21.15.70:0/2528695023 learned_addr learned my addr 172.21.15.70:0/2528695023 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8476184640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8470144720 0x7f84700cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475182640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8470071bf0 0x7f84700b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 -- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8470071bf0 msgr2=0x7f84700b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8470071bf0 0x7f84700b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 -- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8470144720 msgr2=0x7f84700cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8470144720 0x7f84700cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 -- 172.21.15.70:0/2528695023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c009420 con 0x7f847006d840 2023-11-26T07:19:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.828+0000 7f8475983640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f847006d840 0x7f847015a880 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f846c0b0040 tx=0x7f846c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f84667fc640 1 -- 172.21.15.70:0/2528695023 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0b9860 con 0x7f847006d840 2023-11-26T07:19:47.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f84667fc640 1 -- 172.21.15.70:0/2528695023 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c0b99e0 con 0x7f847006d840 2023-11-26T07:19:47.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f84667fc640 1 -- 172.21.15.70:0/2528695023 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0b9d90 con 0x7f847006d840 2023-11-26T07:19:47.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84701408c0 con 0x7f847006d840 2023-11-26T07:19:47.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470140e40 con 0x7f847006d840 2023-11-26T07:19:47.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847013a9d0 con 0x7f847006d840 2023-11-26T07:19:47.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f84667fc640 1 -- 172.21.15.70:0/2528695023 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7f846c0b7400 con 0x7f847006d840 2023-11-26T07:19:47.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f84667fc640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8454066500 0x7f84540689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:47.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f84667fc640 1 -- 172.21.15.70:0/2528695023 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f846c11eb50 con 0x7f847006d840 2023-11-26T07:19:47.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f8475182640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8454066500 0x7f84540689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:47.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.832+0000 7f8475182640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8454066500 0x7f84540689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f84700cca00 tx=0x7f8460009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:47.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:47.836+0000 7f84667fc640 1 -- 172.21.15.70:0/2528695023 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f847013a9d0 con 0x7f847006d840 2023-11-26T07:19:48.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.016+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol33110", "snap_name": "subvol_snap86710", "target_sub_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7f847013a9d0 con 0x7f8454066500 2023-11-26T07:19:48.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.068+0000 7f84667fc640 1 -- 172.21.15.70:0/2528695023 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f847013a9d0 con 0x7f8454066500 2023-11-26T07:19:48.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8454066500 msgr2=0x7f84540689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8454066500 0x7f84540689c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f84700cca00 tx=0x7f8460009040 comp rx=0 tx=0).stop 2023-11-26T07:19:48.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f847006d840 msgr2=0x7f847015a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f847006d840 0x7f847015a880 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f846c0b0040 tx=0x7f846c01ac90 comp rx=0 tx=0).stop 2023-11-26T07:19:48.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 shutdown_connections 2023-11-26T07:19:48.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8470144720 0x7f84700cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8470071bf0 0x7f84700b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8454066500 0x7f84540689c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 --2- 172.21.15.70:0/2528695023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f847006d840 0x7f847015a880 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 >> 172.21.15.70:0/2528695023 conn(0x7f847006a890 msgr2=0x7f847013ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:48.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 shutdown_connections 2023-11-26T07:19:48.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.072+0000 7f8476985640 1 -- 172.21.15.70:0/2528695023 wait complete. 2023-11-26T07:19:48.079 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.076+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.080 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.076+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.080 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.076+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.080 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.076+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.080 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.076+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.096 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.092+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.096 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.092+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.096 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.092+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.096 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.092+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.096 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:19:48.092+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:19:48.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:19:48.100 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir ./volumes/_nogroup/subvol33110/.snap/subvol_snap86710) 2023-11-26T07:19:48.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82360 2023-11-26T07:19:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.312+0000 7fa917a91640 1 Processor -- start 2023-11-26T07:19:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.312+0000 7fa917a91640 1 -- start start 2023-11-26T07:19:48.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa917a91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9100ce680 0x7fa910071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa917a91640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91006c750 con 0x7fa9101596d0 2023-11-26T07:19:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa917a91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9100b3550 con 0x7fa9100b2f80 2023-11-26T07:19:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa917a91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9100cbe00 con 0x7fa9100ce680 2023-11-26T07:19:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91582d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa9101596d0 0x7fa9100b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50650/0 (socket says 172.21.15.70:50650) 2023-11-26T07:19:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91582d640 1 -- 172.21.15.70:0/4051151572 learned_addr learned my addr 172.21.15.70:0/4051151572 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91602e640 1 --2- 172.21.15.70:0/4051151572 >> v2:172.21.15.120:3300/0 conn(0x7fa9100ce680 0x7fa910071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:48.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91482b640 1 -- 172.21.15.70:0/4051151572 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359898660 0 0) 0x7fa91006c750 con 0x7fa9101596d0 2023-11-26T07:19:48.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91482b640 1 -- 172.21.15.70:0/4051151572 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8fc003450 con 0x7fa9101596d0 2023-11-26T07:19:48.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91602e640 1 -- 172.21.15.70:0/4051151572 >> v1:172.21.15.120:6789/0 conn(0x7fa9100b2f80 legacy=0x7fa91006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91602e640 1 -- 172.21.15.70:0/4051151572 >> v1:172.21.15.70:6789/0 conn(0x7fa9101596d0 legacy=0x7fa9100b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.316+0000 7fa91602e640 1 -- 172.21.15.70:0/4051151572 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910071e80 con 0x7fa9100ce680 2023-11-26T07:19:48.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa91602e640 1 --2- 172.21.15.70:0/4051151572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100ce680 0x7fa910071850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa9100cbf40 tx=0x7fa90801c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8d892cb81d770a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:48.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa91482b640 1 -- 172.21.15.70:0/4051151572 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9080a57d0 con 0x7fa9100ce680 2023-11-26T07:19:48.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa91482b640 1 -- 172.21.15.70:0/4051151572 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9080a5930 con 0x7fa9100ce680 2023-11-26T07:19:48.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa91482b640 1 -- 172.21.15.70:0/4051151572 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9080a5ca0 con 0x7fa9100ce680 2023-11-26T07:19:48.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 -- 172.21.15.70:0/4051151572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100ce680 msgr2=0x7fa910071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 --2- 172.21.15.70:0/4051151572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100ce680 0x7fa910071850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa9100cbf40 tx=0x7fa90801c8a0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 -- 172.21.15.70:0/4051151572 shutdown_connections 2023-11-26T07:19:48.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 --2- 172.21.15.70:0/4051151572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100ce680 0x7fa910071850 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 -- 172.21.15.70:0/4051151572 >> 172.21.15.70:0/4051151572 conn(0x7fa91006a890 msgr2=0x7fa91006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:48.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 -- 172.21.15.70:0/4051151572 shutdown_connections 2023-11-26T07:19:48.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 -- 172.21.15.70:0/4051151572 wait complete. 2023-11-26T07:19:48.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 Processor -- start 2023-11-26T07:19:48.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.320+0000 7fa917a91640 1 -- start start 2023-11-26T07:19:48.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100b2f80 0x7fa910142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:48.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9100ce680 0x7fa91015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:48.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9101596d0 0x7fa91015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:48.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910145e40 con 0x7fa9100ce680 2023-11-26T07:19:48.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910145b60 con 0x7fa9100b2f80 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91015bfb0 con 0x7fa9101596d0 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9100ce680 0x7fa91015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9100ce680 0x7fa91015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37008/0 (socket says 172.21.15.70:37008) 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 -- 172.21.15.70:0/571063428 learned_addr learned my addr 172.21.15.70:0/571063428 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 -- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9101596d0 msgr2=0x7fa91015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91602e640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9101596d0 0x7fa91015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91582d640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100b2f80 0x7fa910142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9101596d0 0x7fa91015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 -- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100b2f80 msgr2=0x7fa910142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100b2f80 0x7fa910142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 -- 172.21.15.70:0/571063428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908009a70 con 0x7fa9100ce680 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91602e640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9101596d0 0x7fa91015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91582d640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100b2f80 0x7fa910142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa91502c640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9100ce680 0x7fa91015a210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c420 tx=0x7fa90000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa9067fc640 1 -- 172.21.15.70:0/571063428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000052d0 con 0x7fa9100ce680 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa9067fc640 1 -- 172.21.15.70:0/571063428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900005430 con 0x7fa9100ce680 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa9067fc640 1 -- 172.21.15.70:0/571063428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900007260 con 0x7fa9100ce680 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91015c290 con 0x7fa9100ce680 2023-11-26T07:19:48.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91015ca90 con 0x7fa9100ce680 2023-11-26T07:19:48.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa910067680 con 0x7fa9100ce680 2023-11-26T07:19:48.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.324+0000 7fa9067fc640 1 -- 172.21.15.70:0/571063428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fa9000073c0 con 0x7fa9100ce680 2023-11-26T07:19:48.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.328+0000 7fa9067fc640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa8f4066500 0x7fa8f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:48.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.328+0000 7fa9067fc640 1 -- 172.21.15.70:0/571063428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa900083320 con 0x7fa9100ce680 2023-11-26T07:19:48.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.328+0000 7fa91582d640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa8f4066500 0x7fa8f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:48.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.328+0000 7fa91582d640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa8f4066500 0x7fa8f40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0011f0 tx=0x7fa90c007a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:48.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.332+0000 7fa9067fc640 1 -- 172.21.15.70:0/571063428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa900050740 con 0x7fa9100ce680 2023-11-26T07:19:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.512+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9100b1ef0 con 0x7fa8f4066500 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.516+0000 7fa9067fc640 1 -- 172.21.15.70:0/571063428 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fa9100b1ef0 con 0x7fa8f4066500 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol33110", 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap86710" 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:48.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:48.523 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa8f4066500 msgr2=0x7fa8f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa8f4066500 0x7fa8f40689c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0011f0 tx=0x7fa90c007a90 comp rx=0 tx=0).stop 2023-11-26T07:19:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9100ce680 msgr2=0x7fa91015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9100ce680 0x7fa91015a210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c420 tx=0x7fa90000c8e0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 shutdown_connections 2023-11-26T07:19:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa8f4066500 0x7fa8f40689c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9100ce680 0x7fa91015a210 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9101596d0 0x7fa91015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 --2- 172.21.15.70:0/571063428 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9100b2f80 0x7fa910142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 >> 172.21.15.70:0/571063428 conn(0x7fa91006a890 msgr2=0x7fa91015cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 shutdown_connections 2023-11-26T07:19:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:48.520+0000 7fa917a91640 1 -- 172.21.15.70:0/571063428 wait complete. 2023-11-26T07:19:49.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82360 2023-11-26T07:19:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.680+0000 7fcbc0a9c640 1 Processor -- start 2023-11-26T07:19:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.680+0000 7fcbc0a9c640 1 -- start start 2023-11-26T07:19:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.680+0000 7fcbc0a9c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcbbc143ac0 0x7fcbbc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.680+0000 7fcbc0a9c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc0cc730 con 0x7fcbbc0cf990 2023-11-26T07:19:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbc0a9c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc070ee0 con 0x7fcbbc0708b0 2023-11-26T07:19:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbc0a9c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc143ea0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbba59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcbbc143ac0 0x7fcbbc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbbad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcbbc0cf990 0x7fcbbc0cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50658/0 (socket says 172.21.15.70:50658) 2023-11-26T07:19:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbba59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcbbc143ac0 0x7fcbbc070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37024/0 (socket says 172.21.15.70:37024) 2023-11-26T07:19:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbbad9d640 1 -- 172.21.15.70:0/2322831134 learned_addr learned my addr 172.21.15.70:0/2322831134 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbba59c640 1 -- 172.21.15.70:0/2322831134 >> v1:172.21.15.120:6789/0 conn(0x7fcbbc0708b0 legacy=0x7fcbbc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbba59c640 1 -- 172.21.15.70:0/2322831134 >> v1:172.21.15.70:6789/0 conn(0x7fcbbc0cf990 legacy=0x7fcbbc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbba59c640 1 -- 172.21.15.70:0/2322831134 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc0711c0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbba59c640 1 --2- 172.21.15.70:0/2322831134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc070370 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097c0 tx=0x7fcbac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6e3577fd3931af server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:49.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbb9d9b640 1 -- 172.21.15.70:0/2322831134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0a8050 con 0x7fcbbc143ac0 2023-11-26T07:19:49.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbb9d9b640 1 -- 172.21.15.70:0/2322831134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac0ac5f0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.684+0000 7fcbb9d9b640 1 -- 172.21.15.70:0/2322831134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0ac980 con 0x7fcbbc143ac0 2023-11-26T07:19:49.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2322831134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 msgr2=0x7fcbbc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:49.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2322831134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc070370 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097c0 tx=0x7fcbac01c480 comp rx=0 tx=0).stop 2023-11-26T07:19:49.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2322831134 shutdown_connections 2023-11-26T07:19:49.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2322831134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc070370 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:49.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2322831134 >> 172.21.15.70:0/2322831134 conn(0x7fcbbc06a890 msgr2=0x7fcbbc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:49.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2322831134 shutdown_connections 2023-11-26T07:19:49.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2322831134 wait complete. 2023-11-26T07:19:49.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 Processor -- start 2023-11-26T07:19:49.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- start start 2023-11-26T07:19:49.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbbc0708b0 0x7fcbbc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:49.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbbc0cf990 0x7fcbbc149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:49.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:49.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0ad130 con 0x7fcbbc143ac0 2023-11-26T07:19:49.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0ad410 con 0x7fcbbc0cf990 2023-11-26T07:19:49.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbc0a9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0ad6f0 con 0x7fcbbc0708b0 2023-11-26T07:19:49.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbbad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:49.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbbad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc0af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37036/0 (socket says 172.21.15.70:37036) 2023-11-26T07:19:49.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbbad9d640 1 -- 172.21.15.70:0/2456524670 learned_addr learned my addr 172.21.15.70:0/2456524670 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:49.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbb3fff640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbbc0cf990 0x7fcbbc149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:49.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.688+0000 7fcbba59c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbbc0708b0 0x7fcbbc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:49.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbbad9d640 1 -- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbbc0708b0 msgr2=0x7fcbbc0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:49.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbbad9d640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbbc0708b0 0x7fcbbc0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:49.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbbad9d640 1 -- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbbc0cf990 msgr2=0x7fcbbc149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:49.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbbad9d640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbbc0cf990 0x7fcbbc149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:49.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbbad9d640 1 -- 172.21.15.70:0/2456524670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009420 con 0x7fcbbc143ac0 2023-11-26T07:19:49.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbb3fff640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbbc0cf990 0x7fcbbc149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:49.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbbad9d640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc0af6c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400cbc0 tx=0x7fcbb400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:49.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbb2ffd640 1 -- 172.21.15.70:0/2456524670 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400ad40 con 0x7fcbbc143ac0 2023-11-26T07:19:49.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbb2ffd640 1 -- 172.21.15.70:0/2456524670 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb4012400 con 0x7fcbbc143ac0 2023-11-26T07:19:49.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc0ad9d0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbb2ffd640 1 -- 172.21.15.70:0/2456524670 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400aea0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc0ae1d0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc0adef0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbb2ffd640 1 -- 172.21.15.70:0/2456524670 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 6) v1 ==== 85903+0+0 (secure 0 0 0) 0x7fcbb4007070 con 0x7fcbbc143ac0 2023-11-26T07:19:49.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbb2ffd640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb9c066500 0x7fcb9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:49.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbb2ffd640 1 -- 172.21.15.70:0/2456524670 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbb4083e70 con 0x7fcbbc143ac0 2023-11-26T07:19:49.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.692+0000 7fcbba59c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb9c066500 0x7fcb9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:49.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.696+0000 7fcbba59c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb9c066500 0x7fcb9c0689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0ae000 tx=0x7fcbac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:49.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.696+0000 7fcbb2ffd640 1 -- 172.21.15.70:0/2456524670 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbbc0adef0 con 0x7fcbbc143ac0 2023-11-26T07:19:49.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.876+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbbc0ad580 con 0x7fcb9c066500 2023-11-26T07:19:49.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbb2ffd640 1 -- 172.21.15.70:0/2456524670 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fcbbc0ad580 con 0x7fcb9c066500 2023-11-26T07:19:49.888 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:49.889 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:19:49.889 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:19:49.889 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:19:49.889 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:19:49.889 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol33110", 2023-11-26T07:19:49.889 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap86710" 2023-11-26T07:19:49.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:49.890 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:49.890 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:49.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb9c066500 msgr2=0x7fcb9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:49.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb9c066500 0x7fcb9c0689c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0ae000 tx=0x7fcbac0a7000 comp rx=0 tx=0).stop 2023-11-26T07:19:49.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 msgr2=0x7fcbbc0af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:49.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc0af6c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400cbc0 tx=0x7fcbb400a430 comp rx=0 tx=0).stop 2023-11-26T07:19:49.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 shutdown_connections 2023-11-26T07:19:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb9c066500 0x7fcb9c0689c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbbc143ac0 0x7fcbbc0af6c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbbc0cf990 0x7fcbbc149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 --2- 172.21.15.70:0/2456524670 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbbc0708b0 0x7fcbbc0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 >> 172.21.15.70:0/2456524670 conn(0x7fcbbc06a890 msgr2=0x7fcbbc13caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 shutdown_connections 2023-11-26T07:19:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:49.884+0000 7fcbc0a9c640 1 -- 172.21.15.70:0/2456524670 wait complete. 2023-11-26T07:19:50.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82360 2023-11-26T07:19:51.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.044+0000 7fe5f4ddf640 1 Processor -- start 2023-11-26T07:19:51.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.044+0000 7fe5f4ddf640 1 -- start start 2023-11-26T07:19:51.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5f4ddf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f0071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5f4ddf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe5f00b2f80 0x7fe5f006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5f4ddf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f006c750 con 0x7fe5f00ce680 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5f4ddf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00cbe00 con 0x7fe5f00b2f80 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5f4ddf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00b3550 con 0x7fe5f01596d0 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5eed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe5f00b2f80 0x7fe5f006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5e5d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe5f00ce680 0x7fe5f00b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50660/0 (socket says 172.21.15.70:50660) 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5eed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe5f00b2f80 0x7fe5f006cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37042/0 (socket says 172.21.15.70:37042) 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5e5d9b640 1 -- 172.21.15.70:0/3577228231 learned_addr learned my addr 172.21.15.70:0/3577228231 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:51.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5ee59c640 1 --2- 172.21.15.70:0/3577228231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:51.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5eed9d640 1 -- 172.21.15.70:0/3577228231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 msgr2=0x7fe5f0071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:51.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5eed9d640 1 --2- 172.21.15.70:0/3577228231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f0071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5eed9d640 1 -- 172.21.15.70:0/3577228231 >> v1:172.21.15.70:6789/0 conn(0x7fe5f00ce680 legacy=0x7fe5f00b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:51.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5eed9d640 1 -- 172.21.15.70:0/3577228231 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0071e80 con 0x7fe5f00b2f80 2023-11-26T07:19:51.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.048+0000 7fe5edd9b640 1 -- 172.21.15.70:0/3577228231 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532125557 0 0) 0x7fe5f006c750 con 0x7fe5f00ce680 2023-11-26T07:19:51.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5eed9d640 1 --2- 172.21.15.70:0/3577228231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f006cbe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800aea0 tx=0x7fe5e801da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7316bab9e65a15b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:51.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5edd9b640 1 -- 172.21.15.70:0/3577228231 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800a2d0 con 0x7fe5f00b2f80 2023-11-26T07:19:51.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5edd9b640 1 -- 172.21.15.70:0/3577228231 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e80a6780 con 0x7fe5f00b2f80 2023-11-26T07:19:51.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5edd9b640 1 -- 172.21.15.70:0/3577228231 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80a6b10 con 0x7fe5f00b2f80 2023-11-26T07:19:51.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/3577228231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 msgr2=0x7fe5f006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:51.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/3577228231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f006cbe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800aea0 tx=0x7fe5e801da50 comp rx=0 tx=0).stop 2023-11-26T07:19:51.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/3577228231 shutdown_connections 2023-11-26T07:19:51.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/3577228231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f006cbe0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/3577228231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f0071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/3577228231 >> 172.21.15.70:0/3577228231 conn(0x7fe5f006a890 msgr2=0x7fe5f006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:51.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/3577228231 shutdown_connections 2023-11-26T07:19:51.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/3577228231 wait complete. 2023-11-26T07:19:51.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 Processor -- start 2023-11-26T07:19:51.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.052+0000 7fe5f4ddf640 1 -- start start 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f00cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5f00ce680 0x7fe5f01f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0148230 con 0x7fe5f00b2f80 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00cc990 con 0x7fe5f00ce680 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0150e60 con 0x7fe5f01596d0 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f00cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f00cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37048/0 (socket says 172.21.15.70:37048) 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 -- 172.21.15.70:0/1681711169 learned_addr learned my addr 172.21.15.70:0/1681711169 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:51.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5e5d9b640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5f00ce680 0x7fe5f01f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5eed9d640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 -- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 msgr2=0x7fe5f015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 -- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5f00ce680 msgr2=0x7fe5f01f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5f00ce680 0x7fe5f01f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 -- 172.21.15.70:0/1681711169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e800ab80 con 0x7fe5f00b2f80 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5ee59c640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f00cc450 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000e870 tx=0x7fe5e000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5e77fe640 1 -- 172.21.15.70:0/1681711169 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0009510 con 0x7fe5f00b2f80 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5e77fe640 1 -- 172.21.15.70:0/1681711169 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e000eec0 con 0x7fe5f00b2f80 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5e77fe640 1 -- 172.21.15.70:0/1681711169 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000cb40 con 0x7fe5f00b2f80 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f0151140 con 0x7fe5f00b2f80 2023-11-26T07:19:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f0151700 con 0x7fe5f00b2f80 2023-11-26T07:19:51.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f0067680 con 0x7fe5f00b2f80 2023-11-26T07:19:51.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.056+0000 7fe5e77fe640 1 -- 172.21.15.70:0/1681711169 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) v1 ==== 86005+0+0 (secure 0 0 0) 0x7fe5e000cca0 con 0x7fe5f00b2f80 2023-11-26T07:19:51.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.060+0000 7fe5e77fe640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe5d0066620 0x7fe5d0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:51.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.060+0000 7fe5e77fe640 1 -- 172.21.15.70:0/1681711169 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5e0084240 con 0x7fe5f00b2f80 2023-11-26T07:19:51.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.060+0000 7fe5e5d9b640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe5d0066620 0x7fe5d0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:51.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.060+0000 7fe5e5d9b640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe5d0066620 0x7fe5d0068ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0151ba0 tx=0x7fe5d8007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:51.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.064+0000 7fe5e77fe640 1 -- 172.21.15.70:0/1681711169 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5e00514d0 con 0x7fe5f00b2f80 2023-11-26T07:19:51.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.244+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5f00709f0 con 0x7fe5d0066620 2023-11-26T07:19:51.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5e77fe640 1 -- 172.21.15.70:0/1681711169 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fe5f00709f0 con 0x7fe5d0066620 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol33110", 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap86710" 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:51.256 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe5d0066620 msgr2=0x7fe5d0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe5d0066620 0x7fe5d0068ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0151ba0 tx=0x7fe5d8007b60 comp rx=0 tx=0).stop 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 msgr2=0x7fe5f00cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f00cc450 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000e870 tx=0x7fe5e000ec70 comp rx=0 tx=0).stop 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 shutdown_connections 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5f01596d0 0x7fe5f015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5f00ce680 0x7fe5f01f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe5d0066620 0x7fe5d0068ae0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 --2- 172.21.15.70:0/1681711169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f00b2f80 0x7fe5f00cc450 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:51.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 >> 172.21.15.70:0/1681711169 conn(0x7fe5f006a890 msgr2=0x7fe5f0070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:51.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 shutdown_connections 2023-11-26T07:19:51.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:51.252+0000 7fe5f4ddf640 1 -- 172.21.15.70:0/1681711169 wait complete. 2023-11-26T07:19:52.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82360 2023-11-26T07:19:52.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.412+0000 7f4ad0df5640 1 Processor -- start 2023-11-26T07:19:52.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.412+0000 7f4ad0df5640 1 -- start start 2023-11-26T07:19:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.412+0000 7f4ad0df5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4acc0cf280 0x7f4acc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.412+0000 7f4ad0df5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc0cc730 con 0x7f4acc0cd1b0 2023-11-26T07:19:52.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.412+0000 7f4ad0df5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4acc070ee0 con 0x7f4acc143ac0 2023-11-26T07:19:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.412+0000 7f4ad0df5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4acc143ea0 con 0x7f4acc0cf280 2023-11-26T07:19:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4acc0cf280 0x7f4acc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4acad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4acc0cd1b0 0x7f4acc0cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50670/0 (socket says 172.21.15.70:50670) 2023-11-26T07:19:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4acad9d640 1 -- 172.21.15.70:0/1275303248 learned_addr learned my addr 172.21.15.70:0/1275303248 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac3fff640 1 -- 172.21.15.70:0/1275303248 >> v1:172.21.15.120:6789/0 conn(0x7f4acc143ac0 legacy=0x7f4acc070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac3fff640 1 -- 172.21.15.70:0/1275303248 >> v1:172.21.15.70:6789/0 conn(0x7f4acc0cd1b0 legacy=0x7f4acc0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac3fff640 1 -- 172.21.15.70:0/1275303248 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0711c0 con 0x7f4acc0cf280 2023-11-26T07:19:52.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac3fff640 1 --2- 172.21.15.70:0/1275303248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc0cf710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097c0 tx=0x7f4ab401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1a171faf63807c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac9d9b640 1 -- 172.21.15.70:0/1275303248 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40a8050 con 0x7f4acc0cf280 2023-11-26T07:19:52.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac9d9b640 1 -- 172.21.15.70:0/1275303248 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab40ac5f0 con 0x7f4acc0cf280 2023-11-26T07:19:52.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.416+0000 7f4ac9d9b640 1 -- 172.21.15.70:0/1275303248 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40ac980 con 0x7f4acc0cf280 2023-11-26T07:19:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- 172.21.15.70:0/1275303248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 msgr2=0x7f4acc0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/1275303248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc0cf710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097c0 tx=0x7f4ab401c480 comp rx=0 tx=0).stop 2023-11-26T07:19:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- 172.21.15.70:0/1275303248 shutdown_connections 2023-11-26T07:19:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/1275303248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc0cf710 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- 172.21.15.70:0/1275303248 >> 172.21.15.70:0/1275303248 conn(0x7f4acc06a890 msgr2=0x7f4acc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- 172.21.15.70:0/1275303248 shutdown_connections 2023-11-26T07:19:52.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- 172.21.15.70:0/1275303248 wait complete. 2023-11-26T07:19:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 Processor -- start 2023-11-26T07:19:52.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- start start 2023-11-26T07:19:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc0cd1b0 0x7f4acc1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc143ac0 0x7f4acc156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc156ae0 con 0x7f4acc0cf280 2023-11-26T07:19:52.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0ae010 con 0x7f4acc0cd1b0 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ad0df5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc0ae2f0 con 0x7f4acc143ac0 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc1579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37062/0 (socket says 172.21.15.70:37062) 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 -- 172.21.15.70:0/3963840454 learned_addr learned my addr 172.21.15.70:0/3963840454 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4acad9d640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc143ac0 0x7f4acc156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4aca59c640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc0cd1b0 0x7f4acc1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 -- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc143ac0 msgr2=0x7f4acc156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc143ac0 0x7f4acc156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 -- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc0cd1b0 msgr2=0x7f4acc1565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc0cd1b0 0x7f4acc1565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.420+0000 7f4ac3fff640 1 -- 172.21.15.70:0/3963840454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4009420 con 0x7f4acc0cf280 2023-11-26T07:19:52.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ac3fff640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc1579b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40af040 tx=0x7f4ab4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ac2ffd640 1 -- 172.21.15.70:0/3963840454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40b5620 con 0x7f4acc0cf280 2023-11-26T07:19:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ac2ffd640 1 -- 172.21.15.70:0/3963840454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab40b5780 con 0x7f4acc0cf280 2023-11-26T07:19:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4acc140fd0 con 0x7f4acc0cf280 2023-11-26T07:19:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ac2ffd640 1 -- 172.21.15.70:0/3963840454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40b5b30 con 0x7f4acc0cf280 2023-11-26T07:19:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4acc141590 con 0x7f4acc0cf280 2023-11-26T07:19:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4acc067680 con 0x7f4acc0cf280 2023-11-26T07:19:52.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ac2ffd640 1 -- 172.21.15.70:0/3963840454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f4ab40b3040 con 0x7f4acc0cf280 2023-11-26T07:19:52.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ac2ffd640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4aac066620 0x7f4aac068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:52.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.424+0000 7f4ac2ffd640 1 -- 172.21.15.70:0/3963840454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab411ddf0 con 0x7f4acc0cf280 2023-11-26T07:19:52.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.428+0000 7f4aca59c640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4aac066620 0x7f4aac068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:52.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.428+0000 7f4aca59c640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4aac066620 0x7f4aac068ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4abc000f70 tx=0x7f4abc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:52.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.428+0000 7f4ac2ffd640 1 -- 172.21.15.70:0/3963840454 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ab40eae40 con 0x7f4acc0cf280 2023-11-26T07:19:52.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.608+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7f4acc167be0 con 0x7f4aac066620 2023-11-26T07:19:52.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ac2ffd640 1 -- 172.21.15.70:0/3963840454 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f4abc0012d0 con 0x7f4aac066620 2023-11-26T07:19:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:19:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:19:52.621 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:19:52.621 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:19:52.621 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol33110", 2023-11-26T07:19:52.621 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap86710" 2023-11-26T07:19:52.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:52.621 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4aac066620 msgr2=0x7f4aac068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4aac066620 0x7f4aac068ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4abc000f70 tx=0x7f4abc009040 comp rx=0 tx=0).stop 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 msgr2=0x7f4acc1579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc1579b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40af040 tx=0x7f4ab4019220 comp rx=0 tx=0).stop 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 shutdown_connections 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4aac066620 0x7f4aac068ae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4acc0cf280 0x7f4acc1579b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4acc143ac0 0x7f4acc156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 --2- 172.21.15.70:0/3963840454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4acc0cd1b0 0x7f4acc1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:52.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 >> 172.21.15.70:0/3963840454 conn(0x7f4acc06a890 msgr2=0x7f4acc13c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:52.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 shutdown_connections 2023-11-26T07:19:52.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:52.616+0000 7f4ad0df5640 1 -- 172.21.15.70:0/3963840454 wait complete. 2023-11-26T07:19:53.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82360 2023-11-26T07:19:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.780+0000 7f86006d6640 1 Processor -- start 2023-11-26T07:19:53.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.780+0000 7f86006d6640 1 -- start start 2023-11-26T07:19:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f86006d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85f80cd610 0x7f85f8071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f86006d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f86006d6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f8071530 con 0x7f85f81614b0 2023-11-26T07:19:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f86006d6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f8071eb0 con 0x7f85f80cd610 2023-11-26T07:19:53.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f86006d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f815d970 con 0x7f85f8070ba0 2023-11-26T07:19:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fdc71640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85f80cd610 0x7f85f8071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fe472640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f85f81614b0 0x7f85f8161890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:52056/0 (socket says 172.21.15.70:52056) 2023-11-26T07:19:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fec73640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fe472640 1 -- 172.21.15.70:0/2522628237 learned_addr learned my addr 172.21.15.70:0/2522628237 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:19:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fdc71640 1 -- 172.21.15.70:0/2522628237 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 msgr2=0x7f85f8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fdc71640 1 --2- 172.21.15.70:0/2522628237 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fdc71640 1 -- 172.21.15.70:0/2522628237 >> v1:172.21.15.120:6789/0 conn(0x7f85f81614b0 legacy=0x7f85f8161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fdc71640 1 -- 172.21.15.70:0/2522628237 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f815dc30 con 0x7f85f80cd610 2023-11-26T07:19:53.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.784+0000 7f85fd470640 1 -- 172.21.15.70:0/2522628237 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944333479 0 0) 0x7f85f4001120 con 0x7f85f81614b0 2023-11-26T07:19:53.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.788+0000 7f85fdc71640 1 --2- 172.21.15.70:0/2522628237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 0x7f85f8071970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f85e80097c0 tx=0x7f85e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31e93911459f2a0e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f85fd470640 1 -- 172.21.15.70:0/2522628237 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e80ab650 con 0x7f85f80cd610 2023-11-26T07:19:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f85fd470640 1 -- 172.21.15.70:0/2522628237 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e80ab7b0 con 0x7f85f80cd610 2023-11-26T07:19:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f85fd470640 1 -- 172.21.15.70:0/2522628237 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e80abb40 con 0x7f85f80cd610 2023-11-26T07:19:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 -- 172.21.15.70:0/2522628237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 msgr2=0x7f85f8071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 --2- 172.21.15.70:0/2522628237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 0x7f85f8071970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f85e80097c0 tx=0x7f85e801c450 comp rx=0 tx=0).stop 2023-11-26T07:19:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 -- 172.21.15.70:0/2522628237 shutdown_connections 2023-11-26T07:19:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 --2- 172.21.15.70:0/2522628237 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 --2- 172.21.15.70:0/2522628237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 0x7f85f8071970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 -- 172.21.15.70:0/2522628237 >> 172.21.15.70:0/2522628237 conn(0x7f85f80cf710 msgr2=0x7f85f80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:53.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 -- 172.21.15.70:0/2522628237 shutdown_connections 2023-11-26T07:19:53.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 -- 172.21.15.70:0/2522628237 wait complete. 2023-11-26T07:19:53.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 Processor -- start 2023-11-26T07:19:53.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.792+0000 7f86006d6640 1 -- start start 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 0x7f85f80aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f81614b0 0x7f85f80b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8158000 con 0x7f85f81614b0 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b0e40 con 0x7f85f80cd610 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f81582a0 con 0x7f85f8070ba0 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f81614b0 0x7f85f80b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f81614b0 0x7f85f80b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51746/0 (socket says 172.21.15.70:51746) 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 -- 172.21.15.70:0/2760510769 learned_addr learned my addr 172.21.15.70:0/2760510769 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fdc71640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 0x7f85f80aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fe472640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 -- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 msgr2=0x7f85f8144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8144040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 -- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 msgr2=0x7f85f80aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 0x7f85f80aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 -- 172.21.15.70:0/2760510769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e8009420 con 0x7f85f81614b0 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85fec73640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f81614b0 0x7f85f80b0470 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85f000efc0 tx=0x7f85f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85eeffd640 1 -- 172.21.15.70:0/2760510769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0009ba0 con 0x7f85f81614b0 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85eeffd640 1 -- 172.21.15.70:0/2760510769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f000f040 con 0x7f85f81614b0 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85eeffd640 1 -- 172.21.15.70:0/2760510769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00146c0 con 0x7f85f81614b0 2023-11-26T07:19:53.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f80b1120 con 0x7f85f81614b0 2023-11-26T07:19:53.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f8144580 con 0x7f85f81614b0 2023-11-26T07:19:53.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f8067680 con 0x7f85f81614b0 2023-11-26T07:19:53.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.796+0000 7f85eeffd640 1 -- 172.21.15.70:0/2760510769 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f85f0014820 con 0x7f85f81614b0 2023-11-26T07:19:53.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.800+0000 7f85eeffd640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f85dc066620 0x7f85dc068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:53.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.800+0000 7f85eeffd640 1 -- 172.21.15.70:0/2760510769 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85f0084c00 con 0x7f85f81614b0 2023-11-26T07:19:53.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.800+0000 7f85fe472640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f85dc066620 0x7f85dc068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:53.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.800+0000 7f85fe472640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f85dc066620 0x7f85dc068ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85f4001380 tx=0x7f85f4007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:53.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.804+0000 7f85eeffd640 1 -- 172.21.15.70:0/2760510769 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85f0051d90 con 0x7f85f81614b0 2023-11-26T07:19:53.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:53.984+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7f85f815b1c0 con 0x7f85dc066620 2023-11-26T07:19:56.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f85eeffd640 1 -- 172.21.15.70:0/2760510769 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f85f815b1c0 con 0x7f85dc066620 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "in-progress", 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol33110", 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap86710" 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:19:56.368 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:19:56.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f85dc066620 msgr2=0x7f85dc068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f85dc066620 0x7f85dc068ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85f4001380 tx=0x7f85f4007be0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f81614b0 msgr2=0x7f85f80b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:56.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f81614b0 0x7f85f80b0470 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85f000efc0 tx=0x7f85f000c490 comp rx=0 tx=0).stop 2023-11-26T07:19:56.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 shutdown_connections 2023-11-26T07:19:56.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f85dc066620 0x7f85dc068ae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f81614b0 0x7f85f80b0470 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85f80cd610 0x7f85f80aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 --2- 172.21.15.70:0/2760510769 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f85f8070ba0 0x7f85f8144040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:56.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 >> 172.21.15.70:0/2760510769 conn(0x7f85f80cf710 msgr2=0x7f85f8167580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:56.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 shutdown_connections 2023-11-26T07:19:56.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:56.363+0000 7f86006d6640 1 -- 172.21.15.70:0/2760510769 wait complete. 2023-11-26T07:19:57.396 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82360 2023-11-26T07:19:57.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 Processor -- start 2023-11-26T07:19:57.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 -- start start 2023-11-26T07:19:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f34dc143810 0x7f34dc072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc0b1e10 0x7f34dc15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f34dc15df20 0x7f34dc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc15e3b0 con 0x7f34dc15df20 2023-11-26T07:19:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc15e860 con 0x7f34dc143810 2023-11-26T07:19:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e31a4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0cdba0 con 0x7f34dc0b1e10 2023-11-26T07:19:57.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f34dc15df20 0x7f34dc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f34dc15df20 0x7f34dc0ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51754/0 (socket says 172.21.15.70:51754) 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 -- 172.21.15.70:0/2752979024 learned_addr learned my addr 172.21.15.70:0/2752979024 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e19a1640 1 --2- 172.21.15.70:0/2752979024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc0b1e10 0x7f34dc15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e21a2640 1 --2- 172.21.15.70:0/2752979024 >> v2:172.21.15.120:3300/0 conn(0x7f34dc143810 0x7f34dc072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 -- 172.21.15.70:0/2752979024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc0b1e10 msgr2=0x7f34dc15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 --2- 172.21.15.70:0/2752979024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc0b1e10 0x7f34dc15d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 -- 172.21.15.70:0/2752979024 >> v2:172.21.15.120:3300/0 conn(0x7f34dc143810 msgr2=0x7f34dc072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 --2- 172.21.15.70:0/2752979024 >> v2:172.21.15.120:3300/0 conn(0x7f34dc143810 0x7f34dc072140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e29a3640 1 -- 172.21.15.70:0/2752979024 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc143bf0 con 0x7f34dc15df20 2023-11-26T07:19:57.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.547+0000 7f34e21a2640 1 --2- 172.21.15.70:0/2752979024 >> v2:172.21.15.120:3300/0 conn(0x7f34dc143810 0x7f34dc072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:19:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e29a3640 1 --2- 172.21.15.70:0/2752979024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc15df20 0x7f34dc0ce030 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0b1b80 tx=0x7f34d401eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ac4b8a7077c578 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e11a0640 1 -- 172.21.15.70:0/2752979024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400b2d0 con 0x7f34dc15df20 2023-11-26T07:19:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e11a0640 1 -- 172.21.15.70:0/2752979024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400b430 con 0x7f34dc15df20 2023-11-26T07:19:57.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e11a0640 1 -- 172.21.15.70:0/2752979024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40a7bb0 con 0x7f34dc15df20 2023-11-26T07:19:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 -- 172.21.15.70:0/2752979024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc15df20 msgr2=0x7f34dc0ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 --2- 172.21.15.70:0/2752979024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc15df20 0x7f34dc0ce030 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0b1b80 tx=0x7f34d401eae0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 -- 172.21.15.70:0/2752979024 shutdown_connections 2023-11-26T07:19:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 --2- 172.21.15.70:0/2752979024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc15df20 0x7f34dc0ce030 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 --2- 172.21.15.70:0/2752979024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc0b1e10 0x7f34dc15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 --2- 172.21.15.70:0/2752979024 >> v2:172.21.15.120:3300/0 conn(0x7f34dc143810 0x7f34dc072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 -- 172.21.15.70:0/2752979024 >> 172.21.15.70:0/2752979024 conn(0x7f34dc06a890 msgr2=0x7f34dc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:19:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 -- 172.21.15.70:0/2752979024 shutdown_connections 2023-11-26T07:19:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.551+0000 7f34e31a4640 1 -- 172.21.15.70:0/2752979024 wait complete. 2023-11-26T07:19:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 Processor -- start 2023-11-26T07:19:57.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 -- start start 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc0b1e10 0x7f34dc13b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc143810 0x7f34dc152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34dc15df20 0x7f34dc15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc142970 con 0x7f34dc0b1e10 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc141cf0 con 0x7f34dc15df20 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc141fd0 con 0x7f34dc143810 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc0b1e10 0x7f34dc13b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc0b1e10 0x7f34dc13b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51756/0 (socket says 172.21.15.70:51756) 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 -- 172.21.15.70:0/1867526719 learned_addr learned my addr 172.21.15.70:0/1867526719 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 -- 172.21.15.70:0/1867526719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc143810 msgr2=0x7f34dc152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc143810 0x7f34dc152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 -- 172.21.15.70:0/1867526719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34dc15df20 msgr2=0x7f34dc15ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34dc15df20 0x7f34dc15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 -- 172.21.15.70:0/1867526719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d400bd40 con 0x7f34dc0b1e10 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e21a2640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc0b1e10 0x7f34dc13b700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34d800d800 tx=0x7f34d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34d2ffd640 1 -- 172.21.15.70:0/1867526719 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80096c0 con 0x7f34dc0b1e10 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34d2ffd640 1 -- 172.21.15.70:0/1867526719 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d8009820 con 0x7f34dc0b1e10 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc1422b0 con 0x7f34dc0b1e10 2023-11-26T07:19:57.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34d2ffd640 1 -- 172.21.15.70:0/1867526719 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8009bd0 con 0x7f34dc0b1e10 2023-11-26T07:19:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc13bc40 con 0x7f34dc0b1e10 2023-11-26T07:19:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.555+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc067500 con 0x7f34dc0b1e10 2023-11-26T07:19:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.559+0000 7f34d2ffd640 1 -- 172.21.15.70:0/1867526719 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f34d8009d30 con 0x7f34dc0b1e10 2023-11-26T07:19:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.559+0000 7f34d2ffd640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34c0066620 0x7f34c0068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:19:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.559+0000 7f34d2ffd640 1 -- 172.21.15.70:0/1867526719 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f34d80848e0 con 0x7f34dc0b1e10 2023-11-26T07:19:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.559+0000 7f34e19a1640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34c0066620 0x7f34c0068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:19:57.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.559+0000 7f34e19a1640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34c0066620 0x7f34c0068ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f34dc1511d0 tx=0x7f34cc009480 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:19:57.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.563+0000 7f34d2ffd640 1 -- 172.21.15.70:0/1867526719 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34d8051b30 con 0x7f34dc0b1e10 2023-11-26T07:19:57.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:19:57.743+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7f34dc0cc010 con 0x7f34c0066620 2023-11-26T07:19:59.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:19:59.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.355+0000 7f34d2ffd640 1 -- 172.21.15.70:0/1867526719 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+272 (secure 0 0 0) 0x7f34dc0cc010 con 0x7f34c0066620 2023-11-26T07:20:01.363 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "failed", 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol33110", 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap86710" 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "failure": { 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "errno": "2", 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "error_msg": "snapshot 'subvol_snap86710' does not exist" 2023-11-26T07:20:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:01.365 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:20:01.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34c0066620 msgr2=0x7f34c0068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34c0066620 0x7f34c0068ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f34dc1511d0 tx=0x7f34cc009480 comp rx=0 tx=0).stop 2023-11-26T07:20:01.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc0b1e10 msgr2=0x7f34dc13b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc0b1e10 0x7f34dc13b700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34d800d800 tx=0x7f34d800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 shutdown_connections 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34dc15df20 0x7f34dc15ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34dc143810 0x7f34dc152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f34c0066620 0x7f34c0068ae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 --2- 172.21.15.70:0/1867526719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34dc0b1e10 0x7f34dc13b700 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 >> 172.21.15.70:0/1867526719 conn(0x7f34dc06a890 msgr2=0x7f34dc070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 shutdown_connections 2023-11-26T07:20:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.359+0000 7f34e31a4640 1 -- 172.21.15.70:0/1867526719 wait complete. 2023-11-26T07:20:01.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone82360 2023-11-26T07:20:01.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a325a640 1 Processor -- start 2023-11-26T07:20:01.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a325a640 1 -- start start 2023-11-26T07:20:01.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a325a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c0cf990 0x7f169c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a325a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c06c520 con 0x7f169c15f4e0 2023-11-26T07:20:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a325a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c06c800 con 0x7f169c13e290 2023-11-26T07:20:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a325a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c06cae0 con 0x7f169c0cf990 2023-11-26T07:20:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a17f7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f169c15f4e0 0x7f169c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34762/0 (socket says 172.21.15.70:34762) 2023-11-26T07:20:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16a17f7640 1 -- 172.21.15.70:0/1829489761 learned_addr learned my addr 172.21.15.70:0/1829489761 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:01.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f1693fff640 1 --2- 172.21.15.70:0/1829489761 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c0cf990 0x7f169c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673544025 0 0) 0x7f169c06c520 con 0x7f169c15f4e0 2023-11-26T07:20:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.527+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1684003530 con 0x7f169c15f4e0 2023-11-26T07:20:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720756918 0 0) 0x7f169c06c800 con 0x7f169c13e290 2023-11-26T07:20:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f169c06c520 con 0x7f169c13e290 2023-11-26T07:20:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2439982254 0 0) 0x7f1684003530 con 0x7f169c15f4e0 2023-11-26T07:20:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f1693fff640 1 -- 172.21.15.70:0/1829489761 >> v1:172.21.15.120:6789/0 conn(0x7f169c13e290 legacy=0x7f169c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f1693fff640 1 -- 172.21.15.70:0/1829489761 >> v1:172.21.15.70:6789/0 conn(0x7f169c15f4e0 legacy=0x7f169c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f1693fff640 1 -- 172.21.15.70:0/1829489761 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c06cdc0 con 0x7f169c0cf990 2023-11-26T07:20:01.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f1693fff640 1 --2- 172.21.15.70:0/1829489761 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c0cf990 0x7f169c15efa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097f0 tx=0x7f168c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=892bef612235f8e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694001a00 con 0x7f169c0cf990 2023-11-26T07:20:01.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c0a7050 con 0x7f169c0cf990 2023-11-26T07:20:01.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16937fe640 1 -- 172.21.15.70:0/1829489761 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c004250 con 0x7f169c0cf990 2023-11-26T07:20:01.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16a325a640 1 -- 172.21.15.70:0/1829489761 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c0cf990 msgr2=0x7f169c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.531+0000 7f16a325a640 1 --2- 172.21.15.70:0/1829489761 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c0cf990 0x7f169c15efa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097f0 tx=0x7f168c01c3b0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- 172.21.15.70:0/1829489761 shutdown_connections 2023-11-26T07:20:01.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 --2- 172.21.15.70:0/1829489761 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c0cf990 0x7f169c15efa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- 172.21.15.70:0/1829489761 >> 172.21.15.70:0/1829489761 conn(0x7f169c06a890 msgr2=0x7f169c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- 172.21.15.70:0/1829489761 shutdown_connections 2023-11-26T07:20:01.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- 172.21.15.70:0/1829489761 wait complete. 2023-11-26T07:20:01.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 Processor -- start 2023-11-26T07:20:01.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- start start 2023-11-26T07:20:01.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c0cf990 0x7f169c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c13e290 0x7f169c0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169c15f4e0 0x7f169c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0af7a0 con 0x7f169c0cf990 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c071c70 con 0x7f169c15f4e0 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a325a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1519d0 con 0x7f169c13e290 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c0cf990 0x7f169c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c0cf990 0x7f169c151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51766/0 (socket says 172.21.15.70:51766) 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 -- 172.21.15.70:0/1577208251 learned_addr learned my addr 172.21.15.70:0/1577208251 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f1693fff640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c13e290 0x7f169c0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a17f7640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169c15f4e0 0x7f169c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 -- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c13e290 msgr2=0x7f169c0706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c13e290 0x7f169c0706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 -- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169c15f4e0 msgr2=0x7f169c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169c15f4e0 0x7f169c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a0ff6640 1 -- 172.21.15.70:0/1577208251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c009420 con 0x7f169c0cf990 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.535+0000 7f16a17f7640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169c15f4e0 0x7f169c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16a0ff6640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c0cf990 0x7f169c151490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f169800c490 tx=0x7f169800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16917fa640 1 -- 172.21.15.70:0/1577208251 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980052d0 con 0x7f169c0cf990 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16917fa640 1 -- 172.21.15.70:0/1577208251 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698005430 con 0x7f169c0cf990 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16917fa640 1 -- 172.21.15.70:0/1577208251 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698012870 con 0x7f169c0cf990 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c0710f0 con 0x7f169c0cf990 2023-11-26T07:20:01.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c0716b0 con 0x7f169c0cf990 2023-11-26T07:20:01.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c067680 con 0x7f169c0cf990 2023-11-26T07:20:01.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16917fa640 1 -- 172.21.15.70:0/1577208251 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f16980129d0 con 0x7f169c0cf990 2023-11-26T07:20:01.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16917fa640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1688066620 0x7f1688068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f16917fa640 1 -- 172.21.15.70:0/1577208251 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f1698083dc0 con 0x7f169c0cf990 2023-11-26T07:20:01.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.539+0000 7f1693fff640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1688066620 0x7f1688068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.543+0000 7f1693fff640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1688066620 0x7f1688068ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f168c0ad000 tx=0x7f168c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.543+0000 7f16917fa640 1 -- 172.21.15.70:0/1577208251 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1698050f70 con 0x7f169c0cf990 2023-11-26T07:20:01.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.727+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone82360", "target": ["mon-mgr", ""]}) v1 -- 0x7f169c169020 con 0x7f1688066620 2023-11-26T07:20:01.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16917fa640 1 -- 172.21.15.70:0/1577208251 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+272 (secure 0 0 0) 0x7f168c0bb0c0 con 0x7f1688066620 2023-11-26T07:20:01.739 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "failed", 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol33110", 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap86710" 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "failure": { 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "errno": "2", 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: "error_msg": "snapshot 'subvol_snap86710' does not exist" 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:01.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:01.741 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:20:01.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1688066620 msgr2=0x7f1688068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1688066620 0x7f1688068ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f168c0ad000 tx=0x7f168c0a6000 comp rx=0 tx=0).stop 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c0cf990 msgr2=0x7f169c151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c0cf990 0x7f169c151490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f169800c490 tx=0x7f169800c950 comp rx=0 tx=0).stop 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 shutdown_connections 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169c15f4e0 0x7f169c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f169c13e290 0x7f169c0706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1688066620 0x7f1688068ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 --2- 172.21.15.70:0/1577208251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f169c0cf990 0x7f169c151490 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 >> 172.21.15.70:0/1577208251 conn(0x7f169c06a890 msgr2=0x7f169c134640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 shutdown_connections 2023-11-26T07:20:01.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.735+0000 7f16a325a640 1 -- 172.21.15.70:0/1577208251 wait complete. 2023-11-26T07:20:01.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone82360 --force 2023-11-26T07:20:01.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.895+0000 7f7e39e9c640 1 Processor -- start 2023-11-26T07:20:01.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.895+0000 7f7e39e9c640 1 -- start start 2023-11-26T07:20:01.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e39e9c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e340b2f80 0x7f7e34071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e39e9c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3406c750 con 0x7f7e341596d0 2023-11-26T07:20:01.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e39e9c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e340b3550 con 0x7f7e340ce680 2023-11-26T07:20:01.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e39e9c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e340cbe00 con 0x7f7e340b2f80 2023-11-26T07:20:01.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e32ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e340b2f80 0x7f7e34071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e32ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e340b2f80 0x7f7e34071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51782/0 (socket says 172.21.15.70:51782) 2023-11-26T07:20:01.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e32ffd640 1 -- 172.21.15.70:0/993794138 learned_addr learned my addr 172.21.15.70:0/993794138 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:01.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e32ffd640 1 -- 172.21.15.70:0/993794138 >> v1:172.21.15.120:6789/0 conn(0x7f7e340ce680 legacy=0x7f7e3406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:01.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e32ffd640 1 -- 172.21.15.70:0/993794138 >> v1:172.21.15.70:6789/0 conn(0x7f7e341596d0 legacy=0x7f7e340b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e32ffd640 1 -- 172.21.15.70:0/993794138 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e34071e80 con 0x7f7e340b2f80 2023-11-26T07:20:01.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.899+0000 7f7e327fc640 1 -- 172.21.15.70:0/993794138 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476253252 0 0) 0x7f7e3406c750 con 0x7f7e341596d0 2023-11-26T07:20:01.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e32ffd640 1 --2- 172.21.15.70:0/993794138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340b2f80 0x7f7e34071850 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e340cbf40 tx=0x7f7e2801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17882cb07c3b964f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e327fc640 1 -- 172.21.15.70:0/993794138 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280ab600 con 0x7f7e340b2f80 2023-11-26T07:20:01.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e327fc640 1 -- 172.21.15.70:0/993794138 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e280a7050 con 0x7f7e340b2f80 2023-11-26T07:20:01.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e327fc640 1 -- 172.21.15.70:0/993794138 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280ab980 con 0x7f7e340b2f80 2023-11-26T07:20:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 -- 172.21.15.70:0/993794138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340b2f80 msgr2=0x7f7e34071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/993794138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340b2f80 0x7f7e34071850 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e340cbf40 tx=0x7f7e2801c450 comp rx=0 tx=0).stop 2023-11-26T07:20:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 -- 172.21.15.70:0/993794138 shutdown_connections 2023-11-26T07:20:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/993794138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340b2f80 0x7f7e34071850 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 -- 172.21.15.70:0/993794138 >> 172.21.15.70:0/993794138 conn(0x7f7e3406a890 msgr2=0x7f7e3406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 -- 172.21.15.70:0/993794138 shutdown_connections 2023-11-26T07:20:01.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 -- 172.21.15.70:0/993794138 wait complete. 2023-11-26T07:20:01.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 Processor -- start 2023-11-26T07:20:01.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.903+0000 7f7e39e9c640 1 -- start start 2023-11-26T07:20:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e340b2f80 0x7f7e340cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340ce680 0x7f7e3414ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e341596d0 0x7f7e3415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3415b3a0 con 0x7f7e340ce680 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3415b530 con 0x7f7e340b2f80 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e341f5e90 con 0x7f7e341596d0 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340ce680 0x7f7e3414ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340ce680 0x7f7e3414ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51796/0 (socket says 172.21.15.70:51796) 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 -- 172.21.15.70:0/2991731611 learned_addr learned my addr 172.21.15.70:0/2991731611 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e33fff640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e341596d0 0x7f7e3415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e337fe640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e340b2f80 0x7f7e340cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 -- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e341596d0 msgr2=0x7f7e3415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e341596d0 0x7f7e3415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 -- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e340b2f80 msgr2=0x7f7e340cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e340b2f80 0x7f7e340cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:01.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 -- 172.21.15.70:0/2991731611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280094d0 con 0x7f7e340ce680 2023-11-26T07:20:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e32ffd640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340ce680 0x7f7e3414ce30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7e280ae040 tx=0x7f7e280191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e1bfff640 1 -- 172.21.15.70:0/2991731611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280b4640 con 0x7f7e340ce680 2023-11-26T07:20:01.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e1bfff640 1 -- 172.21.15.70:0/2991731611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e280b47c0 con 0x7f7e340ce680 2023-11-26T07:20:01.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e1bfff640 1 -- 172.21.15.70:0/2991731611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280b4b70 con 0x7f7e340ce680 2023-11-26T07:20:01.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e340cdd30 con 0x7f7e340ce680 2023-11-26T07:20:01.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e34152b00 con 0x7f7e340ce680 2023-11-26T07:20:01.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e34067680 con 0x7f7e340ce680 2023-11-26T07:20:01.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.907+0000 7f7e1bfff640 1 -- 172.21.15.70:0/2991731611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f7e280b2070 con 0x7f7e340ce680 2023-11-26T07:20:01.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.911+0000 7f7e1bfff640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e20066620 0x7f7e20068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:01.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.911+0000 7f7e1bfff640 1 -- 172.21.15.70:0/2991731611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f7e2811e200 con 0x7f7e340ce680 2023-11-26T07:20:01.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.911+0000 7f7e337fe640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e20066620 0x7f7e20068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:01.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.911+0000 7f7e337fe640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e20066620 0x7f7e20068ae0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7e24007fd0 tx=0x7f7e24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:01.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:01.915+0000 7f7e1bfff640 1 -- 172.21.15.70:0/2991731611 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e280eb230 con 0x7f7e340ce680 2023-11-26T07:20:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.091+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone82360", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7e340b1ef0 con 0x7f7e20066620 2023-11-26T07:20:02.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.103+0000 7f7e1bfff640 1 -- 172.21.15.70:0/2991731611 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7e340b1ef0 con 0x7f7e20066620 2023-11-26T07:20:02.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e20066620 msgr2=0x7f7e20068ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e20066620 0x7f7e20068ae0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7e24007fd0 tx=0x7f7e24009040 comp rx=0 tx=0).stop 2023-11-26T07:20:02.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340ce680 msgr2=0x7f7e3414ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340ce680 0x7f7e3414ce30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7e280ae040 tx=0x7f7e280191f0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 shutdown_connections 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e20066620 0x7f7e20068ae0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e340ce680 0x7f7e3414ce30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e341596d0 0x7f7e3415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 --2- 172.21.15.70:0/2991731611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e340b2f80 0x7f7e340cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 >> 172.21.15.70:0/2991731611 conn(0x7f7e3406a890 msgr2=0x7f7e3406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 shutdown_connections 2023-11-26T07:20:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.107+0000 7f7e39e9c640 1 -- 172.21.15.70:0/2991731611 wait complete. 2023-11-26T07:20:02.114 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.107+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.114 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.107+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.114 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.107+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.114 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.107+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.115 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.107+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.129 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.123+0000 7ff292113640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.129 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.123+0000 7ff292113640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.129 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.123+0000 7ff292113640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.129 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.123+0000 7ff292113640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.129 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:02.123+0000 7ff292113640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:02.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol33110 2023-11-26T07:20:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.271+0000 7f355cf2b640 1 Processor -- start 2023-11-26T07:20:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.271+0000 7f355cf2b640 1 -- start start 2023-11-26T07:20:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f355cf2b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f35580b1e10 0x7f355815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f355cf2b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f355815df20 0x7f35580ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f355cf2b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355815e860 con 0x7f3558143810 2023-11-26T07:20:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f355cf2b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355815e3b0 con 0x7f35580b1e10 2023-11-26T07:20:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f355cf2b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580cdba0 con 0x7f355815df20 2023-11-26T07:20:02.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f3556ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f35580b1e10 0x7f355815d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f3557fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f355815df20 0x7f35580ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f35577fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3558143810 0x7f3558072140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:52082/0 (socket says 172.21.15.70:52082) 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f35577fe640 1 -- 172.21.15.70:0/114104318 learned_addr learned my addr 172.21.15.70:0/114104318 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f35567fc640 1 -- 172.21.15.70:0/114104318 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878671543 0 0) 0x7f355815e860 con 0x7f3558143810 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f35567fc640 1 -- 172.21.15.70:0/114104318 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003530 con 0x7f3558143810 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f3556ffd640 1 -- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f355815df20 msgr2=0x7f35580ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f3556ffd640 1 --2- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f355815df20 0x7f35580ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f3556ffd640 1 -- 172.21.15.70:0/114104318 >> v1:172.21.15.120:6789/0 conn(0x7f3558143810 legacy=0x7f3558072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f3556ffd640 1 -- 172.21.15.70:0/114104318 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558143bf0 con 0x7f35580b1e10 2023-11-26T07:20:02.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.275+0000 7f3557fff640 1 --2- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f355815df20 0x7f35580ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:02.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f3556ffd640 1 --2- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35580b1e10 0x7f355815d9e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f354c0097c0 tx=0x7f354c01e660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1aca6f4b55b2a35 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f35567fc640 1 -- 172.21.15.70:0/114104318 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0ab650 con 0x7f35580b1e10 2023-11-26T07:20:02.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f35567fc640 1 -- 172.21.15.70:0/114104318 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0ab7b0 con 0x7f35580b1e10 2023-11-26T07:20:02.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f35567fc640 1 -- 172.21.15.70:0/114104318 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0abb40 con 0x7f35580b1e10 2023-11-26T07:20:02.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 -- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35580b1e10 msgr2=0x7f355815d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 --2- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35580b1e10 0x7f355815d9e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f354c0097c0 tx=0x7f354c01e660 comp rx=0 tx=0).stop 2023-11-26T07:20:02.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 -- 172.21.15.70:0/114104318 shutdown_connections 2023-11-26T07:20:02.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 --2- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f355815df20 0x7f35580ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 --2- 172.21.15.70:0/114104318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35580b1e10 0x7f355815d9e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 -- 172.21.15.70:0/114104318 >> 172.21.15.70:0/114104318 conn(0x7f355806a890 msgr2=0x7f355806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 -- 172.21.15.70:0/114104318 shutdown_connections 2023-11-26T07:20:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 -- 172.21.15.70:0/114104318 wait complete. 2023-11-26T07:20:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 Processor -- start 2023-11-26T07:20:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.279+0000 7f355cf2b640 1 -- start start 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35580b1e10 0x7f35581514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3558143810 0x7f3558139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355815df20 0x7f355813a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355813c6f0 con 0x7f3558143810 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355813b800 con 0x7f355815df20 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355813bae0 con 0x7f35580b1e10 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3558143810 0x7f3558139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3558143810 0x7f3558139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51836/0 (socket says 172.21.15.70:51836) 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 -- 172.21.15.70:0/594819862 learned_addr learned my addr 172.21.15.70:0/594819862 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3557fff640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355815df20 0x7f355813a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f35577fe640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35580b1e10 0x7f35581514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 -- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35580b1e10 msgr2=0x7f35581514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35580b1e10 0x7f35581514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 -- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355815df20 msgr2=0x7f355813a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355815df20 0x7f355813a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 -- 172.21.15.70:0/594819862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009a70 con 0x7f3558143810 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3557fff640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355815df20 0x7f355813a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f35577fe640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35580b1e10 0x7f35581514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f3556ffd640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3558143810 0x7f3558139c20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f354c01cd10 tx=0x7f354c01cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0bc610 con 0x7f3558143810 2023-11-26T07:20:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0bc7b0 con 0x7f3558143810 2023-11-26T07:20:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0bcb60 con 0x7f3558143810 2023-11-26T07:20:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c009420 con 0x7f3558143810 2023-11-26T07:20:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355813c0a0 con 0x7f3558143810 2023-11-26T07:20:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355813c860 con 0x7f3558143810 2023-11-26T07:20:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.283+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) v1 ==== 86005+0+0 (secure 0 0 0) 0x7f354c0b33f0 con 0x7f3558143810 2023-11-26T07:20:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.287+0000 7f353ffff640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3544066650 0x7f3544068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.287+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f354c120f50 con 0x7f3558143810 2023-11-26T07:20:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.287+0000 7f35577fe640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3544066650 0x7f3544068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.287+0000 7f35577fe640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3544066650 0x7f3544068b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3548005890 tx=0x7f3548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:02.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.291+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f354c0edf70 con 0x7f3558143810 2023-11-26T07:20:02.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:02.459+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol33110", "target": ["mon-mgr", ""]}) v1 -- 0x7f3558152fd0 con 0x7f3544066650 2023-11-26T07:20:04.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:04.807+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f354c0ee340 con 0x7f3558143810 2023-11-26T07:20:06.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.367+0000 7f353ffff640 1 -- 172.21.15.70:0/594819862 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3558152fd0 con 0x7f3544066650 2023-11-26T07:20:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3544066650 msgr2=0x7f3544068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3544066650 0x7f3544068b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3548005890 tx=0x7f3548009040 comp rx=0 tx=0).stop 2023-11-26T07:20:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3558143810 msgr2=0x7f3558139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:06.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3558143810 0x7f3558139c20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f354c01cd10 tx=0x7f354c01cea0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 shutdown_connections 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3544066650 0x7f3544068b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3558143810 0x7f3558139c20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f355815df20 0x7f355813a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 --2- 172.21.15.70:0/594819862 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35580b1e10 0x7f35581514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 >> 172.21.15.70:0/594819862 conn(0x7f355806a890 msgr2=0x7f35580b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 shutdown_connections 2023-11-26T07:20:06.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:06.371+0000 7f355cf2b640 1 -- 172.21.15.70:0/594819862 wait complete. 2023-11-26T07:20:06.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:06.406 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:20:06.426 INFO:teuthology.orchestra.run.smithi070.stdout:3 2023-11-26T07:20:11.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:11.429 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:20:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:2 2023-11-26T07:20:11.445 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:20:11.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:20:11.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:20:11.669 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:20:11.669 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:11.670 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:11.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:11.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed673e640 1 Processor -- start 2023-11-26T07:20:11.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed673e640 1 -- start start 2023-11-26T07:20:11.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed673e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1ed0070d10 0x7f1ed015d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed673e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1ed006cd50 0x7f1ed00b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed673e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed015b2f0 con 0x7f1ed00cf280 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed673e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed006c5c0 con 0x7f1ed006cd50 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed673e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed015e1a0 con 0x7f1ed0070d10 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ecffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1ed00cf280 0x7f1ed00cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50440/0 (socket says 172.21.15.70:50440) 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ecffff640 1 -- 172.21.15.70:0/1294770190 learned_addr learned my addr 172.21.15.70:0/1294770190 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.871+0000 7f1ed4cdb640 1 --2- 172.21.15.70:0/1294770190 >> v2:172.21.15.70:3300/0 conn(0x7f1ed006cd50 0x7f1ed00b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1ecf7fe640 1 --2- 172.21.15.70:0/1294770190 >> v2:172.21.15.120:3300/0 conn(0x7f1ed0070d10 0x7f1ed015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1eceffd640 1 -- 172.21.15.70:0/1294770190 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404404426 0 0) 0x7f1ec0001120 con 0x7f1ed00cf280 2023-11-26T07:20:11.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1eceffd640 1 -- 172.21.15.70:0/1294770190 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb8003530 con 0x7f1ed00cf280 2023-11-26T07:20:11.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1ed4cdb640 1 -- 172.21.15.70:0/1294770190 >> v2:172.21.15.120:3300/0 conn(0x7f1ed0070d10 msgr2=0x7f1ed015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:11.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1ed4cdb640 1 --2- 172.21.15.70:0/1294770190 >> v2:172.21.15.120:3300/0 conn(0x7f1ed0070d10 0x7f1ed015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1ed4cdb640 1 -- 172.21.15.70:0/1294770190 >> v1:172.21.15.70:6789/0 conn(0x7f1ed00cf280 legacy=0x7f1ed00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1ed4cdb640 1 -- 172.21.15.70:0/1294770190 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed015e480 con 0x7f1ed006cd50 2023-11-26T07:20:11.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1ed4cdb640 1 --2- 172.21.15.70:0/1294770190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed006cd50 0x7f1ed00b2180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1ed006e480 tx=0x7f1ec801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7d2f6c5f749bca server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1eceffd640 1 -- 172.21.15.70:0/1294770190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80b0440 con 0x7f1ed006cd50 2023-11-26T07:20:11.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1eceffd640 1 -- 172.21.15.70:0/1294770190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80b05a0 con 0x7f1ed006cd50 2023-11-26T07:20:11.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.875+0000 7f1eceffd640 1 -- 172.21.15.70:0/1294770190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80b0930 con 0x7f1ed006cd50 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- 172.21.15.70:0/1294770190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed006cd50 msgr2=0x7f1ed00b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 --2- 172.21.15.70:0/1294770190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed006cd50 0x7f1ed00b2180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1ed006e480 tx=0x7f1ec801f0f0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- 172.21.15.70:0/1294770190 shutdown_connections 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 --2- 172.21.15.70:0/1294770190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed006cd50 0x7f1ed00b2180 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 --2- 172.21.15.70:0/1294770190 >> v2:172.21.15.120:3300/0 conn(0x7f1ed0070d10 0x7f1ed015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- 172.21.15.70:0/1294770190 >> 172.21.15.70:0/1294770190 conn(0x7f1ed006a890 msgr2=0x7f1ed006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- 172.21.15.70:0/1294770190 shutdown_connections 2023-11-26T07:20:11.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- 172.21.15.70:0/1294770190 wait complete. 2023-11-26T07:20:11.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 Processor -- start 2023-11-26T07:20:11.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- start start 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed006cd50 0x7f1ed0157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed0070d10 0x7f1ed01e35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cf280 0x7f1ed01438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed01e5bf0 con 0x7f1ed00cf280 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed01e3b30 con 0x7f1ed006cd50 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed673e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0143e00 con 0x7f1ed0070d10 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cf280 0x7f1ed01438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cf280 0x7f1ed01438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54326/0 (socket says 172.21.15.70:54326) 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 -- 172.21.15.70:0/155185214 learned_addr learned my addr 172.21.15.70:0/155185214 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ecf7fe640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed0070d10 0x7f1ed01e35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ecffff640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed006cd50 0x7f1ed0157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 -- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed0070d10 msgr2=0x7f1ed01e35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed0070d10 0x7f1ed01e35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 -- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed006cd50 msgr2=0x7f1ed0157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed006cd50 0x7f1ed0157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.879+0000 7f1ed4cdb640 1 -- 172.21.15.70:0/155185214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009a70 con 0x7f1ed00cf280 2023-11-26T07:20:11.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1ed4cdb640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cf280 0x7f1ed01438c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ec801bd00 tx=0x7f1ec801be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1eccff9640 1 -- 172.21.15.70:0/155185214 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80b0440 con 0x7f1ed00cf280 2023-11-26T07:20:11.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1eccff9640 1 -- 172.21.15.70:0/155185214 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80bc650 con 0x7f1ed00cf280 2023-11-26T07:20:11.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed01e3dc0 con 0x7f1ed00cf280 2023-11-26T07:20:11.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1eccff9640 1 -- 172.21.15.70:0/155185214 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80bca00 con 0x7f1ed00cf280 2023-11-26T07:20:11.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed01e4380 con 0x7f1ed00cf280 2023-11-26T07:20:11.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed0067680 con 0x7f1ed00cf280 2023-11-26T07:20:11.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1eccff9640 1 -- 172.21.15.70:0/155185214 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f1ec80bcb60 con 0x7f1ed00cf280 2023-11-26T07:20:11.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1eccff9640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066740 0x7f1ebc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:11.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1eccff9640 1 -- 172.21.15.70:0/155185214 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f1ec8122eb0 con 0x7f1ed00cf280 2023-11-26T07:20:11.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.883+0000 7f1ecffff640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066740 0x7f1ebc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:11.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.887+0000 7f1ecffff640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066740 0x7f1ebc068c00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0001280 tx=0x7f1ec0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:11.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:11.887+0000 7f1eccff9640 1 -- 172.21.15.70:0/155185214 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ec80eff80 con 0x7f1ed00cf280 2023-11-26T07:20:12.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ed00b36f0 con 0x7f1ed00cf280 2023-11-26T07:20:12.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1eccff9640 1 -- 172.21.15.70:0/155185214 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16634 (secure 0 0 0) 0x7f1ec80b5090 con 0x7f1ed00cf280 2023-11-26T07:20:12.045 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:12.045 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:03.792953+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066740 msgr2=0x7f1ebc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066740 0x7f1ebc068c00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0001280 tx=0x7f1ec0009040 comp rx=0 tx=0).stop 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cf280 msgr2=0x7f1ed01438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cf280 0x7f1ed01438c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ec801bd00 tx=0x7f1ec801be90 comp rx=0 tx=0).stop 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 shutdown_connections 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1ebc066740 0x7f1ebc068c00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ed00cf280 0x7f1ed01438c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1ed0070d10 0x7f1ed01e35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 --2- 172.21.15.70:0/155185214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ed006cd50 0x7f1ed0157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 >> 172.21.15.70:0/155185214 conn(0x7f1ed006a890 msgr2=0x7f1ed006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 shutdown_connections 2023-11-26T07:20:12.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.043+0000 7f1ed673e640 1 -- 172.21.15.70:0/155185214 wait complete. 2023-11-26T07:20:12.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:19:08.139388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:19:08.576466+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:20:12.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:20:12.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4d0c79640 1 Processor -- start 2023-11-26T07:20:12.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4d0c79640 1 -- start start 2023-11-26T07:20:12.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4d0c79640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe4cc0cf990 0x7fe4cc15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4d0c79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc15f4e0 0x7fe4cc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4d0c79640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc06c520 con 0x7fe4cc13e290 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4d0c79640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc06c800 con 0x7fe4cc0cf990 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4d0c79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc06cae0 con 0x7fe4cc15f4e0 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4c9d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe4cc0cf990 0x7fe4cc15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4cad9d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc15f4e0 0x7fe4cc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4c9d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe4cc0cf990 0x7fe4cc15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:57604/0 (socket says 172.21.15.70:57604) 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4ca59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe4cc13e290 0x7fe4cc0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:35444/0 (socket says 172.21.15.70:35444) 2023-11-26T07:20:12.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.207+0000 7fe4c9d9b640 1 -- 172.21.15.70:0/283644323 learned_addr learned my addr 172.21.15.70:0/283644323 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:12.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4cad9d640 1 -- 172.21.15.70:0/283644323 >> v2:172.21.15.120:3300/0 conn(0x7fe4cc0cf990 msgr2=0x7fe4cc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4cad9d640 1 --2- 172.21.15.70:0/283644323 >> v2:172.21.15.120:3300/0 conn(0x7fe4cc0cf990 0x7fe4cc15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4cad9d640 1 -- 172.21.15.70:0/283644323 >> v1:172.21.15.120:6789/0 conn(0x7fe4cc13e290 legacy=0x7fe4cc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4cad9d640 1 -- 172.21.15.70:0/283644323 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc06cdc0 con 0x7fe4cc15f4e0 2023-11-26T07:20:12.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4c9d9b640 1 --2- 172.21.15.70:0/283644323 >> v2:172.21.15.120:3300/0 conn(0x7fe4cc0cf990 0x7fe4cc15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:12.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4cad9d640 1 --2- 172.21.15.70:0/283644323 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc15f4e0 0x7fe4cc0cd7b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009d90 tx=0x7fe4c401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164e20266d095729 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4c959a640 1 -- 172.21.15.70:0/283644323 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40a5a00 con 0x7fe4cc15f4e0 2023-11-26T07:20:12.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4c959a640 1 -- 172.21.15.70:0/283644323 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c40a5b60 con 0x7fe4cc15f4e0 2023-11-26T07:20:12.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4c959a640 1 -- 172.21.15.70:0/283644323 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40ad440 con 0x7fe4cc15f4e0 2023-11-26T07:20:12.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4d0c79640 1 -- 172.21.15.70:0/283644323 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc15f4e0 msgr2=0x7fe4cc0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.211+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/283644323 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc15f4e0 0x7fe4cc0cd7b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009d90 tx=0x7fe4c401c920 comp rx=0 tx=0).stop 2023-11-26T07:20:12.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- 172.21.15.70:0/283644323 shutdown_connections 2023-11-26T07:20:12.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/283644323 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc15f4e0 0x7fe4cc0cd7b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/283644323 >> v2:172.21.15.120:3300/0 conn(0x7fe4cc0cf990 0x7fe4cc15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- 172.21.15.70:0/283644323 >> 172.21.15.70:0/283644323 conn(0x7fe4cc06a890 msgr2=0x7fe4cc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- 172.21.15.70:0/283644323 shutdown_connections 2023-11-26T07:20:12.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- 172.21.15.70:0/283644323 wait complete. 2023-11-26T07:20:12.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 Processor -- start 2023-11-26T07:20:12.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- start start 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0cf990 0x7fe4cc134410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc13e290 0x7fe4cc071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc15f4e0 0x7fe4cc15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0b0fd0 con 0x7fe4cc0cf990 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0b1870 con 0x7fe4cc15f4e0 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4d0c79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14f810 con 0x7fe4cc13e290 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0cf990 0x7fe4cc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0cf990 0x7fe4cc134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54338/0 (socket says 172.21.15.70:54338) 2023-11-26T07:20:12.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 -- 172.21.15.70:0/1198288213 learned_addr learned my addr 172.21.15.70:0/1198288213 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4cad9d640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc15f4e0 0x7fe4cc15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4c9d9b640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc13e290 0x7fe4cc071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 -- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc13e290 msgr2=0x7fe4cc071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc13e290 0x7fe4cc071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 -- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc15f4e0 msgr2=0x7fe4cc15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc15f4e0 0x7fe4cc15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.215+0000 7fe4ca59c640 1 -- 172.21.15.70:0/1198288213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00094d0 con 0x7fe4cc0cf990 2023-11-26T07:20:12.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4ca59c640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0cf990 0x7fe4cc134410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00c490 tx=0x7fe4bc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4baffd640 1 -- 172.21.15.70:0/1198288213 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc007480 con 0x7fe4cc0cf990 2023-11-26T07:20:12.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4baffd640 1 -- 172.21.15.70:0/1198288213 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0075e0 con 0x7fe4cc0cf990 2023-11-26T07:20:12.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c4009a70 con 0x7fe4cc0cf990 2023-11-26T07:20:12.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4baffd640 1 -- 172.21.15.70:0/1198288213 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc004a10 con 0x7fe4cc0cf990 2023-11-26T07:20:12.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc0b1500 con 0x7fe4cc0cf990 2023-11-26T07:20:12.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc067680 con 0x7fe4cc0cf990 2023-11-26T07:20:12.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4baffd640 1 -- 172.21.15.70:0/1198288213 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fe4bc004b70 con 0x7fe4cc0cf990 2023-11-26T07:20:12.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4baffd640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066770 0x7fe4ac068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4baffd640 1 -- 172.21.15.70:0/1198288213 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe4bc0832d0 con 0x7fe4cc0cf990 2023-11-26T07:20:12.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.219+0000 7fe4c9d9b640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066770 0x7fe4ac068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.223 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.223+0000 7fe4c9d9b640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066770 0x7fe4ac068c30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0cf570 tx=0x7fe4c0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.223+0000 7fe4baffd640 1 -- 172.21.15.70:0/1198288213 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4bc0504e0 con 0x7fe4cc0cf990 2023-11-26T07:20:12.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4cc06df50 con 0x7fe4cc0cf990 2023-11-26T07:20:12.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4baffd640 1 -- 172.21.15.70:0/1198288213 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4bc053b00 con 0x7fe4cc0cf990 2023-11-26T07:20:12.380 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066770 msgr2=0x7fe4ac068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066770 0x7fe4ac068c30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0cf570 tx=0x7fe4c0009240 comp rx=0 tx=0).stop 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0cf990 msgr2=0x7fe4cc134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0cf990 0x7fe4cc134410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00c490 tx=0x7fe4bc00c950 comp rx=0 tx=0).stop 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 shutdown_connections 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4cc15f4e0 0x7fe4cc15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4cc13e290 0x7fe4cc071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4ac066770 0x7fe4ac068c30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 --2- 172.21.15.70:0/1198288213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4cc0cf990 0x7fe4cc134410 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 >> 172.21.15.70:0/1198288213 conn(0x7fe4cc06a890 msgr2=0x7fe4cc139cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 shutdown_connections 2023-11-26T07:20:12.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.379+0000 7fe4d0c79640 1 -- 172.21.15.70:0/1198288213 wait complete. 2023-11-26T07:20:12.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:20:12.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5897372640 1 Processor -- start 2023-11-26T07:20:12.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5897372640 1 -- start start 2023-11-26T07:20:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5897372640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f589006bac0 0x7f5890066320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5897372640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900cd610 con 0x7f58901575c0 2023-11-26T07:20:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5897372640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589015a6d0 con 0x7f589006a490 2023-11-26T07:20:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5897372640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589015a9b0 con 0x7f589006bac0 2023-11-26T07:20:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f589510e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f58901575c0 0x7f5890159e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50442/0 (socket says 172.21.15.70:50442) 2023-11-26T07:20:12.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f589510e640 1 -- 172.21.15.70:0/1980306429 learned_addr learned my addr 172.21.15.70:0/1980306429 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f589490d640 1 --2- 172.21.15.70:0/1980306429 >> v2:172.21.15.120:3300/0 conn(0x7f589006bac0 0x7f5890066320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405967227 0 0) 0x7f58900cd610 con 0x7f58901575c0 2023-11-26T07:20:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.539+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c003530 con 0x7f58901575c0 2023-11-26T07:20:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1270736429 0 0) 0x7f587c003530 con 0x7f58901575c0 2023-11-26T07:20:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 >> v2:172.21.15.120:3300/0 conn(0x7f589006bac0 msgr2=0x7f5890066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 --2- 172.21.15.70:0/1980306429 >> v2:172.21.15.120:3300/0 conn(0x7f589006bac0 0x7f5890066320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 >> v1:172.21.15.120:6789/0 conn(0x7f589006a490 legacy=0x7f5890164440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589015ac90 con 0x7f58901575c0 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f588c001680 con 0x7f58901575c0 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 >> v1:172.21.15.70:6789/0 conn(0x7f58901575c0 legacy=0x7f5890159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0039d0 0x7f587c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f587c0047d0 0x7f587c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587c0051e0 0x7f587c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589015a9b0 con 0x7f587c0051e0 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c00c130 con 0x7f587c0039d0 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c00c2f0 con 0x7f587c0047d0 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589510e640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0039d0 0x7f587c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587c0051e0 0x7f587c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589490d640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f587c0047d0 0x7f587c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 -- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f587c0047d0 msgr2=0x7f587c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f587c0047d0 0x7f587c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 -- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0039d0 msgr2=0x7f587c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0039d0 0x7f587c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 -- 172.21.15.70:0/1980306429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c003530 con 0x7f587c0051e0 2023-11-26T07:20:12.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 -- 172.21.15.70:0/1980306429 reap_dead start 2023-11-26T07:20:12.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.543+0000 7f589590f640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587c0051e0 0x7f587c00b990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5888001e40 tx=0x7f588801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a002bfe228fecea6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888003b80 con 0x7f587c0051e0 2023-11-26T07:20:12.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888003ce0 con 0x7f587c0051e0 2023-11-26T07:20:12.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5887fff640 1 -- 172.21.15.70:0/1980306429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888005310 con 0x7f587c0051e0 2023-11-26T07:20:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- 172.21.15.70:0/1980306429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587c0051e0 msgr2=0x7f587c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587c0051e0 0x7f587c00b990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5888001e40 tx=0x7f588801c540 comp rx=0 tx=0).stop 2023-11-26T07:20:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- 172.21.15.70:0/1980306429 shutdown_connections 2023-11-26T07:20:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 --2- 172.21.15.70:0/1980306429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f587c0051e0 0x7f587c00b990 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- 172.21.15.70:0/1980306429 >> 172.21.15.70:0/1980306429 conn(0x7f58900cf710 msgr2=0x7f58900cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- 172.21.15.70:0/1980306429 shutdown_connections 2023-11-26T07:20:12.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- 172.21.15.70:0/1980306429 wait complete. 2023-11-26T07:20:12.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 Processor -- start 2023-11-26T07:20:12.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- start start 2023-11-26T07:20:12.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0051e0 0x7f589014b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5890154990 0x7f589014bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58900b0af0 0x7f58900ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589014b8b0 con 0x7f58900b0af0 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5890159280 con 0x7f587c0051e0 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f5897372640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5890159560 con 0x7f5890154990 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f589590f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58900b0af0 0x7f58900ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f589590f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58900b0af0 0x7f58900ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54354/0 (socket says 172.21.15.70:54354) 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f589590f640 1 -- 172.21.15.70:0/3886057042 learned_addr learned my addr 172.21.15.70:0/3886057042 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.547+0000 7f589510e640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0051e0 0x7f589014b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f589490d640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5890154990 0x7f589014bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f589590f640 1 -- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5890154990 msgr2=0x7f589014bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f589590f640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5890154990 0x7f589014bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f589590f640 1 -- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0051e0 msgr2=0x7f589014b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f589590f640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0051e0 0x7f589014b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f589590f640 1 -- 172.21.15.70:0/3886057042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890159840 con 0x7f58900b0af0 2023-11-26T07:20:12.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f589590f640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58900b0af0 0x7f58900ada60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f588801cde0 tx=0x7f587c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5885ffb640 1 -- 172.21.15.70:0/3886057042 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888003b80 con 0x7f58900b0af0 2023-11-26T07:20:12.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5885ffb640 1 -- 172.21.15.70:0/3886057042 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888007de0 con 0x7f58900b0af0 2023-11-26T07:20:12.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5885ffb640 1 -- 172.21.15.70:0/3886057042 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888006da0 con 0x7f58900b0af0 2023-11-26T07:20:12.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58900af420 con 0x7f58900b0af0 2023-11-26T07:20:12.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589014c2a0 con 0x7f58900b0af0 2023-11-26T07:20:12.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5890067680 con 0x7f58900b0af0 2023-11-26T07:20:12.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5885ffb640 1 -- 172.21.15.70:0/3886057042 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f58880ab480 con 0x7f58900b0af0 2023-11-26T07:20:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5885ffb640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5874066740 0x7f5874068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.551+0000 7f5885ffb640 1 -- 172.21.15.70:0/3886057042 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f58880b2070 con 0x7f58900b0af0 2023-11-26T07:20:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.555+0000 7f589510e640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5874066740 0x7f5874068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.555+0000 7f589510e640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5874066740 0x7f5874068c00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f588c001060 tx=0x7f588c001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.555+0000 7f5885ffb640 1 -- 172.21.15.70:0/3886057042 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58880ead40 con 0x7f58900b0af0 2023-11-26T07:20:12.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f589006e780 con 0x7f58900b0af0 2023-11-26T07:20:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5885ffb640 1 -- 172.21.15.70:0/3886057042 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58880ee360 con 0x7f58900b0af0 2023-11-26T07:20:12.709 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5874066740 msgr2=0x7f5874068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5874066740 0x7f5874068c00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f588c001060 tx=0x7f588c001a10 comp rx=0 tx=0).stop 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58900b0af0 msgr2=0x7f58900ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58900b0af0 0x7f58900ada60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f588801cde0 tx=0x7f587c005800 comp rx=0 tx=0).stop 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 shutdown_connections 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5874066740 0x7f5874068c00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58900b0af0 0x7f58900ada60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5890154990 0x7f589014bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 --2- 172.21.15.70:0/3886057042 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0051e0 0x7f589014b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 >> 172.21.15.70:0/3886057042 conn(0x7f58900cf710 msgr2=0x7f58900ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 shutdown_connections 2023-11-26T07:20:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.707+0000 7f5897372640 1 -- 172.21.15.70:0/3886057042 wait complete. 2023-11-26T07:20:12.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:20:12.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef5038d640 1 Processor -- start 2023-11-26T07:20:12.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef5038d640 1 -- start start 2023-11-26T07:20:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef5038d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fef48143ac0 0x7fef48070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef5038d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fef480708b0 0x7fef480cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef5038d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef480cc730 con 0x7fef480cf7c0 2023-11-26T07:20:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef5038d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef48143ea0 con 0x7fef48143ac0 2023-11-26T07:20:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef5038d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480cfbd0 con 0x7fef480708b0 2023-11-26T07:20:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef4e129640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fef48143ac0 0x7fef48070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef4e92a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fef480cf7c0 0x7fef480b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50448/0 (socket says 172.21.15.70:50448) 2023-11-26T07:20:12.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef4e92a640 1 -- 172.21.15.70:0/1308167864 learned_addr learned my addr 172.21.15.70:0/1308167864 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:12.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.867+0000 7fef4d928640 1 --2- 172.21.15.70:0/1308167864 >> v2:172.21.15.120:3300/0 conn(0x7fef480708b0 0x7fef480cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4e129640 1 -- 172.21.15.70:0/1308167864 >> v2:172.21.15.120:3300/0 conn(0x7fef480708b0 msgr2=0x7fef480cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:12.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4e129640 1 --2- 172.21.15.70:0/1308167864 >> v2:172.21.15.120:3300/0 conn(0x7fef480708b0 0x7fef480cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4e129640 1 -- 172.21.15.70:0/1308167864 >> v1:172.21.15.70:6789/0 conn(0x7fef480cf7c0 legacy=0x7fef480b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4d127640 1 -- 172.21.15.70:0/1308167864 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613868887 0 0) 0x7fef480cc730 con 0x7fef480cf7c0 2023-11-26T07:20:12.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4e129640 1 -- 172.21.15.70:0/1308167864 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48070ee0 con 0x7fef48143ac0 2023-11-26T07:20:12.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4e129640 1 --2- 172.21.15.70:0/1308167864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef48070370 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef480aeb10 tx=0x7fef4401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1692b89b9ae3558 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4d127640 1 -- 172.21.15.70:0/1308167864 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440ab600 con 0x7fef48143ac0 2023-11-26T07:20:12.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4d127640 1 -- 172.21.15.70:0/1308167864 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440a7050 con 0x7fef48143ac0 2023-11-26T07:20:12.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef4d127640 1 -- 172.21.15.70:0/1308167864 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440ab980 con 0x7fef48143ac0 2023-11-26T07:20:12.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef5038d640 1 -- 172.21.15.70:0/1308167864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 msgr2=0x7fef48070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.871+0000 7fef5038d640 1 --2- 172.21.15.70:0/1308167864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef48070370 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef480aeb10 tx=0x7fef4401c460 comp rx=0 tx=0).stop 2023-11-26T07:20:12.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- 172.21.15.70:0/1308167864 shutdown_connections 2023-11-26T07:20:12.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 --2- 172.21.15.70:0/1308167864 >> v2:172.21.15.120:3300/0 conn(0x7fef480708b0 0x7fef480cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 --2- 172.21.15.70:0/1308167864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef48070370 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- 172.21.15.70:0/1308167864 >> 172.21.15.70:0/1308167864 conn(0x7fef4806a890 msgr2=0x7fef4806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:12.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- 172.21.15.70:0/1308167864 shutdown_connections 2023-11-26T07:20:12.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- 172.21.15.70:0/1308167864 wait complete. 2023-11-26T07:20:12.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 Processor -- start 2023-11-26T07:20:12.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- start start 2023-11-26T07:20:12.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef480708b0 0x7fef48135f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef480cf7c0 0x7fef4813ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef480acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4813c9f0 con 0x7fef48143ac0 2023-11-26T07:20:12.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4815c870 con 0x7fef480708b0 2023-11-26T07:20:12.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef5038d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4815c590 con 0x7fef480cf7c0 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef480acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef480acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54366/0 (socket says 172.21.15.70:54366) 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 -- 172.21.15.70:0/1207874758 learned_addr learned my addr 172.21.15.70:0/1207874758 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e129640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef480708b0 0x7fef48135f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4d928640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef480cf7c0 0x7fef4813ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 -- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef480cf7c0 msgr2=0x7fef4813ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef480cf7c0 0x7fef4813ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 -- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef480708b0 msgr2=0x7fef48135f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef480708b0 0x7fef48135f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 -- 172.21.15.70:0/1207874758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44009420 con 0x7fef48143ac0 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e129640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef480708b0 0x7fef48135f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:12.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.875+0000 7fef4e92a640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef480acdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fef40001570 tx=0x7fef4000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef3effd640 1 -- 172.21.15.70:0/1207874758 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000a640 con 0x7fef48143ac0 2023-11-26T07:20:12.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef3effd640 1 -- 172.21.15.70:0/1207874758 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4000a7c0 con 0x7fef48143ac0 2023-11-26T07:20:12.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef3effd640 1 -- 172.21.15.70:0/1207874758 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000ab70 con 0x7fef48143ac0 2023-11-26T07:20:12.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4813c3a0 con 0x7fef48143ac0 2023-11-26T07:20:12.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef48136450 con 0x7fef48143ac0 2023-11-26T07:20:12.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4813c200 con 0x7fef48143ac0 2023-11-26T07:20:12.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef3effd640 1 -- 172.21.15.70:0/1207874758 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fef4000acd0 con 0x7fef48143ac0 2023-11-26T07:20:12.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef3effd640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fef2c066740 0x7fef2c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:12.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef3effd640 1 -- 172.21.15.70:0/1207874758 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fef40083780 con 0x7fef48143ac0 2023-11-26T07:20:12.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.879+0000 7fef4e129640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fef2c066740 0x7fef2c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:12.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.883+0000 7fef4e129640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fef2c066740 0x7fef2c068c00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fef440ad000 tx=0x7fef440a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:12.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:12.883+0000 7fef3effd640 1 -- 172.21.15.70:0/1207874758 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef4813c200 con 0x7fef48143ac0 2023-11-26T07:20:13.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef4813c200 con 0x7fef48143ac0 2023-11-26T07:20:13.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef3effd640 1 -- 172.21.15.70:0/1207874758 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef4813c200 con 0x7fef48143ac0 2023-11-26T07:20:13.036 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:20:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fef2c066740 msgr2=0x7fef2c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fef2c066740 0x7fef2c068c00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fef440ad000 tx=0x7fef440a6000 comp rx=0 tx=0).stop 2023-11-26T07:20:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 msgr2=0x7fef480acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef480acdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fef40001570 tx=0x7fef4000cca0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 shutdown_connections 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fef2c066740 0x7fef2c068c00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef48143ac0 0x7fef480acdf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef480cf7c0 0x7fef4813ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 --2- 172.21.15.70:0/1207874758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef480708b0 0x7fef48135f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 >> 172.21.15.70:0/1207874758 conn(0x7fef4806a890 msgr2=0x7fef480b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 shutdown_connections 2023-11-26T07:20:13.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.035+0000 7fef5038d640 1 -- 172.21.15.70:0/1207874758 wait complete. 2023-11-26T07:20:13.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:20:13.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 Processor -- start 2023-11-26T07:20:13.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 -- start start 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff70415d370 0x7ff7040d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7040d0e50 0x7ff7040cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040cff90 0x7ff7040b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040d0420 con 0x7ff70415d370 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040cdbf0 con 0x7ff7040d0e50 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70afe4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040cde90 con 0x7ff7040cff90 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff70415d370 0x7ff7040d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff70415d370 0x7ff7040d3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54378/0 (socket says 172.21.15.70:54378) 2023-11-26T07:20:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 -- 172.21.15.70:0/3644583712 learned_addr learned my addr 172.21.15.70:0/3644583712 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff70a7e3640 1 --2- 172.21.15.70:0/3644583712 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040cff90 0x7ff7040b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff7097e1640 1 --2- 172.21.15.70:0/3644583712 >> v2:172.21.15.120:3300/0 conn(0x7ff7040d0e50 0x7ff7040cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 -- 172.21.15.70:0/3644583712 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040cff90 msgr2=0x7ff7040b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 --2- 172.21.15.70:0/3644583712 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040cff90 0x7ff7040b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 -- 172.21.15.70:0/3644583712 >> v2:172.21.15.120:3300/0 conn(0x7ff7040d0e50 msgr2=0x7ff7040cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 --2- 172.21.15.70:0/3644583712 >> v2:172.21.15.120:3300/0 conn(0x7ff7040d0e50 0x7ff7040cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.195+0000 7ff709fe2640 1 -- 172.21.15.70:0/3644583712 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040ce170 con 0x7ff70415d370 2023-11-26T07:20:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff709fe2640 1 --2- 172.21.15.70:0/3644583712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff7040d3b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff700009870 tx=0x7ff70001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d6d39ef2664250 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff708fe0640 1 -- 172.21.15.70:0/3644583712 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000ad640 con 0x7ff70415d370 2023-11-26T07:20:13.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff708fe0640 1 -- 172.21.15.70:0/3644583712 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7000ad7a0 con 0x7ff70415d370 2023-11-26T07:20:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff708fe0640 1 -- 172.21.15.70:0/3644583712 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000adb30 con 0x7ff70415d370 2023-11-26T07:20:13.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 -- 172.21.15.70:0/3644583712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 msgr2=0x7ff7040d3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 --2- 172.21.15.70:0/3644583712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff7040d3b60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff700009870 tx=0x7ff70001c4d0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 -- 172.21.15.70:0/3644583712 shutdown_connections 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 --2- 172.21.15.70:0/3644583712 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040cff90 0x7ff7040b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 --2- 172.21.15.70:0/3644583712 >> v2:172.21.15.120:3300/0 conn(0x7ff7040d0e50 0x7ff7040cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 --2- 172.21.15.70:0/3644583712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff7040d3b60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 -- 172.21.15.70:0/3644583712 >> 172.21.15.70:0/3644583712 conn(0x7ff7040d3070 msgr2=0x7ff7040d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 -- 172.21.15.70:0/3644583712 shutdown_connections 2023-11-26T07:20:13.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.199+0000 7ff70afe4640 1 -- 172.21.15.70:0/3644583712 wait complete. 2023-11-26T07:20:13.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 Processor -- start 2023-11-26T07:20:13.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 -- start start 2023-11-26T07:20:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7040cff90 0x7ff704153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040d0e50 0x7ff704157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff70414a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70414b8e0 con 0x7ff70415d370 2023-11-26T07:20:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040ca500 con 0x7ff7040cff90 2023-11-26T07:20:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7040ca7e0 con 0x7ff7040d0e50 2023-11-26T07:20:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff70414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff70414a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54390/0 (socket says 172.21.15.70:54390) 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 -- 172.21.15.70:0/2493931313 learned_addr learned my addr 172.21.15.70:0/2493931313 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff7097e1640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040d0e50 0x7ff704157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff709fe2640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7040cff90 0x7ff704153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 -- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040d0e50 msgr2=0x7ff704157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040d0e50 0x7ff704157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 -- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7040cff90 msgr2=0x7ff704153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7040cff90 0x7ff704153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 -- 172.21.15.70:0/2493931313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000094d0 con 0x7ff70415d370 2023-11-26T07:20:13.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70a7e3640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff70414a920 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007d20 tx=0x7ff6fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff6fa7fc640 1 -- 172.21.15.70:0/2493931313 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc014420 con 0x7ff70415d370 2023-11-26T07:20:13.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff6fa7fc640 1 -- 172.21.15.70:0/2493931313 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc0145a0 con 0x7ff70415d370 2023-11-26T07:20:13.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff6fa7fc640 1 -- 172.21.15.70:0/2493931313 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc014950 con 0x7ff70415d370 2023-11-26T07:20:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7040caac0 con 0x7ff70415d370 2023-11-26T07:20:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.203+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7040cb080 con 0x7ff70415d370 2023-11-26T07:20:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.207+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff704067500 con 0x7ff70415d370 2023-11-26T07:20:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.207+0000 7ff6fa7fc640 1 -- 172.21.15.70:0/2493931313 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7ff6fc014ab0 con 0x7ff70415d370 2023-11-26T07:20:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.207+0000 7ff6fa7fc640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff6e8066740 0x7ff6e8068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.207+0000 7ff6fa7fc640 1 -- 172.21.15.70:0/2493931313 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7ff6fc084a60 con 0x7ff70415d370 2023-11-26T07:20:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.207+0000 7ff709fe2640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff6e8066740 0x7ff6e8068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.207+0000 7ff709fe2640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff6e8066740 0x7ff6e8068c00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff7000af000 tx=0x7ff700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.211+0000 7ff6fa7fc640 1 -- 172.21.15.70:0/2493931313 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6fc051c20 con 0x7ff70415d370 2023-11-26T07:20:13.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff7040d0620 con 0x7ff70415d370 2023-11-26T07:20:13.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff6fa7fc640 1 -- 172.21.15.70:0/2493931313 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff6fc055240 con 0x7ff70415d370 2023-11-26T07:20:13.377 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:20:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff6e8066740 msgr2=0x7ff6e8068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff6e8066740 0x7ff6e8068c00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff7000af000 tx=0x7ff700009040 comp rx=0 tx=0).stop 2023-11-26T07:20:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 msgr2=0x7ff70414a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff70414a920 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007d20 tx=0x7ff6fc00e4b0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 shutdown_connections 2023-11-26T07:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff6e8066740 0x7ff6e8068c00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff70415d370 0x7ff70414a920 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff7040d0e50 0x7ff704157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.375+0000 7ff70afe4640 1 --2- 172.21.15.70:0/2493931313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7040cff90 0x7ff704153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.379+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 >> 172.21.15.70:0/2493931313 conn(0x7ff7040d3070 msgr2=0x7ff704158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.379+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 shutdown_connections 2023-11-26T07:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.379+0000 7ff70afe4640 1 -- 172.21.15.70:0/2493931313 wait complete. 2023-11-26T07:20:13.398 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2023-11-26T07:20:13.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:13.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:13.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:20:13.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:13.421 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:20:13.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[47434]: fuse finished with error 0 and tester_r 0 2023-11-26T07:20:13.559 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:20:13.559 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:13.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:13.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f019b3ec640 1 Processor -- start 2023-11-26T07:20:13.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f019b3ec640 1 -- start start 2023-11-26T07:20:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f019b3ec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940d1bc0 0x7f01940d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f019b3ec640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f01940b2160 0x7f01940b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f019b3ec640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01940cf0e0 con 0x7f019415d6e0 2023-11-26T07:20:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f019b3ec640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019415dac0 con 0x7f01940b2160 2023-11-26T07:20:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f019b3ec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01940ceb20 con 0x7f01940d1bc0 2023-11-26T07:20:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0199188640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f019415d6e0 0x7f01940d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39592/0 (socket says 172.21.15.70:39592) 2023-11-26T07:20:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0199188640 1 -- 172.21.15.70:0/2264913087 learned_addr learned my addr 172.21.15.70:0/2264913087 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0199989640 1 --2- 172.21.15.70:0/2264913087 >> v2:172.21.15.70:3300/0 conn(0x7f01940b2160 0x7f01940b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0198987640 1 --2- 172.21.15.70:0/2264913087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940d1bc0 0x7f01940d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0199989640 1 -- 172.21.15.70:0/2264913087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940d1bc0 msgr2=0x7f01940d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0199989640 1 --2- 172.21.15.70:0/2264913087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940d1bc0 0x7f01940d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0199989640 1 -- 172.21.15.70:0/2264913087 >> v1:172.21.15.70:6789/0 conn(0x7f019415d6e0 legacy=0x7f01940d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f018bfff640 1 -- 172.21.15.70:0/2264913087 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319497799 0 0) 0x7f01940cf0e0 con 0x7f019415d6e0 2023-11-26T07:20:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0199989640 1 -- 172.21.15.70:0/2264913087 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940cee00 con 0x7f01940b2160 2023-11-26T07:20:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.739+0000 7f0198987640 1 --2- 172.21.15.70:0/2264913087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940d1bc0 0x7f01940d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f0199989640 1 --2- 172.21.15.70:0/2264913087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01940b2160 0x7f01940b0750 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f018c009d90 tx=0x7f018c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10694cf2a0d338a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f018bfff640 1 -- 172.21.15.70:0/2264913087 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0a5900 con 0x7f01940b2160 2023-11-26T07:20:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f018bfff640 1 -- 172.21.15.70:0/2264913087 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c0a5a60 con 0x7f01940b2160 2023-11-26T07:20:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f018bfff640 1 -- 172.21.15.70:0/2264913087 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0a5df0 con 0x7f01940b2160 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 -- 172.21.15.70:0/2264913087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01940b2160 msgr2=0x7f01940b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 --2- 172.21.15.70:0/2264913087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01940b2160 0x7f01940b0750 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f018c009d90 tx=0x7f018c01c950 comp rx=0 tx=0).stop 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 -- 172.21.15.70:0/2264913087 shutdown_connections 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 --2- 172.21.15.70:0/2264913087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01940b2160 0x7f01940b0750 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 --2- 172.21.15.70:0/2264913087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940d1bc0 0x7f01940d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 -- 172.21.15.70:0/2264913087 >> 172.21.15.70:0/2264913087 conn(0x7f019409c550 msgr2=0x7f01940d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 -- 172.21.15.70:0/2264913087 shutdown_connections 2023-11-26T07:20:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.743+0000 7f019b3ec640 1 -- 172.21.15.70:0/2264913087 wait complete. 2023-11-26T07:20:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 Processor -- start 2023-11-26T07:20:13.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 -- start start 2023-11-26T07:20:13.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940b2160 0x7f0194157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01940d1bc0 0x7f01940cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f019415d6e0 0x7f01940cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01940b7940 con 0x7f019415d6e0 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01940b7be0 con 0x7f01940d1bc0 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01940b7ec0 con 0x7f01940b2160 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f019415d6e0 0x7f01940cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f019415d6e0 0x7f01940cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34242/0 (socket says 172.21.15.70:34242) 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 -- 172.21.15.70:0/3247644878 learned_addr learned my addr 172.21.15.70:0/3247644878 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199188640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940b2160 0x7f0194157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0198987640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01940d1bc0 0x7f01940cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 -- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940b2160 msgr2=0x7f0194157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940b2160 0x7f0194157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 -- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01940d1bc0 msgr2=0x7f01940cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01940d1bc0 0x7f01940cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 -- 172.21.15.70:0/3247644878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009a70 con 0x7f019415d6e0 2023-11-26T07:20:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0198987640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01940d1bc0 0x7f01940cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0199989640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f019415d6e0 0x7f01940cc710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f018c01b000 tx=0x7f018c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0189ffb640 1 -- 172.21.15.70:0/3247644878 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0ad950 con 0x7f019415d6e0 2023-11-26T07:20:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0189ffb640 1 -- 172.21.15.70:0/3247644878 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c0adab0 con 0x7f019415d6e0 2023-11-26T07:20:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f0189ffb640 1 -- 172.21.15.70:0/3247644878 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0ade40 con 0x7f019415d6e0 2023-11-26T07:20:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01940b81a0 con 0x7f019415d6e0 2023-11-26T07:20:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.747+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01940cb1b0 con 0x7f019415d6e0 2023-11-26T07:20:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.751+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0194067680 con 0x7f019415d6e0 2023-11-26T07:20:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.751+0000 7f0189ffb640 1 -- 172.21.15.70:0/3247644878 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f018c0b9450 con 0x7f019415d6e0 2023-11-26T07:20:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.751+0000 7f0189ffb640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0178066770 0x7f0178068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.751+0000 7f0189ffb640 1 -- 172.21.15.70:0/3247644878 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f018c11f4a0 con 0x7f019415d6e0 2023-11-26T07:20:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.751+0000 7f0199188640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0178066770 0x7f0178068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.751+0000 7f0199188640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0178066770 0x7f0178068c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0190000f70 tx=0x7f0190007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.755+0000 7f0189ffb640 1 -- 172.21.15.70:0/3247644878 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f018c0ec600 con 0x7f019415d6e0 2023-11-26T07:20:13.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01940b8650 con 0x7f019415d6e0 2023-11-26T07:20:13.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f0189ffb640 1 -- 172.21.15.70:0/3247644878 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16634 (secure 0 0 0) 0x7f018c0efc20 con 0x7f019415d6e0 2023-11-26T07:20:13.909 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:13.909 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:03.792953+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0178066770 msgr2=0x7f0178068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0178066770 0x7f0178068c30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0190000f70 tx=0x7f0190007df0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f019415d6e0 msgr2=0x7f01940cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f019415d6e0 0x7f01940cc710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f018c01b000 tx=0x7f018c0196f0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 shutdown_connections 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0178066770 0x7f0178068c30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f019415d6e0 0x7f01940cc710 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01940d1bc0 0x7f01940cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 --2- 172.21.15.70:0/3247644878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01940b2160 0x7f0194157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:13.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 >> 172.21.15.70:0/3247644878 conn(0x7f019409c550 msgr2=0x7f01940b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:13.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 shutdown_connections 2023-11-26T07:20:13.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:13.907+0000 7f019b3ec640 1 -- 172.21.15.70:0/3247644878 wait complete. 2023-11-26T07:20:13.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:19:08.139388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:19:08.576466+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:20:13.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:20:14.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb4dddf640 1 Processor -- start 2023-11-26T07:20:14.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb4dddf640 1 -- start start 2023-11-26T07:20:14.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb4dddf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb481596d0 0x7fbb48071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb4dddf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4806c750 con 0x7fbb480ce680 2023-11-26T07:20:14.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb4dddf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480b3550 con 0x7fbb480b2f80 2023-11-26T07:20:14.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb4dddf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb480cbe00 con 0x7fbb481596d0 2023-11-26T07:20:14.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb477fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb481596d0 0x7fbb48071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb46ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbb480ce680 0x7fbb480b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39602/0 (socket says 172.21.15.70:39602) 2023-11-26T07:20:14.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb46ffd640 1 -- 172.21.15.70:0/206455366 learned_addr learned my addr 172.21.15.70:0/206455366 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:14.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb477fe640 1 -- 172.21.15.70:0/206455366 >> v1:172.21.15.120:6789/0 conn(0x7fbb480b2f80 legacy=0x7fbb4806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:14.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb477fe640 1 -- 172.21.15.70:0/206455366 >> v1:172.21.15.70:6789/0 conn(0x7fbb480ce680 legacy=0x7fbb480b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.071+0000 7fbb477fe640 1 -- 172.21.15.70:0/206455366 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48071e80 con 0x7fbb481596d0 2023-11-26T07:20:14.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb477fe640 1 --2- 172.21.15.70:0/206455366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb481596d0 0x7fbb48071850 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbb380097c0 tx=0x7fbb3801e4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cdb62d33b21222 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb467fc640 1 -- 172.21.15.70:0/206455366 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380ac430 con 0x7fbb481596d0 2023-11-26T07:20:14.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb467fc640 1 -- 172.21.15.70:0/206455366 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380ac590 con 0x7fbb481596d0 2023-11-26T07:20:14.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb467fc640 1 -- 172.21.15.70:0/206455366 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380ac920 con 0x7fbb481596d0 2023-11-26T07:20:14.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 -- 172.21.15.70:0/206455366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb481596d0 msgr2=0x7fbb48071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/206455366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb481596d0 0x7fbb48071850 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbb380097c0 tx=0x7fbb3801e4e0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 -- 172.21.15.70:0/206455366 shutdown_connections 2023-11-26T07:20:14.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/206455366 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb481596d0 0x7fbb48071850 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 -- 172.21.15.70:0/206455366 >> 172.21.15.70:0/206455366 conn(0x7fbb4806a890 msgr2=0x7fbb4806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:14.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 -- 172.21.15.70:0/206455366 shutdown_connections 2023-11-26T07:20:14.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 -- 172.21.15.70:0/206455366 wait complete. 2023-11-26T07:20:14.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.075+0000 7fbb4dddf640 1 Processor -- start 2023-11-26T07:20:14.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 -- start start 2023-11-26T07:20:14.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb480b2f80 0x7fbb481f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbb480ce680 0x7fbb481504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb481596d0 0x7fbb4814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4814ee40 con 0x7fbb480b2f80 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4815a130 con 0x7fbb481596d0 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4815a410 con 0x7fbb480ce680 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb480b2f80 0x7fbb481f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb480b2f80 0x7fbb481f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34258/0 (socket says 172.21.15.70:34258) 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 -- 172.21.15.70:0/1791243741 learned_addr learned my addr 172.21.15.70:0/1791243741 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb47fff640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb481596d0 0x7fbb4814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb46ffd640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbb480ce680 0x7fbb481504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 -- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbb480ce680 msgr2=0x7fbb481504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbb480ce680 0x7fbb481504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 -- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb481596d0 msgr2=0x7fbb4814c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb481596d0 0x7fbb4814c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 -- 172.21.15.70:0/1791243741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38009420 con 0x7fbb480b2f80 2023-11-26T07:20:14.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb47fff640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb481596d0 0x7fbb4814c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:14.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb46ffd640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbb480ce680 0x7fbb481504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:14.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb477fe640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb480b2f80 0x7fbb481f2e10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbb380ae040 tx=0x7fbb3801cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb2ffff640 1 -- 172.21.15.70:0/1791243741 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380abbb0 con 0x7fbb480b2f80 2023-11-26T07:20:14.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb2ffff640 1 -- 172.21.15.70:0/1791243741 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380abd30 con 0x7fbb480b2f80 2023-11-26T07:20:14.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb2ffff640 1 -- 172.21.15.70:0/1791243741 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380b5660 con 0x7fbb480b2f80 2023-11-26T07:20:14.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4815a6f0 con 0x7fbb480b2f80 2023-11-26T07:20:14.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4814cd60 con 0x7fbb480b2f80 2023-11-26T07:20:14.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.079+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4814cd60 con 0x7fbb480b2f80 2023-11-26T07:20:14.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.083+0000 7fbb2ffff640 1 -- 172.21.15.70:0/1791243741 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fbb380b57c0 con 0x7fbb480b2f80 2023-11-26T07:20:14.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.083+0000 7fbb2ffff640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb34066740 0x7fbb34068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.083+0000 7fbb2ffff640 1 -- 172.21.15.70:0/1791243741 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fbb3811e920 con 0x7fbb480b2f80 2023-11-26T07:20:14.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.083+0000 7fbb46ffd640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb34066740 0x7fbb34068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.083+0000 7fbb46ffd640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb34066740 0x7fbb34068c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb481e3d60 tx=0x7fbb3c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.087+0000 7fbb2ffff640 1 -- 172.21.15.70:0/1791243741 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb380eb920 con 0x7fbb480b2f80 2023-11-26T07:20:14.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.243+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb4814cd60 con 0x7fbb480b2f80 2023-11-26T07:20:14.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.243+0000 7fbb2ffff640 1 -- 172.21.15.70:0/1791243741 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb38006e20 con 0x7fbb480b2f80 2023-11-26T07:20:14.245 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb34066740 msgr2=0x7fbb34068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb34066740 0x7fbb34068c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbb481e3d60 tx=0x7fbb3c00b040 comp rx=0 tx=0).stop 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb480b2f80 msgr2=0x7fbb481f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb480b2f80 0x7fbb481f2e10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbb380ae040 tx=0x7fbb3801cd20 comp rx=0 tx=0).stop 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 shutdown_connections 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbb481596d0 0x7fbb4814c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbb480ce680 0x7fbb481504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb34066740 0x7fbb34068c00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 --2- 172.21.15.70:0/1791243741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb480b2f80 0x7fbb481f2e10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 >> 172.21.15.70:0/1791243741 conn(0x7fbb4806a890 msgr2=0x7fbb480b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:14.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 shutdown_connections 2023-11-26T07:20:14.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.247+0000 7fbb4dddf640 1 -- 172.21.15.70:0/1791243741 wait complete. 2023-11-26T07:20:14.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:20:14.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.403+0000 7f3cadd72640 1 Processor -- start 2023-11-26T07:20:14.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3cadd72640 1 -- start start 2023-11-26T07:20:14.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3cadd72640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3ca813e290 0x7f3ca80cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3cadd72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3cadd72640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca806c520 con 0x7f3ca815f4e0 2023-11-26T07:20:14.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3cadd72640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80cfc40 con 0x7f3ca813e290 2023-11-26T07:20:14.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3cadd72640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca806c800 con 0x7f3ca80cf7c0 2023-11-26T07:20:14.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca7fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3ca815f4e0 0x7f3ca81408e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39604/0 (socket says 172.21.15.70:39604) 2023-11-26T07:20:14.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca7fff640 1 -- 172.21.15.70:0/133501273 learned_addr learned my addr 172.21.15.70:0/133501273 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:14.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca6ffd640 1 --2- 172.21.15.70:0/133501273 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca77fe640 1 --2- 172.21.15.70:0/133501273 >> v2:172.21.15.120:3300/0 conn(0x7f3ca813e290 0x7f3ca80cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca67fc640 1 -- 172.21.15.70:0/133501273 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140348470 0 0) 0x7f3ca806c520 con 0x7f3ca815f4e0 2023-11-26T07:20:14.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca67fc640 1 -- 172.21.15.70:0/133501273 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c90003530 con 0x7f3ca815f4e0 2023-11-26T07:20:14.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca6ffd640 1 -- 172.21.15.70:0/133501273 >> v2:172.21.15.120:3300/0 conn(0x7f3ca813e290 msgr2=0x7f3ca80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:14.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca6ffd640 1 --2- 172.21.15.70:0/133501273 >> v2:172.21.15.120:3300/0 conn(0x7f3ca813e290 0x7f3ca80cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca6ffd640 1 -- 172.21.15.70:0/133501273 >> v1:172.21.15.70:6789/0 conn(0x7f3ca815f4e0 legacy=0x7f3ca81408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca6ffd640 1 -- 172.21.15.70:0/133501273 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca806cae0 con 0x7f3ca80cf7c0 2023-11-26T07:20:14.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.407+0000 7f3ca77fe640 1 --2- 172.21.15.70:0/133501273 >> v2:172.21.15.120:3300/0 conn(0x7f3ca813e290 0x7f3ca80cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:14.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3ca6ffd640 1 --2- 172.21.15.70:0/133501273 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca815efa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0097c0 tx=0x7f3c9c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403004191ffb42aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3ca67fc640 1 -- 172.21.15.70:0/133501273 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0ab650 con 0x7f3ca80cf7c0 2023-11-26T07:20:14.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3ca67fc640 1 -- 172.21.15.70:0/133501273 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c0ab7b0 con 0x7f3ca80cf7c0 2023-11-26T07:20:14.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3ca67fc640 1 -- 172.21.15.70:0/133501273 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0abb40 con 0x7f3ca80cf7c0 2023-11-26T07:20:14.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 -- 172.21.15.70:0/133501273 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 msgr2=0x7f3ca815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 --2- 172.21.15.70:0/133501273 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca815efa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0097c0 tx=0x7f3c9c01c450 comp rx=0 tx=0).stop 2023-11-26T07:20:14.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 -- 172.21.15.70:0/133501273 shutdown_connections 2023-11-26T07:20:14.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 --2- 172.21.15.70:0/133501273 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca815efa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 --2- 172.21.15.70:0/133501273 >> v2:172.21.15.120:3300/0 conn(0x7f3ca813e290 0x7f3ca80cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 -- 172.21.15.70:0/133501273 >> 172.21.15.70:0/133501273 conn(0x7f3ca806a890 msgr2=0x7f3ca806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 -- 172.21.15.70:0/133501273 shutdown_connections 2023-11-26T07:20:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 -- 172.21.15.70:0/133501273 wait complete. 2023-11-26T07:20:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.411+0000 7f3cadd72640 1 Processor -- start 2023-11-26T07:20:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 -- start start 2023-11-26T07:20:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca8154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca813e290 0x7f3ca81418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ca815f4e0 0x7f3ca8141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80af610 con 0x7f3ca813e290 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca815e180 con 0x7f3ca815f4e0 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca815dbc0 con 0x7f3ca80cf7c0 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca813e290 0x7f3ca81418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca813e290 0x7f3ca81418f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34272/0 (socket says 172.21.15.70:34272) 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 -- 172.21.15.70:0/4053163747 learned_addr learned my addr 172.21.15.70:0/4053163747 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca7fff640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ca815f4e0 0x7f3ca8141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca77fe640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca8154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 -- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 msgr2=0x7f3ca8154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca8154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 -- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ca815f4e0 msgr2=0x7f3ca8141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ca815f4e0 0x7f3ca8141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 -- 172.21.15.70:0/4053163747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c98009420 con 0x7f3ca813e290 2023-11-26T07:20:14.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3ca6ffd640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca813e290 0x7f3ca81418f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0ad040 tx=0x7f3c9c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3c8ffff640 1 -- 172.21.15.70:0/4053163747 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0bf610 con 0x7f3ca813e290 2023-11-26T07:20:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3c8ffff640 1 -- 172.21.15.70:0/4053163747 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c0bf7b0 con 0x7f3ca813e290 2023-11-26T07:20:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3c8ffff640 1 -- 172.21.15.70:0/4053163747 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0bfb60 con 0x7f3ca813e290 2023-11-26T07:20:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c009420 con 0x7f3ca813e290 2023-11-26T07:20:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca80afd00 con 0x7f3ca813e290 2023-11-26T07:20:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.415+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca8067680 con 0x7f3ca813e290 2023-11-26T07:20:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.419+0000 7f3c8ffff640 1 -- 172.21.15.70:0/4053163747 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f3c9c0b5400 con 0x7f3ca813e290 2023-11-26T07:20:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.419+0000 7f3c8ffff640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c94066740 0x7f3c94068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.419+0000 7f3c8ffff640 1 -- 172.21.15.70:0/4053163747 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f3c9c11ebf0 con 0x7f3ca813e290 2023-11-26T07:20:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.419+0000 7f3ca77fe640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c94066740 0x7f3c94068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.419+0000 7f3ca77fe640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c94066740 0x7f3c94068c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009cf0 tx=0x7f3c98009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.423+0000 7f3c8ffff640 1 -- 172.21.15.70:0/4053163747 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c9c0ebdb0 con 0x7f3ca813e290 2023-11-26T07:20:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.571+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ca806df50 con 0x7f3ca813e290 2023-11-26T07:20:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.571+0000 7f3c8ffff640 1 -- 172.21.15.70:0/4053163747 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c9c0ef3d0 con 0x7f3ca813e290 2023-11-26T07:20:14.573 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.571+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c94066740 msgr2=0x7f3c94068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.571+0000 7f3cadd72640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c94066740 0x7f3c94068c00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009cf0 tx=0x7f3c98009190 comp rx=0 tx=0).stop 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca813e290 msgr2=0x7f3ca81418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca813e290 0x7f3ca81418f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0ad040 tx=0x7f3c9c01ac90 comp rx=0 tx=0).stop 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 shutdown_connections 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c94066740 0x7f3c94068c00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ca813e290 0x7f3ca81418f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ca815f4e0 0x7f3ca8141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 --2- 172.21.15.70:0/4053163747 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3ca80cf7c0 0x7f3ca8154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 >> 172.21.15.70:0/4053163747 conn(0x7f3ca806a890 msgr2=0x7f3ca8139140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:14.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 shutdown_connections 2023-11-26T07:20:14.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.575+0000 7f3cadd72640 1 -- 172.21.15.70:0/4053163747 wait complete. 2023-11-26T07:20:14.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:20:14.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.731+0000 7f07d6efe640 1 Processor -- start 2023-11-26T07:20:14.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.731+0000 7f07d6efe640 1 -- start start 2023-11-26T07:20:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d6efe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f07d00666f0 0x7f07d00cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d6efe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00cbdb0 con 0x7f07d00cf150 2023-11-26T07:20:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d6efe640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00cbfe0 con 0x7f07d006d150 2023-11-26T07:20:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d6efe640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d0066b40 con 0x7f07d00666f0 2023-11-26T07:20:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d4c9a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f07d00cf150 0x7f07d006ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39612/0 (socket says 172.21.15.70:39612) 2023-11-26T07:20:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d4c9a640 1 -- 172.21.15.70:0/966574674 learned_addr learned my addr 172.21.15.70:0/966574674 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:14.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d549b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f07d00666f0 0x7f07d00cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d549b640 1 -- 172.21.15.70:0/966574674 >> v1:172.21.15.120:6789/0 conn(0x7f07d006d150 legacy=0x7f07d00cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d549b640 1 -- 172.21.15.70:0/966574674 >> v1:172.21.15.70:6789/0 conn(0x7f07d00cf150 legacy=0x7f07d006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07d549b640 1 -- 172.21.15.70:0/966574674 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00cf530 con 0x7f07d00666f0 2023-11-26T07:20:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.735+0000 7f07c77fe640 1 -- 172.21.15.70:0/966574674 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057502347 0 0) 0x7f07d00cbdb0 con 0x7f07d00cf150 2023-11-26T07:20:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d549b640 1 --2- 172.21.15.70:0/966574674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00666f0 0x7f07d00cb870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009d90 tx=0x7f07c801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee911cf537c784aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07c77fe640 1 -- 172.21.15.70:0/966574674 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80a5960 con 0x7f07d00666f0 2023-11-26T07:20:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07c77fe640 1 -- 172.21.15.70:0/966574674 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c80a5ac0 con 0x7f07d00666f0 2023-11-26T07:20:14.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07c77fe640 1 -- 172.21.15.70:0/966574674 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80a5e50 con 0x7f07d00666f0 2023-11-26T07:20:14.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- 172.21.15.70:0/966574674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00666f0 msgr2=0x7f07d00cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 --2- 172.21.15.70:0/966574674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00666f0 0x7f07d00cb870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009d90 tx=0x7f07c801c8a0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- 172.21.15.70:0/966574674 shutdown_connections 2023-11-26T07:20:14.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 --2- 172.21.15.70:0/966574674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00666f0 0x7f07d00cb870 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- 172.21.15.70:0/966574674 >> 172.21.15.70:0/966574674 conn(0x7f07d00cf710 msgr2=0x7f07d00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:14.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- 172.21.15.70:0/966574674 shutdown_connections 2023-11-26T07:20:14.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- 172.21.15.70:0/966574674 wait complete. 2023-11-26T07:20:14.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 Processor -- start 2023-11-26T07:20:14.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- start start 2023-11-26T07:20:14.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07d00666f0 0x7f07d0169420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07d006d150 0x7f07d0140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00cf150 0x7f07d0158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0140f80 con 0x7f07d00cf150 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0142910 con 0x7f07d00666f0 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.739+0000 7f07d6efe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0142bf0 con 0x7f07d006d150 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00cf150 0x7f07d0158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00cf150 0x7f07d0158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34288/0 (socket says 172.21.15.70:34288) 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 -- 172.21.15.70:0/3043577005 learned_addr learned my addr 172.21.15.70:0/3043577005 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07c7fff640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07d006d150 0x7f07d0140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d4c9a640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07d00666f0 0x7f07d0169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 -- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07d006d150 msgr2=0x7f07d0140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07d006d150 0x7f07d0140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 -- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07d00666f0 msgr2=0x7f07d0169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07d00666f0 0x7f07d0169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 -- 172.21.15.70:0/3043577005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8009a70 con 0x7f07d00cf150 2023-11-26T07:20:14.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d549b640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00cf150 0x7f07d0158940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f07c80b0040 tx=0x7f07c8019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07c57fa640 1 -- 172.21.15.70:0/3043577005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80a5e30 con 0x7f07d00cf150 2023-11-26T07:20:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07c57fa640 1 -- 172.21.15.70:0/3043577005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c80adc40 con 0x7f07d00cf150 2023-11-26T07:20:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d013eb50 con 0x7f07d00cf150 2023-11-26T07:20:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07c57fa640 1 -- 172.21.15.70:0/3043577005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80b8480 con 0x7f07d00cf150 2023-11-26T07:20:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d0158e80 con 0x7f07d00cf150 2023-11-26T07:20:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d0067680 con 0x7f07d00cf150 2023-11-26T07:20:14.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.743+0000 7f07c57fa640 1 -- 172.21.15.70:0/3043577005 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f07c80b4040 con 0x7f07d00cf150 2023-11-26T07:20:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.747+0000 7f07c57fa640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f07bc066740 0x7f07bc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.747+0000 7f07c57fa640 1 -- 172.21.15.70:0/3043577005 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f07c811f860 con 0x7f07d00cf150 2023-11-26T07:20:14.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.747+0000 7f07d4c9a640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f07bc066740 0x7f07bc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:14.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.747+0000 7f07d4c9a640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f07bc066740 0x7f07bc068c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07cc000f70 tx=0x7f07cc007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:14.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.751+0000 7f07c57fa640 1 -- 172.21.15.70:0/3043577005 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07c80ecaa0 con 0x7f07d00cf150 2023-11-26T07:20:14.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.899+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07d013f000 con 0x7f07d00cf150 2023-11-26T07:20:14.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.899+0000 7f07c57fa640 1 -- 172.21.15.70:0/3043577005 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07c80f00c0 con 0x7f07d00cf150 2023-11-26T07:20:14.903 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f07bc066740 msgr2=0x7f07bc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f07bc066740 0x7f07bc068c00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f07cc000f70 tx=0x7f07cc007240 comp rx=0 tx=0).stop 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00cf150 msgr2=0x7f07d0158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00cf150 0x7f07d0158940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f07c80b0040 tx=0x7f07c8019640 comp rx=0 tx=0).stop 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 shutdown_connections 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f07bc066740 0x7f07bc068c00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00cf150 0x7f07d0158940 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07d006d150 0x7f07d0140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 --2- 172.21.15.70:0/3043577005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07d00666f0 0x7f07d0169420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 >> 172.21.15.70:0/3043577005 conn(0x7f07d00cf710 msgr2=0x7f07d00ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:14.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 shutdown_connections 2023-11-26T07:20:14.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:14.903+0000 7f07d6efe640 1 -- 172.21.15.70:0/3043577005 wait complete. 2023-11-26T07:20:14.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:20:15.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.059+0000 7fcce9555640 1 Processor -- start 2023-11-26T07:20:15.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.059+0000 7fcce9555640 1 -- start start 2023-11-26T07:20:15.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce9555640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcce415d6e0 0x7fcce40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce9555640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcce40b2160 0x7fcce40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce9555640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce40cf0e0 con 0x7fcce40d19f0 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce9555640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce415dac0 con 0x7fcce415d6e0 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce9555640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40d1e80 con 0x7fcce40b2160 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce37fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcce40d19f0 0x7fcce40cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39626/0 (socket says 172.21.15.70:39626) 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce37fe640 1 -- 172.21.15.70:0/108146396 learned_addr learned my addr 172.21.15.70:0/108146396 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce2ffd640 1 --2- 172.21.15.70:0/108146396 >> v2:172.21.15.70:3300/0 conn(0x7fcce415d6e0 0x7fcce40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fccda7fc640 1 --2- 172.21.15.70:0/108146396 >> v2:172.21.15.120:3300/0 conn(0x7fcce40b2160 0x7fcce40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce27fc640 1 -- 172.21.15.70:0/108146396 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576799729 0 0) 0x7fcce40cf0e0 con 0x7fcce40d19f0 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce27fc640 1 -- 172.21.15.70:0/108146396 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd0003530 con 0x7fcce40d19f0 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce2ffd640 1 -- 172.21.15.70:0/108146396 >> v2:172.21.15.120:3300/0 conn(0x7fcce40b2160 msgr2=0x7fcce40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce2ffd640 1 --2- 172.21.15.70:0/108146396 >> v2:172.21.15.120:3300/0 conn(0x7fcce40b2160 0x7fcce40d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce2ffd640 1 -- 172.21.15.70:0/108146396 >> v1:172.21.15.70:6789/0 conn(0x7fcce40d19f0 legacy=0x7fcce40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.063+0000 7fcce2ffd640 1 -- 172.21.15.70:0/108146396 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40ceb20 con 0x7fcce415d6e0 2023-11-26T07:20:15.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce2ffd640 1 --2- 172.21.15.70:0/108146396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415d6e0 0x7fcce40d0df0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcce40ca2a0 tx=0x7fccd401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12addb505da67d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce27fc640 1 -- 172.21.15.70:0/108146396 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4004230 con 0x7fcce415d6e0 2023-11-26T07:20:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce27fc640 1 -- 172.21.15.70:0/108146396 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd40a7050 con 0x7fcce415d6e0 2023-11-26T07:20:15.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce27fc640 1 -- 172.21.15.70:0/108146396 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003620 con 0x7fcce415d6e0 2023-11-26T07:20:15.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 -- 172.21.15.70:0/108146396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415d6e0 msgr2=0x7fcce40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 --2- 172.21.15.70:0/108146396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415d6e0 0x7fcce40d0df0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcce40ca2a0 tx=0x7fccd401c460 comp rx=0 tx=0).stop 2023-11-26T07:20:15.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 -- 172.21.15.70:0/108146396 shutdown_connections 2023-11-26T07:20:15.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 --2- 172.21.15.70:0/108146396 >> v2:172.21.15.120:3300/0 conn(0x7fcce40b2160 0x7fcce40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 --2- 172.21.15.70:0/108146396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415d6e0 0x7fcce40d0df0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 -- 172.21.15.70:0/108146396 >> 172.21.15.70:0/108146396 conn(0x7fcce409c550 msgr2=0x7fcce40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:15.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 -- 172.21.15.70:0/108146396 shutdown_connections 2023-11-26T07:20:15.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 -- 172.21.15.70:0/108146396 wait complete. 2023-11-26T07:20:15.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 Processor -- start 2023-11-26T07:20:15.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.067+0000 7fcce9555640 1 -- start start 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40b2160 0x7fcce414a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce40d19f0 0x7fcce4155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce415d6e0 0x7fcce40b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4154b70 con 0x7fcce40b2160 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce414acf0 con 0x7fcce40d19f0 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4153cc0 con 0x7fcce415d6e0 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40b2160 0x7fcce414a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40b2160 0x7fcce414a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34312/0 (socket says 172.21.15.70:34312) 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 -- 172.21.15.70:0/1226089612 learned_addr learned my addr 172.21.15.70:0/1226089612 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fccda7fc640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce40d19f0 0x7fcce4155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce37fe640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce415d6e0 0x7fcce40b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 -- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce415d6e0 msgr2=0x7fcce40b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce415d6e0 0x7fcce40b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 -- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce40d19f0 msgr2=0x7fcce4155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce40d19f0 0x7fcce4155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 -- 172.21.15.70:0/1226089612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4009420 con 0x7fcce40b2160 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce37fe640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce415d6e0 0x7fcce40b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce2ffd640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40b2160 0x7fcce414a7b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fccd40ae040 tx=0x7fccd4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fccdbfff640 1 -- 172.21.15.70:0/1226089612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003a30 con 0x7fcce40b2160 2023-11-26T07:20:15.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fccdbfff640 1 -- 172.21.15.70:0/1226089612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4003bb0 con 0x7fcce40b2160 2023-11-26T07:20:15.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fccdbfff640 1 -- 172.21.15.70:0/1226089612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40ab440 con 0x7fcce40b2160 2023-11-26T07:20:15.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4153f60 con 0x7fcce40b2160 2023-11-26T07:20:15.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4154520 con 0x7fcce40b2160 2023-11-26T07:20:15.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce4067680 con 0x7fcce40b2160 2023-11-26T07:20:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.071+0000 7fccdbfff640 1 -- 172.21.15.70:0/1226089612 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fccd40b2040 con 0x7fcce40b2160 2023-11-26T07:20:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.075+0000 7fccdbfff640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc4066740 0x7fccc4068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.075+0000 7fccdbfff640 1 -- 172.21.15.70:0/1226089612 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fccd411e1c0 con 0x7fcce40b2160 2023-11-26T07:20:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.075+0000 7fccda7fc640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc4066740 0x7fccc4068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.075+0000 7fccda7fc640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc4066740 0x7fccc4068c00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcce41f9630 tx=0x7fcccc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.079+0000 7fccdbfff640 1 -- 172.21.15.70:0/1226089612 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccd40eb180 con 0x7fcce40b2160 2023-11-26T07:20:15.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.239+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcce4156ea0 con 0x7fcce40b2160 2023-11-26T07:20:15.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.239+0000 7fccdbfff640 1 -- 172.21.15.70:0/1226089612 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7fccd40ee7a0 con 0x7fcce40b2160 2023-11-26T07:20:15.242 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:20:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc4066740 msgr2=0x7fccc4068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc4066740 0x7fccc4068c00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcce41f9630 tx=0x7fcccc00b040 comp rx=0 tx=0).stop 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40b2160 msgr2=0x7fcce414a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40b2160 0x7fcce414a7b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fccd40ae040 tx=0x7fccd4019200 comp rx=0 tx=0).stop 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 shutdown_connections 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce415d6e0 0x7fcce40b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce40d19f0 0x7fcce4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc4066740 0x7fccc4068c00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 --2- 172.21.15.70:0/1226089612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40b2160 0x7fcce414a7b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 >> 172.21.15.70:0/1226089612 conn(0x7fcce409c550 msgr2=0x7fcce40b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 shutdown_connections 2023-11-26T07:20:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.243+0000 7fcce9555640 1 -- 172.21.15.70:0/1226089612 wait complete. 2023-11-26T07:20:15.263 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2023-11-26T07:20:15.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:15.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:15.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44175]: fuse finished with error 0 and tester_r 0 2023-11-26T07:20:15.288 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:20:15.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:15.288 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:20:15.379 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:15.379 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:15.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:20:15.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:20:15.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:15.389 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-26T07:20:15.438 INFO:teuthology.orchestra.run.smithi070.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-26T07:20:15.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:20:15.439 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:20:15.440 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:15.449 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:20:15.449 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:20:15.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:15.449 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-26T07:20:15.499 INFO:teuthology.orchestra.run.smithi120.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-26T07:20:15.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:20:15.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:15.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.635+0000 7f6b25e6b640 1 Processor -- start 2023-11-26T07:20:15.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.635+0000 7f6b25e6b640 1 -- start start 2023-11-26T07:20:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b25e6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b2006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b25e6b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b2006cf80 0x7f6b2006a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b25e6b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2006be80 con 0x7f6b2006aa40 2023-11-26T07:20:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b25e6b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2006d3c0 con 0x7f6b2006cf80 2023-11-26T07:20:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b25e6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200cbf60 con 0x7f6b200cbb80 2023-11-26T07:20:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b1f7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b2006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b17fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b2006cf80 0x7f6b2006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b1ffff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6b2006aa40 0x7f6b2015dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:56460/0 (socket says 172.21.15.70:56460) 2023-11-26T07:20:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b1ffff640 1 -- 172.21.15.70:0/1149991577 learned_addr learned my addr 172.21.15.70:0/1149991577 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b1f7fe640 1 -- 172.21.15.70:0/1149991577 >> v2:172.21.15.120:3300/0 conn(0x7f6b2006cf80 msgr2=0x7f6b2006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b1f7fe640 1 --2- 172.21.15.70:0/1149991577 >> v2:172.21.15.120:3300/0 conn(0x7f6b2006cf80 0x7f6b2006a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b1f7fe640 1 -- 172.21.15.70:0/1149991577 >> v1:172.21.15.120:6789/0 conn(0x7f6b2006aa40 legacy=0x7f6b2015dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.639+0000 7f6b1f7fe640 1 -- 172.21.15.70:0/1149991577 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2006b270 con 0x7f6b200cbb80 2023-11-26T07:20:15.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b1f7fe640 1 --2- 172.21.15.70:0/1149991577 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b2006ca40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b100097c0 tx=0x7f6b1001c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4012d884aa3fac1f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b1effd640 1 -- 172.21.15.70:0/1149991577 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100ab600 con 0x7f6b200cbb80 2023-11-26T07:20:15.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b1effd640 1 -- 172.21.15.70:0/1149991577 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b100a7050 con 0x7f6b200cbb80 2023-11-26T07:20:15.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b1effd640 1 -- 172.21.15.70:0/1149991577 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100ab980 con 0x7f6b200cbb80 2023-11-26T07:20:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 -- 172.21.15.70:0/1149991577 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 msgr2=0x7f6b2006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/1149991577 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b2006ca40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b100097c0 tx=0x7f6b1001c310 comp rx=0 tx=0).stop 2023-11-26T07:20:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 -- 172.21.15.70:0/1149991577 shutdown_connections 2023-11-26T07:20:15.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/1149991577 >> v2:172.21.15.120:3300/0 conn(0x7f6b2006cf80 0x7f6b2006a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/1149991577 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b2006ca40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 -- 172.21.15.70:0/1149991577 >> 172.21.15.70:0/1149991577 conn(0x7f6b200cf710 msgr2=0x7f6b200cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 -- 172.21.15.70:0/1149991577 shutdown_connections 2023-11-26T07:20:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 -- 172.21.15.70:0/1149991577 wait complete. 2023-11-26T07:20:15.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 Processor -- start 2023-11-26T07:20:15.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.643+0000 7f6b25e6b640 1 -- start start 2023-11-26T07:20:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b2006aa40 0x7f6b20159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b2006cf80 0x7f6b200b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b200b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2014d200 con 0x7f6b2006aa40 2023-11-26T07:20:15.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200b2890 con 0x7f6b2006cf80 2023-11-26T07:20:15.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200b2aa0 con 0x7f6b200cbb80 2023-11-26T07:20:15.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b2006aa40 0x7f6b20159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b2006aa40 0x7f6b20159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34328/0 (socket says 172.21.15.70:34328) 2023-11-26T07:20:15.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 -- 172.21.15.70:0/3279266440 learned_addr learned my addr 172.21.15.70:0/3279266440 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:15.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1ffff640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b200b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b17fff640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b2006cf80 0x7f6b200b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 -- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 msgr2=0x7f6b200b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b200b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 -- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b2006cf80 msgr2=0x7f6b200b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b2006cf80 0x7f6b200b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 -- 172.21.15.70:0/3279266440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009420 con 0x7f6b2006aa40 2023-11-26T07:20:15.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1f7fe640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b2006aa40 0x7f6b20159620 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6b100ae040 tx=0x7f6b100190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1cff9640 1 -- 172.21.15.70:0/3279266440 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100b4820 con 0x7f6b2006aa40 2023-11-26T07:20:15.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1cff9640 1 -- 172.21.15.70:0/3279266440 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b100b4980 con 0x7f6b2006aa40 2023-11-26T07:20:15.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b200b2d80 con 0x7f6b2006aa40 2023-11-26T07:20:15.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b1cff9640 1 -- 172.21.15.70:0/3279266440 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100b4d30 con 0x7f6b2006aa40 2023-11-26T07:20:15.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b200b3340 con 0x7f6b2006aa40 2023-11-26T07:20:15.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.647+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b20067680 con 0x7f6b2006aa40 2023-11-26T07:20:15.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.651+0000 7f6b1cff9640 1 -- 172.21.15.70:0/3279266440 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f6b100b2040 con 0x7f6b2006aa40 2023-11-26T07:20:15.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.651+0000 7f6b1cff9640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b00066740 0x7f6b00068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.651+0000 7f6b1cff9640 1 -- 172.21.15.70:0/3279266440 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f6b1011e850 con 0x7f6b2006aa40 2023-11-26T07:20:15.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.651+0000 7f6b17fff640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b00066740 0x7f6b00068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:15.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.651+0000 7f6b17fff640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b00066740 0x7f6b00068c00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b20148800 tx=0x7f6b08009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:15.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.655+0000 7f6b1cff9640 1 -- 172.21.15.70:0/3279266440 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b100eb8d0 con 0x7f6b2006aa40 2023-11-26T07:20:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.835+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b200663b0 con 0x7f6b2006aa40 2023-11-26T07:20:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b1cff9640 1 -- 172.21.15.70:0/3279266440 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f6b100eeef0 con 0x7f6b2006aa40 2023-11-26T07:20:15.840 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:15.840 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3437884487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3437884487},{"type":"v1","addr":"172.21.15.70:6837","nonce":3437884487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1405314765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1405314765},{"type":"v1","addr":"172.21.15.120:6833","nonce":1405314765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2357317721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2357317721},{"type":"v1","addr":"172.21.15.120:6835","nonce":2357317721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:19:09.585008+0000","modified":"2023-11-26T07:19:12.594028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.70:6836/4160736209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4160736209},{"type":"v1","addr":"172.21.15.70:6836","nonce":4160736209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:20:15.840 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 19 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b00066740 msgr2=0x7f6b00068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b00066740 0x7f6b00068c00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b20148800 tx=0x7f6b08009190 comp rx=0 tx=0).stop 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b2006aa40 msgr2=0x7f6b20159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b2006aa40 0x7f6b20159620 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6b100ae040 tx=0x7f6b100190b0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 shutdown_connections 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b200cbb80 0x7f6b200b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b2006cf80 0x7f6b200b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b00066740 0x7f6b00068c00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 --2- 172.21.15.70:0/3279266440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b2006aa40 0x7f6b20159620 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 >> 172.21.15.70:0/3279266440 conn(0x7f6b200cf710 msgr2=0x7f6b2014aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 shutdown_connections 2023-11-26T07:20:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.839+0000 7f6b25e6b640 1 -- 172.21.15.70:0/3279266440 wait complete. 2023-11-26T07:20:15.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:15.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.995+0000 7fa29f0d6640 1 Processor -- start 2023-11-26T07:20:15.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.995+0000 7fa29f0d6640 1 -- start start 2023-11-26T07:20:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.995+0000 7fa29f0d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cf280 0x7fa2980cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29f0d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa2980cd1b0 0x7fa2980cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29f0d6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2980cfc20 con 0x7fa298143ac0 2023-11-26T07:20:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29f0d6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa298143ea0 con 0x7fa2980cd1b0 2023-11-26T07:20:15.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29f0d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980cc730 con 0x7fa2980cf280 2023-11-26T07:20:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29ce72640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa298143ac0 0x7fa298070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39634/0 (socket says 172.21.15.70:39634) 2023-11-26T07:20:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29ce72640 1 -- 172.21.15.70:0/3110888822 learned_addr learned my addr 172.21.15.70:0/3110888822 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29d673640 1 --2- 172.21.15.70:0/3110888822 >> v2:172.21.15.70:3300/0 conn(0x7fa2980cd1b0 0x7fa2980cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa28ffff640 1 --2- 172.21.15.70:0/3110888822 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cf280 0x7fa2980cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa28f7fe640 1 -- 172.21.15.70:0/3110888822 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619433423 0 0) 0x7fa2980cfc20 con 0x7fa298143ac0 2023-11-26T07:20:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa28f7fe640 1 -- 172.21.15.70:0/3110888822 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa280003530 con 0x7fa298143ac0 2023-11-26T07:20:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29d673640 1 -- 172.21.15.70:0/3110888822 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cf280 msgr2=0x7fa2980cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29d673640 1 --2- 172.21.15.70:0/3110888822 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cf280 0x7fa2980cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29d673640 1 -- 172.21.15.70:0/3110888822 >> v1:172.21.15.70:6789/0 conn(0x7fa298143ac0 legacy=0x7fa298070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29d673640 1 -- 172.21.15.70:0/3110888822 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298070ee0 con 0x7fa2980cd1b0 2023-11-26T07:20:16.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa29d673640 1 --2- 172.21.15.70:0/3110888822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cd1b0 0x7fa2980cd5e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa290009d90 tx=0x7fa29001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c6c828abe4398a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:15.999+0000 7fa28f7fe640 1 -- 172.21.15.70:0/3110888822 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900a5a10 con 0x7fa2980cd1b0 2023-11-26T07:20:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa28f7fe640 1 -- 172.21.15.70:0/3110888822 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900a5b70 con 0x7fa2980cd1b0 2023-11-26T07:20:16.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa28f7fe640 1 -- 172.21.15.70:0/3110888822 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900ad440 con 0x7fa2980cd1b0 2023-11-26T07:20:16.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- 172.21.15.70:0/3110888822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cd1b0 msgr2=0x7fa2980cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/3110888822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cd1b0 0x7fa2980cd5e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa290009d90 tx=0x7fa29001c950 comp rx=0 tx=0).stop 2023-11-26T07:20:16.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- 172.21.15.70:0/3110888822 shutdown_connections 2023-11-26T07:20:16.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/3110888822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cd1b0 0x7fa2980cd5e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/3110888822 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cf280 0x7fa2980cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- 172.21.15.70:0/3110888822 >> 172.21.15.70:0/3110888822 conn(0x7fa29806a890 msgr2=0x7fa29806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:16.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- 172.21.15.70:0/3110888822 shutdown_connections 2023-11-26T07:20:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- 172.21.15.70:0/3110888822 wait complete. 2023-11-26T07:20:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 Processor -- start 2023-11-26T07:20:16.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- start start 2023-11-26T07:20:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cd1b0 0x7fa29815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cf280 0x7fa2981406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298143ac0 0x7fa298158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980b11d0 con 0x7fa2980cf280 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29815d5f0 con 0x7fa298143ac0 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29f0d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa298141330 con 0x7fa2980cd1b0 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa28ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cf280 0x7fa2981406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa29ce72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cd1b0 0x7fa29815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa28ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cf280 0x7fa2981406c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34354/0 (socket says 172.21.15.70:34354) 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.003+0000 7fa28ffff640 1 -- 172.21.15.70:0/1321550267 learned_addr learned my addr 172.21.15.70:0/1321550267 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29d673640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298143ac0 0x7fa298158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29ce72640 1 -- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298143ac0 msgr2=0x7fa298158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29ce72640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298143ac0 0x7fa298158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29ce72640 1 -- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cf280 msgr2=0x7fa2981406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29ce72640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cf280 0x7fa2981406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29ce72640 1 -- 172.21.15.70:0/1321550267 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290009a70 con 0x7fa2980cd1b0 2023-11-26T07:20:16.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa28ffff640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cf280 0x7fa2981406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:16.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29ce72640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cd1b0 0x7fa29815d0b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c400 tx=0x7fa29400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa28d7fa640 1 -- 172.21.15.70:0/1321550267 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294005cf0 con 0x7fa2980cd1b0 2023-11-26T07:20:16.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa28d7fa640 1 -- 172.21.15.70:0/1321550267 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294005e50 con 0x7fa2980cd1b0 2023-11-26T07:20:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa28d7fa640 1 -- 172.21.15.70:0/1321550267 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940072f0 con 0x7fa2980cd1b0 2023-11-26T07:20:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa298140c00 con 0x7fa2980cd1b0 2023-11-26T07:20:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2980b0830 con 0x7fa2980cd1b0 2023-11-26T07:20:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2980b1310 con 0x7fa2980cd1b0 2023-11-26T07:20:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.007+0000 7fa28d7fa640 1 -- 172.21.15.70:0/1321550267 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fa294007450 con 0x7fa2980cd1b0 2023-11-26T07:20:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.011+0000 7fa28d7fa640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066740 0x7fa284068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.011+0000 7fa28d7fa640 1 -- 172.21.15.70:0/1321550267 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fa2940837e0 con 0x7fa2980cd1b0 2023-11-26T07:20:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.011+0000 7fa28ffff640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066740 0x7fa284068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.011+0000 7fa28ffff640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066740 0x7fa284068c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa298142d20 tx=0x7fa288008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.015+0000 7fa28d7fa640 1 -- 172.21.15.70:0/1321550267 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa294050960 con 0x7fa2980cd1b0 2023-11-26T07:20:16.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.171+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa298067680 con 0x7fa2980cd1b0 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.171+0000 7fa28d7fa640 1 -- 172.21.15.70:0/1321550267 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16634 (secure 0 0 0) 0x7fa294017020 con 0x7fa2980cd1b0 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:16.173 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:03.792953+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:16.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.171+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066740 msgr2=0x7fa284068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.171+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066740 0x7fa284068c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa298142d20 tx=0x7fa288008040 comp rx=0 tx=0).stop 2023-11-26T07:20:16.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.171+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cd1b0 msgr2=0x7fa29815d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.171+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cd1b0 0x7fa29815d0b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c400 tx=0x7fa29400c8c0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 shutdown_connections 2023-11-26T07:20:16.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa284066740 0x7fa284068c00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2980cf280 0x7fa2981406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298143ac0 0x7fa298158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 --2- 172.21.15.70:0/1321550267 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa2980cd1b0 0x7fa29815d0b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 >> 172.21.15.70:0/1321550267 conn(0x7fa29806a890 msgr2=0x7fa2980acbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 shutdown_connections 2023-11-26T07:20:16.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.175+0000 7fa29f0d6640 1 -- 172.21.15.70:0/1321550267 wait complete. 2023-11-26T07:20:16.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:19:08.139388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:19:08.576466+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 36, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:20:16.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:20:16.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7e6fe640 1 Processor -- start 2023-11-26T07:20:16.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7e6fe640 1 -- start start 2023-11-26T07:20:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7e6fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e7815d580 0x7f7e780d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7e6fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7e6fe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780d0bc0 con 0x7f7e780d3e60 2023-11-26T07:20:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7e6fe640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780d0320 con 0x7f7e7815d580 2023-11-26T07:20:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7e6fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780d0600 con 0x7f7e780d1f00 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e77fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e7815d580 0x7f7e780d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e77fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e7815d580 0x7f7e780d3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34364/0 (socket says 172.21.15.70:34364) 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e77fff640 1 -- 172.21.15.70:0/4176363029 learned_addr learned my addr 172.21.15.70:0/4176363029 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e777fe640 1 --1- 172.21.15.70:0/4176363029 >> v1:172.21.15.70:6789/0 conn(0x7f7e780d3e60 0x7f7e780d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39650/0 (socket says 172.21.15.70:39650) 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e77fff640 1 -- 172.21.15.70:0/4176363029 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 msgr2=0x7f7e780b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7cc9b640 1 --2- 172.21.15.70:0/4176363029 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e77fff640 1 --2- 172.21.15.70:0/4176363029 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e77fff640 1 -- 172.21.15.70:0/4176363029 >> v1:172.21.15.70:6789/0 conn(0x7f7e780d3e60 legacy=0x7f7e780d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e76ffd640 1 -- 172.21.15.70:0/4176363029 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604549541 0 0) 0x7f7e780d0bc0 con 0x7f7e780d3e60 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e77fff640 1 -- 172.21.15.70:0/4176363029 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780d08e0 con 0x7f7e7815d580 2023-11-26T07:20:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.335+0000 7f7e7cc9b640 1 --2- 172.21.15.70:0/4176363029 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:16.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e77fff640 1 --2- 172.21.15.70:0/4176363029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e7815d580 0x7f7e780d3920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009870 tx=0x7f7e6801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3534a49fd1763020 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e76ffd640 1 -- 172.21.15.70:0/4176363029 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680ab640 con 0x7f7e7815d580 2023-11-26T07:20:16.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e76ffd640 1 -- 172.21.15.70:0/4176363029 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e680a7070 con 0x7f7e7815d580 2023-11-26T07:20:16.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e76ffd640 1 -- 172.21.15.70:0/4176363029 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680ab9c0 con 0x7f7e7815d580 2023-11-26T07:20:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/4176363029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e7815d580 msgr2=0x7f7e780d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/4176363029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e7815d580 0x7f7e780d3920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009870 tx=0x7f7e6801c510 comp rx=0 tx=0).stop 2023-11-26T07:20:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/4176363029 shutdown_connections 2023-11-26T07:20:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/4176363029 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/4176363029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e7815d580 0x7f7e780d3920 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/4176363029 >> 172.21.15.70:0/4176363029 conn(0x7f7e7809c550 msgr2=0x7f7e780d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:16.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/4176363029 shutdown_connections 2023-11-26T07:20:16.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/4176363029 wait complete. 2023-11-26T07:20:16.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.339+0000 7f7e7e6fe640 1 Processor -- start 2023-11-26T07:20:16.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 -- start start 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e780d3e60 0x7f7e780c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e7815d580 0x7f7e780c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b7730 con 0x7f7e780d3e60 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b7a10 con 0x7f7e7815d580 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b7cf0 con 0x7f7e780d1f00 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e780d3e60 0x7f7e780c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e780d3e60 0x7f7e780c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34370/0 (socket says 172.21.15.70:34370) 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 -- 172.21.15.70:0/1420084778 learned_addr learned my addr 172.21.15.70:0/1420084778 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7cc9b640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e7815d580 0x7f7e780c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e77fff640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 -- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 msgr2=0x7f7e780b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 -- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e7815d580 msgr2=0x7f7e780c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e7815d580 0x7f7e780c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 -- 172.21.15.70:0/1420084778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680094d0 con 0x7f7e780d3e60 2023-11-26T07:20:16.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e777fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e780d3e60 0x7f7e780c6d40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0011f0 tx=0x7f7e6c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e74ff9640 1 -- 172.21.15.70:0/1420084778 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0074e0 con 0x7f7e780d3e60 2023-11-26T07:20:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e74ff9640 1 -- 172.21.15.70:0/1420084778 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c007640 con 0x7f7e780d3e60 2023-11-26T07:20:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e74ff9640 1 -- 172.21.15.70:0/1420084778 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c004a10 con 0x7f7e780d3e60 2023-11-26T07:20:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e780b7fd0 con 0x7f7e780d3e60 2023-11-26T07:20:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e780b87d0 con 0x7f7e780d3e60 2023-11-26T07:20:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.343+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e780b8ab0 con 0x7f7e780d3e60 2023-11-26T07:20:16.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.347+0000 7f7e74ff9640 1 -- 172.21.15.70:0/1420084778 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f7e6c004b70 con 0x7f7e780d3e60 2023-11-26T07:20:16.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.347+0000 7f7e74ff9640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e64066740 0x7f7e64068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.347+0000 7f7e74ff9640 1 -- 172.21.15.70:0/1420084778 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7e6c083500 con 0x7f7e780d3e60 2023-11-26T07:20:16.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.347+0000 7f7e77fff640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e64066740 0x7f7e64068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.347+0000 7f7e77fff640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e64066740 0x7f7e64068c00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e680af000 tx=0x7f7e680b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.351+0000 7f7e74ff9640 1 -- 172.21.15.70:0/1420084778 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e780b8ab0 con 0x7f7e780d3e60 2023-11-26T07:20:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.503+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e780b8ab0 con 0x7f7e780d3e60 2023-11-26T07:20:16.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.503+0000 7f7e74ff9640 1 -- 172.21.15.70:0/1420084778 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e780b8ab0 con 0x7f7e780d3e60 2023-11-26T07:20:16.505 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:20:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e64066740 msgr2=0x7f7e64068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e64066740 0x7f7e64068c00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e680af000 tx=0x7f7e680b6040 comp rx=0 tx=0).stop 2023-11-26T07:20:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e780d3e60 msgr2=0x7f7e780c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e780d3e60 0x7f7e780c6d40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0011f0 tx=0x7f7e6c00c9b0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 shutdown_connections 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7e64066740 0x7f7e64068c00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e780d3e60 0x7f7e780c6d40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7e7815d580 0x7f7e780c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 --2- 172.21.15.70:0/1420084778 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7e780d1f00 0x7f7e780b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 >> 172.21.15.70:0/1420084778 conn(0x7f7e7809c550 msgr2=0x7f7e7815c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 shutdown_connections 2023-11-26T07:20:16.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.507+0000 7f7e7e6fe640 1 -- 172.21.15.70:0/1420084778 wait complete. 2023-11-26T07:20:16.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:20:16.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.663+0000 7f7d452dc640 1 Processor -- start 2023-11-26T07:20:16.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.663+0000 7f7d452dc640 1 -- start start 2023-11-26T07:20:16.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d452dc640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d400714e0 0x7f7d40071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d452dc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d4015bde0 0x7f7d4015c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d452dc640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d40071e80 con 0x7f7d40144720 2023-11-26T07:20:16.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d452dc640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4006e3f0 con 0x7f7d4015bde0 2023-11-26T07:20:16.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d452dc640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400722f0 con 0x7f7d400714e0 2023-11-26T07:20:16.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d44adb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d4015bde0 0x7f7d4015c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d44adb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d4015bde0 0x7f7d4015c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34384/0 (socket says 172.21.15.70:34384) 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d44adb640 1 -- 172.21.15.70:0/1507227415 learned_addr learned my addr 172.21.15.70:0/1507227415 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d3f7fe640 1 --2- 172.21.15.70:0/1507227415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d400714e0 0x7f7d40071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d44adb640 1 -- 172.21.15.70:0/1507227415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d400714e0 msgr2=0x7f7d40071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d44adb640 1 --2- 172.21.15.70:0/1507227415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d400714e0 0x7f7d40071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d44adb640 1 -- 172.21.15.70:0/1507227415 >> v1:172.21.15.120:6789/0 conn(0x7f7d40144720 legacy=0x7f7d4006d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d44adb640 1 -- 172.21.15.70:0/1507227415 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4006de30 con 0x7f7d4015bde0 2023-11-26T07:20:16.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.667+0000 7f7d3f7fe640 1 --2- 172.21.15.70:0/1507227415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d400714e0 0x7f7d40071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:16.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d44adb640 1 --2- 172.21.15.70:0/1507227415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d4015c250 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009e50 tx=0x7f7d3801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4547335d784de4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d3effd640 1 -- 172.21.15.70:0/1507227415 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380a5820 con 0x7f7d4015bde0 2023-11-26T07:20:16.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d3effd640 1 -- 172.21.15.70:0/1507227415 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380a5980 con 0x7f7d4015bde0 2023-11-26T07:20:16.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d3effd640 1 -- 172.21.15.70:0/1507227415 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380a5d10 con 0x7f7d4015bde0 2023-11-26T07:20:16.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 -- 172.21.15.70:0/1507227415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 msgr2=0x7f7d4015c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 --2- 172.21.15.70:0/1507227415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d4015c250 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009e50 tx=0x7f7d3801c9a0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 -- 172.21.15.70:0/1507227415 shutdown_connections 2023-11-26T07:20:16.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 --2- 172.21.15.70:0/1507227415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d4015c250 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 --2- 172.21.15.70:0/1507227415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d400714e0 0x7f7d40071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 -- 172.21.15.70:0/1507227415 >> 172.21.15.70:0/1507227415 conn(0x7f7d4006a890 msgr2=0x7f7d4006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:16.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 -- 172.21.15.70:0/1507227415 shutdown_connections 2023-11-26T07:20:16.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 -- 172.21.15.70:0/1507227415 wait complete. 2023-11-26T07:20:16.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 Processor -- start 2023-11-26T07:20:16.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.671+0000 7f7d452dc640 1 -- start start 2023-11-26T07:20:16.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d400714e0 0x7f7d4015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d40144720 0x7f7d4013dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d400accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4015a8c0 con 0x7f7d4015bde0 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4013e640 con 0x7f7d400714e0 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4013e890 con 0x7f7d40144720 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d400accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d400accc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34392/0 (socket says 172.21.15.70:34392) 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 -- 172.21.15.70:0/473742437 learned_addr learned my addr 172.21.15.70:0/473742437 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d3f7fe640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d40144720 0x7f7d4013dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d3ffff640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d400714e0 0x7f7d4015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 -- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d40144720 msgr2=0x7f7d4013dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d40144720 0x7f7d4013dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 -- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d400714e0 msgr2=0x7f7d4015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d400714e0 0x7f7d4015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 -- 172.21.15.70:0/473742437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38009b30 con 0x7f7d4015bde0 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d44adb640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d400accc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7d380af040 tx=0x7f7d38019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d3cff9640 1 -- 172.21.15.70:0/473742437 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b8670 con 0x7f7d4015bde0 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d3cff9640 1 -- 172.21.15.70:0/473742437 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380b87f0 con 0x7f7d4015bde0 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d3cff9640 1 -- 172.21.15.70:0/473742437 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b8ba0 con 0x7f7d4015bde0 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4013eb70 con 0x7f7d4015bde0 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4013f130 con 0x7f7d4015bde0 2023-11-26T07:20:16.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d40067500 con 0x7f7d4015bde0 2023-11-26T07:20:16.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.675+0000 7f7d3cff9640 1 -- 172.21.15.70:0/473742437 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f7d380b8d00 con 0x7f7d4015bde0 2023-11-26T07:20:16.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.679+0000 7f7d3cff9640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d2c066770 0x7f7d2c068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.679+0000 7f7d3cff9640 1 -- 172.21.15.70:0/473742437 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7d3811f520 con 0x7f7d4015bde0 2023-11-26T07:20:16.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.679+0000 7f7d3ffff640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d2c066770 0x7f7d2c068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.679+0000 7f7d3ffff640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d2c066770 0x7f7d2c068c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7d400b3cf0 tx=0x7f7d30007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:16.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.683+0000 7f7d3cff9640 1 -- 172.21.15.70:0/473742437 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d380ec7c0 con 0x7f7d4015bde0 2023-11-26T07:20:16.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.831+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d40067500 con 0x7f7d4015bde0 2023-11-26T07:20:16.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.831+0000 7f7d3cff9640 1 -- 172.21.15.70:0/473742437 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d380efde0 con 0x7f7d4015bde0 2023-11-26T07:20:16.833 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:20:16.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.831+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d2c066770 msgr2=0x7f7d2c068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.831+0000 7f7d452dc640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d2c066770 0x7f7d2c068c30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7d400b3cf0 tx=0x7f7d30007e40 comp rx=0 tx=0).stop 2023-11-26T07:20:16.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 msgr2=0x7f7d400accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d400accc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7d380af040 tx=0x7f7d38019740 comp rx=0 tx=0).stop 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 shutdown_connections 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d2c066770 0x7f7d2c068c30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d4015bde0 0x7f7d400accc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d40144720 0x7f7d4013dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 --2- 172.21.15.70:0/473742437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d400714e0 0x7f7d4015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 >> 172.21.15.70:0/473742437 conn(0x7f7d4006a890 msgr2=0x7f7d401404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:16.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 shutdown_connections 2023-11-26T07:20:16.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.835+0000 7f7d452dc640 1 -- 172.21.15.70:0/473742437 wait complete. 2023-11-26T07:20:16.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:20:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.991+0000 7fb762b1d640 1 Processor -- start 2023-11-26T07:20:16.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.991+0000 7fb762b1d640 1 -- start start 2023-11-26T07:20:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb762b1d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb75c143ac0 0x7fb75c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb762b1d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0cc730 con 0x7fb75c0708b0 2023-11-26T07:20:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb762b1d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c070ee0 con 0x7fb75c0cf990 2023-11-26T07:20:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb762b1d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c143ea0 con 0x7fb75c143ac0 2023-11-26T07:20:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb753fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb75c0708b0 0x7fb75c0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39654/0 (socket says 172.21.15.70:39654) 2023-11-26T07:20:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb753fff640 1 -- 172.21.15.70:0/52545569 learned_addr learned my addr 172.21.15.70:0/52545569 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:16.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb7608b9640 1 --2- 172.21.15.70:0/52545569 >> v2:172.21.15.120:3300/0 conn(0x7fb75c143ac0 0x7fb75c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:16.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb7537fe640 1 -- 172.21.15.70:0/52545569 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215874004 0 0) 0x7fb75c0cc730 con 0x7fb75c0708b0 2023-11-26T07:20:16.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb7537fe640 1 -- 172.21.15.70:0/52545569 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744003530 con 0x7fb75c0708b0 2023-11-26T07:20:16.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb7608b9640 1 -- 172.21.15.70:0/52545569 >> v1:172.21.15.120:6789/0 conn(0x7fb75c0cf990 legacy=0x7fb75c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb7537fe640 1 -- 172.21.15.70:0/52545569 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505523009 0 0) 0x7fb75c070ee0 con 0x7fb75c0cf990 2023-11-26T07:20:16.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb7608b9640 1 -- 172.21.15.70:0/52545569 >> v1:172.21.15.70:6789/0 conn(0x7fb75c0708b0 legacy=0x7fb75c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:16.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.995+0000 7fb7608b9640 1 -- 172.21.15.70:0/52545569 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0711c0 con 0x7fb75c143ac0 2023-11-26T07:20:16.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb7608b9640 1 --2- 172.21.15.70:0/52545569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c070370 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7580097c0 tx=0x7fb75801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4b961c5faa251fc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb7537fe640 1 -- 172.21.15.70:0/52545569 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580a8050 con 0x7fb75c143ac0 2023-11-26T07:20:17.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb7537fe640 1 -- 172.21.15.70:0/52545569 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7580ac5f0 con 0x7fb75c143ac0 2023-11-26T07:20:17.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb7537fe640 1 -- 172.21.15.70:0/52545569 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580ac980 con 0x7fb75c143ac0 2023-11-26T07:20:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 -- 172.21.15.70:0/52545569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 msgr2=0x7fb75c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 --2- 172.21.15.70:0/52545569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c070370 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7580097c0 tx=0x7fb75801c480 comp rx=0 tx=0).stop 2023-11-26T07:20:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 -- 172.21.15.70:0/52545569 shutdown_connections 2023-11-26T07:20:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 --2- 172.21.15.70:0/52545569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c070370 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 -- 172.21.15.70:0/52545569 >> 172.21.15.70:0/52545569 conn(0x7fb75c06a890 msgr2=0x7fb75c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 -- 172.21.15.70:0/52545569 shutdown_connections 2023-11-26T07:20:17.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 -- 172.21.15.70:0/52545569 wait complete. 2023-11-26T07:20:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 Processor -- start 2023-11-26T07:20:17.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:16.999+0000 7fb762b1d640 1 -- start start 2023-11-26T07:20:17.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb75c0708b0 0x7fb75c1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb75c0cf990 0x7fb75c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c157890 con 0x7fb75c0708b0 2023-11-26T07:20:17.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c157b70 con 0x7fb75c143ac0 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c157e50 con 0x7fb75c0cf990 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb75c0708b0 0x7fb75c1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb75c0708b0 0x7fb75c1572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34396/0 (socket says 172.21.15.70:34396) 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 -- 172.21.15.70:0/1656348043 learned_addr learned my addr 172.21.15.70:0/1656348043 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb753fff640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb75c0cf990 0x7fb75c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7610ba640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 -- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb75c0cf990 msgr2=0x7fb75c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb75c0cf990 0x7fb75c15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 -- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 msgr2=0x7fb75c1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 -- 172.21.15.70:0/1656348043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb758009420 con 0x7fb75c0708b0 2023-11-26T07:20:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7610ba640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7608b9640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb75c0708b0 0x7fb75c1572b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb7580097c0 tx=0x7fb75801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7517fa640 1 -- 172.21.15.70:0/1656348043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580bd070 con 0x7fb75c0708b0 2023-11-26T07:20:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7517fa640 1 -- 172.21.15.70:0/1656348043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758006e20 con 0x7fb75c0708b0 2023-11-26T07:20:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb7517fa640 1 -- 172.21.15.70:0/1656348043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580b8660 con 0x7fb75c0708b0 2023-11-26T07:20:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c158130 con 0x7fb75c0708b0 2023-11-26T07:20:17.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c15c000 con 0x7fb75c0708b0 2023-11-26T07:20:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.003+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c067680 con 0x7fb75c0708b0 2023-11-26T07:20:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.007+0000 7fb7517fa640 1 -- 172.21.15.70:0/1656348043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fb7580b87e0 con 0x7fb75c0708b0 2023-11-26T07:20:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.007+0000 7fb7517fa640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb748066740 0x7fb748068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.007+0000 7fb7517fa640 1 -- 172.21.15.70:0/1656348043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb75811de50 con 0x7fb75c0708b0 2023-11-26T07:20:17.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.007+0000 7fb753fff640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb748066740 0x7fb748068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.007+0000 7fb753fff640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb748066740 0x7fb748068c00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb74c007fd0 tx=0x7fb74c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.011+0000 7fb7517fa640 1 -- 172.21.15.70:0/1656348043 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7580eaec0 con 0x7fb75c0708b0 2023-11-26T07:20:17.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.163+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb75c1585e0 con 0x7fb75c0708b0 2023-11-26T07:20:17.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb7517fa640 1 -- 172.21.15.70:0/1656348043 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7580b1020 con 0x7fb75c0708b0 2023-11-26T07:20:17.167 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:20:17.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb748066740 msgr2=0x7fb748068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb748066740 0x7fb748068c00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb74c007fd0 tx=0x7fb74c009040 comp rx=0 tx=0).stop 2023-11-26T07:20:17.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb75c0708b0 msgr2=0x7fb75c1572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb75c0708b0 0x7fb75c1572b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb7580097c0 tx=0x7fb75801acc0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 shutdown_connections 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75c143ac0 0x7fb75c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb75c0cf990 0x7fb75c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb748066740 0x7fb748068c00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 --2- 172.21.15.70:0/1656348043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb75c0708b0 0x7fb75c1572b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 >> 172.21.15.70:0/1656348043 conn(0x7fb75c06a890 msgr2=0x7fb75c06c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 shutdown_connections 2023-11-26T07:20:17.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.167+0000 7fb762b1d640 1 -- 172.21.15.70:0/1656348043 wait complete. 2023-11-26T07:20:17.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:17.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.323+0000 7f4ba0765640 1 Processor -- start 2023-11-26T07:20:17.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.323+0000 7f4ba0765640 1 -- start start 2023-11-26T07:20:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4ba0765640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4b9815d6e0 0x7f4b980d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4ba0765640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 0x7f4b980b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4ba0765640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980cf0e0 con 0x7f4b980b2160 2023-11-26T07:20:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4ba0765640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9815dac0 con 0x7f4b9815d6e0 2023-11-26T07:20:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4ba0765640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980ceb20 con 0x7f4b980d1bc0 2023-11-26T07:20:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4b980b2160 0x7f4b980d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39666/0 (socket says 172.21.15.70:39666) 2023-11-26T07:20:17.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 -- 172.21.15.70:0/3024459774 learned_addr learned my addr 172.21.15.70:0/3024459774 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:17.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928745340 0 0) 0x7f4b980cf0e0 con 0x7f4b980b2160 2023-11-26T07:20:17.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9e501640 1 --2- 172.21.15.70:0/3024459774 >> v2:172.21.15.120:3300/0 conn(0x7f4b9815d6e0 0x7f4b980d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003530 con 0x7f4b980b2160 2023-11-26T07:20:17.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9ed02640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 0x7f4b980b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358249638 0 0) 0x7f4b84003530 con 0x7f4b980b2160 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 msgr2=0x7f4b980b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 0x7f4b980b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 >> v2:172.21.15.120:3300/0 conn(0x7f4b9815d6e0 msgr2=0x7f4b980d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 --2- 172.21.15.70:0/3024459774 >> v2:172.21.15.120:3300/0 conn(0x7f4b9815d6e0 0x7f4b980d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980cee00 con 0x7f4b980b2160 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f4b88001680 con 0x7f4b980b2160 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 >> v1:172.21.15.70:6789/0 conn(0x7f4b980b2160 legacy=0x7f4b980d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 0x7f4b84003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b84004d10 0x7f4b84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9815dac0 con 0x7f4b84003f50 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980ceb20 con 0x7f4b84004d10 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400b990 con 0x7f4b980d1bc0 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9e501640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 0x7f4b84003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9ed02640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b84004d10 0x7f4b84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 -- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 msgr2=0x7f4b84003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980d1bc0 0x7f4b84003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 -- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b84004d10 msgr2=0x7f4b84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b84004d10 0x7f4b84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.327+0000 7f4b9dd00640 1 -- 172.21.15.70:0/3024459774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84003530 con 0x7f4b84003f50 2023-11-26T07:20:17.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4b9dd00640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b840047d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800c140 tx=0x7f4b8801f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1cff7a2d1de660 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88005ae0 con 0x7f4b84003f50 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880ab070 con 0x7f4b84003f50 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4b9d4ff640 1 -- 172.21.15.70:0/3024459774 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88007070 con 0x7f4b84003f50 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4ba0765640 1 -- 172.21.15.70:0/3024459774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 msgr2=0x7f4b840047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4ba0765640 1 --2- 172.21.15.70:0/3024459774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b840047d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800c140 tx=0x7f4b8801f2f0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4b9ed02640 1 -- 172.21.15.70:0/3024459774 reap_dead start 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4ba0765640 1 -- 172.21.15.70:0/3024459774 shutdown_connections 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4ba0765640 1 -- 172.21.15.70:0/3024459774 >> 172.21.15.70:0/3024459774 conn(0x7f4b9809c550 msgr2=0x7f4b980d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4ba0765640 1 -- 172.21.15.70:0/3024459774 shutdown_connections 2023-11-26T07:20:17.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.331+0000 7f4ba0765640 1 -- 172.21.15.70:0/3024459774 wait complete. 2023-11-26T07:20:17.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 Processor -- start 2023-11-26T07:20:17.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 -- start start 2023-11-26T07:20:17.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b980cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b980b4580 0x7f4b9815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980b2f70 0x7f4b980cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980b4160 con 0x7f4b84003f50 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980cc650 con 0x7f4b980b4580 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9815b710 con 0x7f4b980b2f70 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b980cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b980cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34420/0 (socket says 172.21.15.70:34420) 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 -- 172.21.15.70:0/1846646869 learned_addr learned my addr 172.21.15.70:0/1846646869 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9dd00640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b980b4580 0x7f4b9815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9ed02640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980b2f70 0x7f4b980cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 -- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980b2f70 msgr2=0x7f4b980cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980b2f70 0x7f4b980cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 -- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b980b4580 msgr2=0x7f4b9815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b980b4580 0x7f4b9815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 -- 172.21.15.70:0/1846646869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980b34e0 con 0x7f4b84003f50 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b9e501640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b980cc110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4b94011a00 tx=0x7f4b94011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b8effd640 1 -- 172.21.15.70:0/1846646869 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400fb50 con 0x7f4b84003f50 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b8effd640 1 -- 172.21.15.70:0/1846646869 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9400fcb0 con 0x7f4b84003f50 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4b8effd640 1 -- 172.21.15.70:0/1846646869 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94014440 con 0x7f4b84003f50 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b980b37c0 con 0x7f4b84003f50 2023-11-26T07:20:17.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b980b3d80 con 0x7f4b84003f50 2023-11-26T07:20:17.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.335+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98067fa0 con 0x7f4b84003f50 2023-11-26T07:20:17.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.339+0000 7f4b8effd640 1 -- 172.21.15.70:0/1846646869 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f4b940145a0 con 0x7f4b84003f50 2023-11-26T07:20:17.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.339+0000 7f4b8effd640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b7c066740 0x7f4b7c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.339+0000 7f4b8effd640 1 -- 172.21.15.70:0/1846646869 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f4b94084b60 con 0x7f4b84003f50 2023-11-26T07:20:17.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.339+0000 7f4b9dd00640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b7c066740 0x7f4b7c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.339+0000 7f4b9dd00640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b7c066740 0x7f4b7c068c00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b880ae000 tx=0x7f4b880019b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.343+0000 7f4b8effd640 1 -- 172.21.15.70:0/1846646869 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b94051d80 con 0x7f4b84003f50 2023-11-26T07:20:17.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b98067680 con 0x7f4b84003f50 2023-11-26T07:20:17.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4b8effd640 1 -- 172.21.15.70:0/1846646869 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f4b94022020 con 0x7f4b84003f50 2023-11-26T07:20:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:17.524 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3437884487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3437884487},{"type":"v1","addr":"172.21.15.70:6837","nonce":3437884487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1405314765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1405314765},{"type":"v1","addr":"172.21.15.120:6833","nonce":1405314765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2357317721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2357317721},{"type":"v1","addr":"172.21.15.120:6835","nonce":2357317721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:19:09.585008+0000","modified":"2023-11-26T07:19:12.594028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.70:6836/4160736209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4160736209},{"type":"v1","addr":"172.21.15.70:6836","nonce":4160736209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:20:17.525 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 19 2023-11-26T07:20:17.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b7c066740 msgr2=0x7f4b7c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b7c066740 0x7f4b7c068c00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b880ae000 tx=0x7f4b880019b0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 msgr2=0x7f4b980cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b980cc110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4b94011a00 tx=0x7f4b94011ec0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 shutdown_connections 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b980b2f70 0x7f4b980cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b980b4580 0x7f4b9815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b7c066740 0x7f4b7c068c00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 --2- 172.21.15.70:0/1846646869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b84003f50 0x7f4b980cc110 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 >> 172.21.15.70:0/1846646869 conn(0x7f4b9809c550 msgr2=0x7f4b9815c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 shutdown_connections 2023-11-26T07:20:17.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.523+0000 7f4ba0765640 1 -- 172.21.15.70:0/1846646869 wait complete. 2023-11-26T07:20:17.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:17.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.679+0000 7f8c16a32640 1 Processor -- start 2023-11-26T07:20:17.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.679+0000 7f8c16a32640 1 -- start start 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c16a32640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8c101596d0 0x7f8c10071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c16a32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8c100ce680 0x7f8c100b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c16a32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c100b2db0 0x7f8c1015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c16a32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c100b3240 con 0x7f8c100ce680 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c16a32640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c100cbe00 con 0x7f8c101596d0 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c16a32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1006c750 con 0x7f8c100b2db0 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8c100ce680 0x7f8c100b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8c100ce680 0x7f8c100b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34430/0 (socket says 172.21.15.70:34430) 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1292450706 learned_addr learned my addr 172.21.15.70:0/1292450706 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c14fcf640 1 --2- 172.21.15.70:0/1292450706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c100b2db0 0x7f8c1015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0ffff640 1 --2- 172.21.15.70:0/1292450706 >> v2:172.21.15.120:3300/0 conn(0x7f8c101596d0 0x7f8c10071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1292450706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c100b2db0 msgr2=0x7f8c1015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 --2- 172.21.15.70:0/1292450706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c100b2db0 0x7f8c1015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1292450706 >> v2:172.21.15.120:3300/0 conn(0x7f8c101596d0 msgr2=0x7f8c10071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 --2- 172.21.15.70:0/1292450706 >> v2:172.21.15.120:3300/0 conn(0x7f8c101596d0 0x7f8c10071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1292450706 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100b3550 con 0x7f8c100ce680 2023-11-26T07:20:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.683+0000 7f8c0ffff640 1 --2- 172.21.15.70:0/1292450706 >> v2:172.21.15.120:3300/0 conn(0x7f8c101596d0 0x7f8c10071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c0f7fe640 1 --2- 172.21.15.70:0/1292450706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c100b2870 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8c1006e4d0 tx=0x7f8c0401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99440e1820e50557 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c0effd640 1 -- 172.21.15.70:0/1292450706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040ab600 con 0x7f8c100ce680 2023-11-26T07:20:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c0effd640 1 -- 172.21.15.70:0/1292450706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c040a7050 con 0x7f8c100ce680 2023-11-26T07:20:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c0effd640 1 -- 172.21.15.70:0/1292450706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040ab980 con 0x7f8c100ce680 2023-11-26T07:20:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 -- 172.21.15.70:0/1292450706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 msgr2=0x7f8c100b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 --2- 172.21.15.70:0/1292450706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c100b2870 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8c1006e4d0 tx=0x7f8c0401c500 comp rx=0 tx=0).stop 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 -- 172.21.15.70:0/1292450706 shutdown_connections 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 --2- 172.21.15.70:0/1292450706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c100b2db0 0x7f8c1015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 --2- 172.21.15.70:0/1292450706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c100b2870 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 --2- 172.21.15.70:0/1292450706 >> v2:172.21.15.120:3300/0 conn(0x7f8c101596d0 0x7f8c10071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 -- 172.21.15.70:0/1292450706 >> 172.21.15.70:0/1292450706 conn(0x7f8c1006a890 msgr2=0x7f8c1006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 -- 172.21.15.70:0/1292450706 shutdown_connections 2023-11-26T07:20:17.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 -- 172.21.15.70:0/1292450706 wait complete. 2023-11-26T07:20:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 Processor -- start 2023-11-26T07:20:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.687+0000 7f8c16a32640 1 -- start start 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c100b2db0 0x7f8c1014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c101f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c101596d0 0x7f8c100ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c101f9df0 con 0x7f8c100ce680 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c101f9830 con 0x7f8c100b2db0 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c101f9b10 con 0x7f8c101596d0 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c101f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c101f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34442/0 (socket says 172.21.15.70:34442) 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/3376434729 learned_addr learned my addr 172.21.15.70:0/3376434729 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c101596d0 msgr2=0x7f8c100ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c14fcf640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c101596d0 0x7f8c100ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0ffff640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c100b2db0 0x7f8c1014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c101596d0 0x7f8c100ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c100b2db0 msgr2=0x7f8c1014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c100b2db0 0x7f8c1014daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/3376434729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040094d0 con 0x7f8c100ce680 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c14fcf640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c101596d0 0x7f8c100ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0ffff640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c100b2db0 0x7f8c1014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0f7fe640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c101f8ec0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8c0401abb0 tx=0x7f8c040192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0cff9640 1 -- 172.21.15.70:0/3376434729 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040b4440 con 0x7f8c100ce680 2023-11-26T07:20:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0cff9640 1 -- 172.21.15.70:0/3376434729 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c040b45a0 con 0x7f8c100ce680 2023-11-26T07:20:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0cff9640 1 -- 172.21.15.70:0/3376434729 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040b4930 con 0x7f8c100ce680 2023-11-26T07:20:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1015b000 con 0x7f8c100ce680 2023-11-26T07:20:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c101f9400 con 0x7f8c100ce680 2023-11-26T07:20:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c101f95f0 con 0x7f8c100ce680 2023-11-26T07:20:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.691+0000 7f8c0cff9640 1 -- 172.21.15.70:0/3376434729 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f8c040b2070 con 0x7f8c100ce680 2023-11-26T07:20:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.695+0000 7f8c0cff9640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8bfc066740 0x7f8bfc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.695+0000 7f8c0cff9640 1 -- 172.21.15.70:0/3376434729 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f8c0411e2b0 con 0x7f8c100ce680 2023-11-26T07:20:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.695+0000 7f8c0ffff640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8bfc066740 0x7f8bfc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.695+0000 7f8c0ffff640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8bfc066740 0x7f8bfc068c00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006e90 tx=0x7f8c00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:17.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.699+0000 7f8c0cff9640 1 -- 172.21.15.70:0/3376434729 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c101f95f0 con 0x7f8c100ce680 2023-11-26T07:20:17.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c101f95f0 con 0x7f8c100ce680 2023-11-26T07:20:17.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c0cff9640 1 -- 172.21.15.70:0/3376434729 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16634 (secure 0 0 0) 0x7f8c101f95f0 con 0x7f8c100ce680 2023-11-26T07:20:17.853 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:17.853 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:03.792953+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8bfc066740 msgr2=0x7f8bfc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8bfc066740 0x7f8bfc068c00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006e90 tx=0x7f8c00008040 comp rx=0 tx=0).stop 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 msgr2=0x7f8c101f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c101f8ec0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8c0401abb0 tx=0x7f8c040192a0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 shutdown_connections 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8bfc066740 0x7f8bfc068c00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c100ce680 0x7f8c101f8ec0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c101596d0 0x7f8c100ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 --2- 172.21.15.70:0/3376434729 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c100b2db0 0x7f8c1014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 >> 172.21.15.70:0/3376434729 conn(0x7f8c1006a890 msgr2=0x7f8c100cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 shutdown_connections 2023-11-26T07:20:17.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:17.851+0000 7f8c16a32640 1 -- 172.21.15.70:0/3376434729 wait complete. 2023-11-26T07:20:17.874 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:20:17.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:18.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f1110232640 1 Processor -- start 2023-11-26T07:20:18.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f1110232640 1 -- start start 2023-11-26T07:20:18.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f1110232640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11080d09c0 0x7f1108161da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f1110232640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11080cf260 con 0x7f110806f3e0 2023-11-26T07:20:18.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f1110232640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110809a010 con 0x7f110806f000 2023-11-26T07:20:18.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f1110232640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110809a2f0 con 0x7f11080d09c0 2023-11-26T07:20:18.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110d7cd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f110806f3e0 0x7f1108161690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39674/0 (socket says 172.21.15.70:39674) 2023-11-26T07:20:18.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110d7cd640 1 -- 172.21.15.70:0/3510970018 learned_addr learned my addr 172.21.15.70:0/3510970018 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:18.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110e7cf640 1 --2- 172.21.15.70:0/3510970018 >> v2:172.21.15.120:3300/0 conn(0x7f11080d09c0 0x7f1108161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881994754 0 0) 0x7f11080cf260 con 0x7f110806f3e0 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f4003530 con 0x7f110806f3e0 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779114483 0 0) 0x7f110809a010 con 0x7f110806f000 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11080cf260 con 0x7f110806f000 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1785488469 0 0) 0x7f10f4003530 con 0x7f110806f3e0 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110e7cf640 1 -- 172.21.15.70:0/3510970018 >> v1:172.21.15.120:6789/0 conn(0x7f110806f000 legacy=0x7f110806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110e7cf640 1 -- 172.21.15.70:0/3510970018 >> v1:172.21.15.70:6789/0 conn(0x7f110806f3e0 legacy=0x7f1108161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.011+0000 7f110e7cf640 1 -- 172.21.15.70:0/3510970018 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110809a5d0 con 0x7f11080d09c0 2023-11-26T07:20:18.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f110e7cf640 1 --2- 172.21.15.70:0/3510970018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 0x7f1108161da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1100009d90 tx=0x7f110001f060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc6f4d336cc1251 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8001680 con 0x7f11080d09c0 2023-11-26T07:20:18.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11000a8bf0 con 0x7f11080d09c0 2023-11-26T07:20:18.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f110cfcc640 1 -- 172.21.15.70:0/3510970018 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000b0440 con 0x7f11080d09c0 2023-11-26T07:20:18.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f1110232640 1 -- 172.21.15.70:0/3510970018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 msgr2=0x7f1108161da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f1110232640 1 --2- 172.21.15.70:0/3510970018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 0x7f1108161da0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1100009d90 tx=0x7f110001f060 comp rx=0 tx=0).stop 2023-11-26T07:20:18.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f1110232640 1 -- 172.21.15.70:0/3510970018 shutdown_connections 2023-11-26T07:20:18.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f1110232640 1 --2- 172.21.15.70:0/3510970018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 0x7f1108161da0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f1110232640 1 -- 172.21.15.70:0/3510970018 >> 172.21.15.70:0/3510970018 conn(0x7f11080b2d10 msgr2=0x7f11080b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:18.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f1110232640 1 -- 172.21.15.70:0/3510970018 shutdown_connections 2023-11-26T07:20:18.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.015+0000 7f1110232640 1 -- 172.21.15.70:0/3510970018 wait complete. 2023-11-26T07:20:18.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 Processor -- start 2023-11-26T07:20:18.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 -- start start 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f110806f000 0x7f11080b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f110806f3e0 0x7f11080b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 0x7f11080c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11080c59b0 con 0x7f110806f000 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11080c5c90 con 0x7f11080d09c0 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11080c5f70 con 0x7f110806f3e0 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f110806f000 0x7f11080b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f110806f000 0x7f11080b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34446/0 (socket says 172.21.15.70:34446) 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 -- 172.21.15.70:0/3533835365 learned_addr learned my addr 172.21.15.70:0/3533835365 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:18.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110d7cd640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f110806f3e0 0x7f11080b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110e7cf640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 0x7f11080c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 -- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f110806f3e0 msgr2=0x7f11080b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f110806f3e0 0x7f11080b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 -- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 msgr2=0x7f11080c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 0x7f11080c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 -- 172.21.15.70:0/3533835365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009a70 con 0x7f110806f000 2023-11-26T07:20:18.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f110dfce640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f110806f000 0x7f11080b4740 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f110400c490 tx=0x7f110400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f10fe7fc640 1 -- 172.21.15.70:0/3533835365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040052d0 con 0x7f110806f000 2023-11-26T07:20:18.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f10fe7fc640 1 -- 172.21.15.70:0/3533835365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104005430 con 0x7f110806f000 2023-11-26T07:20:18.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11080c6250 con 0x7f110806f000 2023-11-26T07:20:18.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f10fe7fc640 1 -- 172.21.15.70:0/3533835365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104012870 con 0x7f110806f000 2023-11-26T07:20:18.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.019+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11080b4c80 con 0x7f110806f000 2023-11-26T07:20:18.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.023+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11080c6700 con 0x7f110806f000 2023-11-26T07:20:18.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.023+0000 7f10fe7fc640 1 -- 172.21.15.70:0/3533835365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f11040129d0 con 0x7f110806f000 2023-11-26T07:20:18.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.023+0000 7f10fe7fc640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ec066740 0x7f10ec068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.023+0000 7f10fe7fc640 1 -- 172.21.15.70:0/3533835365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f1104083ef0 con 0x7f110806f000 2023-11-26T07:20:18.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.023+0000 7f110d7cd640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ec066740 0x7f10ec068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.023+0000 7f110d7cd640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ec066740 0x7f10ec068c00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1108073e50 tx=0x7f10f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.027+0000 7f10fe7fc640 1 -- 172.21.15.70:0/3533835365 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11080c6700 con 0x7f110806f000 2023-11-26T07:20:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.211+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11080c6700 con 0x7f110806f000 2023-11-26T07:20:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.211+0000 7f10fe7fc640 1 -- 172.21.15.70:0/3533835365 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f11080c6700 con 0x7f110806f000 2023-11-26T07:20:18.214 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:18.214 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3437884487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3437884487},{"type":"v1","addr":"172.21.15.70:6837","nonce":3437884487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1405314765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1405314765},{"type":"v1","addr":"172.21.15.120:6833","nonce":1405314765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2357317721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2357317721},{"type":"v1","addr":"172.21.15.120:6835","nonce":2357317721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:19:09.585008+0000","modified":"2023-11-26T07:19:12.594028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.70:6836/4160736209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4160736209},{"type":"v1","addr":"172.21.15.70:6836","nonce":4160736209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:20:18.214 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 19 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ec066740 msgr2=0x7f10ec068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ec066740 0x7f10ec068c00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1108073e50 tx=0x7f10f8009040 comp rx=0 tx=0).stop 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f110806f000 msgr2=0x7f11080b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f110806f000 0x7f11080b4740 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f110400c490 tx=0x7f110400c950 comp rx=0 tx=0).stop 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 shutdown_connections 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080d09c0 0x7f11080c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f110806f3e0 0x7f11080b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ec066740 0x7f10ec068c00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 --2- 172.21.15.70:0/3533835365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f110806f000 0x7f11080b4740 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 >> 172.21.15.70:0/3533835365 conn(0x7f11080b2d10 msgr2=0x7f11080c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:18.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 shutdown_connections 2023-11-26T07:20:18.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.215+0000 7f1110232640 1 -- 172.21.15.70:0/3533835365 wait complete. 2023-11-26T07:20:18.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c77eea640 1 Processor -- start 2023-11-26T07:20:18.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c77eea640 1 -- start start 2023-11-26T07:20:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c77eea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c700cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c77eea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3c7006cd50 0x7f3c700b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c77eea640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7015b2f0 con 0x7f3c70070d10 2023-11-26T07:20:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c77eea640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7006c5c0 con 0x7f3c7006cd50 2023-11-26T07:20:18.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c77eea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700cfba0 con 0x7f3c700cf280 2023-11-26T07:20:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c75c86640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c700cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c75485640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3c70070d10 0x7f3c7015d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:56492/0 (socket says 172.21.15.70:56492) 2023-11-26T07:20:18.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c75485640 1 -- 172.21.15.70:0/3181173686 learned_addr learned my addr 172.21.15.70:0/3181173686 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c76487640 1 --2- 172.21.15.70:0/3181173686 >> v2:172.21.15.120:3300/0 conn(0x7f3c7006cd50 0x7f3c700b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c74c84640 1 -- 172.21.15.70:0/3181173686 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372235056 0 0) 0x7f3c60001120 con 0x7f3c70070d10 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c74c84640 1 -- 172.21.15.70:0/3181173686 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c5c003530 con 0x7f3c70070d10 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c76487640 1 -- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 msgr2=0x7f3c700cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c76487640 1 --2- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c700cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c76487640 1 -- 172.21.15.70:0/3181173686 >> v1:172.21.15.120:6789/0 conn(0x7f3c70070d10 legacy=0x7f3c7015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c76487640 1 -- 172.21.15.70:0/3181173686 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7015e1a0 con 0x7f3c7006cd50 2023-11-26T07:20:18.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.371+0000 7f3c75c86640 1 --2- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c700cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c76487640 1 --2- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 0x7f3c700b2180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009d90 tx=0x7f3c6801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa256d4675c07c9a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c74c84640 1 -- 172.21.15.70:0/3181173686 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680af600 con 0x7f3c7006cd50 2023-11-26T07:20:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c74c84640 1 -- 172.21.15.70:0/3181173686 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c680ab050 con 0x7f3c7006cd50 2023-11-26T07:20:18.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c74c84640 1 -- 172.21.15.70:0/3181173686 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680af980 con 0x7f3c7006cd50 2023-11-26T07:20:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 -- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 msgr2=0x7f3c700b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 --2- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 0x7f3c700b2180 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009d90 tx=0x7f3c6801f130 comp rx=0 tx=0).stop 2023-11-26T07:20:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 -- 172.21.15.70:0/3181173686 shutdown_connections 2023-11-26T07:20:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 --2- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 0x7f3c700b2180 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 --2- 172.21.15.70:0/3181173686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c700cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 -- 172.21.15.70:0/3181173686 >> 172.21.15.70:0/3181173686 conn(0x7f3c7006a890 msgr2=0x7f3c7006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:18.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 -- 172.21.15.70:0/3181173686 shutdown_connections 2023-11-26T07:20:18.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.375+0000 7f3c77eea640 1 -- 172.21.15.70:0/3181173686 wait complete. 2023-11-26T07:20:18.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 Processor -- start 2023-11-26T07:20:18.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 -- start start 2023-11-26T07:20:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 0x7f3c701f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c70070d10 0x7f3c70156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c70157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701e3d50 con 0x7f3c70070d10 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c70157030 con 0x7f3c7006cd50 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c70158100 con 0x7f3c700cf280 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c70070d10 0x7f3c70156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c70070d10 0x7f3c70156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34462/0 (socket says 172.21.15.70:34462) 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 -- 172.21.15.70:0/1410323211 learned_addr learned my addr 172.21.15.70:0/1410323211 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c76487640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c70157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75c86640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 0x7f3c701f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 -- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 msgr2=0x7f3c70157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c70157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 -- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 msgr2=0x7f3c701f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 0x7f3c701f3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 -- 172.21.15.70:0/1410323211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009420 con 0x7f3c70070d10 2023-11-26T07:20:18.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c76487640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c70157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:18.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c75485640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c70070d10 0x7f3c70156af0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000c450 tx=0x7f3c6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c667fc640 1 -- 172.21.15.70:0/1410323211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60005cf0 con 0x7f3c70070d10 2023-11-26T07:20:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c667fc640 1 -- 172.21.15.70:0/1410323211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60005e50 con 0x7f3c70070d10 2023-11-26T07:20:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c667fc640 1 -- 172.21.15.70:0/1410323211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60007290 con 0x7f3c70070d10 2023-11-26T07:20:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c68009a70 con 0x7f3c70070d10 2023-11-26T07:20:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.379+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c701583a0 con 0x7f3c70070d10 2023-11-26T07:20:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.383+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c701e3e90 con 0x7f3c70070d10 2023-11-26T07:20:18.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.383+0000 7f3c667fc640 1 -- 172.21.15.70:0/1410323211 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f3c600073f0 con 0x7f3c70070d10 2023-11-26T07:20:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.383+0000 7f3c667fc640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c54066740 0x7f3c54068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.383+0000 7f3c667fc640 1 -- 172.21.15.70:0/1410323211 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f3c60083560 con 0x7f3c70070d10 2023-11-26T07:20:18.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.383+0000 7f3c75c86640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c54066740 0x7f3c54068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.383+0000 7f3c75c86640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c54066740 0x7f3c54068c00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009cf0 tx=0x7f3c6c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.387+0000 7f3c667fc640 1 -- 172.21.15.70:0/1410323211 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c701e3e90 con 0x7f3c70070d10 2023-11-26T07:20:18.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.567+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c701e3e90 con 0x7f3c70070d10 2023-11-26T07:20:18.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.567+0000 7f3c667fc640 1 -- 172.21.15.70:0/1410323211 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f3c701e3e90 con 0x7f3c70070d10 2023-11-26T07:20:18.570 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:18.570 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3437884487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3437884487},{"type":"v1","addr":"172.21.15.70:6837","nonce":3437884487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1405314765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1405314765},{"type":"v1","addr":"172.21.15.120:6833","nonce":1405314765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2357317721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2357317721},{"type":"v1","addr":"172.21.15.120:6835","nonce":2357317721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:19:09.585008+0000","modified":"2023-11-26T07:19:12.594028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.70:6836/4160736209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":4160736209},{"type":"v1","addr":"172.21.15.70:6836","nonce":4160736209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-26T07:20:18.570 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 19 2023-11-26T07:20:18.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c54066740 msgr2=0x7f3c54068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c54066740 0x7f3c54068c00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009cf0 tx=0x7f3c6c009190 comp rx=0 tx=0).stop 2023-11-26T07:20:18.571 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c70070d10 msgr2=0x7f3c70156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c70070d10 0x7f3c70156af0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000c450 tx=0x7f3c6000c910 comp rx=0 tx=0).stop 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 shutdown_connections 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3c54066740 0x7f3c54068c00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c70070d10 0x7f3c70156af0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3c700cf280 0x7f3c70157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 --2- 172.21.15.70:0/1410323211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c7006cd50 0x7f3c701f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 >> 172.21.15.70:0/1410323211 conn(0x7f3c7006a890 msgr2=0x7f3c7006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 shutdown_connections 2023-11-26T07:20:18.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.571+0000 7f3c77eea640 1 -- 172.21.15.70:0/1410323211 wait complete. 2023-11-26T07:20:18.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 Processor -- start 2023-11-26T07:20:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 -- start start 2023-11-26T07:20:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc118143ac0 0x7fc118070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1180cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1180cf7c0 0x7fc1180b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc118143ea0 con 0x7fc118143ac0 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1180cfbf0 con 0x7fc1180cf7c0 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc11d52a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180cc730 con 0x7fc1180708b0 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc118143ac0 0x7fc118070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc118143ac0 0x7fc118070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34464/0 (socket says 172.21.15.70:34464) 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 -- 172.21.15.70:0/2117050699 learned_addr learned my addr 172.21.15.70:0/2117050699 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc1177fe640 1 --2- 172.21.15.70:0/2117050699 >> v2:172.21.15.120:3300/0 conn(0x7fc1180cf7c0 0x7fc1180b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc1167fc640 1 --2- 172.21.15.70:0/2117050699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1180cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 -- 172.21.15.70:0/2117050699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 msgr2=0x7fc1180cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 --2- 172.21.15.70:0/2117050699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1180cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 -- 172.21.15.70:0/2117050699 >> v2:172.21.15.120:3300/0 conn(0x7fc1180cf7c0 msgr2=0x7fc1180b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 --2- 172.21.15.70:0/2117050699 >> v2:172.21.15.120:3300/0 conn(0x7fc1180cf7c0 0x7fc1180b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.727+0000 7fc116ffd640 1 -- 172.21.15.70:0/2117050699 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118070ee0 con 0x7fc118143ac0 2023-11-26T07:20:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc116ffd640 1 --2- 172.21.15.70:0/2117050699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc118070370 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc1180718d0 tx=0x7fc10801e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf7512aee09ea93 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc115ffb640 1 -- 172.21.15.70:0/2117050699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080a78b0 con 0x7fc118143ac0 2023-11-26T07:20:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc115ffb640 1 -- 172.21.15.70:0/2117050699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1080a7a10 con 0x7fc118143ac0 2023-11-26T07:20:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc115ffb640 1 -- 172.21.15.70:0/2117050699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080a7da0 con 0x7fc118143ac0 2023-11-26T07:20:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 -- 172.21.15.70:0/2117050699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 msgr2=0x7fc118070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 --2- 172.21.15.70:0/2117050699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc118070370 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc1180718d0 tx=0x7fc10801e910 comp rx=0 tx=0).stop 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 -- 172.21.15.70:0/2117050699 shutdown_connections 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 --2- 172.21.15.70:0/2117050699 >> v2:172.21.15.120:3300/0 conn(0x7fc1180cf7c0 0x7fc1180b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 --2- 172.21.15.70:0/2117050699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1180cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 --2- 172.21.15.70:0/2117050699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc118070370 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 -- 172.21.15.70:0/2117050699 >> 172.21.15.70:0/2117050699 conn(0x7fc11806a890 msgr2=0x7fc11806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 -- 172.21.15.70:0/2117050699 shutdown_connections 2023-11-26T07:20:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.731+0000 7fc11d52a640 1 -- 172.21.15.70:0/2117050699 wait complete. 2023-11-26T07:20:18.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 Processor -- start 2023-11-26T07:20:18.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 -- start start 2023-11-26T07:20:18.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1181593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1180cf7c0 0x7fc118131e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc1180aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11813d1c0 con 0x7fc118143ac0 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11813c640 con 0x7fc1180cf7c0 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11813c920 con 0x7fc1180708b0 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc1180aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc1180aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34474/0 (socket says 172.21.15.70:34474) 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 -- 172.21.15.70:0/4219938706 learned_addr learned my addr 172.21.15.70:0/4219938706 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc116ffd640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1181593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1167fc640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1180cf7c0 0x7fc118131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 -- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 msgr2=0x7fc1181593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1181593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 -- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1180cf7c0 msgr2=0x7fc118131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1180cf7c0 0x7fc118131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 -- 172.21.15.70:0/4219938706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10800b770 con 0x7fc118143ac0 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc1177fe640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc1180aeb10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc11000efc0 tx=0x7fc11000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc0ff7fe640 1 -- 172.21.15.70:0/4219938706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110014480 con 0x7fc118143ac0 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc0ff7fe640 1 -- 172.21.15.70:0/4219938706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11000f040 con 0x7fc118143ac0 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc0ff7fe640 1 -- 172.21.15.70:0/4219938706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110014820 con 0x7fc118143ac0 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11813cc00 con 0x7fc118143ac0 2023-11-26T07:20:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1181598e0 con 0x7fc118143ac0 2023-11-26T07:20:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.735+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc118073ce0 con 0x7fc118143ac0 2023-11-26T07:20:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.739+0000 7fc0ff7fe640 1 -- 172.21.15.70:0/4219938706 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fc110014980 con 0x7fc118143ac0 2023-11-26T07:20:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.739+0000 7fc0ff7fe640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc104066740 0x7fc104068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.739+0000 7fc0ff7fe640 1 -- 172.21.15.70:0/4219938706 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fc110084d70 con 0x7fc118143ac0 2023-11-26T07:20:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.739+0000 7fc116ffd640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc104066740 0x7fc104068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.739+0000 7fc116ffd640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc104066740 0x7fc104068c00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1080b1000 tx=0x7fc108008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.743+0000 7fc0ff7fe640 1 -- 172.21.15.70:0/4219938706 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc118073ce0 con 0x7fc118143ac0 2023-11-26T07:20:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.895+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc118073ce0 con 0x7fc118143ac0 2023-11-26T07:20:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.895+0000 7fc0ff7fe640 1 -- 172.21.15.70:0/4219938706 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16634 (secure 0 0 0) 0x7fc118073ce0 con 0x7fc118143ac0 2023-11-26T07:20:18.898 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:18.898 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:03.792953+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:19:08.139388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-26T07:19:08.576466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:18.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc104066740 msgr2=0x7fc104068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc104066740 0x7fc104068c00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1080b1000 tx=0x7fc108008040 comp rx=0 tx=0).stop 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 msgr2=0x7fc1180aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc1180aeb10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc11000efc0 tx=0x7fc11000c490 comp rx=0 tx=0).stop 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 shutdown_connections 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc104066740 0x7fc104068c00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118143ac0 0x7fc1180aeb10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1180cf7c0 0x7fc118131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 --2- 172.21.15.70:0/4219938706 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc1180708b0 0x7fc1181593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 >> 172.21.15.70:0/4219938706 conn(0x7fc11806a890 msgr2=0x7fc1180b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 shutdown_connections 2023-11-26T07:20:18.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:18.899+0000 7fc11d52a640 1 -- 172.21.15.70:0/4219938706 wait complete. 2023-11-26T07:20:18.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:20:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.055+0000 7f394bdec640 1 Processor -- start 2023-11-26T07:20:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.055+0000 7f394bdec640 1 -- start start 2023-11-26T07:20:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f394bdec640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f39440cf990 0x7f394415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f394bdec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f394415f4e0 0x7f39440cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f394bdec640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394406c520 con 0x7f394413e290 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f394bdec640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394406c800 con 0x7f39440cf990 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f394bdec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394406cae0 con 0x7f394415f4e0 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f3949387640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f39440cf990 0x7f394415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f3949387640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f39440cf990 0x7f394415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34484/0 (socket says 172.21.15.70:34484) 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f3949387640 1 -- 172.21.15.70:0/1504903005 learned_addr learned my addr 172.21.15.70:0/1504903005 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f394a389640 1 --2- 172.21.15.70:0/1504903005 >> v2:172.21.15.120:3300/0 conn(0x7f394415f4e0 0x7f39440cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f3949387640 1 -- 172.21.15.70:0/1504903005 >> v2:172.21.15.120:3300/0 conn(0x7f394415f4e0 msgr2=0x7f39440cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f3949387640 1 --2- 172.21.15.70:0/1504903005 >> v2:172.21.15.120:3300/0 conn(0x7f394415f4e0 0x7f39440cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f3949387640 1 -- 172.21.15.70:0/1504903005 >> v1:172.21.15.120:6789/0 conn(0x7f394413e290 legacy=0x7f39440cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f3949387640 1 -- 172.21.15.70:0/1504903005 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394406cdc0 con 0x7f39440cf990 2023-11-26T07:20:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.059+0000 7f394a389640 1 --2- 172.21.15.70:0/1504903005 >> v2:172.21.15.120:3300/0 conn(0x7f394415f4e0 0x7f39440cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:19.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f3949387640 1 --2- 172.21.15.70:0/1504903005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39440cf990 0x7f394415efa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3944155cf0 tx=0x7f393401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce6f77d6b6c2572 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f3948b86640 1 -- 172.21.15.70:0/1504903005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340aa610 con 0x7f39440cf990 2023-11-26T07:20:19.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f3948b86640 1 -- 172.21.15.70:0/1504903005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340a6040 con 0x7f39440cf990 2023-11-26T07:20:19.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f3948b86640 1 -- 172.21.15.70:0/1504903005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340aa990 con 0x7f39440cf990 2023-11-26T07:20:19.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- 172.21.15.70:0/1504903005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39440cf990 msgr2=0x7f394415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 --2- 172.21.15.70:0/1504903005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39440cf990 0x7f394415efa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3944155cf0 tx=0x7f393401c490 comp rx=0 tx=0).stop 2023-11-26T07:20:19.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- 172.21.15.70:0/1504903005 shutdown_connections 2023-11-26T07:20:19.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 --2- 172.21.15.70:0/1504903005 >> v2:172.21.15.120:3300/0 conn(0x7f394415f4e0 0x7f39440cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 --2- 172.21.15.70:0/1504903005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39440cf990 0x7f394415efa0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- 172.21.15.70:0/1504903005 >> 172.21.15.70:0/1504903005 conn(0x7f394406a890 msgr2=0x7f394406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:19.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- 172.21.15.70:0/1504903005 shutdown_connections 2023-11-26T07:20:19.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- 172.21.15.70:0/1504903005 wait complete. 2023-11-26T07:20:19.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 Processor -- start 2023-11-26T07:20:19.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- start start 2023-11-26T07:20:19.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39440cf990 0x7f3944136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f394413e290 0x7f3944154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f394415f4e0 0x7f3944154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39441367c0 con 0x7f394413e290 2023-11-26T07:20:19.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39441376a0 con 0x7f39440cf990 2023-11-26T07:20:19.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.063+0000 7f394bdec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3944137980 con 0x7f394415f4e0 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f394413e290 0x7f3944154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f394413e290 0x7f3944154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34486/0 (socket says 172.21.15.70:34486) 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 -- 172.21.15.70:0/3181684746 learned_addr learned my addr 172.21.15.70:0/3181684746 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f394a389640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f394415f4e0 0x7f3944154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949b88640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39440cf990 0x7f3944136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 -- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f394415f4e0 msgr2=0x7f3944154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f394415f4e0 0x7f3944154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 -- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39440cf990 msgr2=0x7f3944136280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39440cf990 0x7f3944136280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 -- 172.21.15.70:0/3181684746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340094d0 con 0x7f394413e290 2023-11-26T07:20:19.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f394a389640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f394415f4e0 0x7f3944154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949b88640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39440cf990 0x7f3944136280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f3949387640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f394413e290 0x7f3944154250 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f39340ac040 tx=0x7f393401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f393a7fc640 1 -- 172.21.15.70:0/3181684746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340b3600 con 0x7f394413e290 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f393a7fc640 1 -- 172.21.15.70:0/3181684746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340b3780 con 0x7f394413e290 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f393a7fc640 1 -- 172.21.15.70:0/3181684746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340b3b30 con 0x7f394413e290 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3944155ff0 con 0x7f394413e290 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3944137c60 con 0x7f394413e290 2023-11-26T07:20:19.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3944067680 con 0x7f394413e290 2023-11-26T07:20:19.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.067+0000 7f393a7fc640 1 -- 172.21.15.70:0/3181684746 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f39340b3c90 con 0x7f394413e290 2023-11-26T07:20:19.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.071+0000 7f393a7fc640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3928066740 0x7f3928068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.071+0000 7f393a7fc640 1 -- 172.21.15.70:0/3181684746 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f394415fb00 con 0x7f394413e290 2023-11-26T07:20:19.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.071+0000 7f3949b88640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3928066740 0x7f3928068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.071+0000 7f3949b88640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3928066740 0x7f3928068c00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3940003ec0 tx=0x7f3940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.075+0000 7f393a7fc640 1 -- 172.21.15.70:0/3181684746 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39340eba80 con 0x7f394413e290 2023-11-26T07:20:19.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.259+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f394406df50 con 0x7f394413e290 2023-11-26T07:20:19.260 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-11-26T07:20:19.259+0000 7fe8c07be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:20:19.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.259+0000 7f393a7fc640 1 -- 172.21.15.70:0/3181684746 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f39340ef0a0 con 0x7f394413e290 2023-11-26T07:20:19.262 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:20:19.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3928066740 msgr2=0x7f3928068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3928066740 0x7f3928068c00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3940003ec0 tx=0x7f3940009040 comp rx=0 tx=0).stop 2023-11-26T07:20:19.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f394413e290 msgr2=0x7f3944154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f394413e290 0x7f3944154250 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f39340ac040 tx=0x7f393401acd0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 shutdown_connections 2023-11-26T07:20:19.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3928066740 0x7f3928068c00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f394413e290 0x7f3944154250 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f394415f4e0 0x7f3944154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 --2- 172.21.15.70:0/3181684746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39440cf990 0x7f3944136280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 >> 172.21.15.70:0/3181684746 conn(0x7f394406a890 msgr2=0x7f39440b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:19.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.263+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 shutdown_connections 2023-11-26T07:20:19.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.267+0000 7f394bdec640 1 -- 172.21.15.70:0/3181684746 wait complete. 2023-11-26T07:20:19.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:20:19.333 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-11-26T07:20:19.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58c49a640 1 Processor -- start 2023-11-26T07:20:19.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58c49a640 1 -- start start 2023-11-26T07:20:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58c49a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58c49a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb58415f6b0 0x7fb5840cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58c49a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58406c520 con 0x7fb5840cf7c0 2023-11-26T07:20:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58c49a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5840cfc40 con 0x7fb58415f6b0 2023-11-26T07:20:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58c49a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58415fb40 con 0x7fb58413e290 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb58aa37640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb58415f6b0 0x7fb5840cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb589a35640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb5840cf7c0 0x7fb58415efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39690/0 (socket says 172.21.15.70:39690) 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.427+0000 7fb589a35640 1 -- 172.21.15.70:0/4006478655 learned_addr learned my addr 172.21.15.70:0/4006478655 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb58a236640 1 --2- 172.21.15.70:0/4006478655 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb58aa37640 1 -- 172.21.15.70:0/4006478655 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 msgr2=0x7fb5840cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb58aa37640 1 --2- 172.21.15.70:0/4006478655 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb58aa37640 1 -- 172.21.15.70:0/4006478655 >> v1:172.21.15.70:6789/0 conn(0x7fb5840cf7c0 legacy=0x7fb58415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb58aa37640 1 -- 172.21.15.70:0/4006478655 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58406c800 con 0x7fb58415f6b0 2023-11-26T07:20:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb589234640 1 -- 172.21.15.70:0/4006478655 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309905931 0 0) 0x7fb58406c520 con 0x7fb5840cf7c0 2023-11-26T07:20:19.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb58aa37640 1 --2- 172.21.15.70:0/4006478655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb5840cd7b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009d90 tx=0x7fb57c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cf00797d180a68 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb589234640 1 -- 172.21.15.70:0/4006478655 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0a59e0 con 0x7fb58415f6b0 2023-11-26T07:20:19.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb589234640 1 -- 172.21.15.70:0/4006478655 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c0a5b40 con 0x7fb58415f6b0 2023-11-26T07:20:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.431+0000 7fb589234640 1 -- 172.21.15.70:0/4006478655 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0ad440 con 0x7fb58415f6b0 2023-11-26T07:20:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- 172.21.15.70:0/4006478655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 msgr2=0x7fb5840cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 --2- 172.21.15.70:0/4006478655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb5840cd7b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009d90 tx=0x7fb57c01c920 comp rx=0 tx=0).stop 2023-11-26T07:20:19.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- 172.21.15.70:0/4006478655 shutdown_connections 2023-11-26T07:20:19.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 --2- 172.21.15.70:0/4006478655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb5840cd7b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 --2- 172.21.15.70:0/4006478655 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- 172.21.15.70:0/4006478655 >> 172.21.15.70:0/4006478655 conn(0x7fb58406a890 msgr2=0x7fb58406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:19.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- 172.21.15.70:0/4006478655 shutdown_connections 2023-11-26T07:20:19.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- 172.21.15.70:0/4006478655 wait complete. 2023-11-26T07:20:19.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 Processor -- start 2023-11-26T07:20:19.437 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- start start 2023-11-26T07:20:19.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5840cf7c0 0x7fb5841f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb58415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb584070980 con 0x7fb58415f6b0 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5841f9780 con 0x7fb5840cf7c0 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58c49a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5841f9a60 con 0x7fb58413e290 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb58415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb58415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34536/0 (socket says 172.21.15.70:34536) 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 -- 172.21.15.70:0/2967750613 learned_addr learned my addr 172.21.15.70:0/2967750613 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58a236640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5840cf7c0 0x7fb5841f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb589a35640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 -- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 msgr2=0x7fb5840afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 -- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5840cf7c0 msgr2=0x7fb5841f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5840cf7c0 0x7fb5841f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.435+0000 7fb58aa37640 1 -- 172.21.15.70:0/2967750613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c009a70 con 0x7fb58415f6b0 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb58aa37640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb58415b510 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb57c01afd0 tx=0x7fb57c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb57affd640 1 -- 172.21.15.70:0/2967750613 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0add10 con 0x7fb58415f6b0 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb57affd640 1 -- 172.21.15.70:0/2967750613 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c0ade70 con 0x7fb58415f6b0 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5841f9d40 con 0x7fb58415f6b0 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb57affd640 1 -- 172.21.15.70:0/2967750613 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0b9650 con 0x7fb58415f6b0 2023-11-26T07:20:19.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5841f9470 con 0x7fb58415f6b0 2023-11-26T07:20:19.442 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb584070ac0 con 0x7fb58415f6b0 2023-11-26T07:20:19.442 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb57affd640 1 -- 172.21.15.70:0/2967750613 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fb57c0b97b0 con 0x7fb58415f6b0 2023-11-26T07:20:19.442 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb57affd640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb568066740 0x7fb568068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:19.442 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb57affd640 1 -- 172.21.15.70:0/2967750613 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb57c11f900 con 0x7fb58415f6b0 2023-11-26T07:20:19.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.439+0000 7fb58a236640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb568066740 0x7fb568068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:19.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.443+0000 7fb58a236640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb568066740 0x7fb568068c00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb580009b60 tx=0x7fb580009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:19.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.443+0000 7fb57affd640 1 -- 172.21.15.70:0/2967750613 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb584070ac0 con 0x7fb58415f6b0 2023-11-26T07:20:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:19.623+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb584070ac0 con 0x7fb58415f6b0 2023-11-26T07:20:20.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.267+0000 7fb57affd640 1 -- 172.21.15.70:0/2967750613 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb584070ac0 con 0x7fb58415f6b0 2023-11-26T07:20:20.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.267+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb568066740 msgr2=0x7fb568068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.267+0000 7fb58c49a640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb568066740 0x7fb568068c00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb580009b60 tx=0x7fb580009190 comp rx=0 tx=0).stop 2023-11-26T07:20:20.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.267+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 msgr2=0x7fb58415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.267+0000 7fb58c49a640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb58415b510 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb57c01afd0 tx=0x7fb57c0196c0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 shutdown_connections 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb568066740 0x7fb568068c00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb58415f6b0 0x7fb58415b510 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb58413e290 0x7fb5840afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 --2- 172.21.15.70:0/2967750613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5840cf7c0 0x7fb5841f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 >> 172.21.15.70:0/2967750613 conn(0x7fb58406a890 msgr2=0x7fb58413aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 shutdown_connections 2023-11-26T07:20:20.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.271+0000 7fb58c49a640 1 -- 172.21.15.70:0/2967750613 wait complete. 2023-11-26T07:20:20.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:20:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f307a45a640 1 Processor -- start 2023-11-26T07:20:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f307a45a640 1 -- start start 2023-11-26T07:20:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f307a45a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f30741614b0 0x7f30740cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f307a45a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3074071970 0x7f3074161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f307a45a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307415d970 con 0x7f3074070ba0 2023-11-26T07:20:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f307a45a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3074161dd0 con 0x7f3074071970 2023-11-26T07:20:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f307a45a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307415dc30 con 0x7f30741614b0 2023-11-26T07:20:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f30737fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3074071970 0x7f3074161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f30789f7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3074070ba0 0x7f307406dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39694/0 (socket says 172.21.15.70:39694) 2023-11-26T07:20:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f30789f7640 1 -- 172.21.15.70:0/1310746379 learned_addr learned my addr 172.21.15.70:0/1310746379 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f3073fff640 1 --2- 172.21.15.70:0/1310746379 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f30741614b0 0x7f30740cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f30737fe640 1 -- 172.21.15.70:0/1310746379 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f30741614b0 msgr2=0x7f30740cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f30737fe640 1 --2- 172.21.15.70:0/1310746379 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f30741614b0 0x7f30740cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f30737fe640 1 -- 172.21.15.70:0/1310746379 >> v1:172.21.15.70:6789/0 conn(0x7f3074070ba0 legacy=0x7f307406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f30737fe640 1 -- 172.21.15.70:0/1310746379 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307415df10 con 0x7f3074071970 2023-11-26T07:20:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f3072ffd640 1 -- 172.21.15.70:0/1310746379 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967425910 0 0) 0x7f307415d970 con 0x7f3074070ba0 2023-11-26T07:20:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.479+0000 7f3073fff640 1 --2- 172.21.15.70:0/1310746379 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f30741614b0 0x7f30740cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:20.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f30737fe640 1 --2- 172.21.15.70:0/1310746379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3074071970 0x7f3074161890 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f30680097c0 tx=0x7f306801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7e9f62282cfd0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f3072ffd640 1 -- 172.21.15.70:0/1310746379 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30680ab620 con 0x7f3074071970 2023-11-26T07:20:20.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f3072ffd640 1 -- 172.21.15.70:0/1310746379 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30680ab780 con 0x7f3074071970 2023-11-26T07:20:20.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f3072ffd640 1 -- 172.21.15.70:0/1310746379 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30680abb10 con 0x7f3074071970 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 -- 172.21.15.70:0/1310746379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3074071970 msgr2=0x7f3074161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 --2- 172.21.15.70:0/1310746379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3074071970 0x7f3074161890 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f30680097c0 tx=0x7f306801c450 comp rx=0 tx=0).stop 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 -- 172.21.15.70:0/1310746379 shutdown_connections 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 --2- 172.21.15.70:0/1310746379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3074071970 0x7f3074161890 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 --2- 172.21.15.70:0/1310746379 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f30741614b0 0x7f30740cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 -- 172.21.15.70:0/1310746379 >> 172.21.15.70:0/1310746379 conn(0x7f30740cf710 msgr2=0x7f30740cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 -- 172.21.15.70:0/1310746379 shutdown_connections 2023-11-26T07:20:20.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.483+0000 7f307a45a640 1 -- 172.21.15.70:0/1310746379 wait complete. 2023-11-26T07:20:20.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 Processor -- start 2023-11-26T07:20:20.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 -- start start 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3074070ba0 0x7f3074153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3074071970 0x7f3074156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30741614b0 0x7f3074157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3074150b60 con 0x7f30741614b0 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307414db50 con 0x7f3074071970 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30741501c0 con 0x7f3074070ba0 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30741614b0 0x7f3074157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30741614b0 0x7f3074157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34562/0 (socket says 172.21.15.70:34562) 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 -- 172.21.15.70:0/2061931693 learned_addr learned my addr 172.21.15.70:0/2061931693 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:20.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f3073fff640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3074070ba0 0x7f3074153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30737fe640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3074071970 0x7f3074156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 -- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3074070ba0 msgr2=0x7f3074153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3074070ba0 0x7f3074153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 -- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3074071970 msgr2=0x7f3074156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3074071970 0x7f3074156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 -- 172.21.15.70:0/2061931693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009420 con 0x7f30741614b0 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f30789f7640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30741614b0 0x7f3074157370 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c730 tx=0x7f306c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f3070ff9640 1 -- 172.21.15.70:0/2061931693 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c00ce40 con 0x7f30741614b0 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f3070ff9640 1 -- 172.21.15.70:0/2061931693 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c00a640 con 0x7f30741614b0 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30741504a0 con 0x7f30741614b0 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f3070ff9640 1 -- 172.21.15.70:0/2061931693 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c00aa30 con 0x7f30741614b0 2023-11-26T07:20:20.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.487+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30740ae450 con 0x7f30741614b0 2023-11-26T07:20:20.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.491+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3074150ca0 con 0x7f30741614b0 2023-11-26T07:20:20.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.491+0000 7f3070ff9640 1 -- 172.21.15.70:0/2061931693 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f306c00ab90 con 0x7f30741614b0 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.491+0000 7f3070ff9640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3060066740 0x7f3060068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.491+0000 7f3070ff9640 1 -- 172.21.15.70:0/2061931693 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f306c083a10 con 0x7f30741614b0 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.491+0000 7f3073fff640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3060066740 0x7f3060068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:20.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.491+0000 7f3073fff640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3060066740 0x7f3060068c00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f30740ad950 tx=0x7f3064008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:20.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.495+0000 7f3070ff9640 1 -- 172.21.15.70:0/2061931693 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3074150ca0 con 0x7f30741614b0 2023-11-26T07:20:20.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:20.647+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3074150ca0 con 0x7f30741614b0 2023-11-26T07:20:21.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.267+0000 7f3070ff9640 1 -- 172.21.15.70:0/2061931693 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3074150ca0 con 0x7f30741614b0 2023-11-26T07:20:21.270 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:20:21.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3060066740 msgr2=0x7f3060068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3060066740 0x7f3060068c00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f30740ad950 tx=0x7f3064008040 comp rx=0 tx=0).stop 2023-11-26T07:20:21.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30741614b0 msgr2=0x7f3074157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30741614b0 0x7f3074157370 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c730 tx=0x7f306c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 shutdown_connections 2023-11-26T07:20:21.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3060066740 0x7f3060068c00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30741614b0 0x7f3074157370 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3074071970 0x7f3074156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 --2- 172.21.15.70:0/2061931693 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3074070ba0 0x7f3074153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.271+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 >> 172.21.15.70:0/2061931693 conn(0x7f30740cf710 msgr2=0x7f307406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:21.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.275+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 shutdown_connections 2023-11-26T07:20:21.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.275+0000 7f307a45a640 1 -- 172.21.15.70:0/2061931693 wait complete. 2023-11-26T07:20:21.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:20:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba81aa640 1 Processor -- start 2023-11-26T07:20:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba81aa640 1 -- start start 2023-11-26T07:20:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba81aa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbba014b1e0 0x7fbba00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba81aa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbba0070fd0 0x7fbba0162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba81aa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba00cfc20 con 0x7fbba00cf7c0 2023-11-26T07:20:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba81aa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba0162080 con 0x7fbba014b1e0 2023-11-26T07:20:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba81aa640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba0161d70 con 0x7fbba0070fd0 2023-11-26T07:20:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba5f46640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbba014b1e0 0x7fbba00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba5f46640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbba014b1e0 0x7fbba00cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34576/0 (socket says 172.21.15.70:34576) 2023-11-26T07:20:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba5f46640 1 -- 172.21.15.70:0/3165910809 learned_addr learned my addr 172.21.15.70:0/3165910809 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:21.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba5f46640 1 -- 172.21.15.70:0/3165910809 >> v2:172.21.15.120:3300/0 conn(0x7fbba0070fd0 msgr2=0x7fbba0162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:21.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba5f46640 1 --2- 172.21.15.70:0/3165910809 >> v2:172.21.15.120:3300/0 conn(0x7fbba0070fd0 0x7fbba0162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba5f46640 1 -- 172.21.15.70:0/3165910809 >> v1:172.21.15.120:6789/0 conn(0x7fbba00cf7c0 legacy=0x7fbba00708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:21.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.443+0000 7fbba5f46640 1 -- 172.21.15.70:0/3165910809 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba014b5c0 con 0x7fbba014b1e0 2023-11-26T07:20:21.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba5f46640 1 --2- 172.21.15.70:0/3165910809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba00cf280 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbba0072110 tx=0x7fbb9c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e4cd60f33ec9d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba4f44640 1 -- 172.21.15.70:0/3165910809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0aa5f0 con 0x7fbba014b1e0 2023-11-26T07:20:21.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba4f44640 1 -- 172.21.15.70:0/3165910809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0aa750 con 0x7fbba014b1e0 2023-11-26T07:20:21.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba4f44640 1 -- 172.21.15.70:0/3165910809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0aaae0 con 0x7fbba014b1e0 2023-11-26T07:20:21.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 -- 172.21.15.70:0/3165910809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 msgr2=0x7fbba00cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 --2- 172.21.15.70:0/3165910809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba00cf280 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbba0072110 tx=0x7fbb9c01c490 comp rx=0 tx=0).stop 2023-11-26T07:20:21.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 -- 172.21.15.70:0/3165910809 shutdown_connections 2023-11-26T07:20:21.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 --2- 172.21.15.70:0/3165910809 >> v2:172.21.15.120:3300/0 conn(0x7fbba0070fd0 0x7fbba0162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 --2- 172.21.15.70:0/3165910809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba00cf280 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 -- 172.21.15.70:0/3165910809 >> 172.21.15.70:0/3165910809 conn(0x7fbba006a890 msgr2=0x7fbba006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:21.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 -- 172.21.15.70:0/3165910809 shutdown_connections 2023-11-26T07:20:21.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.447+0000 7fbba81aa640 1 -- 172.21.15.70:0/3165910809 wait complete. 2023-11-26T07:20:21.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 Processor -- start 2023-11-26T07:20:21.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 -- start start 2023-11-26T07:20:21.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbba0070fd0 0x7fbba014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba00cf7c0 0x7fbba00b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba0143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba014cfa0 con 0x7fbba014b1e0 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba014d280 con 0x7fbba00cf7c0 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba014d560 con 0x7fbba0070fd0 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba0143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba0143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34586/0 (socket says 172.21.15.70:34586) 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba5f46640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbba0070fd0 0x7fbba014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 -- 172.21.15.70:0/4026285017 learned_addr learned my addr 172.21.15.70:0/4026285017 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba5745640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba00cf7c0 0x7fbba00b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 -- 172.21.15.70:0/4026285017 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbba0070fd0 msgr2=0x7fbba014e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbba0070fd0 0x7fbba014e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 -- 172.21.15.70:0/4026285017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba00cf7c0 msgr2=0x7fbba00b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:21.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba00cf7c0 0x7fbba00b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:21.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 -- 172.21.15.70:0/4026285017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0094d0 con 0x7fbba014b1e0 2023-11-26T07:20:21.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba6747640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba0143ef0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800b970 tx=0x7fbb9800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbb967fc640 1 -- 172.21.15.70:0/4026285017 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800cb40 con 0x7fbba014b1e0 2023-11-26T07:20:21.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbb967fc640 1 -- 172.21.15.70:0/4026285017 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800ccc0 con 0x7fbba014b1e0 2023-11-26T07:20:21.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba014d840 con 0x7fbba014b1e0 2023-11-26T07:20:21.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbb967fc640 1 -- 172.21.15.70:0/4026285017 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98014680 con 0x7fbba014b1e0 2023-11-26T07:20:21.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.451+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba014e580 con 0x7fbba014b1e0 2023-11-26T07:20:21.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.455+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba0067680 con 0x7fbba014b1e0 2023-11-26T07:20:21.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.455+0000 7fbb967fc640 1 -- 172.21.15.70:0/4026285017 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fbb9801d3b0 con 0x7fbba014b1e0 2023-11-26T07:20:21.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.455+0000 7fbb967fc640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb84066770 0x7fbb84068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:21.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.455+0000 7fbb967fc640 1 -- 172.21.15.70:0/4026285017 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fbb98083ff0 con 0x7fbba014b1e0 2023-11-26T07:20:21.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.455+0000 7fbba5f46640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb84066770 0x7fbb84068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:21.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.455+0000 7fbba5f46640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb84066770 0x7fbb84068c30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0ae000 tx=0x7fbb9c0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:21.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.459+0000 7fbb967fc640 1 -- 172.21.15.70:0/4026285017 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb980512f0 con 0x7fbba014b1e0 2023-11-26T07:20:21.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:21.611+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbba014dcf0 con 0x7fbba014b1e0 2023-11-26T07:20:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.275+0000 7fbb967fc640 1 -- 172.21.15.70:0/4026285017 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbb980190d0 con 0x7fbba014b1e0 2023-11-26T07:20:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2023-11-26T07:20:22.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.275+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb84066770 msgr2=0x7fbb84068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.275+0000 7fbba81aa640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb84066770 0x7fbb84068c30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0ae000 tx=0x7fbb9c0b5040 comp rx=0 tx=0).stop 2023-11-26T07:20:22.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.275+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 msgr2=0x7fbba0143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.275+0000 7fbba81aa640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba0143ef0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800b970 tx=0x7fbb9800be30 comp rx=0 tx=0).stop 2023-11-26T07:20:22.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 shutdown_connections 2023-11-26T07:20:22.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbb84066770 0x7fbb84068c30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba014b1e0 0x7fbba0143ef0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbba00cf7c0 0x7fbba00b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 --2- 172.21.15.70:0/4026285017 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbba0070fd0 0x7fbba014e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 >> 172.21.15.70:0/4026285017 conn(0x7fbba006a890 msgr2=0x7fbba00af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 shutdown_connections 2023-11-26T07:20:22.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.279+0000 7fbba81aa640 1 -- 172.21.15.70:0/4026285017 wait complete. 2023-11-26T07:20:22.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:20:22.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.451+0000 7f0575bf5640 1 Processor -- start 2023-11-26T07:20:22.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.451+0000 7f0575bf5640 1 -- start start 2023-11-26T07:20:22.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f0575bf5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05700d1bc0 0x7f05700d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f0575bf5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05700b2160 0x7f05700b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f0575bf5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700cf0e0 con 0x7f057015d6e0 2023-11-26T07:20:22.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f0575bf5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057015dac0 con 0x7f05700d1bc0 2023-11-26T07:20:22.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f0575bf5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700ceb20 con 0x7f05700b2160 2023-11-26T07:20:22.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05700d1bc0 0x7f05700d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05700d1bc0 0x7f05700d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34590/0 (socket says 172.21.15.70:34590) 2023-11-26T07:20:22.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056effd640 1 -- 172.21.15.70:0/3653801449 learned_addr learned my addr 172.21.15.70:0/3653801449 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:22.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056ffff640 1 --2- 172.21.15.70:0/3653801449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05700b2160 0x7f05700b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056effd640 1 -- 172.21.15.70:0/3653801449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05700b2160 msgr2=0x7f05700b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:22.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056effd640 1 --2- 172.21.15.70:0/3653801449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05700b2160 0x7f05700b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056effd640 1 -- 172.21.15.70:0/3653801449 >> v1:172.21.15.120:6789/0 conn(0x7f057015d6e0 legacy=0x7f05700d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:22.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056effd640 1 -- 172.21.15.70:0/3653801449 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700cee00 con 0x7f05700d1bc0 2023-11-26T07:20:22.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.455+0000 7f056ffff640 1 --2- 172.21.15.70:0/3653801449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05700b2160 0x7f05700b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:22.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f056effd640 1 --2- 172.21.15.70:0/3653801449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700d1bc0 0x7f05700d0df0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0564009870 tx=0x7f056401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff5af1b75a22012 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f056e7fc640 1 -- 172.21.15.70:0/3653801449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640ac410 con 0x7f05700d1bc0 2023-11-26T07:20:22.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f056e7fc640 1 -- 172.21.15.70:0/3653801449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05640ac570 con 0x7f05700d1bc0 2023-11-26T07:20:22.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f056e7fc640 1 -- 172.21.15.70:0/3653801449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640ac900 con 0x7f05700d1bc0 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 -- 172.21.15.70:0/3653801449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700d1bc0 msgr2=0x7f05700d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 --2- 172.21.15.70:0/3653801449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700d1bc0 0x7f05700d0df0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0564009870 tx=0x7f056401c500 comp rx=0 tx=0).stop 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 -- 172.21.15.70:0/3653801449 shutdown_connections 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 --2- 172.21.15.70:0/3653801449 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f05700b2160 0x7f05700b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 --2- 172.21.15.70:0/3653801449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700d1bc0 0x7f05700d0df0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 -- 172.21.15.70:0/3653801449 >> 172.21.15.70:0/3653801449 conn(0x7f057009c550 msgr2=0x7f05700d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 -- 172.21.15.70:0/3653801449 shutdown_connections 2023-11-26T07:20:22.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 -- 172.21.15.70:0/3653801449 wait complete. 2023-11-26T07:20:22.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 Processor -- start 2023-11-26T07:20:22.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.459+0000 7f0575bf5640 1 -- start start 2023-11-26T07:20:22.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b2160 0x7f05701559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05700d1bc0 0x7f05700c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f057015d6e0 0x7f0570154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700c91e0 con 0x7f05700b2160 2023-11-26T07:20:22.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700c82e0 con 0x7f05700d1bc0 2023-11-26T07:20:22.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700c8560 con 0x7f057015d6e0 2023-11-26T07:20:22.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b2160 0x7f05701559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b2160 0x7f05701559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34602/0 (socket says 172.21.15.70:34602) 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 -- 172.21.15.70:0/1662677270 learned_addr learned my addr 172.21.15.70:0/1662677270 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056ffff640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f057015d6e0 0x7f0570154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056effd640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05700d1bc0 0x7f05700c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 -- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f057015d6e0 msgr2=0x7f0570154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f057015d6e0 0x7f0570154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 -- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05700d1bc0 msgr2=0x7f05700c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05700d1bc0 0x7f05700c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 -- 172.21.15.70:0/1662677270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640094d0 con 0x7f05700b2160 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056effd640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05700d1bc0 0x7f05700c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:22.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f056f7fe640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b2160 0x7f05701559d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f056000b410 tx=0x7f056000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0557fff640 1 -- 172.21.15.70:0/1662677270 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560004020 con 0x7f05700b2160 2023-11-26T07:20:22.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0557fff640 1 -- 172.21.15.70:0/1662677270 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560004180 con 0x7f05700b2160 2023-11-26T07:20:22.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0557fff640 1 -- 172.21.15.70:0/1662677270 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560011630 con 0x7f05700b2160 2023-11-26T07:20:22.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05700c8840 con 0x7f05700b2160 2023-11-26T07:20:22.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05700c8e00 con 0x7f05700b2160 2023-11-26T07:20:22.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570067680 con 0x7f05700b2160 2023-11-26T07:20:22.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.463+0000 7f0557fff640 1 -- 172.21.15.70:0/1662677270 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f0560011790 con 0x7f05700b2160 2023-11-26T07:20:22.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.467+0000 7f0557fff640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f055c066740 0x7f055c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.467+0000 7f0557fff640 1 -- 172.21.15.70:0/1662677270 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0560083ce0 con 0x7f05700b2160 2023-11-26T07:20:22.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.467+0000 7f056effd640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f055c066740 0x7f055c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.467+0000 7f056effd640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f055c066740 0x7f055c068c00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f05640ae000 tx=0x7f0564008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.471+0000 7f0557fff640 1 -- 172.21.15.70:0/1662677270 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05600510d0 con 0x7f05700b2160 2023-11-26T07:20:22.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.619+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f0570067d40 con 0x7f05700b2160 2023-11-26T07:20:22.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.623+0000 7f0557fff640 1 -- 172.21.15.70:0/1662677270 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f05600546f0 con 0x7f05700b2160 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f055c066740 msgr2=0x7f055c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f055c066740 0x7f055c068c00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f05640ae000 tx=0x7f0564008040 comp rx=0 tx=0).stop 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b2160 msgr2=0x7f05701559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b2160 0x7f05701559d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f056000b410 tx=0x7f056000b8d0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 shutdown_connections 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f057015d6e0 0x7f0570154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05700d1bc0 0x7f05700c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f055c066740 0x7f055c068c00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 --2- 172.21.15.70:0/1662677270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b2160 0x7f05701559d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 >> 172.21.15.70:0/1662677270 conn(0x7f057009c550 msgr2=0x7f05700d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 shutdown_connections 2023-11-26T07:20:22.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.627+0000 7f0575bf5640 1 -- 172.21.15.70:0/1662677270 wait complete. 2023-11-26T07:20:22.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:20:22.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.783+0000 7f6a8450f640 1 Processor -- start 2023-11-26T07:20:22.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.783+0000 7f6a8450f640 1 -- start start 2023-11-26T07:20:22.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a8450f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6a7c13e290 0x7f6a7c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a8450f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c0cf7c0 0x7f6a7c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a8450f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7c06c520 con 0x7f6a7c15f4e0 2023-11-26T07:20:22.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a8450f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7c0cfc40 con 0x7f6a7c13e290 2023-11-26T07:20:22.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a8450f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c06c800 con 0x7f6a7c0cf7c0 2023-11-26T07:20:22.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a822ab640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6a7c13e290 0x7f6a7c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a822ab640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6a7c13e290 0x7f6a7c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34608/0 (socket says 172.21.15.70:34608) 2023-11-26T07:20:22.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a822ab640 1 -- 172.21.15.70:0/3659726852 learned_addr learned my addr 172.21.15.70:0/3659726852 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:22.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a822ab640 1 -- 172.21.15.70:0/3659726852 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c0cf7c0 msgr2=0x7f6a7c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:22.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a822ab640 1 --2- 172.21.15.70:0/3659726852 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c0cf7c0 0x7f6a7c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a822ab640 1 -- 172.21.15.70:0/3659726852 >> v1:172.21.15.120:6789/0 conn(0x7f6a7c15f4e0 legacy=0x7f6a7c1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:22.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.787+0000 7f6a822ab640 1 -- 172.21.15.70:0/3659726852 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c06cae0 con 0x7f6a7c13e290 2023-11-26T07:20:22.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a822ab640 1 --2- 172.21.15.70:0/3659726852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0cf280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009870 tx=0x7f6a7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ed96ff62f3cf67 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a812a9640 1 -- 172.21.15.70:0/3659726852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780aa5f0 con 0x7f6a7c13e290 2023-11-26T07:20:22.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a812a9640 1 -- 172.21.15.70:0/3659726852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a780aa750 con 0x7f6a7c13e290 2023-11-26T07:20:22.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a812a9640 1 -- 172.21.15.70:0/3659726852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780aaae0 con 0x7f6a7c13e290 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 -- 172.21.15.70:0/3659726852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 msgr2=0x7f6a7c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 --2- 172.21.15.70:0/3659726852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0cf280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009870 tx=0x7f6a7801c4d0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 -- 172.21.15.70:0/3659726852 shutdown_connections 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 --2- 172.21.15.70:0/3659726852 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c0cf7c0 0x7f6a7c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 --2- 172.21.15.70:0/3659726852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0cf280 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 -- 172.21.15.70:0/3659726852 >> 172.21.15.70:0/3659726852 conn(0x7f6a7c06a890 msgr2=0x7f6a7c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 -- 172.21.15.70:0/3659726852 shutdown_connections 2023-11-26T07:20:22.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 -- 172.21.15.70:0/3659726852 wait complete. 2023-11-26T07:20:22.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 Processor -- start 2023-11-26T07:20:22.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.791+0000 7f6a8450f640 1 -- start start 2023-11-26T07:20:22.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a7c0cf7c0 0x7f6a7c154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c15f4e0 0x7f6a7c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c142870 con 0x7f6a7c13e290 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c141c60 con 0x7f6a7c0cf7c0 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c141f40 con 0x7f6a7c15f4e0 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34618/0 (socket says 172.21.15.70:34618) 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 -- 172.21.15.70:0/180411867 learned_addr learned my addr 172.21.15.70:0/180411867 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a82aac640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c15f4e0 0x7f6a7c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a822ab640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a7c0cf7c0 0x7f6a7c154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 -- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c15f4e0 msgr2=0x7f6a7c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c15f4e0 0x7f6a7c0b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 -- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a7c0cf7c0 msgr2=0x7f6a7c154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a7c0cf7c0 0x7f6a7c154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 -- 172.21.15.70:0/180411867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780094d0 con 0x7f6a7c13e290 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a81aaa640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0b11f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00b550 tx=0x7f6a6c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a72ffd640 1 -- 172.21.15.70:0/180411867 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c010870 con 0x7f6a7c13e290 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a72ffd640 1 -- 172.21.15.70:0/180411867 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0109f0 con 0x7f6a7c13e290 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c142220 con 0x7f6a7c13e290 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a72ffd640 1 -- 172.21.15.70:0/180411867 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c010da0 con 0x7f6a7c13e290 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c154da0 con 0x7f6a7c13e290 2023-11-26T07:20:22.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c067680 con 0x7f6a7c13e290 2023-11-26T07:20:22.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.795+0000 7f6a72ffd640 1 -- 172.21.15.70:0/180411867 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f6a6c00f3c0 con 0x7f6a7c13e290 2023-11-26T07:20:22.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.799+0000 7f6a72ffd640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6a60066740 0x7f6a60068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:22.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.799+0000 7f6a72ffd640 1 -- 172.21.15.70:0/180411867 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6a6c084000 con 0x7f6a7c13e290 2023-11-26T07:20:22.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.799+0000 7f6a822ab640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6a60066740 0x7f6a60068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:22.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.799+0000 7f6a822ab640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6a60066740 0x7f6a60068c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ae000 tx=0x7f6a780a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:22.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.803+0000 7f6a72ffd640 1 -- 172.21.15.70:0/180411867 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a6c0513f0 con 0x7f6a7c13e290 2023-11-26T07:20:22.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.951+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6a7c06df50 con 0x7f6a7c13e290 2023-11-26T07:20:22.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.955+0000 7f6a72ffd640 1 -- 172.21.15.70:0/180411867 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a6c054a10 con 0x7f6a7c13e290 2023-11-26T07:20:22.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6a60066740 msgr2=0x7f6a60068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6a60066740 0x7f6a60068c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ae000 tx=0x7f6a780a7000 comp rx=0 tx=0).stop 2023-11-26T07:20:22.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 msgr2=0x7f6a7c0b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0b11f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00b550 tx=0x7f6a6c00ba10 comp rx=0 tx=0).stop 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 shutdown_connections 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6a60066740 0x7f6a60068c00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a7c13e290 0x7f6a7c0b11f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a7c15f4e0 0x7f6a7c0b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 --2- 172.21.15.70:0/180411867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a7c0cf7c0 0x7f6a7c154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 >> 172.21.15.70:0/180411867 conn(0x7f6a7c06a890 msgr2=0x7f6a7c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 shutdown_connections 2023-11-26T07:20:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:22.959+0000 7f6a8450f640 1 -- 172.21.15.70:0/180411867 wait complete. 2023-11-26T07:20:22.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2023-11-26T07:20:23.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc9026aa640 1 Processor -- start 2023-11-26T07:20:23.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc9026aa640 1 -- start start 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc9026aa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc8fc070ba0 0x7fc8fc15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc9026aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc9026aa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc0714c0 con 0x7fc8fc0cd610 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc9026aa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc0cde60 con 0x7fc8fc070ba0 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc9026aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc15dc10 con 0x7fc8fc06bae0 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc8fc070ba0 0x7fc8fc15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc8fc070ba0 0x7fc8fc15e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34620/0 (socket says 172.21.15.70:34620) 2023-11-26T07:20:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fbfff640 1 -- 172.21.15.70:0/520511944 learned_addr learned my addr 172.21.15.70:0/520511944 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fb7fe640 1 --2- 172.21.15.70:0/520511944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fbfff640 1 -- 172.21.15.70:0/520511944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 msgr2=0x7fc8fc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fbfff640 1 --2- 172.21.15.70:0/520511944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fbfff640 1 -- 172.21.15.70:0/520511944 >> v1:172.21.15.120:6789/0 conn(0x7fc8fc0cd610 legacy=0x7fc8fc1610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.115+0000 7fc8fbfff640 1 -- 172.21.15.70:0/520511944 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc15def0 con 0x7fc8fc070ba0 2023-11-26T07:20:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc8fbfff640 1 --2- 172.21.15.70:0/520511944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15e6f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009870 tx=0x7fc8ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd382eeef244ad5e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc8faffd640 1 -- 172.21.15.70:0/520511944 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0ab620 con 0x7fc8fc070ba0 2023-11-26T07:20:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc8faffd640 1 -- 172.21.15.70:0/520511944 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0ab780 con 0x7fc8fc070ba0 2023-11-26T07:20:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc8faffd640 1 -- 172.21.15.70:0/520511944 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0abb10 con 0x7fc8fc070ba0 2023-11-26T07:20:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 -- 172.21.15.70:0/520511944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 msgr2=0x7fc8fc15e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 --2- 172.21.15.70:0/520511944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15e6f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009870 tx=0x7fc8ec01c480 comp rx=0 tx=0).stop 2023-11-26T07:20:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 -- 172.21.15.70:0/520511944 shutdown_connections 2023-11-26T07:20:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 --2- 172.21.15.70:0/520511944 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 --2- 172.21.15.70:0/520511944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15e6f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 -- 172.21.15.70:0/520511944 >> 172.21.15.70:0/520511944 conn(0x7fc8fc0cf710 msgr2=0x7fc8fc0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:23.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 -- 172.21.15.70:0/520511944 shutdown_connections 2023-11-26T07:20:23.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.119+0000 7fc9026aa640 1 -- 172.21.15.70:0/520511944 wait complete. 2023-11-26T07:20:23.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 Processor -- start 2023-11-26T07:20:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 -- start start 2023-11-26T07:20:23.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc0ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8fc0cd610 0x7fc8fc14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc151810 con 0x7fc8fc070ba0 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc150c00 con 0x7fc8fc0cd610 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc150ee0 con 0x7fc8fc06bae0 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34626/0 (socket says 172.21.15.70:34626) 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 -- 172.21.15.70:0/814719338 learned_addr learned my addr 172.21.15.70:0/814719338 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fbfff640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc0ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc900c47640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8fc0cd610 0x7fc8fc14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 -- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 msgr2=0x7fc8fc0ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc0ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 -- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8fc0cd610 msgr2=0x7fc8fc14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:23.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8fc0cd610 0x7fc8fc14ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:23.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 -- 172.21.15.70:0/814719338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0094d0 con 0x7fc8fc070ba0 2023-11-26T07:20:23.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fbfff640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc0ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:23.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc900c47640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8fc0cd610 0x7fc8fc14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:23.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8fb7fe640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15baf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000d5f0 tx=0x7fc8f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8f8ff9640 1 -- 172.21.15.70:0/814719338 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00125f0 con 0x7fc8fc070ba0 2023-11-26T07:20:23.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8f8ff9640 1 -- 172.21.15.70:0/814719338 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f0012750 con 0x7fc8fc070ba0 2023-11-26T07:20:23.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc8f8ff9640 1 -- 172.21.15.70:0/814719338 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0012b00 con 0x7fc8fc070ba0 2023-11-26T07:20:23.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc1511c0 con 0x7fc8fc070ba0 2023-11-26T07:20:23.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.123+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc0b0770 con 0x7fc8fc070ba0 2023-11-26T07:20:23.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.127+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc067680 con 0x7fc8fc070ba0 2023-11-26T07:20:23.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.127+0000 7fc8f8ff9640 1 -- 172.21.15.70:0/814719338 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fc8f0012c60 con 0x7fc8fc070ba0 2023-11-26T07:20:23.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.127+0000 7fc8f8ff9640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc8e8066740 0x7fc8e8068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:23.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.127+0000 7fc8f8ff9640 1 -- 172.21.15.70:0/814719338 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8f0084580 con 0x7fc8fc070ba0 2023-11-26T07:20:23.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.127+0000 7fc8fbfff640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc8e8066740 0x7fc8e8068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:23.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.127+0000 7fc8fbfff640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc8e8066740 0x7fc8e8068c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0af000 tx=0x7fc8ec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.131+0000 7fc8f8ff9640 1 -- 172.21.15.70:0/814719338 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8f0051970 con 0x7fc8fc070ba0 2023-11-26T07:20:23.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:23.343+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) v1 -- 0x7fc8fc06b730 con 0x7fc8fc070ba0 2023-11-26T07:20:24.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc8f8ff9640 1 -- 172.21.15.70:0/814719338 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v144) v1 ==== 165+0+0 (secure 0 0 0) 0x7fc8f0054f90 con 0x7fc8fc070ba0 2023-11-26T07:20:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc8e8066740 msgr2=0x7fc8e8068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc8e8066740 0x7fc8e8068c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0af000 tx=0x7fc8ec0a7000 comp rx=0 tx=0).stop 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 msgr2=0x7fc8fc15baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15baf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000d5f0 tx=0x7fc8f000dab0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 shutdown_connections 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc8e8066740 0x7fc8e8068c00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8fc070ba0 0x7fc8fc15baf0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8fc0cd610 0x7fc8fc14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 --2- 172.21.15.70:0/814719338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8fc06bae0 0x7fc8fc0ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.279+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 >> 172.21.15.70:0/814719338 conn(0x7fc8fc0cf710 msgr2=0x7fc8fc0ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.283+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 shutdown_connections 2023-11-26T07:20:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.283+0000 7fc9026aa640 1 -- 172.21.15.70:0/814719338 wait complete. 2023-11-26T07:20:24.304 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is in failed state and validate the reason ... ok 2023-11-26T07:20:24.305 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during in-progress state and validate the reason 2023-11-26T07:20:24.305 INFO:tasks.cephfs_test_runner:test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:20:24.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:24.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.439+0000 7feb8b3b4640 1 Processor -- start 2023-11-26T07:20:24.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8b3b4640 1 -- start start 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8b3b4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb84144720 0x7feb8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8b3b4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb8406d840 0x7feb840714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8b3b4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8406e3f0 con 0x7feb84071a20 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8b3b4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb84071e90 con 0x7feb8406d840 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8b3b4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840722f0 con 0x7feb84144720 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8a3b2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb84144720 0x7feb8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8a3b2640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb84144720 0x7feb8406d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:49356/0 (socket says 172.21.15.70:49356) 2023-11-26T07:20:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8a3b2640 1 -- 172.21.15.70:0/4236804412 learned_addr learned my addr 172.21.15.70:0/4236804412 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:24.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb89bb1640 1 --2- 172.21.15.70:0/4236804412 >> v2:172.21.15.120:3300/0 conn(0x7feb8406d840 0x7feb840714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8a3b2640 1 -- 172.21.15.70:0/4236804412 >> v2:172.21.15.120:3300/0 conn(0x7feb8406d840 msgr2=0x7feb840714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:24.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8a3b2640 1 --2- 172.21.15.70:0/4236804412 >> v2:172.21.15.120:3300/0 conn(0x7feb8406d840 0x7feb840714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8a3b2640 1 -- 172.21.15.70:0/4236804412 >> v1:172.21.15.120:6789/0 conn(0x7feb84071a20 legacy=0x7feb840cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb8a3b2640 1 -- 172.21.15.70:0/4236804412 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8406de30 con 0x7feb84144720 2023-11-26T07:20:24.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.443+0000 7feb893b0640 1 -- 172.21.15.70:0/4236804412 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007595798 0 0) 0x7feb8406e3f0 con 0x7feb84071a20 2023-11-26T07:20:24.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8a3b2640 1 --2- 172.21.15.70:0/4236804412 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb84144720 0x7feb8406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feb80009870 tx=0x7feb8001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f7f58e8a56a2d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:24.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb893b0640 1 -- 172.21.15.70:0/4236804412 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800ab620 con 0x7feb84144720 2023-11-26T07:20:24.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb893b0640 1 -- 172.21.15.70:0/4236804412 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb800ab780 con 0x7feb84144720 2023-11-26T07:20:24.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb893b0640 1 -- 172.21.15.70:0/4236804412 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800abb10 con 0x7feb84144720 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 -- 172.21.15.70:0/4236804412 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb84144720 msgr2=0x7feb8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/4236804412 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb84144720 0x7feb8406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feb80009870 tx=0x7feb8001c510 comp rx=0 tx=0).stop 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 -- 172.21.15.70:0/4236804412 shutdown_connections 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/4236804412 >> v2:172.21.15.120:3300/0 conn(0x7feb8406d840 0x7feb840714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/4236804412 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb84144720 0x7feb8406d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 -- 172.21.15.70:0/4236804412 >> 172.21.15.70:0/4236804412 conn(0x7feb8406a890 msgr2=0x7feb8406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 -- 172.21.15.70:0/4236804412 shutdown_connections 2023-11-26T07:20:24.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.447+0000 7feb8b3b4640 1 -- 172.21.15.70:0/4236804412 wait complete. 2023-11-26T07:20:24.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 Processor -- start 2023-11-26T07:20:24.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 -- start start 2023-11-26T07:20:24.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8406d840 0x7feb8415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb84071a20 0x7feb840b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb84144720 0x7feb840b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b3690 con 0x7feb84071a20 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8413cb20 con 0x7feb84144720 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b2a80 con 0x7feb8406d840 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb84071a20 0x7feb840b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb84071a20 0x7feb840b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48226/0 (socket says 172.21.15.70:48226) 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 -- 172.21.15.70:0/634340177 learned_addr learned my addr 172.21.15.70:0/634340177 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8a3b2640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8406d840 0x7feb8415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8abb3640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb84144720 0x7feb840b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 -- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8406d840 msgr2=0x7feb8415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8406d840 0x7feb8415a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 -- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb84144720 msgr2=0x7feb840b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb84144720 0x7feb840b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 -- 172.21.15.70:0/634340177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800094d0 con 0x7feb84071a20 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb89bb1640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb84071a20 0x7feb840b1f10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feb7400e930 tx=0x7feb7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb7affd640 1 -- 172.21.15.70:0/634340177 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74009690 con 0x7feb84071a20 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb7affd640 1 -- 172.21.15.70:0/634340177 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7400ca00 con 0x7feb84071a20 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb840b2d60 con 0x7feb84071a20 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb7affd640 1 -- 172.21.15.70:0/634340177 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400cd70 con 0x7feb84071a20 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840b3320 con 0x7feb84071a20 2023-11-26T07:20:24.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.451+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb840b3840 con 0x7feb84071a20 2023-11-26T07:20:24.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.455+0000 7feb7affd640 1 -- 172.21.15.70:0/634340177 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7feb74013470 con 0x7feb84071a20 2023-11-26T07:20:24.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.455+0000 7feb7affd640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb68066740 0x7feb68068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.455+0000 7feb7affd640 1 -- 172.21.15.70:0/634340177 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb74084150 con 0x7feb84071a20 2023-11-26T07:20:24.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.455+0000 7feb8a3b2640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb68066740 0x7feb68068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.455+0000 7feb8a3b2640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb68066740 0x7feb68068c00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feb800af000 tx=0x7feb800a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:24.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.459+0000 7feb7affd640 1 -- 172.21.15.70:0/634340177 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb840b3840 con 0x7feb84071a20 2023-11-26T07:20:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb84067500 con 0x7feb84071a20 2023-11-26T07:20:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb7affd640 1 -- 172.21.15.70:0/634340177 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12986 (secure 0 0 0) 0x7feb740516f0 con 0x7feb84071a20 2023-11-26T07:20:24.613 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:24.613 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":40,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:22.271078+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6836/4160736209":"2023-11-27T07:20:19.260365+0000","172.21.15.70:6834/4160736209":"2023-11-27T07:20:19.260365+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb68066740 msgr2=0x7feb68068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb68066740 0x7feb68068c00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feb800af000 tx=0x7feb800a7000 comp rx=0 tx=0).stop 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb84071a20 msgr2=0x7feb840b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb84071a20 0x7feb840b1f10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feb7400e930 tx=0x7feb7400edf0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 shutdown_connections 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb68066740 0x7feb68068c00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb84071a20 0x7feb840b1f10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb84144720 0x7feb840b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 --2- 172.21.15.70:0/634340177 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8406d840 0x7feb8415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 >> 172.21.15.70:0/634340177 conn(0x7feb8406a890 msgr2=0x7feb840af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 shutdown_connections 2023-11-26T07:20:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.611+0000 7feb8b3b4640 1 -- 172.21.15.70:0/634340177 wait complete. 2023-11-26T07:20:24.634 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:20:24.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:20:24.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d18ff8640 1 Processor -- start 2023-11-26T07:20:24.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d18ff8640 1 -- start start 2023-11-26T07:20:24.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d18ff8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d140cf280 0x7f5d140cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d18ff8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d140cfc20 con 0x7f5d14143ac0 2023-11-26T07:20:24.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d18ff8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d140cc730 con 0x7f5d140cd1b0 2023-11-26T07:20:24.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d18ff8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14143ea0 con 0x7f5d140cf280 2023-11-26T07:20:24.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d1259c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5d14143ac0 0x7f5d14070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:54084/0 (socket says 172.21.15.70:54084) 2023-11-26T07:20:24.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d1259c640 1 -- 172.21.15.70:0/2643404060 learned_addr learned my addr 172.21.15.70:0/2643404060 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:24.778 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d09d9b640 1 --2- 172.21.15.70:0/2643404060 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d140cf280 0x7f5d140cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584273961 0 0) 0x7f5d140cfc20 con 0x7f5d14143ac0 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d00003530 con 0x7f5d14143ac0 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677106404 0 0) 0x7f5d140cc730 con 0x7f5d140cd1b0 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d140cfc20 con 0x7f5d140cd1b0 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3266192906 0 0) 0x7f5d00003530 con 0x7f5d14143ac0 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d09d9b640 1 -- 172.21.15.70:0/2643404060 >> v1:172.21.15.120:6789/0 conn(0x7f5d140cd1b0 legacy=0x7f5d140cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d09d9b640 1 -- 172.21.15.70:0/2643404060 >> v1:172.21.15.70:6789/0 conn(0x7f5d14143ac0 legacy=0x7f5d14070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.775+0000 7f5d09d9b640 1 -- 172.21.15.70:0/2643404060 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14070ee0 con 0x7f5d140cf280 2023-11-26T07:20:24.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d09d9b640 1 --2- 172.21.15.70:0/2643404060 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d140cf280 0x7f5d140cf6e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0097f0 tx=0x7f5cfc01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a281059501e18a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:24.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04001680 con 0x7f5d140cf280 2023-11-26T07:20:24.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc0ad460 con 0x7f5d140cf280 2023-11-26T07:20:24.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d11d9b640 1 -- 172.21.15.70:0/2643404060 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0ad7f0 con 0x7f5d140cf280 2023-11-26T07:20:24.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d18ff8640 1 -- 172.21.15.70:0/2643404060 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d140cf280 msgr2=0x7f5d140cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/2643404060 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d140cf280 0x7f5d140cf6e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0097f0 tx=0x7f5cfc01c3e0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d18ff8640 1 -- 172.21.15.70:0/2643404060 shutdown_connections 2023-11-26T07:20:24.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/2643404060 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d140cf280 0x7f5d140cf6e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d18ff8640 1 -- 172.21.15.70:0/2643404060 >> 172.21.15.70:0/2643404060 conn(0x7f5d1406a890 msgr2=0x7f5d1406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:24.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d18ff8640 1 -- 172.21.15.70:0/2643404060 shutdown_connections 2023-11-26T07:20:24.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.779+0000 7f5d18ff8640 1 -- 172.21.15.70:0/2643404060 wait complete. 2023-11-26T07:20:24.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 Processor -- start 2023-11-26T07:20:24.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 -- start start 2023-11-26T07:20:24.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d140cd1b0 0x7f5d140aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d140cf280 0x7f5d14155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d14143ac0 0x7f5d14138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140aff50 con 0x7f5d140cf280 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140b1380 con 0x7f5d140cd1b0 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140af050 con 0x7f5d14143ac0 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d140cf280 0x7f5d14155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d140cf280 0x7f5d14155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48242/0 (socket says 172.21.15.70:48242) 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 -- 172.21.15.70:0/1867203606 learned_addr learned my addr 172.21.15.70:0/1867203606 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d12d9d640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d14143ac0 0x7f5d14138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d1259c640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d140cd1b0 0x7f5d140aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 -- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d14143ac0 msgr2=0x7f5d14138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d14143ac0 0x7f5d14138c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 -- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d140cd1b0 msgr2=0x7f5d140aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d140cd1b0 0x7f5d140aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 -- 172.21.15.70:0/1867203606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc009420 con 0x7f5d140cf280 2023-11-26T07:20:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d12d9d640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d14143ac0 0x7f5d14138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d09d9b640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d140cf280 0x7f5d14155590 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0097f0 tx=0x7f5cfc019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d0b7fe640 1 -- 172.21.15.70:0/1867203606 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0bd070 con 0x7f5d140cf280 2023-11-26T07:20:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d0b7fe640 1 -- 172.21.15.70:0/1867203606 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc0ade30 con 0x7f5d140cf280 2023-11-26T07:20:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d14157f00 con 0x7f5d140cf280 2023-11-26T07:20:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d0b7fe640 1 -- 172.21.15.70:0/1867203606 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc004220 con 0x7f5d140cf280 2023-11-26T07:20:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.783+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d140b0dc0 con 0x7f5d140cf280 2023-11-26T07:20:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.787+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14067680 con 0x7f5d140cf280 2023-11-26T07:20:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.787+0000 7f5d0b7fe640 1 -- 172.21.15.70:0/1867203606 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f5cfc0b4040 con 0x7f5d140cf280 2023-11-26T07:20:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.787+0000 7f5d0b7fe640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5cf4066740 0x7f5cf4068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.787+0000 7f5d0b7fe640 1 -- 172.21.15.70:0/1867203606 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5cfc11da20 con 0x7f5d140cf280 2023-11-26T07:20:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.787+0000 7f5d1259c640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5cf4066740 0x7f5cf4068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.787+0000 7f5d1259c640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5cf4066740 0x7f5cf4068c00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5d04000f70 tx=0x7f5d040016c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.791+0000 7f5d0b7fe640 1 -- 172.21.15.70:0/1867203606 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5cfc0eac70 con 0x7f5d140cf280 2023-11-26T07:20:24.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.943+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d1413a0d0 con 0x7f5d140cf280 2023-11-26T07:20:24.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.943+0000 7f5d0b7fe640 1 -- 172.21.15.70:0/1867203606 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cfc0b20a0 con 0x7f5d140cf280 2023-11-26T07:20:24.945 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:20:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.943+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5cf4066740 msgr2=0x7f5cf4068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.943+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5cf4066740 0x7f5cf4068c00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5d04000f70 tx=0x7f5d040016c0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.943+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d140cf280 msgr2=0x7f5d14155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d140cf280 0x7f5d14155590 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0097f0 tx=0x7f5cfc019180 comp rx=0 tx=0).stop 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 shutdown_connections 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5cf4066740 0x7f5cf4068c00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d140cf280 0x7f5d14155590 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d14143ac0 0x7f5d14138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 --2- 172.21.15.70:0/1867203606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d140cd1b0 0x7f5d140aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 >> 172.21.15.70:0/1867203606 conn(0x7f5d1406a890 msgr2=0x7f5d14072130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 shutdown_connections 2023-11-26T07:20:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:24.947+0000 7f5d18ff8640 1 -- 172.21.15.70:0/1867203606 wait complete. 2023-11-26T07:20:24.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-11-26T07:20:25.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.103+0000 7fd6f6f2a640 1 Processor -- start 2023-11-26T07:20:25.107 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.103+0000 7fd6f6f2a640 1 -- start start 2023-11-26T07:20:25.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f6f2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f6f2a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00cc730 con 0x7fd6f00708b0 2023-11-26T07:20:25.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f6f2a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0070ee0 con 0x7fd6f00cf990 2023-11-26T07:20:25.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f6f2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0143ea0 con 0x7fd6f0143ac0 2023-11-26T07:20:25.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6e7fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd6f00708b0 0x7fd6f00cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:54090/0 (socket says 172.21.15.70:54090) 2023-11-26T07:20:25.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6e7fff640 1 -- 172.21.15.70:0/1274579105 learned_addr learned my addr 172.21.15.70:0/1274579105 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f4cc6640 1 --2- 172.21.15.70:0/1274579105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6e77fe640 1 -- 172.21.15.70:0/1274579105 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124445249 0 0) 0x7fd6f00cc730 con 0x7fd6f00708b0 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6e77fe640 1 -- 172.21.15.70:0/1274579105 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d8003530 con 0x7fd6f00708b0 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6e77fe640 1 -- 172.21.15.70:0/1274579105 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353305114 0 0) 0x7fd6f0070ee0 con 0x7fd6f00cf990 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6e77fe640 1 -- 172.21.15.70:0/1274579105 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f00cc730 con 0x7fd6f00cf990 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f4cc6640 1 -- 172.21.15.70:0/1274579105 >> v1:172.21.15.120:6789/0 conn(0x7fd6f00cf990 legacy=0x7fd6f00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f4cc6640 1 -- 172.21.15.70:0/1274579105 >> v1:172.21.15.70:6789/0 conn(0x7fd6f00708b0 legacy=0x7fd6f00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.107+0000 7fd6f4cc6640 1 -- 172.21.15.70:0/1274579105 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00711c0 con 0x7fd6f0143ac0 2023-11-26T07:20:25.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f4cc6640 1 --2- 172.21.15.70:0/1274579105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0070370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0097f0 tx=0x7fd6ec01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187be77f7b47841f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:25.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6e77fe640 1 -- 172.21.15.70:0/1274579105 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0ac630 con 0x7fd6f0143ac0 2023-11-26T07:20:25.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6e77fe640 1 -- 172.21.15.70:0/1274579105 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec0ac790 con 0x7fd6f0143ac0 2023-11-26T07:20:25.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6e77fe640 1 -- 172.21.15.70:0/1274579105 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0acb00 con 0x7fd6f0143ac0 2023-11-26T07:20:25.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/1274579105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 msgr2=0x7fd6f0070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/1274579105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0070370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0097f0 tx=0x7fd6ec01c4c0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/1274579105 shutdown_connections 2023-11-26T07:20:25.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/1274579105 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0070370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/1274579105 >> 172.21.15.70:0/1274579105 conn(0x7fd6f006a890 msgr2=0x7fd6f006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:25.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/1274579105 shutdown_connections 2023-11-26T07:20:25.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/1274579105 wait complete. 2023-11-26T07:20:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 Processor -- start 2023-11-26T07:20:25.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.111+0000 7fd6f6f2a640 1 -- start start 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f00708b0 0x7fd6f0138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6f00cf990 0x7fd6f0136590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01393d0 con 0x7fd6f00708b0 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00b3df0 con 0x7fd6f00cf990 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01544a0 con 0x7fd6f0143ac0 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f00708b0 0x7fd6f0138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f00708b0 0x7fd6f0138e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48254/0 (socket says 172.21.15.70:48254) 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 -- 172.21.15.70:0/2224413928 learned_addr learned my addr 172.21.15.70:0/2224413928 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6e7fff640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6f00cf990 0x7fd6f0136590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f54c7640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 -- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 msgr2=0x7fd6f0136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 -- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6f00cf990 msgr2=0x7fd6f0136590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6f00cf990 0x7fd6f0136590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 -- 172.21.15.70:0/2224413928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009420 con 0x7fd6f00708b0 2023-11-26T07:20:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f54c7640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:25.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f4cc6640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f00708b0 0x7fd6f0138e90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec000c10 tx=0x7fd6ec019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:25.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6e57fa640 1 -- 172.21.15.70:0/2224413928 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0b5600 con 0x7fd6f00708b0 2023-11-26T07:20:25.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6e57fa640 1 -- 172.21.15.70:0/2224413928 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec0b5760 con 0x7fd6f00708b0 2023-11-26T07:20:25.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6e57fa640 1 -- 172.21.15.70:0/2224413928 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0b5af0 con 0x7fd6f00708b0 2023-11-26T07:20:25.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f0154780 con 0x7fd6f00708b0 2023-11-26T07:20:25.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f0150500 con 0x7fd6f00708b0 2023-11-26T07:20:25.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.115+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f01506f0 con 0x7fd6f00708b0 2023-11-26T07:20:25.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.119+0000 7fd6e57fa640 1 -- 172.21.15.70:0/2224413928 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fd6ec0b3040 con 0x7fd6f00708b0 2023-11-26T07:20:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.119+0000 7fd6e57fa640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6dc066740 0x7fd6dc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.119+0000 7fd6e57fa640 1 -- 172.21.15.70:0/2224413928 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd6ec11dfe0 con 0x7fd6f00708b0 2023-11-26T07:20:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.119+0000 7fd6e7fff640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6dc066740 0x7fd6dc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:25.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.119+0000 7fd6e7fff640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6dc066740 0x7fd6dc068c00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0152920 tx=0x7fd6e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:25.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.123+0000 7fd6e57fa640 1 -- 172.21.15.70:0/2224413928 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6ec0eb270 con 0x7fd6f00708b0 2023-11-26T07:20:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:25.327+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7fd6f0067680 con 0x7fd6f00708b0 2023-11-26T07:20:26.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.287+0000 7fd6e57fa640 1 -- 172.21.15.70:0/2224413928 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v146) v1 ==== 183+0+0 (secure 0 0 0) 0x7fd6ec0a8020 con 0x7fd6f00708b0 2023-11-26T07:20:26.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6dc066740 msgr2=0x7fd6dc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6dc066740 0x7fd6dc068c00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0152920 tx=0x7fd6e0009040 comp rx=0 tx=0).stop 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f00708b0 msgr2=0x7fd6f0138e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f00708b0 0x7fd6f0138e90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec000c10 tx=0x7fd6ec019260 comp rx=0 tx=0).stop 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 shutdown_connections 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6f0143ac0 0x7fd6f0136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6f00cf990 0x7fd6f0136590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6dc066740 0x7fd6dc068c00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 --2- 172.21.15.70:0/2224413928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6f00708b0 0x7fd6f0138e90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 >> 172.21.15.70:0/2224413928 conn(0x7fd6f006a890 msgr2=0x7fd6f006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 shutdown_connections 2023-11-26T07:20:26.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.291+0000 7fd6f6f2a640 1 -- 172.21.15.70:0/2224413928 wait complete. 2023-11-26T07:20:26.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:20:26.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda96fe640 1 Processor -- start 2023-11-26T07:20:26.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda96fe640 1 -- start start 2023-11-26T07:20:26.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda96fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efda40b2160 0x7efda40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda96fe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40cf0e0 con 0x7efda40d1bc0 2023-11-26T07:20:26.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda96fe640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40ceb20 con 0x7efda415d6e0 2023-11-26T07:20:26.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda96fe640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda415dac0 con 0x7efda40b2160 2023-11-26T07:20:26.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efd9a7fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efda40d1bc0 0x7efda40b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:54102/0 (socket says 172.21.15.70:54102) 2023-11-26T07:20:26.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efd9a7fc640 1 -- 172.21.15.70:0/3280734719 learned_addr learned my addr 172.21.15.70:0/3280734719 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541234914 0 0) 0x7efda40cf0e0 con 0x7efda40d1bc0 2023-11-26T07:20:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda37fe640 1 --2- 172.21.15.70:0/3280734719 >> v2:172.21.15.120:3300/0 conn(0x7efda40b2160 0x7efda40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd90003530 con 0x7efda40d1bc0 2023-11-26T07:20:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 153633933 0 0) 0x7efd90003530 con 0x7efda40d1bc0 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 >> v2:172.21.15.120:3300/0 conn(0x7efda40b2160 msgr2=0x7efda40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 --2- 172.21.15.70:0/3280734719 >> v2:172.21.15.120:3300/0 conn(0x7efda40b2160 0x7efda40d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 >> v1:172.21.15.120:6789/0 conn(0x7efda415d6e0 legacy=0x7efda40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40cee00 con 0x7efda40d1bc0 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7efd8c001a00 con 0x7efda40d1bc0 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 >> v1:172.21.15.70:6789/0 conn(0x7efda40d1bc0 legacy=0x7efda40b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd900039d0 0x7efd90003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd900047d0 0x7efd90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd90005190 0x7efd9000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda415dac0 con 0x7efd900039d0 2023-11-26T07:20:26.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9000c090 con 0x7efd90005190 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.459+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9000c250 con 0x7efd900047d0 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda2ffd640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd900039d0 0x7efd90003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efd9a7fc640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd900047d0 0x7efd90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda37fe640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd90005190 0x7efd9000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda2ffd640 1 -- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd900047d0 msgr2=0x7efd90004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda2ffd640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd900047d0 0x7efd90004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda2ffd640 1 -- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd90005190 msgr2=0x7efd9000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda2ffd640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd90005190 0x7efd9000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda2ffd640 1 -- 172.21.15.70:0/3280734719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90003530 con 0x7efd900039d0 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda37fe640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd90005190 0x7efd9000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efd9a7fc640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd900047d0 0x7efd90004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:26.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda37fe640 1 -- 172.21.15.70:0/3280734719 reap_dead start 2023-11-26T07:20:26.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda2ffd640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd900039d0 0x7efd90003df0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd94001780 tx=0x7efd9401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f79cb258c299d56 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940052d0 con 0x7efd900039d0 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd940a7050 con 0x7efd900039d0 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.463+0000 7efda27fc640 1 -- 172.21.15.70:0/3280734719 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94003600 con 0x7efd900039d0 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- 172.21.15.70:0/3280734719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd900039d0 msgr2=0x7efd90003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd900039d0 0x7efd90003df0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd94001780 tx=0x7efd9401c3b0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- 172.21.15.70:0/3280734719 shutdown_connections 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 --2- 172.21.15.70:0/3280734719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd900039d0 0x7efd90003df0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- 172.21.15.70:0/3280734719 >> 172.21.15.70:0/3280734719 conn(0x7efda409c550 msgr2=0x7efda40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- 172.21.15.70:0/3280734719 shutdown_connections 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- 172.21.15.70:0/3280734719 wait complete. 2023-11-26T07:20:26.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 Processor -- start 2023-11-26T07:20:26.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- start start 2023-11-26T07:20:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd900039d0 0x7efda40c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efda40b3470 0x7efda40b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efda40cc3b0 0x7efda40cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40cbf20 con 0x7efda40b3470 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda40cb940 con 0x7efd900039d0 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda96fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda40b41a0 con 0x7efda40cc3b0 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efda40b3470 0x7efda40b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efda40b3470 0x7efda40b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48258/0 (socket says 172.21.15.70:48258) 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 -- 172.21.15.70:0/2929179532 learned_addr learned my addr 172.21.15.70:0/2929179532 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda37fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efda40cc3b0 0x7efda40cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda2ffd640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd900039d0 0x7efda40c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 -- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efda40cc3b0 msgr2=0x7efda40cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efda40cc3b0 0x7efda40cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 -- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd900039d0 msgr2=0x7efda40c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd900039d0 0x7efda40c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efd9a7fc640 1 -- 172.21.15.70:0/2929179532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40cbbb0 con 0x7efda40b3470 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda2ffd640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd900039d0 0x7efda40c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.467+0000 7efda37fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efda40cc3b0 0x7efda40cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efd9a7fc640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efda40b3470 0x7efda40b38f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd8c007a40 tx=0x7efd8c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efd9bfff640 1 -- 172.21.15.70:0/2929179532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c001980 con 0x7efda40b3470 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efd9bfff640 1 -- 172.21.15.70:0/2929179532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c00ee50 con 0x7efda40b3470 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda40b4480 con 0x7efda40b3470 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efd9bfff640 1 -- 172.21.15.70:0/2929179532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c013620 con 0x7efda40b3470 2023-11-26T07:20:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda40c9df0 con 0x7efda40b3470 2023-11-26T07:20:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda40cb7a0 con 0x7efda40b3470 2023-11-26T07:20:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efd9bfff640 1 -- 172.21.15.70:0/2929179532 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7efd8c013780 con 0x7efda40b3470 2023-11-26T07:20:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efd9bfff640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd84066740 0x7efd84068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efd9bfff640 1 -- 172.21.15.70:0/2929179532 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd8c084590 con 0x7efda40b3470 2023-11-26T07:20:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.471+0000 7efda2ffd640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd84066740 0x7efd84068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.475+0000 7efda2ffd640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd84066740 0x7efd84068c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efd94001750 tx=0x7efd940011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.475+0000 7efd9bfff640 1 -- 172.21.15.70:0/2929179532 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efda40cb7a0 con 0x7efda40b3470 2023-11-26T07:20:26.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.627+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efda40cb7a0 con 0x7efda40b3470 2023-11-26T07:20:26.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efd9bfff640 1 -- 172.21.15.70:0/2929179532 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7efda40cb7a0 con 0x7efda40b3470 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd84066740 msgr2=0x7efd84068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd84066740 0x7efd84068c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efd94001750 tx=0x7efd940011a0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efda40b3470 msgr2=0x7efda40b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efda40b3470 0x7efda40b38f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd8c007a40 tx=0x7efd8c00e530 comp rx=0 tx=0).stop 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 shutdown_connections 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd84066740 0x7efd84068c00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efda40b3470 0x7efda40b38f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efda40cc3b0 0x7efda40cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 --2- 172.21.15.70:0/2929179532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd900039d0 0x7efda40c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 >> 172.21.15.70:0/2929179532 conn(0x7efda409c550 msgr2=0x7efda406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 shutdown_connections 2023-11-26T07:20:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:26.631+0000 7efda96fe640 1 -- 172.21.15.70:0/2929179532 wait complete. 2023-11-26T07:20:26.654 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:20:26.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:20:26.729 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:20:26.805 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:20:26.805 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:26.805 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:26.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:20:26.814 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:20:26.814 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:26.823 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:20:26.823 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:26.823 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:26.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:20:26.863 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:20:26.863 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:26.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:20:26.875 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:20:26.875 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:27.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.039+0000 7fe6f9879640 1 Processor -- start 2023-11-26T07:20:27.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f9879640 1 -- start start 2023-11-26T07:20:27.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f9879640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f415d6e0 0x7fe6f40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f9879640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe6f40b2160 0x7fe6f40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f9879640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40cf0e0 con 0x7fe6f40d19f0 2023-11-26T07:20:27.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f9879640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f415dac0 con 0x7fe6f40b2160 2023-11-26T07:20:27.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f9879640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40d1e80 con 0x7fe6f415d6e0 2023-11-26T07:20:27.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f2ffd640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f415d6e0 0x7fe6f40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f2ffd640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f415d6e0 0x7fe6f40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:49410/0 (socket says 172.21.15.70:49410) 2023-11-26T07:20:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f2ffd640 1 -- 172.21.15.70:0/1522488073 learned_addr learned my addr 172.21.15.70:0/1522488073 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f27fc640 1 --2- 172.21.15.70:0/1522488073 >> v2:172.21.15.120:3300/0 conn(0x7fe6f40b2160 0x7fe6f40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f2ffd640 1 -- 172.21.15.70:0/1522488073 >> v2:172.21.15.120:3300/0 conn(0x7fe6f40b2160 msgr2=0x7fe6f40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f2ffd640 1 --2- 172.21.15.70:0/1522488073 >> v2:172.21.15.120:3300/0 conn(0x7fe6f40b2160 0x7fe6f40d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f2ffd640 1 -- 172.21.15.70:0/1522488073 >> v1:172.21.15.120:6789/0 conn(0x7fe6f40d19f0 legacy=0x7fe6f40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f2ffd640 1 -- 172.21.15.70:0/1522488073 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40ceb20 con 0x7fe6f415d6e0 2023-11-26T07:20:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.043+0000 7fe6f1ffb640 1 -- 172.21.15.70:0/1522488073 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97213807 0 0) 0x7fe6f40cf0e0 con 0x7fe6f40d19f0 2023-11-26T07:20:27.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f2ffd640 1 --2- 172.21.15.70:0/1522488073 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f415d6e0 0x7fe6f40d0df0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009870 tx=0x7fe6e401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab32c77c78c51c49 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f1ffb640 1 -- 172.21.15.70:0/1522488073 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40a7070 con 0x7fe6f415d6e0 2023-11-26T07:20:27.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f1ffb640 1 -- 172.21.15.70:0/1522488073 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e40ab430 con 0x7fe6f415d6e0 2023-11-26T07:20:27.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f1ffb640 1 -- 172.21.15.70:0/1522488073 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40ab7c0 con 0x7fe6f415d6e0 2023-11-26T07:20:27.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 -- 172.21.15.70:0/1522488073 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f415d6e0 msgr2=0x7fe6f40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 --2- 172.21.15.70:0/1522488073 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f415d6e0 0x7fe6f40d0df0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009870 tx=0x7fe6e401c540 comp rx=0 tx=0).stop 2023-11-26T07:20:27.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 -- 172.21.15.70:0/1522488073 shutdown_connections 2023-11-26T07:20:27.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 --2- 172.21.15.70:0/1522488073 >> v2:172.21.15.120:3300/0 conn(0x7fe6f40b2160 0x7fe6f40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 --2- 172.21.15.70:0/1522488073 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f415d6e0 0x7fe6f40d0df0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 -- 172.21.15.70:0/1522488073 >> 172.21.15.70:0/1522488073 conn(0x7fe6f409c550 msgr2=0x7fe6f40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:27.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 -- 172.21.15.70:0/1522488073 shutdown_connections 2023-11-26T07:20:27.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 -- 172.21.15.70:0/1522488073 wait complete. 2023-11-26T07:20:27.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.047+0000 7fe6f9879640 1 Processor -- start 2023-11-26T07:20:27.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 -- start start 2023-11-26T07:20:27.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6f40b2160 0x7fe6f4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f40d19f0 0x7fe6f4142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6f415d6e0 0x7fe6f4156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4143110 con 0x7fe6f415d6e0 2023-11-26T07:20:27.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41548c0 con 0x7fe6f40b2160 2023-11-26T07:20:27.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f4154ba0 con 0x7fe6f40d19f0 2023-11-26T07:20:27.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6f415d6e0 0x7fe6f4156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f27fc640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f40d19f0 0x7fe6f4142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6f40b2160 0x7fe6f4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6f415d6e0 0x7fe6f4156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48264/0 (socket says 172.21.15.70:48264) 2023-11-26T07:20:27.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f37fe640 1 -- 172.21.15.70:0/3014268911 learned_addr learned my addr 172.21.15.70:0/3014268911 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:27.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f27fc640 1 -- 172.21.15.70:0/3014268911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6f40b2160 msgr2=0x7fe6f4154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f27fc640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6f40b2160 0x7fe6f4154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f27fc640 1 -- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6f415d6e0 msgr2=0x7fe6f4156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f27fc640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6f415d6e0 0x7fe6f4156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f27fc640 1 -- 172.21.15.70:0/3014268911 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40094d0 con 0x7fe6f40d19f0 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f37fe640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6f415d6e0 0x7fe6f4156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f27fc640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f40d19f0 0x7fe6f4142bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e870 tx=0x7fe6e800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6dbfff640 1 -- 172.21.15.70:0/3014268911 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80095d0 con 0x7fe6f40d19f0 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6dbfff640 1 -- 172.21.15.70:0/3014268911 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800c940 con 0x7fe6f40d19f0 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6dbfff640 1 -- 172.21.15.70:0/3014268911 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800ccb0 con 0x7fe6f40d19f0 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f4154e80 con 0x7fe6f40d19f0 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f4155440 con 0x7fe6f40d19f0 2023-11-26T07:20:27.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.051+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f40d2fa0 con 0x7fe6f40d19f0 2023-11-26T07:20:27.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.055+0000 7fe6dbfff640 1 -- 172.21.15.70:0/3014268911 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fe6e8013470 con 0x7fe6f40d19f0 2023-11-26T07:20:27.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.055+0000 7fe6dbfff640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6e0066740 0x7fe6e0068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.055+0000 7fe6dbfff640 1 -- 172.21.15.70:0/3014268911 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe6e8084160 con 0x7fe6f40d19f0 2023-11-26T07:20:27.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.055+0000 7fe6f2ffd640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6e0066740 0x7fe6e0068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.055+0000 7fe6f2ffd640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6e0066740 0x7fe6e0068c00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40af000 tx=0x7fe6e40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.059+0000 7fe6dbfff640 1 -- 172.21.15.70:0/3014268911 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6e8051600 con 0x7fe6f40d19f0 2023-11-26T07:20:27.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.239+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6f40cb940 con 0x7fe6f40d19f0 2023-11-26T07:20:27.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.239+0000 7fe6dbfff640 1 -- 172.21.15.70:0/3014268911 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fe6e8021e90 con 0x7fe6f40d19f0 2023-11-26T07:20:27.242 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:27.242 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/3437884487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6835","nonce":3437884487},{"type":"v1","addr":"172.21.15.70:6837","nonce":3437884487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1405314765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1405314765},{"type":"v1","addr":"172.21.15.120:6833","nonce":1405314765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2357317721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2357317721},{"type":"v1","addr":"172.21.15.120:6835","nonce":2357317721}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6836/3401530407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3401530407},{"type":"v1","addr":"172.21.15.70:6836","nonce":3401530407}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2023-11-26T07:20:27.243 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 21 2023-11-26T07:20:27.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6e0066740 msgr2=0x7fe6e0068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6e0066740 0x7fe6e0068c00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40af000 tx=0x7fe6e40a7000 comp rx=0 tx=0).stop 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f40d19f0 msgr2=0x7fe6f4142bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f40d19f0 0x7fe6f4142bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800e870 tx=0x7fe6e800ed30 comp rx=0 tx=0).stop 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 shutdown_connections 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe6e0066740 0x7fe6e0068c00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6f415d6e0 0x7fe6f4156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe6f40d19f0 0x7fe6f4142bd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 --2- 172.21.15.70:0/3014268911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6f40b2160 0x7fe6f4154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 >> 172.21.15.70:0/3014268911 conn(0x7fe6f409c550 msgr2=0x7fe6f406c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 shutdown_connections 2023-11-26T07:20:27.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.243+0000 7fe6f9879640 1 -- 172.21.15.70:0/3014268911 wait complete. 2023-11-26T07:20:27.264 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:20:27.264 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:20:27.264 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:20:27.264 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:27.264 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:20:27.264 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:20:27.265 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:20:27.265 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:27.265 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:20:27.265 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:20:27.265 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:20:27.265 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:27.265 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:20:27.265 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:20:27.266 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:20:27.266 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:20:27.277 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:20:27.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:20:27.278 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:20:27.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:20:27.281 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:20:27.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:20:27.282 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:20:27.283 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:20:27.326 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:20:27.326 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:27.328 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:20:27.329 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:27.329 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:20:27.329 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:27.332 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:20:27.332 DEBUG:teuthology.parallel:result is None 2023-11-26T07:20:27.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:20:27.413 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-11-26T07:20:27.417 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2023-11-26T07:20:27.421 INFO:tasks.ceph.mds.b.smithi120.stdout:starting mds.b at 2023-11-26T07:20:27.423 INFO:tasks.ceph.mds.d.smithi120.stdout:starting mds.d at 2023-11-26T07:20:27.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.475+0000 7f344c172640 1 Processor -- start 2023-11-26T07:20:27.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.475+0000 7f344c172640 1 -- start start 2023-11-26T07:20:27.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344c172640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f344413e290 0x7f34440cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344c172640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f34440cf7c0 0x7f344415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344c172640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f344415f4e0 0x7f34441408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344c172640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440cfc40 con 0x7f344413e290 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344c172640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344406c520 con 0x7f34440cf7c0 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344c172640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344406c800 con 0x7f344415f4e0 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f344413e290 0x7f34440cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f344413e290 0x7f34440cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48300/0 (socket says 172.21.15.70:48300) 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 -- 172.21.15.70:0/105496189 learned_addr learned my addr 172.21.15.70:0/105496189 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344a70f640 1 --2- 172.21.15.70:0/105496189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f344415f4e0 0x7f34441408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f344970d640 1 --2- 172.21.15.70:0/105496189 >> v2:172.21.15.120:3300/0 conn(0x7f34440cf7c0 0x7f344415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 -- 172.21.15.70:0/105496189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f344415f4e0 msgr2=0x7f34441408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 --2- 172.21.15.70:0/105496189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f344415f4e0 0x7f34441408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 -- 172.21.15.70:0/105496189 >> v2:172.21.15.120:3300/0 conn(0x7f34440cf7c0 msgr2=0x7f344415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 --2- 172.21.15.70:0/105496189 >> v2:172.21.15.120:3300/0 conn(0x7f34440cf7c0 0x7f344415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.479+0000 7f3449f0e640 1 -- 172.21.15.70:0/105496189 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344406cae0 con 0x7f344413e290 2023-11-26T07:20:27.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f3449f0e640 1 --2- 172.21.15.70:0/105496189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f34440cf280 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f34440cfe40 tx=0x7f344001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3ce15a7aedd6ac server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f3448f0c640 1 -- 172.21.15.70:0/105496189 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400ab600 con 0x7f344413e290 2023-11-26T07:20:27.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f3448f0c640 1 -- 172.21.15.70:0/105496189 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34400a7050 con 0x7f344413e290 2023-11-26T07:20:27.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f3448f0c640 1 -- 172.21.15.70:0/105496189 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400ab980 con 0x7f344413e290 2023-11-26T07:20:27.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- 172.21.15.70:0/105496189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 msgr2=0x7f34440cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 --2- 172.21.15.70:0/105496189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f34440cf280 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f34440cfe40 tx=0x7f344001c210 comp rx=0 tx=0).stop 2023-11-26T07:20:27.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- 172.21.15.70:0/105496189 shutdown_connections 2023-11-26T07:20:27.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 --2- 172.21.15.70:0/105496189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f344415f4e0 0x7f34441408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 --2- 172.21.15.70:0/105496189 >> v2:172.21.15.120:3300/0 conn(0x7f34440cf7c0 0x7f344415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 --2- 172.21.15.70:0/105496189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f34440cf280 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- 172.21.15.70:0/105496189 >> 172.21.15.70:0/105496189 conn(0x7f344406a890 msgr2=0x7f344406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:27.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- 172.21.15.70:0/105496189 shutdown_connections 2023-11-26T07:20:27.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- 172.21.15.70:0/105496189 wait complete. 2023-11-26T07:20:27.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 Processor -- start 2023-11-26T07:20:27.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- start start 2023-11-26T07:20:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34440cf7c0 0x7f344413ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f3444135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f344415f4e0 0x7f3444152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444143920 con 0x7f344413e290 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444143bc0 con 0x7f344415f4e0 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.483+0000 7f344c172640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3444143ea0 con 0x7f34440cf7c0 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f3444135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f3444135460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48308/0 (socket says 172.21.15.70:48308) 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 -- 172.21.15.70:0/743160750 learned_addr learned my addr 172.21.15.70:0/743160750 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344a70f640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f344415f4e0 0x7f3444152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f3449f0e640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34440cf7c0 0x7f344413ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 -- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34440cf7c0 msgr2=0x7f344413ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34440cf7c0 0x7f344413ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 -- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f344415f4e0 msgr2=0x7f3444152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f344415f4e0 0x7f3444152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:27.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 -- 172.21.15.70:0/743160750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400094d0 con 0x7f344413e290 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344970d640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f3444135460 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f343400e8b0 tx=0x7f343400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f343a7fc640 1 -- 172.21.15.70:0/743160750 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400c940 con 0x7f344413e290 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f343a7fc640 1 -- 172.21.15.70:0/743160750 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343400caa0 con 0x7f344413e290 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3444144180 con 0x7f344413e290 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f343a7fc640 1 -- 172.21.15.70:0/743160750 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400ce30 con 0x7f344413e290 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3444144740 con 0x7f344413e290 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344406df50 con 0x7f344413e290 2023-11-26T07:20:27.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.487+0000 7f343a7fc640 1 -- 172.21.15.70:0/743160750 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f3434013470 con 0x7f344413e290 2023-11-26T07:20:27.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.491+0000 7f343a7fc640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3428066740 0x7f3428068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:27.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.491+0000 7f343a7fc640 1 -- 172.21.15.70:0/743160750 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f34340841f0 con 0x7f344413e290 2023-11-26T07:20:27.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.491+0000 7f3449f0e640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3428066740 0x7f3428068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:27.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.491+0000 7f3449f0e640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3428066740 0x7f3428068c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f34400a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:27.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.495+0000 7f343a7fc640 1 -- 172.21.15.70:0/743160750 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34340515e0 con 0x7f344413e290 2023-11-26T07:20:27.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:27.655+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3444067660 con 0x7f344413e290 2023-11-26T07:20:28.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.303+0000 7f343a7fc640 1 -- 172.21.15.70:0/743160750 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3434054c00 con 0x7f344413e290 2023-11-26T07:20:28.305 INFO:teuthology.orchestra.run.smithi070.stderr: removed all blocklist entries 2023-11-26T07:20:28.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3428066740 msgr2=0x7f3428068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3428066740 0x7f3428068c00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f34400a6000 comp rx=0 tx=0).stop 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 msgr2=0x7f3444135460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f3444135460 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f343400e8b0 tx=0x7f343400ed70 comp rx=0 tx=0).stop 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 shutdown_connections 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3428066740 0x7f3428068c00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f344413e290 0x7f3444135460 secure :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f343400e8b0 tx=0x7f343400ed70 comp rx=0 tx=0).stop 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f344415f4e0 0x7f3444152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 --2- 172.21.15.70:0/743160750 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f34440cf7c0 0x7f344413ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 >> 172.21.15.70:0/743160750 conn(0x7f344406a890 msgr2=0x7f34440aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 shutdown_connections 2023-11-26T07:20:28.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.307+0000 7f344c172640 1 -- 172.21.15.70:0/743160750 wait complete. 2023-11-26T07:20:28.335 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:20:28.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d67268640 1 Processor -- start 2023-11-26T07:20:28.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d67268640 1 -- start start 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d67268640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7d600d1bc0 0x7f7d600d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d67268640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d600b2160 0x7f7d600b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d67268640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d600cf0e0 con 0x7f7d6015d6e0 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d67268640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6015dac0 con 0x7f7d600b2160 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d67268640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d600ceb20 con 0x7f7d600d1bc0 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d65805640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d600b2160 0x7f7d600b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d65805640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7d600b2160 0x7f7d600b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48310/0 (socket says 172.21.15.70:48310) 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d65805640 1 -- 172.21.15.70:0/3877835705 learned_addr learned my addr 172.21.15.70:0/3877835705 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d64803640 1 --2- 172.21.15.70:0/3877835705 >> v2:172.21.15.120:3300/0 conn(0x7f7d600d1bc0 0x7f7d600d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d65805640 1 -- 172.21.15.70:0/3877835705 >> v2:172.21.15.120:3300/0 conn(0x7f7d600d1bc0 msgr2=0x7f7d600d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d65805640 1 --2- 172.21.15.70:0/3877835705 >> v2:172.21.15.120:3300/0 conn(0x7f7d600d1bc0 0x7f7d600d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d65805640 1 -- 172.21.15.70:0/3877835705 >> v1:172.21.15.120:6789/0 conn(0x7f7d6015d6e0 legacy=0x7f7d600d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d65805640 1 -- 172.21.15.70:0/3877835705 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d600cee00 con 0x7f7d600b2160 2023-11-26T07:20:28.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.475+0000 7f7d64803640 1 --2- 172.21.15.70:0/3877835705 >> v2:172.21.15.120:3300/0 conn(0x7f7d600d1bc0 0x7f7d600d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:28.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d65805640 1 --2- 172.21.15.70:0/3877835705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d600b2160 0x7f7d600b0750 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7d600ca2a0 tx=0x7f7d5801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80815df358a2902 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d57fff640 1 -- 172.21.15.70:0/3877835705 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580a5740 con 0x7f7d600b2160 2023-11-26T07:20:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d57fff640 1 -- 172.21.15.70:0/3877835705 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d580a58a0 con 0x7f7d600b2160 2023-11-26T07:20:28.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d57fff640 1 -- 172.21.15.70:0/3877835705 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580a5c30 con 0x7f7d600b2160 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 -- 172.21.15.70:0/3877835705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d600b2160 msgr2=0x7f7d600b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 --2- 172.21.15.70:0/3877835705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d600b2160 0x7f7d600b0750 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7d600ca2a0 tx=0x7f7d5801c990 comp rx=0 tx=0).stop 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 -- 172.21.15.70:0/3877835705 shutdown_connections 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 --2- 172.21.15.70:0/3877835705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d600b2160 0x7f7d600b0750 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 --2- 172.21.15.70:0/3877835705 >> v2:172.21.15.120:3300/0 conn(0x7f7d600d1bc0 0x7f7d600d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 -- 172.21.15.70:0/3877835705 >> 172.21.15.70:0/3877835705 conn(0x7f7d6009c550 msgr2=0x7f7d600d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 -- 172.21.15.70:0/3877835705 shutdown_connections 2023-11-26T07:20:28.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.479+0000 7f7d67268640 1 -- 172.21.15.70:0/3877835705 wait complete. 2023-11-26T07:20:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 Processor -- start 2023-11-26T07:20:28.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 -- start start 2023-11-26T07:20:28.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d600b2160 0x7f7d6006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d1bc0 0x7f7d6015b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d6015d6e0 0x7f7d600b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600cbf20 con 0x7f7d6015d6e0 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600cb8f0 con 0x7f7d600d1bc0 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6015bf30 con 0x7f7d600b2160 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d6015d6e0 0x7f7d600b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d6015d6e0 0x7f7d600b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48314/0 (socket says 172.21.15.70:48314) 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 -- 172.21.15.70:0/4213038634 learned_addr learned my addr 172.21.15.70:0/4213038634 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d64803640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d1bc0 0x7f7d6015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65004640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d600b2160 0x7f7d6006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 -- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d600b2160 msgr2=0x7f7d6006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d600b2160 0x7f7d6006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 -- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d1bc0 msgr2=0x7f7d6015b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d1bc0 0x7f7d6015b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 -- 172.21.15.70:0/4213038634 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58009b30 con 0x7f7d6015d6e0 2023-11-26T07:20:28.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d65805640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d6015d6e0 0x7f7d600b6d50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7d580af040 tx=0x7f7d58019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d55ffb640 1 -- 172.21.15.70:0/4213038634 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580b8670 con 0x7f7d6015d6e0 2023-11-26T07:20:28.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d55ffb640 1 -- 172.21.15.70:0/4213038634 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d580b87d0 con 0x7f7d6015d6e0 2023-11-26T07:20:28.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d55ffb640 1 -- 172.21.15.70:0/4213038634 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580b8b40 con 0x7f7d6015d6e0 2023-11-26T07:20:28.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6015c210 con 0x7f7d6015d6e0 2023-11-26T07:20:28.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.483+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6006c9e0 con 0x7f7d6015d6e0 2023-11-26T07:20:28.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.487+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d60067680 con 0x7f7d6015d6e0 2023-11-26T07:20:28.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.487+0000 7f7d55ffb640 1 -- 172.21.15.70:0/4213038634 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f7d580b8ca0 con 0x7f7d6015d6e0 2023-11-26T07:20:28.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.487+0000 7f7d55ffb640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d44066740 0x7f7d44068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.487+0000 7f7d55ffb640 1 -- 172.21.15.70:0/4213038634 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d5811f4b0 con 0x7f7d6015d6e0 2023-11-26T07:20:28.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.487+0000 7f7d65004640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d44066740 0x7f7d44068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.487+0000 7f7d65004640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d44066740 0x7f7d44068c00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d600d2e90 tx=0x7f7d5c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.491+0000 7f7d55ffb640 1 -- 172.21.15.70:0/4213038634 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d580ecb90 con 0x7f7d6015d6e0 2023-11-26T07:20:28.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.691+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7d600b1ca0 con 0x7f7d6015d6e0 2023-11-26T07:20:28.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d55ffb640 1 -- 172.21.15.70:0/4213038634 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7d580f01b0 con 0x7f7d6015d6e0 2023-11-26T07:20:28.695 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:28.695 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_dump": [ 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.a", 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlK818ExAA3Pl7hruKT9tvdseH1RoDNw==", 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.b", 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl+74KIBAAAU2yWLE9nGWyh2Eew8a2cQ==", 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.c", 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl2a4KGxAAGVTHr4IYGCxqIbJI4GAlHw==", 2023-11-26T07:20:28.697 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.d", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlkKVrJxAA/tao4nxlwlxXqNbpcOQO0w==", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:20:28.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.0", 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDv8GJlMTzJDRAAtRLnzO4hzBrRsOTxU0sn1g==", 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.699 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.1", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDy8GJlYwIPFBAA08sYURmRGI+e5KAfsYCowQ==", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.2", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD18GJl2yAVGxAAbmsr89meMeh8tOtuLwO2nQ==", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.700 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.3", 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD48GJlgsovIRAAR7B4+PHY5+5A/pLTUYSv/Q==", 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.4", 2023-11-26T07:20:28.701 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD+8GJllmjnJRAAfX4zIcgsX+H5/jgeJd4fJQ==", 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.5", 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAB8WJlebhlLBAAXicxjU2Nww1KEts/9c6YWQ==", 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.702 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.6", 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAE8WJlrYwEMxAAt996EyIggEIdDG5Jo8pxLg==", 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.7", 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAH8WJlUqeLOhAAMXAlFPwvIZkjtwDqTqj9Dg==", 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.0", 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA==", 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.704 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow r", 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.1", 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl19ntNBAAm+Na43D/jVnw3XfgG4syqg==", 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.2", 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlbfhnMRAAUU4/Sqog5uGnzt4xD/6M6g==", 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.3", 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlUVjqOhAAg1iYDvnKqcoojshB4YtI7Q==", 2023-11-26T07:20:28.706 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.admin", 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDs8GJlRiV4MhAABZ2mWkM6iWcfvniCtWCj4w==", 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:20:28.707 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.x", 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl5WcCDxAAAQ7rZ5sJaZ6CGeJ2izEpNA==", 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:28.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.y", 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlc3stCxAAjCksCvC5/30P/2m2kedt6w==", 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-11-26T07:20:28.709 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d44066740 msgr2=0x7f7d44068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d44066740 0x7f7d44068c00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d600d2e90 tx=0x7f7d5c009060 comp rx=0 tx=0).stop 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d6015d6e0 msgr2=0x7f7d600b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d6015d6e0 0x7f7d600b6d50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7d580af040 tx=0x7f7d58019730 comp rx=0 tx=0).stop 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 shutdown_connections 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7d44066740 0x7f7d44068c00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d6015d6e0 0x7f7d600b6d50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d1bc0 0x7f7d6015b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 --2- 172.21.15.70:0/4213038634 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7d600b2160 0x7f7d6006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 >> 172.21.15.70:0/4213038634 conn(0x7f7d6009c550 msgr2=0x7f7d600d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 shutdown_connections 2023-11-26T07:20:28.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.695+0000 7f7d67268640 1 -- 172.21.15.70:0/4213038634 wait complete. 2023-11-26T07:20:28.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:28.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f429e1a1640 1 Processor -- start 2023-11-26T07:20:28.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f429e1a1640 1 -- start start 2023-11-26T07:20:28.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f429e1a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f42980d1bc0 0x7f42980d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f429e1a1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980cf0e0 con 0x7f429815d6e0 2023-11-26T07:20:28.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f429e1a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980ceb20 con 0x7f42980b2160 2023-11-26T07:20:28.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f429e1a1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429815dac0 con 0x7f42980d1bc0 2023-11-26T07:20:28.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f42977fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f429815d6e0 0x7f42980d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:54128/0 (socket says 172.21.15.70:54128) 2023-11-26T07:20:28.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f42977fe640 1 -- 172.21.15.70:0/3909627488 learned_addr learned my addr 172.21.15.70:0/3909627488 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:28.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f4296ffd640 1 --2- 172.21.15.70:0/3909627488 >> v2:172.21.15.120:3300/0 conn(0x7f42980d1bc0 0x7f42980d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f42967fc640 1 -- 172.21.15.70:0/3909627488 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624912533 0 0) 0x7f42980cf0e0 con 0x7f429815d6e0 2023-11-26T07:20:28.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f42967fc640 1 -- 172.21.15.70:0/3909627488 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4280003530 con 0x7f429815d6e0 2023-11-26T07:20:28.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f4296ffd640 1 -- 172.21.15.70:0/3909627488 >> v1:172.21.15.120:6789/0 conn(0x7f42980b2160 legacy=0x7f42980b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f4296ffd640 1 -- 172.21.15.70:0/3909627488 >> v1:172.21.15.70:6789/0 conn(0x7f429815d6e0 legacy=0x7f42980d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.855+0000 7f4296ffd640 1 -- 172.21.15.70:0/3909627488 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980cee00 con 0x7f42980d1bc0 2023-11-26T07:20:28.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f4296ffd640 1 --2- 172.21.15.70:0/3909627488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980d1bc0 0x7f42980d0df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f428c0097c0 tx=0x7f428c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24500f5476fd5479 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f42967fc640 1 -- 172.21.15.70:0/3909627488 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0ab600 con 0x7f42980d1bc0 2023-11-26T07:20:28.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f42967fc640 1 -- 172.21.15.70:0/3909627488 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c0a7050 con 0x7f42980d1bc0 2023-11-26T07:20:28.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f42967fc640 1 -- 172.21.15.70:0/3909627488 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0ab960 con 0x7f42980d1bc0 2023-11-26T07:20:28.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f429e1a1640 1 -- 172.21.15.70:0/3909627488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980d1bc0 msgr2=0x7f42980d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3909627488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980d1bc0 0x7f42980d0df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f428c0097c0 tx=0x7f428c01c480 comp rx=0 tx=0).stop 2023-11-26T07:20:28.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f429e1a1640 1 -- 172.21.15.70:0/3909627488 shutdown_connections 2023-11-26T07:20:28.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3909627488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980d1bc0 0x7f42980d0df0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f429e1a1640 1 -- 172.21.15.70:0/3909627488 >> 172.21.15.70:0/3909627488 conn(0x7f429809c550 msgr2=0x7f42980d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:28.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f429e1a1640 1 -- 172.21.15.70:0/3909627488 shutdown_connections 2023-11-26T07:20:28.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.859+0000 7f429e1a1640 1 -- 172.21.15.70:0/3909627488 wait complete. 2023-11-26T07:20:28.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 Processor -- start 2023-11-26T07:20:28.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 -- start start 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980b2160 0x7f4298151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42980d1bc0 0x7f429815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f429815d6e0 0x7f42980c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4298160b00 con 0x7f429815d6e0 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4298160540 con 0x7f42980b2160 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4298160820 con 0x7f42980d1bc0 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f429815d6e0 0x7f42980c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f429815d6e0 0x7f42980c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48328/0 (socket says 172.21.15.70:48328) 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 -- 172.21.15.70:0/3051874611 learned_addr learned my addr 172.21.15.70:0/3051874611 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f42977fe640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980b2160 0x7f4298151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4296ffd640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42980d1bc0 0x7f429815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 -- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42980d1bc0 msgr2=0x7f429815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42980d1bc0 0x7f429815eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 -- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980b2160 msgr2=0x7f4298151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980b2160 0x7f4298151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 -- 172.21.15.70:0/3051874611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009420 con 0x7f429815d6e0 2023-11-26T07:20:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f4297fff640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f429815d6e0 0x7f42980c79a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f429000c7a0 tx=0x7f429000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f427ffff640 1 -- 172.21.15.70:0/3051874611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290003b80 con 0x7f429815d6e0 2023-11-26T07:20:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f427ffff640 1 -- 172.21.15.70:0/3051874611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4290003ce0 con 0x7f429815d6e0 2023-11-26T07:20:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f427ffff640 1 -- 172.21.15.70:0/3051874611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000aa30 con 0x7f429815d6e0 2023-11-26T07:20:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429815e6b0 con 0x7f429815d6e0 2023-11-26T07:20:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.863+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4298151bd0 con 0x7f429815d6e0 2023-11-26T07:20:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.867+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429815ebd0 con 0x7f429815d6e0 2023-11-26T07:20:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.867+0000 7f427ffff640 1 -- 172.21.15.70:0/3051874611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f429000ab90 con 0x7f429815d6e0 2023-11-26T07:20:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.867+0000 7f427ffff640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4284066740 0x7f4284068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.867+0000 7f427ffff640 1 -- 172.21.15.70:0/3051874611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4290083c00 con 0x7f429815d6e0 2023-11-26T07:20:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.867+0000 7f42977fe640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4284066740 0x7f4284068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.867+0000 7f42977fe640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4284066740 0x7f4284068c00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f42880011f0 tx=0x7f4288007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:28.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:28.871+0000 7f427ffff640 1 -- 172.21.15.70:0/3051874611 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f429815ebd0 con 0x7f429815d6e0 2023-11-26T07:20:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.023+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f429815ebd0 con 0x7f429815d6e0 2023-11-26T07:20:29.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.023+0000 7f427ffff640 1 -- 172.21.15.70:0/3051874611 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f429815ebd0 con 0x7f429815d6e0 2023-11-26T07:20:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:29.026 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":44,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:28.314406+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4284066740 msgr2=0x7f4284068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4284066740 0x7f4284068c00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f42880011f0 tx=0x7f4288007d40 comp rx=0 tx=0).stop 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f429815d6e0 msgr2=0x7f42980c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f429815d6e0 0x7f42980c79a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f429000c7a0 tx=0x7f429000cc60 comp rx=0 tx=0).stop 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 shutdown_connections 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4284066740 0x7f4284068c00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f429815d6e0 0x7f42980c79a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42980d1bc0 0x7f429815eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 --2- 172.21.15.70:0/3051874611 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42980b2160 0x7f4298151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 >> 172.21.15.70:0/3051874611 conn(0x7f429809c550 msgr2=0x7f42980b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 shutdown_connections 2023-11-26T07:20:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.027+0000 7f429e1a1640 1 -- 172.21.15.70:0/3051874611 wait complete. 2023-11-26T07:20:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:20:29.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:20:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ef4e3640 1 Processor -- start 2023-11-26T07:20:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ef4e3640 1 -- start start 2023-11-26T07:20:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ef4e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f20e81614f0 0x7f20e80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ef4e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e815d1e0 0x7f20e815d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ef4e3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e80ccfa0 con 0x7f20e80745d0 2023-11-26T07:20:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ef4e3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e815db90 con 0x7f20e81614f0 2023-11-26T07:20:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ef4e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e806e280 con 0x7f20e815d1e0 2023-11-26T07:20:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ed27f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f20e81614f0 0x7f20e80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ed27f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f20e81614f0 0x7f20e80cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48332/0 (socket says 172.21.15.70:48332) 2023-11-26T07:20:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ed27f640 1 -- 172.21.15.70:0/2055467812 learned_addr learned my addr 172.21.15.70:0/2055467812 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20eda80640 1 --2- 172.21.15.70:0/2055467812 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e815d1e0 0x7f20e815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ed27f640 1 -- 172.21.15.70:0/2055467812 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e815d1e0 msgr2=0x7f20e815d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ed27f640 1 --2- 172.21.15.70:0/2055467812 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e815d1e0 0x7f20e815d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ed27f640 1 -- 172.21.15.70:0/2055467812 >> v1:172.21.15.70:6789/0 conn(0x7f20e80745d0 legacy=0x7f20e81618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20ed27f640 1 -- 172.21.15.70:0/2055467812 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e806e8b0 con 0x7f20e81614f0 2023-11-26T07:20:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.187+0000 7f20dffff640 1 -- 172.21.15.70:0/2055467812 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898755531 0 0) 0x7f20e80ccfa0 con 0x7f20e80745d0 2023-11-26T07:20:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ed27f640 1 --2- 172.21.15.70:0/2055467812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e81614f0 0x7f20e80cec40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a90487de2cec181 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20dffff640 1 -- 172.21.15.70:0/2055467812 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40aa670 con 0x7f20e81614f0 2023-11-26T07:20:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20dffff640 1 -- 172.21.15.70:0/2055467812 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40aa7d0 con 0x7f20e81614f0 2023-11-26T07:20:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20dffff640 1 -- 172.21.15.70:0/2055467812 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40aab60 con 0x7f20e81614f0 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 -- 172.21.15.70:0/2055467812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e81614f0 msgr2=0x7f20e80cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/2055467812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e81614f0 0x7f20e80cec40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e401c510 comp rx=0 tx=0).stop 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 -- 172.21.15.70:0/2055467812 shutdown_connections 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/2055467812 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e815d1e0 0x7f20e815d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/2055467812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e81614f0 0x7f20e80cec40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 -- 172.21.15.70:0/2055467812 >> 172.21.15.70:0/2055467812 conn(0x7f20e80b0d80 msgr2=0x7f20e80b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 -- 172.21.15.70:0/2055467812 shutdown_connections 2023-11-26T07:20:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.191+0000 7f20ef4e3640 1 -- 172.21.15.70:0/2055467812 wait complete. 2023-11-26T07:20:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 Processor -- start 2023-11-26T07:20:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 -- start start 2023-11-26T07:20:29.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20e80745d0 0x7f20e80cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e815d1e0 0x7f20e81537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e81614f0 0x7f20e80c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80cb9c0 con 0x7f20e815d1e0 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80b3190 con 0x7f20e80745d0 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80ca3e0 con 0x7f20e81614f0 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e815d1e0 0x7f20e81537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e815d1e0 0x7f20e81537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48344/0 (socket says 172.21.15.70:48344) 2023-11-26T07:20:29.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 -- 172.21.15.70:0/1796518985 learned_addr learned my addr 172.21.15.70:0/1796518985 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eda80640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e81614f0 0x7f20e80c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ed27f640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20e80745d0 0x7f20e80cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 -- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e81614f0 msgr2=0x7f20e80c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e81614f0 0x7f20e80c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 -- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20e80745d0 msgr2=0x7f20e80cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20e80745d0 0x7f20e80cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 -- 172.21.15.70:0/1796518985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40094d0 con 0x7f20e815d1e0 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ed27f640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20e80745d0 0x7f20e80cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20eca7e640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e815d1e0 0x7f20e81537b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c4d0 tx=0x7f20d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ddffb640 1 -- 172.21.15.70:0/1796518985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8005480 con 0x7f20e815d1e0 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ddffb640 1 -- 172.21.15.70:0/1796518985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8003600 con 0x7f20e815d1e0 2023-11-26T07:20:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e80ca6c0 con 0x7f20e815d1e0 2023-11-26T07:20:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ddffb640 1 -- 172.21.15.70:0/1796518985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80039b0 con 0x7f20e815d1e0 2023-11-26T07:20:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e80cac80 con 0x7f20e815d1e0 2023-11-26T07:20:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.195+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e8067680 con 0x7f20e815d1e0 2023-11-26T07:20:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.199+0000 7f20ddffb640 1 -- 172.21.15.70:0/1796518985 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f20d8003b10 con 0x7f20e815d1e0 2023-11-26T07:20:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.199+0000 7f20ddffb640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20cc066740 0x7f20cc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.199+0000 7f20ddffb640 1 -- 172.21.15.70:0/1796518985 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f20d80835a0 con 0x7f20e815d1e0 2023-11-26T07:20:29.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.199+0000 7f20ed27f640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20cc066740 0x7f20cc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.199+0000 7f20ed27f640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20cc066740 0x7f20cc068c00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f20e40ae000 tx=0x7f20e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.203+0000 7f20ddffb640 1 -- 172.21.15.70:0/1796518985 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20d8050aa0 con 0x7f20e815d1e0 2023-11-26T07:20:29.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:29.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.359+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20e80b51b0 con 0x7f20e815d1e0 2023-11-26T07:20:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.359+0000 7f20ddffb640 1 -- 172.21.15.70:0/1796518985 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20d8017020 con 0x7f20e815d1e0 2023-11-26T07:20:29.361 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20cc066740 msgr2=0x7f20cc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20cc066740 0x7f20cc068c00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f20e40ae000 tx=0x7f20e4008040 comp rx=0 tx=0).stop 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e815d1e0 msgr2=0x7f20e81537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e815d1e0 0x7f20e81537b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c4d0 tx=0x7f20d800c990 comp rx=0 tx=0).stop 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 shutdown_connections 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f20cc066740 0x7f20cc068c00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20e815d1e0 0x7f20e81537b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f20e81614f0 0x7f20e80c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 --2- 172.21.15.70:0/1796518985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20e80745d0 0x7f20e80cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 >> 172.21.15.70:0/1796518985 conn(0x7f20e80b0d80 msgr2=0x7f20e80cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 shutdown_connections 2023-11-26T07:20:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.363+0000 7f20ef4e3640 1 -- 172.21.15.70:0/1796518985 wait complete. 2023-11-26T07:20:29.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:20:29.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fdbb57640 1 Processor -- start 2023-11-26T07:20:29.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fdbb57640 1 -- start start 2023-11-26T07:20:29.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fdbb57640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4fd413e290 0x7f4fd40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fdbb57640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4fd415f6b0 0x7f4fd40cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fdbb57640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd415fb20 con 0x7f4fd40cf7c0 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fdbb57640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd40cfc40 con 0x7f4fd413e290 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fdbb57640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd406c520 con 0x7f4fd415f6b0 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fd98f3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4fd413e290 0x7f4fd40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fd98f3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4fd413e290 0x7f4fd40cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48354/0 (socket says 172.21.15.70:48354) 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fd98f3640 1 -- 172.21.15.70:0/3583542819 learned_addr learned my addr 172.21.15.70:0/3583542819 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fda0f4640 1 --2- 172.21.15.70:0/3583542819 >> v2:172.21.15.120:3300/0 conn(0x7f4fd415f6b0 0x7f4fd40cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fd98f3640 1 -- 172.21.15.70:0/3583542819 >> v2:172.21.15.120:3300/0 conn(0x7f4fd415f6b0 msgr2=0x7f4fd40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fd98f3640 1 --2- 172.21.15.70:0/3583542819 >> v2:172.21.15.120:3300/0 conn(0x7f4fd415f6b0 0x7f4fd40cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fd98f3640 1 -- 172.21.15.70:0/3583542819 >> v1:172.21.15.120:6789/0 conn(0x7f4fd40cf7c0 legacy=0x7f4fd415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:29.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.519+0000 7f4fd98f3640 1 -- 172.21.15.70:0/3583542819 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd406c800 con 0x7f4fd413e290 2023-11-26T07:20:29.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fd98f3640 1 --2- 172.21.15.70:0/3583542819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd413e290 0x7f4fd40cf280 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40725a0 tx=0x7f4fd001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d6feec229c3d65 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fd88f1640 1 -- 172.21.15.70:0/3583542819 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00ab670 con 0x7f4fd413e290 2023-11-26T07:20:29.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fd88f1640 1 -- 172.21.15.70:0/3583542819 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd00ab7d0 con 0x7f4fd413e290 2023-11-26T07:20:29.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fd88f1640 1 -- 172.21.15.70:0/3583542819 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00abb60 con 0x7f4fd413e290 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 -- 172.21.15.70:0/3583542819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd413e290 msgr2=0x7f4fd40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/3583542819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd413e290 0x7f4fd40cf280 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40725a0 tx=0x7f4fd001c470 comp rx=0 tx=0).stop 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 -- 172.21.15.70:0/3583542819 shutdown_connections 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/3583542819 >> v2:172.21.15.120:3300/0 conn(0x7f4fd415f6b0 0x7f4fd40cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/3583542819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd413e290 0x7f4fd40cf280 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 -- 172.21.15.70:0/3583542819 >> 172.21.15.70:0/3583542819 conn(0x7f4fd406a890 msgr2=0x7f4fd406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 -- 172.21.15.70:0/3583542819 shutdown_connections 2023-11-26T07:20:29.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.523+0000 7f4fdbb57640 1 -- 172.21.15.70:0/3583542819 wait complete. 2023-11-26T07:20:29.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 Processor -- start 2023-11-26T07:20:29.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 -- start start 2023-11-26T07:20:29.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fd40cf7c0 0x7f4fd40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4fd413e290 0x7f4fd4154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd415f6b0 0x7f4fd4154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4128cd0 con 0x7f4fd415f6b0 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4128fb0 con 0x7f4fd40cf7c0 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4129290 con 0x7f4fd413e290 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd415f6b0 0x7f4fd4154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd415f6b0 0x7f4fd4154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48364/0 (socket says 172.21.15.70:48364) 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fd98f3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fd40cf7c0 0x7f4fd40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 -- 172.21.15.70:0/2706919211 learned_addr learned my addr 172.21.15.70:0/2706919211 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:29.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fd90f2640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4fd413e290 0x7f4fd4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 -- 172.21.15.70:0/2706919211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4fd413e290 msgr2=0x7f4fd4154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4fd413e290 0x7f4fd4154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 -- 172.21.15.70:0/2706919211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fd40cf7c0 msgr2=0x7f4fd40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fd40cf7c0 0x7f4fd40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 -- 172.21.15.70:0/2706919211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd00094d0 con 0x7f4fd415f6b0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fda0f4640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd415f6b0 0x7f4fd4154b80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007e60 tx=0x7f4fcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fca7fc640 1 -- 172.21.15.70:0/2706919211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc014420 con 0x7f4fd415f6b0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fca7fc640 1 -- 172.21.15.70:0/2706919211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0145a0 con 0x7f4fd415f6b0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd4129570 con 0x7f4fd415f6b0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fca7fc640 1 -- 172.21.15.70:0/2706919211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc014950 con 0x7f4fd415f6b0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd40add80 con 0x7f4fd415f6b0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.527+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd4067680 con 0x7f4fd415f6b0 2023-11-26T07:20:29.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.531+0000 7f4fca7fc640 1 -- 172.21.15.70:0/2706919211 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f4fcc014ab0 con 0x7f4fd415f6b0 2023-11-26T07:20:29.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.531+0000 7f4fca7fc640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4fb8066740 0x7f4fb8068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.531+0000 7f4fca7fc640 1 -- 172.21.15.70:0/2706919211 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4fcc084700 con 0x7f4fd415f6b0 2023-11-26T07:20:29.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.531+0000 7f4fd98f3640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4fb8066740 0x7f4fb8068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.531+0000 7f4fd98f3640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4fb8066740 0x7f4fb8068c00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00af000 tx=0x7f4fd00b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.535+0000 7f4fca7fc640 1 -- 172.21.15.70:0/2706919211 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fcc051c80 con 0x7f4fd415f6b0 2023-11-26T07:20:29.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4fd4129a20 con 0x7f4fd415f6b0 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fca7fc640 1 -- 172.21.15.70:0/2706919211 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4fcc0552a0 con 0x7f4fd415f6b0 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:29.689 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4fb8066740 msgr2=0x7f4fb8068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4fb8066740 0x7f4fb8068c00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00af000 tx=0x7f4fd00b6040 comp rx=0 tx=0).stop 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd415f6b0 msgr2=0x7f4fd4154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd415f6b0 0x7f4fd4154b80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007e60 tx=0x7f4fcc00e4b0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 shutdown_connections 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4fb8066740 0x7f4fb8068c00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fd415f6b0 0x7f4fd4154b80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4fd413e290 0x7f4fd4154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 --2- 172.21.15.70:0/2706919211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4fd40cf7c0 0x7f4fd40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 >> 172.21.15.70:0/2706919211 conn(0x7f4fd406a890 msgr2=0x7f4fd40aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:29.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 shutdown_connections 2023-11-26T07:20:29.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.687+0000 7f4fdbb57640 1 -- 172.21.15.70:0/2706919211 wait complete. 2023-11-26T07:20:29.710 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:20:29.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:20:29.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e958d6640 1 Processor -- start 2023-11-26T07:20:29.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e958d6640 1 -- start start 2023-11-26T07:20:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e958d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e9006f3e0 0x7f9e90161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e958d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e90099a70 0x7f9e90161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e958d6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e900cf260 con 0x7f9e9006f000 2023-11-26T07:20:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e958d6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9009a010 con 0x7f9e9006f3e0 2023-11-26T07:20:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e958d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9009a2f0 con 0x7f9e90099a70 2023-11-26T07:20:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e867fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e9006f3e0 0x7f9e90161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e867fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e9006f3e0 0x7f9e90161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48380/0 (socket says 172.21.15.70:48380) 2023-11-26T07:20:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e867fc640 1 -- 172.21.15.70:0/1186159186 learned_addr learned my addr 172.21.15.70:0/1186159186 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e867fc640 1 -- 172.21.15.70:0/1186159186 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e90099a70 msgr2=0x7f9e90161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e867fc640 1 --2- 172.21.15.70:0/1186159186 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e90099a70 0x7f9e90161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e867fc640 1 -- 172.21.15.70:0/1186159186 >> v1:172.21.15.120:6789/0 conn(0x7f9e9006f000 legacy=0x7f9e9006d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:29.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.851+0000 7f9e867fc640 1 -- 172.21.15.70:0/1186159186 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9009a5d0 con 0x7f9e9006f3e0 2023-11-26T07:20:29.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e867fc640 1 --2- 172.21.15.70:0/1186159186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e90161690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009e50 tx=0x7f9e7801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de133c69097ce748 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e8e7fc640 1 -- 172.21.15.70:0/1186159186 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780af400 con 0x7f9e9006f3e0 2023-11-26T07:20:29.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e8e7fc640 1 -- 172.21.15.70:0/1186159186 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780ab050 con 0x7f9e9006f3e0 2023-11-26T07:20:29.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e8e7fc640 1 -- 172.21.15.70:0/1186159186 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780af780 con 0x7f9e9006f3e0 2023-11-26T07:20:29.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 -- 172.21.15.70:0/1186159186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 msgr2=0x7f9e90161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1186159186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e90161690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009e50 tx=0x7f9e7801f1c0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 -- 172.21.15.70:0/1186159186 shutdown_connections 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1186159186 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e90099a70 0x7f9e90161bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1186159186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e90161690 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 -- 172.21.15.70:0/1186159186 >> 172.21.15.70:0/1186159186 conn(0x7f9e900b2d10 msgr2=0x7f9e900b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 -- 172.21.15.70:0/1186159186 shutdown_connections 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 -- 172.21.15.70:0/1186159186 wait complete. 2023-11-26T07:20:29.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.855+0000 7f9e958d6640 1 Processor -- start 2023-11-26T07:20:29.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 -- start start 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e9006f000 0x7f9e900c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e9015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e90099a70 0x7f9e900cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e900c6dd0 con 0x7f9e9006f3e0 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90148160 con 0x7f9e90099a70 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e900c61c0 con 0x7f9e9006f000 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e9015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e9015fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48386/0 (socket says 172.21.15.70:48386) 2023-11-26T07:20:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 -- 172.21.15.70:0/1241349740 learned_addr learned my addr 172.21.15.70:0/1241349740 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e8effd640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e9006f000 0x7f9e900c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e8f7fe640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e90099a70 0x7f9e900cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 -- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e9006f000 msgr2=0x7f9e900c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e9006f000 0x7f9e900c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 -- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e90099a70 msgr2=0x7f9e900cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e90099a70 0x7f9e900cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 -- 172.21.15.70:0/1241349740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78009b30 con 0x7f9e9006f3e0 2023-11-26T07:20:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e867fc640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e9015fde0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9e780b2040 tx=0x7f9e7801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e8cff9640 1 -- 172.21.15.70:0/1241349740 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780c0070 con 0x7f9e9006f3e0 2023-11-26T07:20:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e8cff9640 1 -- 172.21.15.70:0/1241349740 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780afc60 con 0x7f9e9006f3e0 2023-11-26T07:20:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e900c64a0 con 0x7f9e9006f3e0 2023-11-26T07:20:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e8cff9640 1 -- 172.21.15.70:0/1241349740 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780b8400 con 0x7f9e9006f3e0 2023-11-26T07:20:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e900c6a60 con 0x7f9e9006f3e0 2023-11-26T07:20:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.859+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e900c6f40 con 0x7f9e9006f3e0 2023-11-26T07:20:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.863+0000 7f9e8cff9640 1 -- 172.21.15.70:0/1241349740 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f9e780b6040 con 0x7f9e9006f3e0 2023-11-26T07:20:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.863+0000 7f9e8cff9640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066740 0x7f9e70068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.863+0000 7f9e8cff9640 1 -- 172.21.15.70:0/1241349740 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e78121ad0 con 0x7f9e9006f3e0 2023-11-26T07:20:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.863+0000 7f9e8effd640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066740 0x7f9e70068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:29.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.863+0000 7f9e8effd640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066740 0x7f9e70068c00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b810 tx=0x7f9e80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:29.867+0000 7f9e8cff9640 1 -- 172.21.15.70:0/1241349740 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e780eefe0 con 0x7f9e9006f3e0 2023-11-26T07:20:30.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.015+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9e90067680 con 0x7f9e9006f3e0 2023-11-26T07:20:30.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.311+0000 7f9e8cff9640 1 -- 172.21.15.70:0/1241349740 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9e780f2600 con 0x7f9e9006f3e0 2023-11-26T07:20:30.313 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2023-11-26T07:20:30.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066740 msgr2=0x7f9e70068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:30.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066740 0x7f9e70068c00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b810 tx=0x7f9e80008040 comp rx=0 tx=0).stop 2023-11-26T07:20:30.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 msgr2=0x7f9e9015fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:30.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e9015fde0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9e780b2040 tx=0x7f9e7801bf60 comp rx=0 tx=0).stop 2023-11-26T07:20:30.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 shutdown_connections 2023-11-26T07:20:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066740 0x7f9e70068c00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e9006f3e0 0x7f9e9015fde0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e90099a70 0x7f9e900cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 --2- 172.21.15.70:0/1241349740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e9006f000 0x7f9e900c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 >> 172.21.15.70:0/1241349740 conn(0x7f9e900b2d10 msgr2=0x7f9e9015c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 shutdown_connections 2023-11-26T07:20:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.315+0000 7f9e958d6640 1 -- 172.21.15.70:0/1241349740 wait complete. 2023-11-26T07:20:30.341 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:20:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 Processor -- start 2023-11-26T07:20:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 -- start start 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc244143c00 0x7fc2440b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244070390 0x7fc2440cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2440ccce0 0x7fc244071550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2440b25f0 con 0x7fc244143c00 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2440b28d0 con 0x7fc2440ccce0 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc24b1c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440b2bb0 con 0x7fc244070390 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc248f60640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc244143c00 0x7fc2440b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc248f60640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc244143c00 0x7fc2440b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48400/0 (socket says 172.21.15.70:48400) 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.483+0000 7fc248f60640 1 -- 172.21.15.70:0/758260264 learned_addr learned my addr 172.21.15.70:0/758260264 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc23bfff640 1 --2- 172.21.15.70:0/758260264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244070390 0x7fc2440cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc249761640 1 --2- 172.21.15.70:0/758260264 >> v2:172.21.15.120:3300/0 conn(0x7fc2440ccce0 0x7fc244071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc248f60640 1 -- 172.21.15.70:0/758260264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244070390 msgr2=0x7fc2440cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc248f60640 1 --2- 172.21.15.70:0/758260264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244070390 0x7fc2440cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc248f60640 1 -- 172.21.15.70:0/758260264 >> v2:172.21.15.120:3300/0 conn(0x7fc2440ccce0 msgr2=0x7fc244071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc248f60640 1 --2- 172.21.15.70:0/758260264 >> v2:172.21.15.120:3300/0 conn(0x7fc2440ccce0 0x7fc244071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc248f60640 1 -- 172.21.15.70:0/758260264 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440b2e90 con 0x7fc244143c00 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc23bfff640 1 --2- 172.21.15.70:0/758260264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244070390 0x7fc2440cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc249761640 1 --2- 172.21.15.70:0/758260264 >> v2:172.21.15.120:3300/0 conn(0x7fc2440ccce0 0x7fc244071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:30.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc248f60640 1 --2- 172.21.15.70:0/758260264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc244143c00 0x7fc2440b1ef0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc24406bde0 tx=0x7fc24001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af8927c1ed246d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc23b7fe640 1 -- 172.21.15.70:0/758260264 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400ab650 con 0x7fc244143c00 2023-11-26T07:20:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc23b7fe640 1 -- 172.21.15.70:0/758260264 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2400ab7b0 con 0x7fc244143c00 2023-11-26T07:20:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.487+0000 7fc23b7fe640 1 -- 172.21.15.70:0/758260264 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400abb40 con 0x7fc244143c00 2023-11-26T07:20:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- 172.21.15.70:0/758260264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc244143c00 msgr2=0x7fc2440b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/758260264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc244143c00 0x7fc2440b1ef0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc24406bde0 tx=0x7fc24001c470 comp rx=0 tx=0).stop 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- 172.21.15.70:0/758260264 shutdown_connections 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/758260264 >> v2:172.21.15.120:3300/0 conn(0x7fc2440ccce0 0x7fc244071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/758260264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244070390 0x7fc2440cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/758260264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc244143c00 0x7fc2440b1ef0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- 172.21.15.70:0/758260264 >> 172.21.15.70:0/758260264 conn(0x7fc2440b0bf0 msgr2=0x7fc2440b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- 172.21.15.70:0/758260264 shutdown_connections 2023-11-26T07:20:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- 172.21.15.70:0/758260264 wait complete. 2023-11-26T07:20:30.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 Processor -- start 2023-11-26T07:20:30.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- start start 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc244070390 0x7fc244157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2440ccce0 0x7fc24413a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244143c00 0x7fc24413acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441f6b00 con 0x7fc2440ccce0 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441f6240 con 0x7fc244070390 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc24b1c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441f64b0 con 0x7fc244143c00 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2440ccce0 0x7fc24413a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2440ccce0 0x7fc24413a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48414/0 (socket says 172.21.15.70:48414) 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 -- 172.21.15.70:0/3861548628 learned_addr learned my addr 172.21.15.70:0/3861548628 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc249761640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244143c00 0x7fc24413acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc248f60640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc244070390 0x7fc244157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 -- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244143c00 msgr2=0x7fc24413acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244143c00 0x7fc24413acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 -- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc244070390 msgr2=0x7fc244157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc244070390 0x7fc244157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.491+0000 7fc23bfff640 1 -- 172.21.15.70:0/3861548628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400094d0 con 0x7fc2440ccce0 2023-11-26T07:20:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc23bfff640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2440ccce0 0x7fc24413a780 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc23400c7f0 tx=0x7fc23400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc2397fa640 1 -- 172.21.15.70:0/3861548628 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23400cea0 con 0x7fc2440ccce0 2023-11-26T07:20:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc2397fa640 1 -- 172.21.15.70:0/3861548628 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234007a30 con 0x7fc2440ccce0 2023-11-26T07:20:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2441f6790 con 0x7fc2440ccce0 2023-11-26T07:20:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc2397fa640 1 -- 172.21.15.70:0/3861548628 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234007de0 con 0x7fc2440ccce0 2023-11-26T07:20:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc244158c80 con 0x7fc2440ccce0 2023-11-26T07:20:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2441f6cb0 con 0x7fc2440ccce0 2023-11-26T07:20:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.495+0000 7fc2397fa640 1 -- 172.21.15.70:0/3861548628 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fc234023480 con 0x7fc2440ccce0 2023-11-26T07:20:30.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.499+0000 7fc2397fa640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc230066740 0x7fc230068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:30.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.499+0000 7fc2397fa640 1 -- 172.21.15.70:0/3861548628 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc2340844e0 con 0x7fc2440ccce0 2023-11-26T07:20:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.499+0000 7fc248f60640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc230066740 0x7fc230068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.499+0000 7fc248f60640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc230066740 0x7fc230068c00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc2400af000 tx=0x7fc2400b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:30.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.499+0000 7fc2397fa640 1 -- 172.21.15.70:0/3861548628 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2340517d0 con 0x7fc2440ccce0 2023-11-26T07:20:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:30.651+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc244067720 con 0x7fc2440ccce0 2023-11-26T07:20:31.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.315+0000 7fc2397fa640 1 -- 172.21.15.70:0/3861548628 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc234054df0 con 0x7fc2440ccce0 2023-11-26T07:20:31.317 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2023-11-26T07:20:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.315+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc230066740 msgr2=0x7fc230068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.315+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc230066740 0x7fc230068c00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc2400af000 tx=0x7fc2400b6040 comp rx=0 tx=0).stop 2023-11-26T07:20:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.315+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2440ccce0 msgr2=0x7fc24413a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:31.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.315+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2440ccce0 0x7fc24413a780 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc23400c7f0 tx=0x7fc23400ccb0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 shutdown_connections 2023-11-26T07:20:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc230066740 0x7fc230068c00 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc2400af000 tx=0x7fc2400b6040 comp rx=0 tx=0).stop 2023-11-26T07:20:31.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2440ccce0 0x7fc24413a780 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc244143c00 0x7fc24413acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 --2- 172.21.15.70:0/3861548628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc244070390 0x7fc244157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 >> 172.21.15.70:0/3861548628 conn(0x7fc2440b0bf0 msgr2=0x7fc2440ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:31.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 shutdown_connections 2023-11-26T07:20:31.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.319+0000 7fc24b1c4640 1 -- 172.21.15.70:0/3861548628 wait complete. 2023-11-26T07:20:31.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:20:31.500 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfc013640 1 Processor -- start 2023-11-26T07:20:31.501 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfc013640 1 -- start start 2023-11-26T07:20:31.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfc013640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf40cf990 0x7f7cf415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:31.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfc013640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7cf415f4e0 0x7f7cf40cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfc013640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf406c520 con 0x7f7cf413e290 2023-11-26T07:20:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfc013640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf406c800 con 0x7f7cf415f4e0 2023-11-26T07:20:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfc013640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf406cae0 con 0x7f7cf40cf990 2023-11-26T07:20:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfa5b0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7cf415f4e0 0x7f7cf40cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfa5b0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7cf415f4e0 0x7f7cf40cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48428/0 (socket says 172.21.15.70:48428) 2023-11-26T07:20:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfa5b0640 1 -- 172.21.15.70:0/657035345 learned_addr learned my addr 172.21.15.70:0/657035345 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:31.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cf95ae640 1 --2- 172.21.15.70:0/657035345 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf40cf990 0x7f7cf415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfa5b0640 1 -- 172.21.15.70:0/657035345 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf40cf990 msgr2=0x7f7cf415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfa5b0640 1 --2- 172.21.15.70:0/657035345 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf40cf990 0x7f7cf415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfa5b0640 1 -- 172.21.15.70:0/657035345 >> v1:172.21.15.120:6789/0 conn(0x7f7cf413e290 legacy=0x7f7cf40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:31.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.499+0000 7f7cfa5b0640 1 -- 172.21.15.70:0/657035345 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf406cdc0 con 0x7f7cf415f4e0 2023-11-26T07:20:31.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfa5b0640 1 --2- 172.21.15.70:0/657035345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf415f4e0 0x7f7cf40cd7b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009e50 tx=0x7f7cec01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ede2b919c84af85 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:31.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cf8dad640 1 -- 172.21.15.70:0/657035345 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0a58d0 con 0x7f7cf415f4e0 2023-11-26T07:20:31.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cf8dad640 1 -- 172.21.15.70:0/657035345 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec0a5a30 con 0x7f7cf415f4e0 2023-11-26T07:20:31.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cf8dad640 1 -- 172.21.15.70:0/657035345 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0a5dc0 con 0x7f7cf415f4e0 2023-11-26T07:20:31.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 -- 172.21.15.70:0/657035345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf415f4e0 msgr2=0x7f7cf40cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:31.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 --2- 172.21.15.70:0/657035345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf415f4e0 0x7f7cf40cd7b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009e50 tx=0x7f7cec01c9e0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 -- 172.21.15.70:0/657035345 shutdown_connections 2023-11-26T07:20:31.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 --2- 172.21.15.70:0/657035345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf415f4e0 0x7f7cf40cd7b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 --2- 172.21.15.70:0/657035345 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf40cf990 0x7f7cf415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 -- 172.21.15.70:0/657035345 >> 172.21.15.70:0/657035345 conn(0x7f7cf406a890 msgr2=0x7f7cf406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:31.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 -- 172.21.15.70:0/657035345 shutdown_connections 2023-11-26T07:20:31.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.503+0000 7f7cfc013640 1 -- 172.21.15.70:0/657035345 wait complete. 2023-11-26T07:20:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 Processor -- start 2023-11-26T07:20:31.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 -- start start 2023-11-26T07:20:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cf40cf990 0x7f7cf415c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf413e290 0x7f7cf4137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf415f4e0 0x7f7cf41f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf41f9910 con 0x7f7cf413e290 2023-11-26T07:20:31.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf41f9bf0 con 0x7f7cf40cf990 2023-11-26T07:20:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf41f9ed0 con 0x7f7cf415f4e0 2023-11-26T07:20:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf413e290 0x7f7cf4137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf413e290 0x7f7cf4137a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48430/0 (socket says 172.21.15.70:48430) 2023-11-26T07:20:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 -- 172.21.15.70:0/2091166546 learned_addr learned my addr 172.21.15.70:0/2091166546 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf9daf640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cf40cf990 0x7f7cf415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfa5b0640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf415f4e0 0x7f7cf41f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:31.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 -- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf415f4e0 msgr2=0x7f7cf41f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf415f4e0 0x7f7cf41f9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 -- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cf40cf990 msgr2=0x7f7cf415c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cf40cf990 0x7f7cf415c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 -- 172.21.15.70:0/2091166546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec009b30 con 0x7f7cf413e290 2023-11-26T07:20:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cf95ae640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf413e290 0x7f7cf4137a70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d5f0 tx=0x7f7ce400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:31.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cea7fc640 1 -- 172.21.15.70:0/2091166546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40125f0 con 0x7f7cf413e290 2023-11-26T07:20:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cea7fc640 1 -- 172.21.15.70:0/2091166546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4012750 con 0x7f7cf413e290 2023-11-26T07:20:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf40afb90 con 0x7f7cf413e290 2023-11-26T07:20:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.507+0000 7f7cea7fc640 1 -- 172.21.15.70:0/2091166546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4012b00 con 0x7f7cf413e290 2023-11-26T07:20:31.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.511+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf4137fb0 con 0x7f7cf413e290 2023-11-26T07:20:31.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.511+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4067680 con 0x7f7cf413e290 2023-11-26T07:20:31.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.511+0000 7f7cea7fc640 1 -- 172.21.15.70:0/2091166546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f7ce4012c60 con 0x7f7cf413e290 2023-11-26T07:20:31.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.511+0000 7f7cea7fc640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7cd8066740 0x7f7cd8068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:31.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.511+0000 7f7cea7fc640 1 -- 172.21.15.70:0/2091166546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7ce4085140 con 0x7f7cf413e290 2023-11-26T07:20:31.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.511+0000 7f7cf9daf640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7cd8066740 0x7f7cd8068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:31.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.511+0000 7f7cf9daf640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7cd8066740 0x7f7cd8068c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0007fd0 tx=0x7f7cf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:31.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.515+0000 7f7cea7fc640 1 -- 172.21.15.70:0/2091166546 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ce40523c0 con 0x7f7cf413e290 2023-11-26T07:20:31.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:31.695+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7cf406b130 con 0x7f7cf413e290 2023-11-26T07:20:32.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.334+0000 7f7cea7fc640 1 -- 172.21.15.70:0/2091166546 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v24) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7ce405ae60 con 0x7f7cf413e290 2023-11-26T07:20:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 6 and data pool 7 2023-11-26T07:20:32.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7cd8066740 msgr2=0x7f7cd8068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7cd8066740 0x7f7cd8068c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0007fd0 tx=0x7f7cf0009040 comp rx=0 tx=0).stop 2023-11-26T07:20:32.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf413e290 msgr2=0x7f7cf4137a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf413e290 0x7f7cf4137a70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d5f0 tx=0x7f7ce400dab0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 shutdown_connections 2023-11-26T07:20:32.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7cd8066740 0x7f7cd8068c00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cf413e290 0x7f7cf4137a70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7cf415f4e0 0x7f7cf41f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 --2- 172.21.15.70:0/2091166546 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cf40cf990 0x7f7cf415c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.350+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 >> 172.21.15.70:0/2091166546 conn(0x7f7cf406a890 msgr2=0x7f7cf413aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.354+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 shutdown_connections 2023-11-26T07:20:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.354+0000 7f7cfc013640 1 -- 172.21.15.70:0/2091166546 wait complete. 2023-11-26T07:20:32.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:32.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47e57d640 1 Processor -- start 2023-11-26T07:20:32.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47e57d640 1 -- start start 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47e57d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb47815d2a0 0x7fb4780d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47e57d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb47815d680 0x7fb4780cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47e57d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4780cdc40 con 0x7fb4780d0e80 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47e57d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780ce7a0 con 0x7fb47815d680 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47e57d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4780d1440 con 0x7fb47815d2a0 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47cd7a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb47815d680 0x7fb4780cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47dd7c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb4780d0e80 0x7fb4780d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:54138/0 (socket says 172.21.15.70:54138) 2023-11-26T07:20:32.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47dd7c640 1 -- 172.21.15.70:0/2647037548 learned_addr learned my addr 172.21.15.70:0/2647037548 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:32.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47d57b640 1 --2- 172.21.15.70:0/2647037548 >> v2:172.21.15.120:3300/0 conn(0x7fb47815d2a0 0x7fb4780d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47cd7a640 1 -- 172.21.15.70:0/2647037548 >> v2:172.21.15.120:3300/0 conn(0x7fb47815d2a0 msgr2=0x7fb4780d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:32.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47cd7a640 1 --2- 172.21.15.70:0/2647037548 >> v2:172.21.15.120:3300/0 conn(0x7fb47815d2a0 0x7fb4780d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47cd7a640 1 -- 172.21.15.70:0/2647037548 >> v1:172.21.15.70:6789/0 conn(0x7fb4780d0e80 legacy=0x7fb4780d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47cd7a640 1 -- 172.21.15.70:0/2647037548 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780cde70 con 0x7fb47815d680 2023-11-26T07:20:32.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.526+0000 7fb47d57b640 1 --2- 172.21.15.70:0/2647037548 >> v2:172.21.15.120:3300/0 conn(0x7fb47815d2a0 0x7fb4780d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:32.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47cd7a640 1 --2- 172.21.15.70:0/2647037548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d680 0x7fb4780cec30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb47808b990 tx=0x7fb46801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1781f151ca0d1178 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:32.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb46ffff640 1 -- 172.21.15.70:0/2647037548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4680ab600 con 0x7fb47815d680 2023-11-26T07:20:32.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb46ffff640 1 -- 172.21.15.70:0/2647037548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4680a7050 con 0x7fb47815d680 2023-11-26T07:20:32.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb46ffff640 1 -- 172.21.15.70:0/2647037548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4680ab980 con 0x7fb47815d680 2023-11-26T07:20:32.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 -- 172.21.15.70:0/2647037548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d680 msgr2=0x7fb4780cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2647037548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d680 0x7fb4780cec30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb47808b990 tx=0x7fb46801c430 comp rx=0 tx=0).stop 2023-11-26T07:20:32.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 -- 172.21.15.70:0/2647037548 shutdown_connections 2023-11-26T07:20:32.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2647037548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d680 0x7fb4780cec30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2647037548 >> v2:172.21.15.120:3300/0 conn(0x7fb47815d2a0 0x7fb4780d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 -- 172.21.15.70:0/2647037548 >> 172.21.15.70:0/2647037548 conn(0x7fb4780d30a0 msgr2=0x7fb4780d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:32.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 -- 172.21.15.70:0/2647037548 shutdown_connections 2023-11-26T07:20:32.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 -- 172.21.15.70:0/2647037548 wait complete. 2023-11-26T07:20:32.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.530+0000 7fb47e57d640 1 Processor -- start 2023-11-26T07:20:32.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 -- start start 2023-11-26T07:20:32.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4780d0e80 0x7fb4780c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d2a0 0x7fb4780b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb47815d680 0x7fb4780b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780c8a60 con 0x7fb47815d2a0 2023-11-26T07:20:32.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780b75b0 con 0x7fb47815d680 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4780b7860 con 0x7fb4780d0e80 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d2a0 0x7fb4780b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d2a0 0x7fb4780b7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48434/0 (socket says 172.21.15.70:48434) 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 -- 172.21.15.70:0/2163014653 learned_addr learned my addr 172.21.15.70:0/2163014653 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47dd7c640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb47815d680 0x7fb4780b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47d57b640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4780d0e80 0x7fb4780c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 -- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4780d0e80 msgr2=0x7fb4780c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4780d0e80 0x7fb4780c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 -- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb47815d680 msgr2=0x7fb4780b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb47815d680 0x7fb4780b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 -- 172.21.15.70:0/2163014653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468009420 con 0x7fb47815d2a0 2023-11-26T07:20:32.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47dd7c640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb47815d680 0x7fb4780b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47d57b640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4780d0e80 0x7fb4780c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47cd7a640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d2a0 0x7fb4780b7070 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb46801a060 tx=0x7fb46801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb46dffb640 1 -- 172.21.15.70:0/2163014653 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4680b37d0 con 0x7fb47815d2a0 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb46dffb640 1 -- 172.21.15.70:0/2163014653 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4680b3930 con 0x7fb47815d2a0 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4780b7b40 con 0x7fb47815d2a0 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb46dffb640 1 -- 172.21.15.70:0/2163014653 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4680b3cc0 con 0x7fb47815d2a0 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4780b8100 con 0x7fb47815d2a0 2023-11-26T07:20:32.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.534+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb478067500 con 0x7fb47815d2a0 2023-11-26T07:20:32.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.538+0000 7fb46dffb640 1 -- 172.21.15.70:0/2163014653 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fb4680b2070 con 0x7fb47815d2a0 2023-11-26T07:20:32.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.538+0000 7fb46dffb640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb45c066740 0x7fb45c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.538+0000 7fb46dffb640 1 -- 172.21.15.70:0/2163014653 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb46811e720 con 0x7fb47815d2a0 2023-11-26T07:20:32.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.538+0000 7fb47d57b640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb45c066740 0x7fb45c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.538+0000 7fb47d57b640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb45c066740 0x7fb45c068c00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb474008930 tx=0x7fb474008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:32.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.542+0000 7fb46dffb640 1 -- 172.21.15.70:0/2163014653 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4680eb790 con 0x7fb47815d2a0 2023-11-26T07:20:32.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.690+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb47808c7f0 con 0x7fb47815d2a0 2023-11-26T07:20:32.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb46dffb640 1 -- 172.21.15.70:0/2163014653 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16526 (secure 0 0 0) 0x7fb4680b0090 con 0x7fb47815d2a0 2023-11-26T07:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:32.696 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":47,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:31.699683+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb45c066740 msgr2=0x7fb45c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb45c066740 0x7fb45c068c00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb474008930 tx=0x7fb474008040 comp rx=0 tx=0).stop 2023-11-26T07:20:32.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d2a0 msgr2=0x7fb4780b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d2a0 0x7fb4780b7070 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb46801a060 tx=0x7fb46801ac70 comp rx=0 tx=0).stop 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 shutdown_connections 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb45c066740 0x7fb45c068c00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb47815d2a0 0x7fb4780b7070 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb47815d680 0x7fb4780b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 --2- 172.21.15.70:0/2163014653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4780d0e80 0x7fb4780c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 >> 172.21.15.70:0/2163014653 conn(0x7fb4780d30a0 msgr2=0x7fb4780d25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 shutdown_connections 2023-11-26T07:20:32.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.694+0000 7fb47e57d640 1 -- 172.21.15.70:0/2163014653 wait complete. 2023-11-26T07:20:32.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:32.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.850+0000 7f196ce54640 1 Processor -- start 2023-11-26T07:20:32.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.850+0000 7f196ce54640 1 -- start start 2023-11-26T07:20:32.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.850+0000 7f196ce54640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1968070d10 0x7f196815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f196ce54640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196815b2f0 con 0x7f19680cf280 2023-11-26T07:20:32.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f196ce54640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196806c5c0 con 0x7f196806cd50 2023-11-26T07:20:32.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f196ce54640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196815e1a0 con 0x7f1968070d10 2023-11-26T07:20:32.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f196659c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f19680cf280 0x7f19680cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:54148/0 (socket says 172.21.15.70:54148) 2023-11-26T07:20:32.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f196659c640 1 -- 172.21.15.70:0/502151010 learned_addr learned my addr 172.21.15.70:0/502151010 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:32.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f195ffff640 1 --2- 172.21.15.70:0/502151010 >> v2:172.21.15.120:3300/0 conn(0x7f1968070d10 0x7f196815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f1965d9b640 1 -- 172.21.15.70:0/502151010 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150945633 0 0) 0x7f1958001120 con 0x7f19680cf280 2023-11-26T07:20:32.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f1965d9b640 1 -- 172.21.15.70:0/502151010 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1954003530 con 0x7f19680cf280 2023-11-26T07:20:32.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f195ffff640 1 -- 172.21.15.70:0/502151010 >> v1:172.21.15.120:6789/0 conn(0x7f196806cd50 legacy=0x7f19680b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f1965d9b640 1 -- 172.21.15.70:0/502151010 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141152551 0 0) 0x7f196806c5c0 con 0x7f196806cd50 2023-11-26T07:20:32.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f195ffff640 1 -- 172.21.15.70:0/502151010 >> v1:172.21.15.70:6789/0 conn(0x7f19680cf280 legacy=0x7f19680cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f195ffff640 1 -- 172.21.15.70:0/502151010 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196815e480 con 0x7f1968070d10 2023-11-26T07:20:32.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.854+0000 7f195ffff640 1 --2- 172.21.15.70:0/502151010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968070d10 0x7f196815d900 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f19500097c0 tx=0x7f195001eab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970177f966d54b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:32.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f1965d9b640 1 -- 172.21.15.70:0/502151010 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958001810 con 0x7f1968070d10 2023-11-26T07:20:32.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f1965d9b640 1 -- 172.21.15.70:0/502151010 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19500a8570 con 0x7f1968070d10 2023-11-26T07:20:32.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f1965d9b640 1 -- 172.21.15.70:0/502151010 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19500a8900 con 0x7f1968070d10 2023-11-26T07:20:32.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- 172.21.15.70:0/502151010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968070d10 msgr2=0x7f196815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 --2- 172.21.15.70:0/502151010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968070d10 0x7f196815d900 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f19500097c0 tx=0x7f195001eab0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- 172.21.15.70:0/502151010 shutdown_connections 2023-11-26T07:20:32.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 --2- 172.21.15.70:0/502151010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1968070d10 0x7f196815d900 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- 172.21.15.70:0/502151010 >> 172.21.15.70:0/502151010 conn(0x7f196806a890 msgr2=0x7f196806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:32.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- 172.21.15.70:0/502151010 shutdown_connections 2023-11-26T07:20:32.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- 172.21.15.70:0/502151010 wait complete. 2023-11-26T07:20:32.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 Processor -- start 2023-11-26T07:20:32.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- start start 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f196806cd50 0x7f1968153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1968070d10 0x7f19681f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19680cf280 0x7f19681e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19680cc2a0 con 0x7f1968070d10 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19680b1a80 con 0x7f19680cf280 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.858+0000 7f196ce54640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1968155e60 con 0x7f196806cd50 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1968070d10 0x7f19681f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1968070d10 0x7f19681f31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48444/0 (socket says 172.21.15.70:48444) 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 -- 172.21.15.70:0/2411918006 learned_addr learned my addr 172.21.15.70:0/2411918006 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f1966d9d640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19680cf280 0x7f19681e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f196659c640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f196806cd50 0x7f1968153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 -- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f196806cd50 msgr2=0x7f1968153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f196806cd50 0x7f1968153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 -- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19680cf280 msgr2=0x7f19681e89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19680cf280 0x7f19681e89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:32.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 -- 172.21.15.70:0/2411918006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950009420 con 0x7f1968070d10 2023-11-26T07:20:32.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195ffff640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1968070d10 0x7f19681f31c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f19500097c0 tx=0x7f195001b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:32.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195effd640 1 -- 172.21.15.70:0/2411918006 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19500c0070 con 0x7f1968070d10 2023-11-26T07:20:32.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195effd640 1 -- 172.21.15.70:0/2411918006 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1950006e20 con 0x7f1968070d10 2023-11-26T07:20:32.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1968153e70 con 0x7f1968070d10 2023-11-26T07:20:32.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195effd640 1 -- 172.21.15.70:0/2411918006 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19500b0890 con 0x7f1968070d10 2023-11-26T07:20:32.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19680cc760 con 0x7f1968070d10 2023-11-26T07:20:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1968067680 con 0x7f1968070d10 2023-11-26T07:20:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.862+0000 7f195effd640 1 -- 172.21.15.70:0/2411918006 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f19500b7040 con 0x7f1968070d10 2023-11-26T07:20:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.866+0000 7f195effd640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1948066740 0x7f1948068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.866+0000 7f195effd640 1 -- 172.21.15.70:0/2411918006 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1950120d80 con 0x7f1968070d10 2023-11-26T07:20:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.866+0000 7f196659c640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1948066740 0x7f1948068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.866+0000 7f196659c640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1948066740 0x7f1948068c00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1958001ec0 tx=0x7f1958001c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:32.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:32.870+0000 7f195effd640 1 -- 172.21.15.70:0/2411918006 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19500edfb0 con 0x7f1968070d10 2023-11-26T07:20:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.018+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1968067680 con 0x7f1968070d10 2023-11-26T07:20:33.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.018+0000 7f195effd640 1 -- 172.21.15.70:0/2411918006 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16526 (secure 0 0 0) 0x7f19500b5020 con 0x7f1968070d10 2023-11-26T07:20:33.023 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:33.023 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":47,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:31.699683+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1948066740 msgr2=0x7f1948068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1948066740 0x7f1948068c00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1958001ec0 tx=0x7f1958001c00 comp rx=0 tx=0).stop 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1968070d10 msgr2=0x7f19681f31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1968070d10 0x7f19681f31c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f19500097c0 tx=0x7f195001b850 comp rx=0 tx=0).stop 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 shutdown_connections 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1948066740 0x7f1948068c00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1968070d10 0x7f19681f31c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19680cf280 0x7f19681e89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 --2- 172.21.15.70:0/2411918006 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f196806cd50 0x7f1968153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:33.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 >> 172.21.15.70:0/2411918006 conn(0x7f196806a890 msgr2=0x7f19681e9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:33.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 shutdown_connections 2023-11-26T07:20:33.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.022+0000 7f196ce54640 1 -- 172.21.15.70:0/2411918006 wait complete. 2023-11-26T07:20:33.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:20:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c29d1640 1 Processor -- start 2023-11-26T07:20:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c29d1640 1 -- start start 2023-11-26T07:20:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c29d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb7bc0cf280 0x7fb7bc0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c29d1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc15b2f0 con 0x7fb7bc06cd50 2023-11-26T07:20:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c29d1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc06c5c0 con 0x7fb7bc070d10 2023-11-26T07:20:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c29d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cfba0 con 0x7fb7bc0cf280 2023-11-26T07:20:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7bbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb7bc0cf280 0x7fb7bc0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c0f6e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb7bc06cd50 0x7fb7bc0b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:54152/0 (socket says 172.21.15.70:54152) 2023-11-26T07:20:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7c0f6e640 1 -- 172.21.15.70:0/730554151 learned_addr learned my addr 172.21.15.70:0/730554151 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7bbfff640 1 -- 172.21.15.70:0/730554151 >> v1:172.21.15.120:6789/0 conn(0x7fb7bc070d10 legacy=0x7fb7bc15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:33.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7bbfff640 1 -- 172.21.15.70:0/730554151 >> v1:172.21.15.70:6789/0 conn(0x7fb7bc06cd50 legacy=0x7fb7bc0b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:33.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7bbfff640 1 -- 172.21.15.70:0/730554151 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc15e1a0 con 0x7fb7bc0cf280 2023-11-26T07:20:33.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.182+0000 7fb7baffd640 1 -- 172.21.15.70:0/730554151 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569434154 0 0) 0x7fb7b40014a0 con 0x7fb7bc06cd50 2023-11-26T07:20:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7bbfff640 1 --2- 172.21.15.70:0/730554151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc0cf280 0x7fb7bc0cf660 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0097c0 tx=0x7fb7ac01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a3a77ccc05720f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7baffd640 1 -- 172.21.15.70:0/730554151 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0a8970 con 0x7fb7bc0cf280 2023-11-26T07:20:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7baffd640 1 -- 172.21.15.70:0/730554151 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0a8ad0 con 0x7fb7bc0cf280 2023-11-26T07:20:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7baffd640 1 -- 172.21.15.70:0/730554151 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0a8e60 con 0x7fb7bc0cf280 2023-11-26T07:20:33.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7c29d1640 1 -- 172.21.15.70:0/730554151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc0cf280 msgr2=0x7fb7bc0cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:33.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/730554151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc0cf280 0x7fb7bc0cf660 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0097c0 tx=0x7fb7ac01ec70 comp rx=0 tx=0).stop 2023-11-26T07:20:33.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7c29d1640 1 -- 172.21.15.70:0/730554151 shutdown_connections 2023-11-26T07:20:33.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/730554151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc0cf280 0x7fb7bc0cf660 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:33.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7c29d1640 1 -- 172.21.15.70:0/730554151 >> 172.21.15.70:0/730554151 conn(0x7fb7bc06a890 msgr2=0x7fb7bc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:33.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7c29d1640 1 -- 172.21.15.70:0/730554151 shutdown_connections 2023-11-26T07:20:33.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.186+0000 7fb7c29d1640 1 -- 172.21.15.70:0/730554151 wait complete. 2023-11-26T07:20:33.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 Processor -- start 2023-11-26T07:20:33.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 -- start start 2023-11-26T07:20:33.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7bc06cd50 0x7fb7bc153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:33.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc070d10 0x7fb7bc1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:33.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb7bc0cf280 0x7fb7bc1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:33.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc1568d0 con 0x7fb7bc070d10 2023-11-26T07:20:33.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cc4e0 con 0x7fb7bc06cd50 2023-11-26T07:20:33.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cc7c0 con 0x7fb7bc0cf280 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc070d10 0x7fb7bc1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc070d10 0x7fb7bc1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48464/0 (socket says 172.21.15.70:48464) 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 -- 172.21.15.70:0/768877961 learned_addr learned my addr 172.21.15.70:0/768877961 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c0f6e640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb7bc0cf280 0x7fb7bc1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bbfff640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7bc06cd50 0x7fb7bc153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 -- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb7bc0cf280 msgr2=0x7fb7bc1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb7bc0cf280 0x7fb7bc1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 -- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7bc06cd50 msgr2=0x7fb7bc153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7bc06cd50 0x7fb7bc153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 -- 172.21.15.70:0/768877961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac009420 con 0x7fb7bc070d10 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7bb7fe640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc070d10 0x7fb7bc1591a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c500 tx=0x7fb7b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:33.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7b8ff9640 1 -- 172.21.15.70:0/768877961 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0005220 con 0x7fb7bc070d10 2023-11-26T07:20:33.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7b8ff9640 1 -- 172.21.15.70:0/768877961 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b0005380 con 0x7fb7bc070d10 2023-11-26T07:20:33.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc1e3770 con 0x7fb7bc070d10 2023-11-26T07:20:33.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.190+0000 7fb7b8ff9640 1 -- 172.21.15.70:0/768877961 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0007270 con 0x7fb7bc070d10 2023-11-26T07:20:33.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.194+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc153db0 con 0x7fb7bc070d10 2023-11-26T07:20:33.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.194+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc067680 con 0x7fb7bc070d10 2023-11-26T07:20:33.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.194+0000 7fb7b8ff9640 1 -- 172.21.15.70:0/768877961 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fb7b00073d0 con 0x7fb7bc070d10 2023-11-26T07:20:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.194+0000 7fb7b8ff9640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb7a8066740 0x7fb7a8068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.194+0000 7fb7b8ff9640 1 -- 172.21.15.70:0/768877961 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7b0083a80 con 0x7fb7bc070d10 2023-11-26T07:20:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.194+0000 7fb7bbfff640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb7a8066740 0x7fb7a8068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.194+0000 7fb7bbfff640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb7a8066740 0x7fb7a8068c00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0b2000 tx=0x7fb7ac0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:33.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.198+0000 7fb7b8ff9640 1 -- 172.21.15.70:0/768877961 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7b0050c30 con 0x7fb7bc070d10 2023-11-26T07:20:33.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:33.386+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb7bc0cc980 con 0x7fb7bc070d10 2023-11-26T07:20:34.314 INFO:tasks.ceph.mds.c.smithi070.stderr:2023-11-26T07:20:34.310+0000 7f77b7938640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:20:34.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.342+0000 7fb7b8ff9640 1 -- 172.21.15.70:0/768877961 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb7b0054250 con 0x7fb7bc070d10 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb7a8066740 msgr2=0x7fb7a8068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb7a8066740 0x7fb7a8068c00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0b2000 tx=0x7fb7ac0aa070 comp rx=0 tx=0).stop 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc070d10 msgr2=0x7fb7bc1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc070d10 0x7fb7bc1591a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c500 tx=0x7fb7b000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 shutdown_connections 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb7a8066740 0x7fb7a8068c00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb7bc070d10 0x7fb7bc1591a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb7bc0cf280 0x7fb7bc1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 --2- 172.21.15.70:0/768877961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7bc06cd50 0x7fb7bc153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 >> 172.21.15.70:0/768877961 conn(0x7fb7bc06a890 msgr2=0x7fb7bc0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 shutdown_connections 2023-11-26T07:20:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.346+0000 7fb7c29d1640 1 -- 172.21.15.70:0/768877961 wait complete. 2023-11-26T07:20:34.373 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:20:34.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:20:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7f01994640 1 Processor -- start 2023-11-26T07:20:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7f01994640 1 -- start start 2023-11-26T07:20:34.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7f01994640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7efc0cf280 0x7f7efc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7f01994640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cd1b0 0x7f7efc0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7f01994640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0cc730 con 0x7f7efc143ac0 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7f01994640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc143ea0 con 0x7f7efc0cf280 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7f01994640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0cfc50 con 0x7f7efc0cd1b0 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7ef27fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7efc0cf280 0x7f7efc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7ef27fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7efc0cf280 0x7f7efc0cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34148/0 (socket says 172.21.15.70:34148) 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7ef27fc640 1 -- 172.21.15.70:0/3440082108 learned_addr learned my addr 172.21.15.70:0/3440082108 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:34.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7efb7fe640 1 --2- 172.21.15.70:0/3440082108 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cd1b0 0x7f7efc0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:34.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7ef27fc640 1 -- 172.21.15.70:0/3440082108 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cd1b0 msgr2=0x7f7efc0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:34.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.514+0000 7f7ef27fc640 1 --2- 172.21.15.70:0/3440082108 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cd1b0 0x7f7efc0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7ef27fc640 1 -- 172.21.15.70:0/3440082108 >> v1:172.21.15.120:6789/0 conn(0x7f7efc143ac0 legacy=0x7f7efc070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:34.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7ef27fc640 1 -- 172.21.15.70:0/3440082108 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc070ee0 con 0x7f7efc0cf280 2023-11-26T07:20:34.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7ef27fc640 1 --2- 172.21.15.70:0/3440082108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc0cf280 0x7f7efc0cf710 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96dea30b89f3e80 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:34.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7efa7fc640 1 -- 172.21.15.70:0/3440082108 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40a9400 con 0x7f7efc0cf280 2023-11-26T07:20:34.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7efa7fc640 1 -- 172.21.15.70:0/3440082108 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40a9560 con 0x7f7efc0cf280 2023-11-26T07:20:34.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7efa7fc640 1 -- 172.21.15.70:0/3440082108 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40a98f0 con 0x7f7efc0cf280 2023-11-26T07:20:34.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 -- 172.21.15.70:0/3440082108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc0cf280 msgr2=0x7f7efc0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:34.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 --2- 172.21.15.70:0/3440082108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc0cf280 0x7f7efc0cf710 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009870 tx=0x7f7ee401c540 comp rx=0 tx=0).stop 2023-11-26T07:20:34.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 -- 172.21.15.70:0/3440082108 shutdown_connections 2023-11-26T07:20:34.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 --2- 172.21.15.70:0/3440082108 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cd1b0 0x7f7efc0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 --2- 172.21.15.70:0/3440082108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc0cf280 0x7f7efc0cf710 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 -- 172.21.15.70:0/3440082108 >> 172.21.15.70:0/3440082108 conn(0x7f7efc06a890 msgr2=0x7f7efc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:34.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 -- 172.21.15.70:0/3440082108 shutdown_connections 2023-11-26T07:20:34.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.518+0000 7f7f01994640 1 -- 172.21.15.70:0/3440082108 wait complete. 2023-11-26T07:20:34.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 Processor -- start 2023-11-26T07:20:34.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 -- start start 2023-11-26T07:20:34.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc0cd1b0 0x7f7efc142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:34.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cf280 0x7f7efc15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:34.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc143ac0 0x7f7efc159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:34.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15c610 con 0x7f7efc143ac0 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15ba00 con 0x7f7efc0cd1b0 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7f01994640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15bce0 con 0x7f7efc0cf280 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc143ac0 0x7f7efc159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc143ac0 0x7f7efc159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34156/0 (socket says 172.21.15.70:34156) 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 -- 172.21.15.70:0/3275868690 learned_addr learned my addr 172.21.15.70:0/3275868690 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efaffd640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc0cd1b0 0x7f7efc142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7ef27fc640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cf280 0x7f7efc15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 -- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cf280 msgr2=0x7f7efc15afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cf280 0x7f7efc15afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 -- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc0cd1b0 msgr2=0x7f7efc142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:34.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc0cd1b0 0x7f7efc142680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:34.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 -- 172.21.15.70:0/3275868690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40094d0 con 0x7f7efc143ac0 2023-11-26T07:20:34.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.522+0000 7f7efb7fe640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc143ac0 0x7f7efc159500 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e7f0 tx=0x7f7ef400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:34.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7ef8ff9640 1 -- 172.21.15.70:0/3275868690 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4009530 con 0x7f7efc143ac0 2023-11-26T07:20:34.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7ef8ff9640 1 -- 172.21.15.70:0/3275868690 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef400eea0 con 0x7f7efc143ac0 2023-11-26T07:20:34.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7ef8ff9640 1 -- 172.21.15.70:0/3275868690 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400cb60 con 0x7f7efc143ac0 2023-11-26T07:20:34.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc15bfc0 con 0x7f7efc143ac0 2023-11-26T07:20:34.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc0afd60 con 0x7f7efc143ac0 2023-11-26T07:20:34.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc0cf8a0 con 0x7f7efc143ac0 2023-11-26T07:20:34.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7ef8ff9640 1 -- 172.21.15.70:0/3275868690 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f7ef400ccc0 con 0x7f7efc143ac0 2023-11-26T07:20:34.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7ef8ff9640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7edc066740 0x7f7edc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:34.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7ef8ff9640 1 -- 172.21.15.70:0/3275868690 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ef4084370 con 0x7f7efc143ac0 2023-11-26T07:20:34.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.526+0000 7f7efaffd640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7edc066740 0x7f7edc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:34.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.530+0000 7f7efaffd640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7edc066740 0x7f7edc068c00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0012f0 tx=0x7f7eec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:34.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.534+0000 7f7ef8ff9640 1 -- 172.21.15.70:0/3275868690 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ef4051510 con 0x7f7efc143ac0 2023-11-26T07:20:34.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:34.714+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7efc067680 con 0x7f7efc143ac0 2023-11-26T07:20:35.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.350+0000 7f7ef8ff9640 1 -- 172.21.15.70:0/3275868690 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7ef4054b30 con 0x7f7efc143ac0 2023-11-26T07:20:35.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.350+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7edc066740 msgr2=0x7f7edc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.350+0000 7f7f01994640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7edc066740 0x7f7edc068c00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0012f0 tx=0x7f7eec009040 comp rx=0 tx=0).stop 2023-11-26T07:20:35.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.350+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc143ac0 msgr2=0x7f7efc159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.350+0000 7f7f01994640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc143ac0 0x7f7efc159500 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e7f0 tx=0x7f7ef400ecb0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.350+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 shutdown_connections 2023-11-26T07:20:35.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.354+0000 7f7f01994640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7edc066740 0x7f7edc068c00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.354+0000 7f7f01994640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc143ac0 0x7f7efc159500 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.354+0000 7f7f01994640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7efc0cf280 0x7f7efc15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.354+0000 7f7f01994640 1 --2- 172.21.15.70:0/3275868690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc0cd1b0 0x7f7efc142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.354+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 >> 172.21.15.70:0/3275868690 conn(0x7f7efc06a890 msgr2=0x7f7efc0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:35.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.354+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 shutdown_connections 2023-11-26T07:20:35.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.354+0000 7f7f01994640 1 -- 172.21.15.70:0/3275868690 wait complete. 2023-11-26T07:20:35.378 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:20:35.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:35.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facb4a68640 1 Processor -- start 2023-11-26T07:20:35.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facb4a68640 1 -- start start 2023-11-26T07:20:35.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facb4a68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facb4a68640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7facb00708b0 0x7facb00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facb4a68640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00cfbf0 con 0x7facb00cf7c0 2023-11-26T07:20:35.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facb4a68640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb0143ea0 con 0x7facb00708b0 2023-11-26T07:20:35.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facb4a68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00cc730 con 0x7facb0143ac0 2023-11-26T07:20:35.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7faca5d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7facb00708b0 0x7facb00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facaed9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7facb00cf7c0 0x7facb00b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41914/0 (socket says 172.21.15.70:41914) 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facaed9d640 1 -- 172.21.15.70:0/486032227 learned_addr learned my addr 172.21.15.70:0/486032227 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.514+0000 7facae59c640 1 --2- 172.21.15.70:0/486032227 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7faca5d9b640 1 -- 172.21.15.70:0/486032227 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 msgr2=0x7facb0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7faca5d9b640 1 --2- 172.21.15.70:0/486032227 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7faca5d9b640 1 -- 172.21.15.70:0/486032227 >> v1:172.21.15.70:6789/0 conn(0x7facb00cf7c0 legacy=0x7facb00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7facadd9b640 1 -- 172.21.15.70:0/486032227 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361057894 0 0) 0x7facb00cfbf0 con 0x7facb00cf7c0 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7faca5d9b640 1 -- 172.21.15.70:0/486032227 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0070ee0 con 0x7facb00708b0 2023-11-26T07:20:35.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7facae59c640 1 --2- 172.21.15.70:0/486032227 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:35.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7faca5d9b640 1 --2- 172.21.15.70:0/486032227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb00cf280 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faca00097c0 tx=0x7faca001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf5395bb13e1dee server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:35.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7facadd9b640 1 -- 172.21.15.70:0/486032227 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00ad640 con 0x7facb00708b0 2023-11-26T07:20:35.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7facadd9b640 1 -- 172.21.15.70:0/486032227 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00ad7a0 con 0x7facb00708b0 2023-11-26T07:20:35.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7facadd9b640 1 -- 172.21.15.70:0/486032227 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00adb30 con 0x7facb00708b0 2023-11-26T07:20:35.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7facb4a68640 1 -- 172.21.15.70:0/486032227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 msgr2=0x7facb00cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.518+0000 7facb4a68640 1 --2- 172.21.15.70:0/486032227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb00cf280 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7faca00097c0 tx=0x7faca001c480 comp rx=0 tx=0).stop 2023-11-26T07:20:35.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- 172.21.15.70:0/486032227 shutdown_connections 2023-11-26T07:20:35.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 --2- 172.21.15.70:0/486032227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb00cf280 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 --2- 172.21.15.70:0/486032227 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- 172.21.15.70:0/486032227 >> 172.21.15.70:0/486032227 conn(0x7facb006a890 msgr2=0x7facb006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:35.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- 172.21.15.70:0/486032227 shutdown_connections 2023-11-26T07:20:35.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- 172.21.15.70:0/486032227 wait complete. 2023-11-26T07:20:35.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 Processor -- start 2023-11-26T07:20:35.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- start start 2023-11-26T07:20:35.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb01f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb00cf7c0 0x7facb00af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00b0000 con 0x7facb00708b0 2023-11-26T07:20:35.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00b02e0 con 0x7facb00cf7c0 2023-11-26T07:20:35.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facb4a68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb015af60 con 0x7facb0143ac0 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb01f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb01f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34186/0 (socket says 172.21.15.70:34186) 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 -- 172.21.15.70:0/3702045365 learned_addr learned my addr 172.21.15.70:0/3702045365 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facaed9d640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7faca5d9b640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb00cf7c0 0x7facb00af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 -- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 msgr2=0x7facb0159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 -- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb00cf7c0 msgr2=0x7facb00af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb00cf7c0 0x7facb00af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7facae59c640 1 -- 172.21.15.70:0/3702045365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009420 con 0x7facb00708b0 2023-11-26T07:20:35.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.522+0000 7faca5d9b640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb00cf7c0 0x7facb00af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:35.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7facae59c640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb01f6320 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fac9800e810 tx=0x7fac9800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:35.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7faca77fe640 1 -- 172.21.15.70:0/3702045365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9800c8d0 con 0x7facb00708b0 2023-11-26T07:20:35.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7faca77fe640 1 -- 172.21.15.70:0/3702045365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9800ca30 con 0x7facb00708b0 2023-11-26T07:20:35.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb015b240 con 0x7facb00708b0 2023-11-26T07:20:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7faca77fe640 1 -- 172.21.15.70:0/3702045365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9800cdc0 con 0x7facb00708b0 2023-11-26T07:20:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb006cb60 con 0x7facb00708b0 2023-11-26T07:20:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb015adc0 con 0x7facb00708b0 2023-11-26T07:20:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7faca77fe640 1 -- 172.21.15.70:0/3702045365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fac98013410 con 0x7facb00708b0 2023-11-26T07:20:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7faca77fe640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fac90066740 0x7fac90068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7faca77fe640 1 -- 172.21.15.70:0/3702045365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac98084200 con 0x7facb00708b0 2023-11-26T07:20:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.526+0000 7faca5d9b640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fac90066740 0x7fac90068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.530+0000 7faca5d9b640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fac90066740 0x7fac90068c00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faca00af000 tx=0x7faca0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:35.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.530+0000 7faca77fe640 1 -- 172.21.15.70:0/3702045365 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7facb015adc0 con 0x7facb00708b0 2023-11-26T07:20:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.710+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facb015adc0 con 0x7facb00708b0 2023-11-26T07:20:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.710+0000 7faca77fe640 1 -- 172.21.15.70:0/3702045365 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4919 (secure 0 0 0) 0x7facb015adc0 con 0x7facb00708b0 2023-11-26T07:20:35.718 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:35.718 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3372803527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3372803527},{"type":"v1","addr":"172.21.15.120:6833","nonce":3372803527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5671,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2241396376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2241396376},{"type":"v1","addr":"172.21.15.120:6835","nonce":2241396376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1311811000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1311811000},{"type":"v1","addr":"172.21.15.70:6835","nonce":1311811000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:31.700041+0000","modified":"2023-11-26T07:20:34.716588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/1491316829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":1491316829},{"type":"v1","addr":"172.21.15.70:6837","nonce":1491316829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:20:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2023-11-26T07:20:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fac90066740 msgr2=0x7fac90068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fac90066740 0x7fac90068c00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faca00af000 tx=0x7faca0008040 comp rx=0 tx=0).stop 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 msgr2=0x7facb01f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb01f6320 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fac9800e810 tx=0x7fac9800ecd0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 shutdown_connections 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7facb0143ac0 0x7facb0159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facb00cf7c0 0x7facb00af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fac90066740 0x7fac90068c00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 --2- 172.21.15.70:0/3702045365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facb00708b0 0x7facb01f6320 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 >> 172.21.15.70:0/3702045365 conn(0x7facb006a890 msgr2=0x7facb013fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 shutdown_connections 2023-11-26T07:20:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.714+0000 7facb4a68640 1 -- 172.21.15.70:0/3702045365 wait complete. 2023-11-26T07:20:35.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:20:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.870+0000 7f4b52e5a640 1 Processor -- start 2023-11-26T07:20:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.870+0000 7f4b52e5a640 1 -- start start 2023-11-26T07:20:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b52e5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4b4c0ce680 0x7f4b4c071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b52e5a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c06c750 con 0x7f4b4c0b2f80 2023-11-26T07:20:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b52e5a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0b3550 con 0x7f4b4c1596d0 2023-11-26T07:20:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b52e5a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0cbe00 con 0x7f4b4c0ce680 2023-11-26T07:20:35.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4b4c0b2f80 0x7f4b4c06cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41916/0 (socket says 172.21.15.70:41916) 2023-11-26T07:20:35.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 -- 172.21.15.70:0/381660026 learned_addr learned my addr 172.21.15.70:0/381660026 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889777071 0 0) 0x7f4b4c06c750 con 0x7f4b4c0b2f80 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b34003450 con 0x7f4b4c0b2f80 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b513f7640 1 --2- 172.21.15.70:0/381660026 >> v2:172.21.15.120:3300/0 conn(0x7f4b4c0ce680 0x7f4b4c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1067184204 0 0) 0x7f4b34003450 con 0x7f4b4c0b2f80 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 >> v2:172.21.15.120:3300/0 conn(0x7f4b4c0ce680 msgr2=0x7f4b4c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 --2- 172.21.15.70:0/381660026 >> v2:172.21.15.120:3300/0 conn(0x7f4b4c0ce680 0x7f4b4c071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 >> v1:172.21.15.120:6789/0 conn(0x7f4b4c1596d0 legacy=0x7f4b4c0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c071e80 con 0x7f4b4c0b2f80 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f4b3c001680 con 0x7f4b4c0b2f80 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 >> v1:172.21.15.70:6789/0 conn(0x7f4b4c0b2f80 legacy=0x7f4b4c06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b34003a70 0x7f4b34003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b34008860 0x7f4b3400acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b3400b550 0x7f4b3400da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0cbe00 con 0x7f4b34008860 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3400e2f0 con 0x7f4b3400b550 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3400e4b0 con 0x7f4b34003a70 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b34008860 0x7f4b3400acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b50bf6640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b34003a70 0x7f4b34003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b513f7640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b3400b550 0x7f4b3400da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 -- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b34003a70 msgr2=0x7f4b34003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b34003a70 0x7f4b34003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 -- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b3400b550 msgr2=0x7f4b3400da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b3400b550 0x7f4b3400da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b43fff640 1 -- 172.21.15.70:0/381660026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34003450 con 0x7f4b34008860 2023-11-26T07:20:35.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b513f7640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b3400b550 0x7f4b3400da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:35.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.874+0000 7f4b513f7640 1 -- 172.21.15.70:0/381660026 reap_dead start 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b43fff640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b34008860 0x7f4b3400acb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c005050 tx=0x7f4b3c01d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba5f6adeb357b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0a5d00 con 0x7f4b34008860 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0a5e60 con 0x7f4b34008860 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b437fe640 1 -- 172.21.15.70:0/381660026 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c005b00 con 0x7f4b34008860 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 -- 172.21.15.70:0/381660026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b34008860 msgr2=0x7f4b3400acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b34008860 0x7f4b3400acb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c005050 tx=0x7f4b3c01d220 comp rx=0 tx=0).stop 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 -- 172.21.15.70:0/381660026 shutdown_connections 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/381660026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b34008860 0x7f4b3400acb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 -- 172.21.15.70:0/381660026 >> 172.21.15.70:0/381660026 conn(0x7f4b4c06a890 msgr2=0x7f4b4c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 -- 172.21.15.70:0/381660026 shutdown_connections 2023-11-26T07:20:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 -- 172.21.15.70:0/381660026 wait complete. 2023-11-26T07:20:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 Processor -- start 2023-11-26T07:20:35.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.878+0000 7f4b52e5a640 1 -- start start 2023-11-26T07:20:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b34008860 0x7f4b4c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b4c15c1f0 0x7f4b4c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b4c150ff0 0x7f4b4c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c15cbb0 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c14f1b0 con 0x7f4b34008860 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c14f450 con 0x7f4b4c150ff0 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b4c15c1f0 0x7f4b4c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b4c15c1f0 0x7f4b4c15c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34202/0 (socket says 172.21.15.70:34202) 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 -- 172.21.15.70:0/1246861059 learned_addr learned my addr 172.21.15.70:0/1246861059 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 -- 172.21.15.70:0/1246861059 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b4c150ff0 msgr2=0x7f4b4c151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b4c150ff0 0x7f4b4c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 -- 172.21.15.70:0/1246861059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b34008860 msgr2=0x7f4b4c14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b34008860 0x7f4b4c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 -- 172.21.15.70:0/1246861059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c14f730 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b43fff640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b4c15c1f0 0x7f4b4c15c670 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0ab040 tx=0x7f4b34003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:35.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b417fa640 1 -- 172.21.15.70:0/1246861059 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c001d20 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b417fa640 1 -- 172.21.15.70:0/1246861059 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0b3070 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b417fa640 1 -- 172.21.15.70:0/1246861059 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c005ac0 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c14fa10 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.886 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c1519b0 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c067680 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.882+0000 7f4b417fa640 1 -- 172.21.15.70:0/1246861059 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f4b3c0b5030 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.886+0000 7f4b417fa640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b38066740 0x7f4b38068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:35.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.886+0000 7f4b417fa640 1 -- 172.21.15.70:0/1246861059 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b3c11df70 con 0x7f4b4c15c1f0 2023-11-26T07:20:35.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.886+0000 7f4b50bf6640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b38066740 0x7f4b38068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:35.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.886+0000 7f4b50bf6640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b38066740 0x7f4b38068c00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b48007ab0 tx=0x7f4b48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:35.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:35.890+0000 7f4b417fa640 1 -- 172.21.15.70:0/1246861059 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b3c0eb130 con 0x7f4b4c15c1f0 2023-11-26T07:20:36.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.042+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b4c0b1ec0 con 0x7f4b4c15c1f0 2023-11-26T07:20:36.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.042+0000 7f4b417fa640 1 -- 172.21.15.70:0/1246861059 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16513 (secure 0 0 0) 0x7f4b4c0b1ec0 con 0x7f4b4c15c1f0 2023-11-26T07:20:36.046 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:36.046 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":48,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:20:33.337923+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b38066740 msgr2=0x7f4b38068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b38066740 0x7f4b38068c00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b48007ab0 tx=0x7f4b48009040 comp rx=0 tx=0).stop 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b4c15c1f0 msgr2=0x7f4b4c15c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b4c15c1f0 0x7f4b4c15c670 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0ab040 tx=0x7f4b34003700 comp rx=0 tx=0).stop 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 shutdown_connections 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b38066740 0x7f4b38068c00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b4c15c1f0 0x7f4b4c15c670 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4b4c150ff0 0x7f4b4c151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 --2- 172.21.15.70:0/1246861059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b34008860 0x7f4b4c14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 >> 172.21.15.70:0/1246861059 conn(0x7f4b4c06a890 msgr2=0x7f4b4c0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:36.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 shutdown_connections 2023-11-26T07:20:36.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.046+0000 7f4b52e5a640 1 -- 172.21.15.70:0/1246861059 wait complete. 2023-11-26T07:20:36.067 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:20:36.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:20:36.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff50a172640 1 Processor -- start 2023-11-26T07:20:36.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff50a172640 1 -- start start 2023-11-26T07:20:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff50a172640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff50415d6e0 0x7ff5040d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff50a172640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5040d1bc0 0x7ff5040b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff50a172640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5040cf0e0 con 0x7ff5040b2160 2023-11-26T07:20:36.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff50a172640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50415dac0 con 0x7ff50415d6e0 2023-11-26T07:20:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff50a172640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040ceb20 con 0x7ff5040d1bc0 2023-11-26T07:20:36.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff5037fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff50415d6e0 0x7ff5040d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff503fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5040d1bc0 0x7ff5040b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff5037fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff50415d6e0 0x7ff5040d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:49228/0 (socket says 172.21.15.70:49228) 2023-11-26T07:20:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff5037fe640 1 -- 172.21.15.70:0/862366599 learned_addr learned my addr 172.21.15.70:0/862366599 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff5037fe640 1 -- 172.21.15.70:0/862366599 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5040d1bc0 msgr2=0x7ff5040b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff5037fe640 1 --2- 172.21.15.70:0/862366599 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5040d1bc0 0x7ff5040b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff5037fe640 1 -- 172.21.15.70:0/862366599 >> v1:172.21.15.120:6789/0 conn(0x7ff5040b2160 legacy=0x7ff5040d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.202+0000 7ff5037fe640 1 -- 172.21.15.70:0/862366599 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040cee00 con 0x7ff50415d6e0 2023-11-26T07:20:36.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff5037fe640 1 --2- 172.21.15.70:0/862366599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50415d6e0 0x7ff5040d0df0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009870 tx=0x7ff4f401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f91acc70ba28f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff5027fc640 1 -- 172.21.15.70:0/862366599 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40a7070 con 0x7ff50415d6e0 2023-11-26T07:20:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff5027fc640 1 -- 172.21.15.70:0/862366599 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f40ab430 con 0x7ff50415d6e0 2023-11-26T07:20:36.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff5027fc640 1 -- 172.21.15.70:0/862366599 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40ab7c0 con 0x7ff50415d6e0 2023-11-26T07:20:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 -- 172.21.15.70:0/862366599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50415d6e0 msgr2=0x7ff5040d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 --2- 172.21.15.70:0/862366599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50415d6e0 0x7ff5040d0df0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009870 tx=0x7ff4f401c540 comp rx=0 tx=0).stop 2023-11-26T07:20:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 -- 172.21.15.70:0/862366599 shutdown_connections 2023-11-26T07:20:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 --2- 172.21.15.70:0/862366599 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5040d1bc0 0x7ff5040b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 --2- 172.21.15.70:0/862366599 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50415d6e0 0x7ff5040d0df0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 -- 172.21.15.70:0/862366599 >> 172.21.15.70:0/862366599 conn(0x7ff50409c550 msgr2=0x7ff5040d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 -- 172.21.15.70:0/862366599 shutdown_connections 2023-11-26T07:20:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.206+0000 7ff50a172640 1 -- 172.21.15.70:0/862366599 wait complete. 2023-11-26T07:20:36.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 Processor -- start 2023-11-26T07:20:36.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 -- start start 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5040b2160 0x7ff50415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5040d1bc0 0x7ff5040c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff50415d6e0 0x7ff50415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff504154b90 con 0x7ff5040d1bc0 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff504154e00 con 0x7ff5040b2160 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5041550e0 con 0x7ff50415d6e0 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5040d1bc0 0x7ff5040c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff5037fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5040b2160 0x7ff50415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5040d1bc0 0x7ff5040c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34206/0 (socket says 172.21.15.70:34206) 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 -- 172.21.15.70:0/1285038683 learned_addr learned my addr 172.21.15.70:0/1285038683 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff503fff640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff50415d6e0 0x7ff50415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 -- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff50415d6e0 msgr2=0x7ff50415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff50415d6e0 0x7ff50415f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 -- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5040b2160 msgr2=0x7ff50415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5040b2160 0x7ff50415dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 -- 172.21.15.70:0/1285038683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40094d0 con 0x7ff5040d1bc0 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff5037fe640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5040b2160 0x7ff50415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:20:36.219 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff502ffd640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5040d1bc0 0x7ff5040c6490 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c500 tx=0x7ff4f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff4ebfff640 1 -- 172.21.15.70:0/1285038683 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8005220 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff4ebfff640 1 -- 172.21.15.70:0/1285038683 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8005380 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5041553c0 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff4ebfff640 1 -- 172.21.15.70:0/1285038683 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8007270 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.210+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50415e230 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.214+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff504067dc0 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.214+0000 7ff4ebfff640 1 -- 172.21.15.70:0/1285038683 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7ff4f80073d0 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.214+0000 7ff4ebfff640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4f0066740 0x7ff4f0068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.214+0000 7ff4ebfff640 1 -- 172.21.15.70:0/1285038683 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4f8083ac0 con 0x7ff5040d1bc0 2023-11-26T07:20:36.220 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.214+0000 7ff5037fe640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4f0066740 0x7ff4f0068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.214+0000 7ff5037fe640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4f0066740 0x7ff4f0068c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40af000 tx=0x7ff4f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.222 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.218+0000 7ff4ebfff640 1 -- 172.21.15.70:0/1285038683 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4f8050c70 con 0x7ff5040d1bc0 2023-11-26T07:20:36.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.366+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5040c6ba0 con 0x7ff4f0066740 2023-11-26T07:20:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.374+0000 7ff4ebfff640 1 -- 172.21.15.70:0/1285038683 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289158 (secure 0 0 0) 0x7ff5040c6ba0 con 0x7ff4f0066740 2023-11-26T07:20:36.381 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:36.389 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:20:36.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4f0066740 msgr2=0x7ff4f0068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4f0066740 0x7ff4f0068c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40af000 tx=0x7ff4f4008040 comp rx=0 tx=0).stop 2023-11-26T07:20:36.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5040d1bc0 msgr2=0x7ff5040c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5040d1bc0 0x7ff5040c6490 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c500 tx=0x7ff4f800c9c0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 shutdown_connections 2023-11-26T07:20:36.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4f0066740 0x7ff4f0068c00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5040d1bc0 0x7ff5040c6490 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff50415d6e0 0x7ff50415f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 --2- 172.21.15.70:0/1285038683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5040b2160 0x7ff50415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 >> 172.21.15.70:0/1285038683 conn(0x7ff50409c550 msgr2=0x7ff5040734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:36.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 shutdown_connections 2023-11-26T07:20:36.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.378+0000 7ff50a172640 1 -- 172.21.15.70:0/1285038683 wait complete. 2023-11-26T07:20:36.404 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2023-11-26T07:20:36.023933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242628,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732092,"statfs":{"total":773094113280,"available":772845662208,"internally_reserved":0,"allocated":5775360,"data_stored":3042444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709489"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214620+0000","last_change":"2023-11-26T07:20:32.349236+0000","last_active":"2023-11-26T07:20:34.214620+0000","last_peered":"2023-11-26T07:20:34.214620+0000","last_clean":"2023-11-26T07:20:34.214620+0000","last_became_active":"2023-11-26T07:20:32.348176+0000","last_became_peered":"2023-11-26T07:20:32.348176+0000","last_unstale":"2023-11-26T07:20:34.214620+0000","last_undegraded":"2023-11-26T07:20:34.214620+0000","last_fullsized":"2023-11-26T07:20:34.214620+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:51.468708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831949+0000","last_change":"2023-11-26T07:20:32.350170+0000","last_active":"2023-11-26T07:20:33.831949+0000","last_peered":"2023-11-26T07:20:33.831949+0000","last_clean":"2023-11-26T07:20:33.831949+0000","last_became_active":"2023-11-26T07:20:32.349739+0000","last_became_peered":"2023-11-26T07:20:32.349739+0000","last_unstale":"2023-11-26T07:20:33.831949+0000","last_undegraded":"2023-11-26T07:20:33.831949+0000","last_fullsized":"2023-11-26T07:20:33.831949+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:55.284923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214117+0000","last_change":"2023-11-26T07:20:32.358424+0000","last_active":"2023-11-26T07:20:34.214117+0000","last_peered":"2023-11-26T07:20:34.214117+0000","last_clean":"2023-11-26T07:20:34.214117+0000","last_became_active":"2023-11-26T07:20:32.358138+0000","last_became_peered":"2023-11-26T07:20:32.358138+0000","last_unstale":"2023-11-26T07:20:34.214117+0000","last_undegraded":"2023-11-26T07:20:34.214117+0000","last_fullsized":"2023-11-26T07:20:34.214117+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:26.928757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455933+0000","last_change":"2023-11-26T07:20:32.359170+0000","last_active":"2023-11-26T07:20:33.455933+0000","last_peered":"2023-11-26T07:20:33.455933+0000","last_clean":"2023-11-26T07:20:33.455933+0000","last_became_active":"2023-11-26T07:20:32.358919+0000","last_became_peered":"2023-11-26T07:20:32.358919+0000","last_unstale":"2023-11-26T07:20:33.455933+0000","last_undegraded":"2023-11-26T07:20:33.455933+0000","last_fullsized":"2023-11-26T07:20:33.455933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:06.549419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831726+0000","last_change":"2023-11-26T07:20:32.359502+0000","last_active":"2023-11-26T07:20:33.831726+0000","last_peered":"2023-11-26T07:20:33.831726+0000","last_clean":"2023-11-26T07:20:33.831726+0000","last_became_active":"2023-11-26T07:20:32.359192+0000","last_became_peered":"2023-11-26T07:20:32.359192+0000","last_unstale":"2023-11-26T07:20:33.831726+0000","last_undegraded":"2023-11-26T07:20:33.831726+0000","last_fullsized":"2023-11-26T07:20:33.831726+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:06.549419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347578+0000","last_change":"2023-11-26T07:20:32.354205+0000","last_active":"2023-11-26T07:20:33.347578+0000","last_peered":"2023-11-26T07:20:33.347578+0000","last_clean":"2023-11-26T07:20:33.347578+0000","last_became_active":"2023-11-26T07:20:32.347611+0000","last_became_peered":"2023-11-26T07:20:32.347611+0000","last_unstale":"2023-11-26T07:20:33.347578+0000","last_undegraded":"2023-11-26T07:20:33.347578+0000","last_fullsized":"2023-11-26T07:20:33.347578+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:39.726313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215284+0000","last_change":"2023-11-26T07:20:32.344423+0000","last_active":"2023-11-26T07:20:34.215284+0000","last_peered":"2023-11-26T07:20:34.215284+0000","last_clean":"2023-11-26T07:20:34.215284+0000","last_became_active":"2023-11-26T07:20:32.344040+0000","last_became_peered":"2023-11-26T07:20:32.344040+0000","last_unstale":"2023-11-26T07:20:34.215284+0000","last_undegraded":"2023-11-26T07:20:34.215284+0000","last_fullsized":"2023-11-26T07:20:34.215284+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:43:16.302808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455257+0000","last_change":"2023-11-26T07:20:32.354539+0000","last_active":"2023-11-26T07:20:33.455257+0000","last_peered":"2023-11-26T07:20:33.455257+0000","last_clean":"2023-11-26T07:20:33.455257+0000","last_became_active":"2023-11-26T07:20:32.353940+0000","last_became_peered":"2023-11-26T07:20:32.353940+0000","last_unstale":"2023-11-26T07:20:33.455257+0000","last_undegraded":"2023-11-26T07:20:33.455257+0000","last_fullsized":"2023-11-26T07:20:33.455257+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:35.979098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455673+0000","last_change":"2023-11-26T07:20:32.365557+0000","last_active":"2023-11-26T07:20:33.455673+0000","last_peered":"2023-11-26T07:20:33.455673+0000","last_clean":"2023-11-26T07:20:33.455673+0000","last_became_active":"2023-11-26T07:20:32.363218+0000","last_became_peered":"2023-11-26T07:20:32.363218+0000","last_unstale":"2023-11-26T07:20:33.455673+0000","last_undegraded":"2023-11-26T07:20:33.455673+0000","last_fullsized":"2023-11-26T07:20:33.455673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:15.622376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455750+0000","last_change":"2023-11-26T07:20:32.361307+0000","last_active":"2023-11-26T07:20:33.455750+0000","last_peered":"2023-11-26T07:20:33.455750+0000","last_clean":"2023-11-26T07:20:33.455750+0000","last_became_active":"2023-11-26T07:20:32.361024+0000","last_became_peered":"2023-11-26T07:20:32.361024+0000","last_unstale":"2023-11-26T07:20:33.455750+0000","last_undegraded":"2023-11-26T07:20:33.455750+0000","last_fullsized":"2023-11-26T07:20:33.455750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:12.512344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455486+0000","last_change":"2023-11-26T07:20:32.355471+0000","last_active":"2023-11-26T07:20:33.455486+0000","last_peered":"2023-11-26T07:20:33.455486+0000","last_clean":"2023-11-26T07:20:33.455486+0000","last_became_active":"2023-11-26T07:20:32.355199+0000","last_became_peered":"2023-11-26T07:20:32.355199+0000","last_unstale":"2023-11-26T07:20:33.455486+0000","last_undegraded":"2023-11-26T07:20:33.455486+0000","last_fullsized":"2023-11-26T07:20:33.455486+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:53:00.482026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831855+0000","last_change":"2023-11-26T07:20:32.357665+0000","last_active":"2023-11-26T07:20:33.831855+0000","last_peered":"2023-11-26T07:20:33.831855+0000","last_clean":"2023-11-26T07:20:33.831855+0000","last_became_active":"2023-11-26T07:20:32.357238+0000","last_became_peered":"2023-11-26T07:20:32.357238+0000","last_unstale":"2023-11-26T07:20:33.831855+0000","last_undegraded":"2023-11-26T07:20:33.831855+0000","last_fullsized":"2023-11-26T07:20:33.831855+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:48:56.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.346985+0000","last_change":"2023-11-26T07:20:32.346103+0000","last_active":"2023-11-26T07:20:33.346985+0000","last_peered":"2023-11-26T07:20:33.346985+0000","last_clean":"2023-11-26T07:20:33.346985+0000","last_became_active":"2023-11-26T07:20:32.345779+0000","last_became_peered":"2023-11-26T07:20:32.345779+0000","last_unstale":"2023-11-26T07:20:33.346985+0000","last_undegraded":"2023-11-26T07:20:33.346985+0000","last_fullsized":"2023-11-26T07:20:33.346985+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:18.711290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455412+0000","last_change":"2023-11-26T07:20:32.351696+0000","last_active":"2023-11-26T07:20:33.455412+0000","last_peered":"2023-11-26T07:20:33.455412+0000","last_clean":"2023-11-26T07:20:33.455412+0000","last_became_active":"2023-11-26T07:20:32.351437+0000","last_became_peered":"2023-11-26T07:20:32.351437+0000","last_unstale":"2023-11-26T07:20:33.455412+0000","last_undegraded":"2023-11-26T07:20:33.455412+0000","last_fullsized":"2023-11-26T07:20:33.455412+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:15:20.052741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347273+0000","last_change":"2023-11-26T07:20:32.352593+0000","last_active":"2023-11-26T07:20:33.347273+0000","last_peered":"2023-11-26T07:20:33.347273+0000","last_clean":"2023-11-26T07:20:33.347273+0000","last_became_active":"2023-11-26T07:20:32.352333+0000","last_became_peered":"2023-11-26T07:20:32.352333+0000","last_unstale":"2023-11-26T07:20:33.347273+0000","last_undegraded":"2023-11-26T07:20:33.347273+0000","last_fullsized":"2023-11-26T07:20:33.347273+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:25.808089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.213892+0000","last_change":"2023-11-26T07:20:32.356824+0000","last_active":"2023-11-26T07:20:34.213892+0000","last_peered":"2023-11-26T07:20:34.213892+0000","last_clean":"2023-11-26T07:20:34.213892+0000","last_became_active":"2023-11-26T07:20:32.356300+0000","last_became_peered":"2023-11-26T07:20:32.356300+0000","last_unstale":"2023-11-26T07:20:34.213892+0000","last_undegraded":"2023-11-26T07:20:34.213892+0000","last_fullsized":"2023-11-26T07:20:34.213892+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:39.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215327+0000","last_change":"2023-11-26T07:20:32.351805+0000","last_active":"2023-11-26T07:20:34.215327+0000","last_peered":"2023-11-26T07:20:34.215327+0000","last_clean":"2023-11-26T07:20:34.215327+0000","last_became_active":"2023-11-26T07:20:32.351487+0000","last_became_peered":"2023-11-26T07:20:32.351487+0000","last_unstale":"2023-11-26T07:20:34.215327+0000","last_undegraded":"2023-11-26T07:20:34.215327+0000","last_fullsized":"2023-11-26T07:20:34.215327+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:48:56.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214230+0000","last_change":"2023-11-26T07:20:32.360617+0000","last_active":"2023-11-26T07:20:34.214230+0000","last_peered":"2023-11-26T07:20:34.214230+0000","last_clean":"2023-11-26T07:20:34.214230+0000","last_became_active":"2023-11-26T07:20:32.360199+0000","last_became_peered":"2023-11-26T07:20:32.360199+0000","last_unstale":"2023-11-26T07:20:34.214230+0000","last_undegraded":"2023-11-26T07:20:34.214230+0000","last_fullsized":"2023-11-26T07:20:34.214230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:46:22.057262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215002+0000","last_change":"2023-11-26T07:20:32.354172+0000","last_active":"2023-11-26T07:20:34.215002+0000","last_peered":"2023-11-26T07:20:34.215002+0000","last_clean":"2023-11-26T07:20:34.215002+0000","last_became_active":"2023-11-26T07:20:32.353733+0000","last_became_peered":"2023-11-26T07:20:32.353733+0000","last_unstale":"2023-11-26T07:20:34.215002+0000","last_undegraded":"2023-11-26T07:20:34.215002+0000","last_fullsized":"2023-11-26T07:20:34.215002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:32.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347400+0000","last_change":"2023-11-26T07:20:32.352549+0000","last_active":"2023-11-26T07:20:33.347400+0000","last_peered":"2023-11-26T07:20:33.347400+0000","last_clean":"2023-11-26T07:20:33.347400+0000","last_became_active":"2023-11-26T07:20:32.352257+0000","last_became_peered":"2023-11-26T07:20:32.352257+0000","last_unstale":"2023-11-26T07:20:33.347400+0000","last_undegraded":"2023-11-26T07:20:33.347400+0000","last_fullsized":"2023-11-26T07:20:33.347400+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:39.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347967+0000","last_change":"2023-11-26T07:20:32.355682+0000","last_active":"2023-11-26T07:20:33.347967+0000","last_peered":"2023-11-26T07:20:33.347967+0000","last_clean":"2023-11-26T07:20:33.347967+0000","last_became_active":"2023-11-26T07:20:32.355415+0000","last_became_peered":"2023-11-26T07:20:32.355415+0000","last_unstale":"2023-11-26T07:20:33.347967+0000","last_undegraded":"2023-11-26T07:20:33.347967+0000","last_fullsized":"2023-11-26T07:20:33.347967+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:44:31.947556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455502+0000","last_change":"2023-11-26T07:20:32.361621+0000","last_active":"2023-11-26T07:20:33.455502+0000","last_peered":"2023-11-26T07:20:33.455502+0000","last_clean":"2023-11-26T07:20:33.455502+0000","last_became_active":"2023-11-26T07:20:32.360558+0000","last_became_peered":"2023-11-26T07:20:32.360558+0000","last_unstale":"2023-11-26T07:20:33.455502+0000","last_undegraded":"2023-11-26T07:20:33.455502+0000","last_fullsized":"2023-11-26T07:20:33.455502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:18:00.866098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214158+0000","last_change":"2023-11-26T07:20:32.346234+0000","last_active":"2023-11-26T07:20:34.214158+0000","last_peered":"2023-11-26T07:20:34.214158+0000","last_clean":"2023-11-26T07:20:34.214158+0000","last_became_active":"2023-11-26T07:20:32.345799+0000","last_became_peered":"2023-11-26T07:20:32.345799+0000","last_unstale":"2023-11-26T07:20:34.214158+0000","last_undegraded":"2023-11-26T07:20:34.214158+0000","last_fullsized":"2023-11-26T07:20:34.214158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:48:56.147691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.213900+0000","last_change":"2023-11-26T07:20:32.357086+0000","last_active":"2023-11-26T07:20:34.213900+0000","last_peered":"2023-11-26T07:20:34.213900+0000","last_clean":"2023-11-26T07:20:34.213900+0000","last_became_active":"2023-11-26T07:20:32.356818+0000","last_became_peered":"2023-11-26T07:20:32.356818+0000","last_unstale":"2023-11-26T07:20:34.213900+0000","last_undegraded":"2023-11-26T07:20:34.213900+0000","last_fullsized":"2023-11-26T07:20:34.213900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:13.180733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215034+0000","last_change":"2023-11-26T07:20:32.363265+0000","last_active":"2023-11-26T07:20:34.215034+0000","last_peered":"2023-11-26T07:20:34.215034+0000","last_clean":"2023-11-26T07:20:34.215034+0000","last_became_active":"2023-11-26T07:20:32.363000+0000","last_became_peered":"2023-11-26T07:20:32.363000+0000","last_unstale":"2023-11-26T07:20:34.215034+0000","last_undegraded":"2023-11-26T07:20:34.215034+0000","last_fullsized":"2023-11-26T07:20:34.215034+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:23.534814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347101+0000","last_change":"2023-11-26T07:20:32.344942+0000","last_active":"2023-11-26T07:20:33.347101+0000","last_peered":"2023-11-26T07:20:33.347101+0000","last_clean":"2023-11-26T07:20:33.347101+0000","last_became_active":"2023-11-26T07:20:32.344679+0000","last_became_peered":"2023-11-26T07:20:32.344679+0000","last_unstale":"2023-11-26T07:20:33.347101+0000","last_undegraded":"2023-11-26T07:20:33.347101+0000","last_fullsized":"2023-11-26T07:20:33.347101+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:18.740673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214267+0000","last_change":"2023-11-26T07:20:32.350542+0000","last_active":"2023-11-26T07:20:34.214267+0000","last_peered":"2023-11-26T07:20:34.214267+0000","last_clean":"2023-11-26T07:20:34.214267+0000","last_became_active":"2023-11-26T07:20:32.350249+0000","last_became_peered":"2023-11-26T07:20:32.350249+0000","last_unstale":"2023-11-26T07:20:34.214267+0000","last_undegraded":"2023-11-26T07:20:34.214267+0000","last_fullsized":"2023-11-26T07:20:34.214267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:12.512344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831957+0000","last_change":"2023-11-26T07:20:32.348331+0000","last_active":"2023-11-26T07:20:33.831957+0000","last_peered":"2023-11-26T07:20:33.831957+0000","last_clean":"2023-11-26T07:20:33.831957+0000","last_became_active":"2023-11-26T07:20:32.347924+0000","last_became_peered":"2023-11-26T07:20:32.347924+0000","last_unstale":"2023-11-26T07:20:33.831957+0000","last_undegraded":"2023-11-26T07:20:33.831957+0000","last_fullsized":"2023-11-26T07:20:33.831957+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:04:21.912417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214307+0000","last_change":"2023-11-26T07:20:32.354436+0000","last_active":"2023-11-26T07:20:34.214307+0000","last_peered":"2023-11-26T07:20:34.214307+0000","last_clean":"2023-11-26T07:20:34.214307+0000","last_became_active":"2023-11-26T07:20:32.352913+0000","last_became_peered":"2023-11-26T07:20:32.352913+0000","last_unstale":"2023-11-26T07:20:34.214307+0000","last_undegraded":"2023-11-26T07:20:34.214307+0000","last_fullsized":"2023-11-26T07:20:34.214307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:25:40.680896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214195+0000","last_change":"2023-11-26T07:20:32.349921+0000","last_active":"2023-11-26T07:20:34.214195+0000","last_peered":"2023-11-26T07:20:34.214195+0000","last_clean":"2023-11-26T07:20:34.214195+0000","last_became_active":"2023-11-26T07:20:32.349625+0000","last_became_peered":"2023-11-26T07:20:32.349625+0000","last_unstale":"2023-11-26T07:20:34.214195+0000","last_undegraded":"2023-11-26T07:20:34.214195+0000","last_fullsized":"2023-11-26T07:20:34.214195+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:15.622376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347419+0000","last_change":"2023-11-26T07:20:32.351914+0000","last_active":"2023-11-26T07:20:33.347419+0000","last_peered":"2023-11-26T07:20:33.347419+0000","last_clean":"2023-11-26T07:20:33.347419+0000","last_became_active":"2023-11-26T07:20:32.351601+0000","last_became_peered":"2023-11-26T07:20:32.351601+0000","last_unstale":"2023-11-26T07:20:33.347419+0000","last_undegraded":"2023-11-26T07:20:33.347419+0000","last_fullsized":"2023-11-26T07:20:33.347419+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:52:07.666011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.346717+0000","last_change":"2023-11-26T07:20:32.341525+0000","last_active":"2023-11-26T07:20:33.346717+0000","last_peered":"2023-11-26T07:20:33.346717+0000","last_clean":"2023-11-26T07:20:33.346717+0000","last_became_active":"2023-11-26T07:20:32.341240+0000","last_became_peered":"2023-11-26T07:20:32.341240+0000","last_unstale":"2023-11-26T07:20:33.346717+0000","last_undegraded":"2023-11-26T07:20:33.346717+0000","last_fullsized":"2023-11-26T07:20:33.346717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:43:22.086098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348639+0000","last_change":"2023-11-26T07:20:32.351428+0000","last_active":"2023-11-26T07:20:33.348639+0000","last_peered":"2023-11-26T07:20:33.348639+0000","last_clean":"2023-11-26T07:20:33.348639+0000","last_became_active":"2023-11-26T07:20:32.351222+0000","last_became_peered":"2023-11-26T07:20:32.351222+0000","last_unstale":"2023-11-26T07:20:33.348639+0000","last_undegraded":"2023-11-26T07:20:33.348639+0000","last_fullsized":"2023-11-26T07:20:33.348639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:50.254389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375133+0000","last_change":"2023-11-26T07:20:31.345675+0000","last_active":"2023-11-26T07:20:32.375133+0000","last_peered":"2023-11-26T07:20:32.375133+0000","last_clean":"2023-11-26T07:20:32.375133+0000","last_became_active":"2023-11-26T07:20:31.344584+0000","last_became_peered":"2023-11-26T07:20:31.344584+0000","last_unstale":"2023-11-26T07:20:32.375133+0000","last_undegraded":"2023-11-26T07:20:32.375133+0000","last_fullsized":"2023-11-26T07:20:32.375133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:50.462959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215160+0000","last_change":"2023-11-26T07:20:32.353583+0000","last_active":"2023-11-26T07:20:34.215160+0000","last_peered":"2023-11-26T07:20:34.215160+0000","last_clean":"2023-11-26T07:20:34.215160+0000","last_became_active":"2023-11-26T07:20:32.353271+0000","last_became_peered":"2023-11-26T07:20:32.353271+0000","last_unstale":"2023-11-26T07:20:34.215160+0000","last_undegraded":"2023-11-26T07:20:34.215160+0000","last_fullsized":"2023-11-26T07:20:34.215160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:50.254389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373702+0000","last_change":"2023-11-26T07:20:31.343042+0000","last_active":"2023-11-26T07:20:32.373702+0000","last_peered":"2023-11-26T07:20:32.373702+0000","last_clean":"2023-11-26T07:20:32.373702+0000","last_became_active":"2023-11-26T07:20:31.342571+0000","last_became_peered":"2023-11-26T07:20:31.342571+0000","last_unstale":"2023-11-26T07:20:32.373702+0000","last_undegraded":"2023-11-26T07:20:32.373702+0000","last_fullsized":"2023-11-26T07:20:32.373702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:17:59.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831983+0000","last_change":"2023-11-26T07:20:32.354079+0000","last_active":"2023-11-26T07:20:33.831983+0000","last_peered":"2023-11-26T07:20:33.831983+0000","last_clean":"2023-11-26T07:20:33.831983+0000","last_became_active":"2023-11-26T07:20:32.353761+0000","last_became_peered":"2023-11-26T07:20:32.353761+0000","last_unstale":"2023-11-26T07:20:33.831983+0000","last_undegraded":"2023-11-26T07:20:33.831983+0000","last_fullsized":"2023-11-26T07:20:33.831983+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:43.631106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375053+0000","last_change":"2023-11-26T07:20:31.338674+0000","last_active":"2023-11-26T07:20:32.375053+0000","last_peered":"2023-11-26T07:20:32.375053+0000","last_clean":"2023-11-26T07:20:32.375053+0000","last_became_active":"2023-11-26T07:20:31.338407+0000","last_became_peered":"2023-11-26T07:20:31.338407+0000","last_unstale":"2023-11-26T07:20:32.375053+0000","last_undegraded":"2023-11-26T07:20:32.375053+0000","last_fullsized":"2023-11-26T07:20:32.375053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:31.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348774+0000","last_change":"2023-11-26T07:20:32.353555+0000","last_active":"2023-11-26T07:20:33.348774+0000","last_peered":"2023-11-26T07:20:33.348774+0000","last_clean":"2023-11-26T07:20:33.348774+0000","last_became_active":"2023-11-26T07:20:32.353052+0000","last_became_peered":"2023-11-26T07:20:32.353052+0000","last_unstale":"2023-11-26T07:20:33.348774+0000","last_undegraded":"2023-11-26T07:20:33.348774+0000","last_fullsized":"2023-11-26T07:20:33.348774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:35.979098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373607+0000","last_change":"2023-11-26T07:20:31.330956+0000","last_active":"2023-11-26T07:20:32.373607+0000","last_peered":"2023-11-26T07:20:32.373607+0000","last_clean":"2023-11-26T07:20:32.373607+0000","last_became_active":"2023-11-26T07:20:31.330649+0000","last_became_peered":"2023-11-26T07:20:31.330649+0000","last_unstale":"2023-11-26T07:20:32.373607+0000","last_undegraded":"2023-11-26T07:20:32.373607+0000","last_fullsized":"2023-11-26T07:20:32.373607+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:48:55.227637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214880+0000","last_change":"2023-11-26T07:20:32.358351+0000","last_active":"2023-11-26T07:20:34.214880+0000","last_peered":"2023-11-26T07:20:34.214880+0000","last_clean":"2023-11-26T07:20:34.214880+0000","last_became_active":"2023-11-26T07:20:32.358045+0000","last_became_peered":"2023-11-26T07:20:32.358045+0000","last_unstale":"2023-11-26T07:20:34.214880+0000","last_undegraded":"2023-11-26T07:20:34.214880+0000","last_fullsized":"2023-11-26T07:20:34.214880+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:06.549419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.374882+0000","last_change":"2023-11-26T07:20:31.345663+0000","last_active":"2023-11-26T07:20:32.374882+0000","last_peered":"2023-11-26T07:20:32.374882+0000","last_clean":"2023-11-26T07:20:32.374882+0000","last_became_active":"2023-11-26T07:20:31.345363+0000","last_became_peered":"2023-11-26T07:20:31.345363+0000","last_unstale":"2023-11-26T07:20:32.374882+0000","last_undegraded":"2023-11-26T07:20:32.374882+0000","last_fullsized":"2023-11-26T07:20:32.374882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:42.625357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455576+0000","last_change":"2023-11-26T07:20:32.358724+0000","last_active":"2023-11-26T07:20:33.455576+0000","last_peered":"2023-11-26T07:20:33.455576+0000","last_clean":"2023-11-26T07:20:33.455576+0000","last_became_active":"2023-11-26T07:20:32.358438+0000","last_became_peered":"2023-11-26T07:20:32.358438+0000","last_unstale":"2023-11-26T07:20:33.455576+0000","last_undegraded":"2023-11-26T07:20:33.455576+0000","last_fullsized":"2023-11-26T07:20:33.455576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:46:39.318881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.369898+0000","last_change":"2023-11-26T07:20:31.340363+0000","last_active":"2023-11-26T07:20:32.369898+0000","last_peered":"2023-11-26T07:20:32.369898+0000","last_clean":"2023-11-26T07:20:32.369898+0000","last_became_active":"2023-11-26T07:20:31.339785+0000","last_became_peered":"2023-11-26T07:20:31.339785+0000","last_unstale":"2023-11-26T07:20:32.369898+0000","last_undegraded":"2023-11-26T07:20:32.369898+0000","last_fullsized":"2023-11-26T07:20:32.369898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:31.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455336+0000","last_change":"2023-11-26T07:20:32.354715+0000","last_active":"2023-11-26T07:20:33.455336+0000","last_peered":"2023-11-26T07:20:33.455336+0000","last_clean":"2023-11-26T07:20:33.455336+0000","last_became_active":"2023-11-26T07:20:32.354281+0000","last_became_peered":"2023-11-26T07:20:32.354281+0000","last_unstale":"2023-11-26T07:20:33.455336+0000","last_undegraded":"2023-11-26T07:20:33.455336+0000","last_fullsized":"2023-11-26T07:20:33.455336+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:19:29.286838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.340345+0000","last_change":"2023-11-26T07:20:31.335203+0000","last_active":"2023-11-26T07:20:32.340345+0000","last_peered":"2023-11-26T07:20:32.340345+0000","last_clean":"2023-11-26T07:20:32.340345+0000","last_became_active":"2023-11-26T07:20:31.334608+0000","last_became_peered":"2023-11-26T07:20:31.334608+0000","last_unstale":"2023-11-26T07:20:32.340345+0000","last_undegraded":"2023-11-26T07:20:32.340345+0000","last_fullsized":"2023-11-26T07:20:32.340345+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:11.506595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.213898+0000","last_change":"2023-11-26T07:20:32.352522+0000","last_active":"2023-11-26T07:20:34.213898+0000","last_peered":"2023-11-26T07:20:34.213898+0000","last_clean":"2023-11-26T07:20:34.213898+0000","last_became_active":"2023-11-26T07:20:32.351941+0000","last_became_peered":"2023-11-26T07:20:32.351941+0000","last_unstale":"2023-11-26T07:20:34.213898+0000","last_undegraded":"2023-11-26T07:20:34.213898+0000","last_fullsized":"2023-11-26T07:20:34.213898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:42.255761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.346893+0000","last_change":"2023-11-26T07:20:31.342841+0000","last_active":"2023-11-26T07:20:32.346893+0000","last_peered":"2023-11-26T07:20:32.346893+0000","last_clean":"2023-11-26T07:20:32.346893+0000","last_became_active":"2023-11-26T07:20:31.342390+0000","last_became_peered":"2023-11-26T07:20:31.342390+0000","last_unstale":"2023-11-26T07:20:32.346893+0000","last_undegraded":"2023-11-26T07:20:32.346893+0000","last_fullsized":"2023-11-26T07:20:32.346893+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:22.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214409+0000","last_change":"2023-11-26T07:20:32.360421+0000","last_active":"2023-11-26T07:20:34.214409+0000","last_peered":"2023-11-26T07:20:34.214409+0000","last_clean":"2023-11-26T07:20:34.214409+0000","last_became_active":"2023-11-26T07:20:32.359832+0000","last_became_peered":"2023-11-26T07:20:32.359832+0000","last_unstale":"2023-11-26T07:20:34.214409+0000","last_undegraded":"2023-11-26T07:20:34.214409+0000","last_fullsized":"2023-11-26T07:20:34.214409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:11:22.276923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.340393+0000","last_change":"2023-11-26T07:20:31.338047+0000","last_active":"2023-11-26T07:20:32.340393+0000","last_peered":"2023-11-26T07:20:32.340393+0000","last_clean":"2023-11-26T07:20:32.340393+0000","last_became_active":"2023-11-26T07:20:31.337713+0000","last_became_peered":"2023-11-26T07:20:31.337713+0000","last_unstale":"2023-11-26T07:20:32.340393+0000","last_undegraded":"2023-11-26T07:20:32.340393+0000","last_fullsized":"2023-11-26T07:20:32.340393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:34.973349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214774+0000","last_change":"2023-11-26T07:20:32.352810+0000","last_active":"2023-11-26T07:20:34.214774+0000","last_peered":"2023-11-26T07:20:34.214774+0000","last_clean":"2023-11-26T07:20:34.214774+0000","last_became_active":"2023-11-26T07:20:32.352532+0000","last_became_peered":"2023-11-26T07:20:32.352532+0000","last_unstale":"2023-11-26T07:20:34.214774+0000","last_undegraded":"2023-11-26T07:20:34.214774+0000","last_fullsized":"2023-11-26T07:20:34.214774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:53.654216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.346167+0000","last_change":"2023-11-26T07:20:31.349927+0000","last_active":"2023-11-26T07:20:32.346167+0000","last_peered":"2023-11-26T07:20:32.346167+0000","last_clean":"2023-11-26T07:20:32.346167+0000","last_became_active":"2023-11-26T07:20:31.349594+0000","last_became_peered":"2023-11-26T07:20:31.349594+0000","last_unstale":"2023-11-26T07:20:32.346167+0000","last_undegraded":"2023-11-26T07:20:32.346167+0000","last_fullsized":"2023-11-26T07:20:32.346167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:53.731327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348559+0000","last_change":"2023-11-26T07:20:32.340748+0000","last_active":"2023-11-26T07:20:33.348559+0000","last_peered":"2023-11-26T07:20:33.348559+0000","last_clean":"2023-11-26T07:20:33.348559+0000","last_became_active":"2023-11-26T07:20:32.340498+0000","last_became_peered":"2023-11-26T07:20:32.340498+0000","last_unstale":"2023-11-26T07:20:33.348559+0000","last_undegraded":"2023-11-26T07:20:33.348559+0000","last_fullsized":"2023-11-26T07:20:33.348559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:06:13.721536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.374153+0000","last_change":"2023-11-26T07:20:31.343317+0000","last_active":"2023-11-26T07:20:32.374153+0000","last_peered":"2023-11-26T07:20:32.374153+0000","last_clean":"2023-11-26T07:20:32.374153+0000","last_became_active":"2023-11-26T07:20:31.342985+0000","last_became_peered":"2023-11-26T07:20:31.342985+0000","last_unstale":"2023-11-26T07:20:32.374153+0000","last_undegraded":"2023-11-26T07:20:32.374153+0000","last_fullsized":"2023-11-26T07:20:32.374153+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:03.506646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215202+0000","last_change":"2023-11-26T07:20:32.341768+0000","last_active":"2023-11-26T07:20:34.215202+0000","last_peered":"2023-11-26T07:20:34.215202+0000","last_clean":"2023-11-26T07:20:34.215202+0000","last_became_active":"2023-11-26T07:20:32.340867+0000","last_became_peered":"2023-11-26T07:20:32.340867+0000","last_unstale":"2023-11-26T07:20:34.215202+0000","last_undegraded":"2023-11-26T07:20:34.215202+0000","last_fullsized":"2023-11-26T07:20:34.215202+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:46:58.298705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.377724+0000","last_change":"2023-11-26T07:20:31.338018+0000","last_active":"2023-11-26T07:20:32.377724+0000","last_peered":"2023-11-26T07:20:32.377724+0000","last_clean":"2023-11-26T07:20:32.377724+0000","last_became_active":"2023-11-26T07:20:31.337739+0000","last_became_peered":"2023-11-26T07:20:31.337739+0000","last_unstale":"2023-11-26T07:20:32.377724+0000","last_undegraded":"2023-11-26T07:20:32.377724+0000","last_fullsized":"2023-11-26T07:20:32.377724+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:16:15.891428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214761+0000","last_change":"2023-11-26T07:20:32.353737+0000","last_active":"2023-11-26T07:20:34.214761+0000","last_peered":"2023-11-26T07:20:34.214761+0000","last_clean":"2023-11-26T07:20:34.214761+0000","last_became_active":"2023-11-26T07:20:32.353374+0000","last_became_peered":"2023-11-26T07:20:32.353374+0000","last_unstale":"2023-11-26T07:20:34.214761+0000","last_undegraded":"2023-11-26T07:20:34.214761+0000","last_fullsized":"2023-11-26T07:20:34.214761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:04:39.120163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373841+0000","last_change":"2023-11-26T07:20:31.349000+0000","last_active":"2023-11-26T07:20:32.373841+0000","last_peered":"2023-11-26T07:20:32.373841+0000","last_clean":"2023-11-26T07:20:32.373841+0000","last_became_active":"2023-11-26T07:20:31.348643+0000","last_became_peered":"2023-11-26T07:20:31.348643+0000","last_unstale":"2023-11-26T07:20:32.373841+0000","last_undegraded":"2023-11-26T07:20:32.373841+0000","last_fullsized":"2023-11-26T07:20:32.373841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:15.425814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455647+0000","last_change":"2023-11-26T07:20:32.358148+0000","last_active":"2023-11-26T07:20:33.455647+0000","last_peered":"2023-11-26T07:20:33.455647+0000","last_clean":"2023-11-26T07:20:33.455647+0000","last_became_active":"2023-11-26T07:20:32.357884+0000","last_became_peered":"2023-11-26T07:20:32.357884+0000","last_unstale":"2023-11-26T07:20:33.455647+0000","last_undegraded":"2023-11-26T07:20:33.455647+0000","last_fullsized":"2023-11-26T07:20:33.455647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:26.928757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.339132+0000","last_change":"2023-11-26T07:20:31.337492+0000","last_active":"2023-11-26T07:20:32.339132+0000","last_peered":"2023-11-26T07:20:32.339132+0000","last_clean":"2023-11-26T07:20:32.339132+0000","last_became_active":"2023-11-26T07:20:31.337199+0000","last_became_peered":"2023-11-26T07:20:31.337199+0000","last_unstale":"2023-11-26T07:20:32.339132+0000","last_undegraded":"2023-11-26T07:20:32.339132+0000","last_fullsized":"2023-11-26T07:20:32.339132+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:43:41.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347255+0000","last_change":"2023-11-26T07:20:32.342077+0000","last_active":"2023-11-26T07:20:33.347255+0000","last_peered":"2023-11-26T07:20:33.347255+0000","last_clean":"2023-11-26T07:20:33.347255+0000","last_became_active":"2023-11-26T07:20:32.341855+0000","last_became_peered":"2023-11-26T07:20:32.341855+0000","last_unstale":"2023-11-26T07:20:33.347255+0000","last_undegraded":"2023-11-26T07:20:33.347255+0000","last_fullsized":"2023-11-26T07:20:33.347255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:43:16.302808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336599+0000","last_change":"2023-11-26T07:20:31.347170+0000","last_active":"2023-11-26T07:20:32.336599+0000","last_peered":"2023-11-26T07:20:32.336599+0000","last_clean":"2023-11-26T07:20:32.336599+0000","last_became_active":"2023-11-26T07:20:31.346871+0000","last_became_peered":"2023-11-26T07:20:31.346871+0000","last_unstale":"2023-11-26T07:20:32.336599+0000","last_undegraded":"2023-11-26T07:20:32.336599+0000","last_fullsized":"2023-11-26T07:20:32.336599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:46:57.292956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215426+0000","last_change":"2023-11-26T07:20:32.356987+0000","last_active":"2023-11-26T07:20:34.215426+0000","last_peered":"2023-11-26T07:20:34.215426+0000","last_clean":"2023-11-26T07:20:34.215426+0000","last_became_active":"2023-11-26T07:20:32.356276+0000","last_became_peered":"2023-11-26T07:20:32.356276+0000","last_unstale":"2023-11-26T07:20:34.215426+0000","last_undegraded":"2023-11-26T07:20:34.215426+0000","last_fullsized":"2023-11-26T07:20:34.215426+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:52:07.666011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375590+0000","last_change":"2023-11-26T07:20:31.340365+0000","last_active":"2023-11-26T07:20:32.375590+0000","last_peered":"2023-11-26T07:20:32.375590+0000","last_clean":"2023-11-26T07:20:32.375590+0000","last_became_active":"2023-11-26T07:20:31.340077+0000","last_became_peered":"2023-11-26T07:20:31.340077+0000","last_unstale":"2023-11-26T07:20:32.375590+0000","last_undegraded":"2023-11-26T07:20:32.375590+0000","last_fullsized":"2023-11-26T07:20:32.375590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:04:38.114414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347202+0000","last_change":"2023-11-26T07:20:32.357326+0000","last_active":"2023-11-26T07:20:33.347202+0000","last_peered":"2023-11-26T07:20:33.347202+0000","last_clean":"2023-11-26T07:20:33.347202+0000","last_became_active":"2023-11-26T07:20:32.354403+0000","last_became_peered":"2023-11-26T07:20:32.354403+0000","last_unstale":"2023-11-26T07:20:33.347202+0000","last_undegraded":"2023-11-26T07:20:33.347202+0000","last_fullsized":"2023-11-26T07:20:33.347202+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:25.832716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373123+0000","last_change":"2023-11-26T07:20:31.340439+0000","last_active":"2023-11-26T07:20:32.373123+0000","last_peered":"2023-11-26T07:20:32.373123+0000","last_clean":"2023-11-26T07:20:32.373123+0000","last_became_active":"2023-11-26T07:20:31.337633+0000","last_became_peered":"2023-11-26T07:20:31.337633+0000","last_unstale":"2023-11-26T07:20:32.373123+0000","last_undegraded":"2023-11-26T07:20:32.373123+0000","last_fullsized":"2023-11-26T07:20:32.373123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:58:04.264264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455748+0000","last_change":"2023-11-26T07:20:32.361640+0000","last_active":"2023-11-26T07:20:33.455748+0000","last_peered":"2023-11-26T07:20:33.455748+0000","last_clean":"2023-11-26T07:20:33.455748+0000","last_became_active":"2023-11-26T07:20:32.361360+0000","last_became_peered":"2023-11-26T07:20:32.361360+0000","last_unstale":"2023-11-26T07:20:33.455748+0000","last_undegraded":"2023-11-26T07:20:33.455748+0000","last_fullsized":"2023-11-26T07:20:33.455748+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:46:22.057262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373824+0000","last_change":"2023-11-26T07:20:31.336961+0000","last_active":"2023-11-26T07:20:32.373824+0000","last_peered":"2023-11-26T07:20:32.373824+0000","last_clean":"2023-11-26T07:20:32.373824+0000","last_became_active":"2023-11-26T07:20:31.336663+0000","last_became_peered":"2023-11-26T07:20:31.336663+0000","last_unstale":"2023-11-26T07:20:32.373824+0000","last_undegraded":"2023-11-26T07:20:32.373824+0000","last_fullsized":"2023-11-26T07:20:32.373824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:52:59.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214166+0000","last_change":"2023-11-26T07:20:32.360174+0000","last_active":"2023-11-26T07:20:34.214166+0000","last_peered":"2023-11-26T07:20:34.214166+0000","last_clean":"2023-11-26T07:20:34.214166+0000","last_became_active":"2023-11-26T07:20:32.359129+0000","last_became_peered":"2023-11-26T07:20:32.359129+0000","last_unstale":"2023-11-26T07:20:34.214166+0000","last_undegraded":"2023-11-26T07:20:34.214166+0000","last_fullsized":"2023-11-26T07:20:34.214166+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:03.467443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.371672+0000","last_change":"2023-11-26T07:20:31.330081+0000","last_active":"2023-11-26T07:20:32.371672+0000","last_peered":"2023-11-26T07:20:32.371672+0000","last_clean":"2023-11-26T07:20:32.371672+0000","last_became_active":"2023-11-26T07:20:31.329778+0000","last_became_peered":"2023-11-26T07:20:31.329778+0000","last_unstale":"2023-11-26T07:20:32.371672+0000","last_undegraded":"2023-11-26T07:20:32.371672+0000","last_fullsized":"2023-11-26T07:20:32.371672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:25.923008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214758+0000","last_change":"2023-11-26T07:20:32.353121+0000","last_active":"2023-11-26T07:20:34.214758+0000","last_peered":"2023-11-26T07:20:34.214758+0000","last_clean":"2023-11-26T07:20:34.214758+0000","last_became_active":"2023-11-26T07:20:32.352789+0000","last_became_peered":"2023-11-26T07:20:32.352789+0000","last_unstale":"2023-11-26T07:20:34.214758+0000","last_undegraded":"2023-11-26T07:20:34.214758+0000","last_fullsized":"2023-11-26T07:20:34.214758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:54.737076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336176+0000","last_change":"2023-11-26T07:20:31.343251+0000","last_active":"2023-11-26T07:20:32.336176+0000","last_peered":"2023-11-26T07:20:32.336176+0000","last_clean":"2023-11-26T07:20:32.336176+0000","last_became_active":"2023-11-26T07:20:31.342942+0000","last_became_peered":"2023-11-26T07:20:31.342942+0000","last_unstale":"2023-11-26T07:20:32.336176+0000","last_undegraded":"2023-11-26T07:20:32.336176+0000","last_fullsized":"2023-11-26T07:20:32.336176+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:04:20.906669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347687+0000","last_change":"2023-11-26T07:20:32.354734+0000","last_active":"2023-11-26T07:20:33.347687+0000","last_peered":"2023-11-26T07:20:33.347687+0000","last_clean":"2023-11-26T07:20:33.347687+0000","last_became_active":"2023-11-26T07:20:32.354486+0000","last_became_peered":"2023-11-26T07:20:32.354486+0000","last_unstale":"2023-11-26T07:20:33.347687+0000","last_undegraded":"2023-11-26T07:20:33.347687+0000","last_fullsized":"2023-11-26T07:20:33.347687+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:18:33.614661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375171+0000","last_change":"2023-11-26T07:20:31.341608+0000","last_active":"2023-11-26T07:20:32.375171+0000","last_peered":"2023-11-26T07:20:32.375171+0000","last_clean":"2023-11-26T07:20:32.375171+0000","last_became_active":"2023-11-26T07:20:31.341101+0000","last_became_peered":"2023-11-26T07:20:31.341101+0000","last_unstale":"2023-11-26T07:20:32.375171+0000","last_undegraded":"2023-11-26T07:20:32.375171+0000","last_fullsized":"2023-11-26T07:20:32.375171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:52.648467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348267+0000","last_change":"2023-11-26T07:20:32.352865+0000","last_active":"2023-11-26T07:20:33.348267+0000","last_peered":"2023-11-26T07:20:33.348267+0000","last_clean":"2023-11-26T07:20:33.348267+0000","last_became_active":"2023-11-26T07:20:32.352442+0000","last_became_peered":"2023-11-26T07:20:32.352442+0000","last_unstale":"2023-11-26T07:20:33.348267+0000","last_undegraded":"2023-11-26T07:20:33.348267+0000","last_fullsized":"2023-11-26T07:20:33.348267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:23.534814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.338730+0000","last_change":"2023-11-26T07:20:31.339833+0000","last_active":"2023-11-26T07:20:32.338730+0000","last_peered":"2023-11-26T07:20:32.338730+0000","last_clean":"2023-11-26T07:20:32.338730+0000","last_became_active":"2023-11-26T07:20:31.339568+0000","last_became_peered":"2023-11-26T07:20:31.339568+0000","last_unstale":"2023-11-26T07:20:32.338730+0000","last_undegraded":"2023-11-26T07:20:32.338730+0000","last_fullsized":"2023-11-26T07:20:32.338730+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:46:38.313132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.346793+0000","last_change":"2023-11-26T07:20:32.343470+0000","last_active":"2023-11-26T07:20:33.346793+0000","last_peered":"2023-11-26T07:20:33.346793+0000","last_clean":"2023-11-26T07:20:33.346793+0000","last_became_active":"2023-11-26T07:20:32.343198+0000","last_became_peered":"2023-11-26T07:20:32.343198+0000","last_unstale":"2023-11-26T07:20:33.346793+0000","last_undegraded":"2023-11-26T07:20:33.346793+0000","last_fullsized":"2023-11-26T07:20:33.346793+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:46.676549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.339892+0000","last_change":"2023-11-26T07:20:31.349908+0000","last_active":"2023-11-26T07:20:32.339892+0000","last_peered":"2023-11-26T07:20:32.339892+0000","last_clean":"2023-11-26T07:20:32.339892+0000","last_became_active":"2023-11-26T07:20:31.349587+0000","last_became_peered":"2023-11-26T07:20:31.349587+0000","last_unstale":"2023-11-26T07:20:32.339892+0000","last_undegraded":"2023-11-26T07:20:32.339892+0000","last_fullsized":"2023-11-26T07:20:32.339892+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:38.145444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455350+0000","last_change":"2023-11-26T07:20:32.362306+0000","last_active":"2023-11-26T07:20:33.455350+0000","last_peered":"2023-11-26T07:20:33.455350+0000","last_clean":"2023-11-26T07:20:33.455350+0000","last_became_active":"2023-11-26T07:20:32.361999+0000","last_became_peered":"2023-11-26T07:20:32.361999+0000","last_unstale":"2023-11-26T07:20:33.455350+0000","last_undegraded":"2023-11-26T07:20:33.455350+0000","last_fullsized":"2023-11-26T07:20:33.455350+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:45:56.117030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336628+0000","last_change":"2023-11-26T07:20:31.337638+0000","last_active":"2023-11-26T07:20:32.336628+0000","last_peered":"2023-11-26T07:20:32.336628+0000","last_clean":"2023-11-26T07:20:32.336628+0000","last_became_active":"2023-11-26T07:20:31.337288+0000","last_became_peered":"2023-11-26T07:20:31.337288+0000","last_unstale":"2023-11-26T07:20:32.336628+0000","last_undegraded":"2023-11-26T07:20:32.336628+0000","last_fullsized":"2023-11-26T07:20:32.336628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:11:21.271174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215284+0000","last_change":"2023-11-26T07:20:32.362048+0000","last_active":"2023-11-26T07:20:34.215284+0000","last_peered":"2023-11-26T07:20:34.215284+0000","last_clean":"2023-11-26T07:20:34.215284+0000","last_became_active":"2023-11-26T07:20:32.361558+0000","last_became_peered":"2023-11-26T07:20:32.361558+0000","last_unstale":"2023-11-26T07:20:34.215284+0000","last_undegraded":"2023-11-26T07:20:34.215284+0000","last_fullsized":"2023-11-26T07:20:34.215284+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:35.979098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336268+0000","last_change":"2023-11-26T07:20:31.338667+0000","last_active":"2023-11-26T07:20:32.336268+0000","last_peered":"2023-11-26T07:20:32.336268+0000","last_clean":"2023-11-26T07:20:32.336268+0000","last_became_active":"2023-11-26T07:20:31.338353+0000","last_became_peered":"2023-11-26T07:20:31.338353+0000","last_unstale":"2023-11-26T07:20:32.336268+0000","last_undegraded":"2023-11-26T07:20:32.336268+0000","last_fullsized":"2023-11-26T07:20:32.336268+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:43:41.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455879+0000","last_change":"2023-11-26T07:20:32.354943+0000","last_active":"2023-11-26T07:20:33.455879+0000","last_peered":"2023-11-26T07:20:33.455879+0000","last_clean":"2023-11-26T07:20:33.455879+0000","last_became_active":"2023-11-26T07:20:32.354667+0000","last_became_peered":"2023-11-26T07:20:32.354667+0000","last_unstale":"2023-11-26T07:20:33.455879+0000","last_undegraded":"2023-11-26T07:20:33.455879+0000","last_fullsized":"2023-11-26T07:20:33.455879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:04.512395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336669+0000","last_change":"2023-11-26T07:20:31.344903+0000","last_active":"2023-11-26T07:20:32.336669+0000","last_peered":"2023-11-26T07:20:32.336669+0000","last_clean":"2023-11-26T07:20:32.336669+0000","last_became_active":"2023-11-26T07:20:31.342846+0000","last_became_peered":"2023-11-26T07:20:31.342846+0000","last_unstale":"2023-11-26T07:20:32.336669+0000","last_undegraded":"2023-11-26T07:20:32.336669+0000","last_fullsized":"2023-11-26T07:20:32.336669+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:05.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215353+0000","last_change":"2023-11-26T07:20:32.353352+0000","last_active":"2023-11-26T07:20:34.215353+0000","last_peered":"2023-11-26T07:20:34.215353+0000","last_clean":"2023-11-26T07:20:34.215353+0000","last_became_active":"2023-11-26T07:20:32.353086+0000","last_became_peered":"2023-11-26T07:20:32.353086+0000","last_unstale":"2023-11-26T07:20:34.215353+0000","last_undegraded":"2023-11-26T07:20:34.215353+0000","last_fullsized":"2023-11-26T07:20:34.215353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:25.808089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.334054+0000","last_change":"2023-11-26T07:20:31.338609+0000","last_active":"2023-11-26T07:20:32.334054+0000","last_peered":"2023-11-26T07:20:32.334054+0000","last_clean":"2023-11-26T07:20:32.334054+0000","last_became_active":"2023-11-26T07:20:31.338194+0000","last_became_peered":"2023-11-26T07:20:31.338194+0000","last_unstale":"2023-11-26T07:20:32.334054+0000","last_undegraded":"2023-11-26T07:20:32.334054+0000","last_fullsized":"2023-11-26T07:20:32.334054+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:04:38.114414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347813+0000","last_change":"2023-11-26T07:20:32.350151+0000","last_active":"2023-11-26T07:20:33.347813+0000","last_peered":"2023-11-26T07:20:33.347813+0000","last_clean":"2023-11-26T07:20:33.347813+0000","last_became_active":"2023-11-26T07:20:32.347182+0000","last_became_peered":"2023-11-26T07:20:32.347182+0000","last_unstale":"2023-11-26T07:20:33.347813+0000","last_undegraded":"2023-11-26T07:20:33.347813+0000","last_fullsized":"2023-11-26T07:20:33.347813+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:04:09.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.337045+0000","last_change":"2023-11-26T07:20:31.347117+0000","last_active":"2023-11-26T07:20:32.337045+0000","last_peered":"2023-11-26T07:20:32.337045+0000","last_clean":"2023-11-26T07:20:32.337045+0000","last_became_active":"2023-11-26T07:20:31.346824+0000","last_became_peered":"2023-11-26T07:20:31.346824+0000","last_unstale":"2023-11-26T07:20:32.337045+0000","last_undegraded":"2023-11-26T07:20:32.337045+0000","last_fullsized":"2023-11-26T07:20:32.337045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:54.279174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348077+0000","last_change":"2023-11-26T07:20:32.352151+0000","last_active":"2023-11-26T07:20:33.348077+0000","last_peered":"2023-11-26T07:20:33.348077+0000","last_clean":"2023-11-26T07:20:33.348077+0000","last_became_active":"2023-11-26T07:20:32.345134+0000","last_became_peered":"2023-11-26T07:20:32.345134+0000","last_unstale":"2023-11-26T07:20:33.348077+0000","last_undegraded":"2023-11-26T07:20:33.348077+0000","last_fullsized":"2023-11-26T07:20:33.348077+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:52.555460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.339230+0000","last_change":"2023-11-26T07:20:31.341950+0000","last_active":"2023-11-26T07:20:32.339230+0000","last_peered":"2023-11-26T07:20:32.339230+0000","last_clean":"2023-11-26T07:20:32.339230+0000","last_became_active":"2023-11-26T07:20:31.341681+0000","last_became_peered":"2023-11-26T07:20:31.341681+0000","last_unstale":"2023-11-26T07:20:32.339230+0000","last_undegraded":"2023-11-26T07:20:32.339230+0000","last_fullsized":"2023-11-26T07:20:32.339230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:22.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831624+0000","last_change":"2023-11-26T07:20:32.350202+0000","last_active":"2023-11-26T07:20:33.831624+0000","last_peered":"2023-11-26T07:20:33.831624+0000","last_clean":"2023-11-26T07:20:33.831624+0000","last_became_active":"2023-11-26T07:20:32.349797+0000","last_became_peered":"2023-11-26T07:20:32.349797+0000","last_unstale":"2023-11-26T07:20:33.831624+0000","last_undegraded":"2023-11-26T07:20:33.831624+0000","last_fullsized":"2023-11-26T07:20:33.831624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:04.512395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.333956+0000","last_change":"2023-11-26T07:20:31.343570+0000","last_active":"2023-11-26T07:20:32.333956+0000","last_peered":"2023-11-26T07:20:32.333956+0000","last_clean":"2023-11-26T07:20:32.333956+0000","last_became_active":"2023-11-26T07:20:31.343238+0000","last_became_peered":"2023-11-26T07:20:31.343238+0000","last_unstale":"2023-11-26T07:20:32.333956+0000","last_undegraded":"2023-11-26T07:20:32.333956+0000","last_fullsized":"2023-11-26T07:20:32.333956+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:53.731327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214410+0000","last_change":"2023-11-26T07:20:32.351984+0000","last_active":"2023-11-26T07:20:34.214410+0000","last_peered":"2023-11-26T07:20:34.214410+0000","last_clean":"2023-11-26T07:20:34.214410+0000","last_became_active":"2023-11-26T07:20:32.351681+0000","last_became_peered":"2023-11-26T07:20:32.351681+0000","last_unstale":"2023-11-26T07:20:34.214410+0000","last_undegraded":"2023-11-26T07:20:34.214410+0000","last_fullsized":"2023-11-26T07:20:34.214410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:04.512395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.346722+0000","last_change":"2023-11-26T07:20:31.342258+0000","last_active":"2023-11-26T07:20:32.346722+0000","last_peered":"2023-11-26T07:20:32.346722+0000","last_clean":"2023-11-26T07:20:32.346722+0000","last_became_active":"2023-11-26T07:20:31.341991+0000","last_became_peered":"2023-11-26T07:20:31.341991+0000","last_unstale":"2023-11-26T07:20:32.346722+0000","last_undegraded":"2023-11-26T07:20:32.346722+0000","last_fullsized":"2023-11-26T07:20:32.346722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:31.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455796+0000","last_change":"2023-11-26T07:20:32.359336+0000","last_active":"2023-11-26T07:20:33.455796+0000","last_peered":"2023-11-26T07:20:33.455796+0000","last_clean":"2023-11-26T07:20:33.455796+0000","last_became_active":"2023-11-26T07:20:32.358622+0000","last_became_peered":"2023-11-26T07:20:32.358622+0000","last_unstale":"2023-11-26T07:20:33.455796+0000","last_undegraded":"2023-11-26T07:20:33.455796+0000","last_fullsized":"2023-11-26T07:20:33.455796+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:11:22.276923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.372456+0000","last_change":"2023-11-26T07:20:31.341968+0000","last_active":"2023-11-26T07:20:32.372456+0000","last_peered":"2023-11-26T07:20:32.372456+0000","last_clean":"2023-11-26T07:20:32.372456+0000","last_became_active":"2023-11-26T07:20:31.341623+0000","last_became_peered":"2023-11-26T07:20:31.341623+0000","last_unstale":"2023-11-26T07:20:32.372456+0000","last_undegraded":"2023-11-26T07:20:32.372456+0000","last_fullsized":"2023-11-26T07:20:32.372456+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:14.616628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.337230+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:20:32.337230+0000","last_peered":"2023-11-26T07:20:32.337230+0000","last_clean":"2023-11-26T07:20:32.337230+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:20:32.337230+0000","last_undegraded":"2023-11-26T07:20:32.337230+0000","last_fullsized":"2023-11-26T07:20:32.337230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":822569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.61299999999999999},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63,"15min":0.624},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.874,"5min":0.876,"15min":0.876},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83899999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.90000000000000002,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.877,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.52300000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.875,"5min":1.923,"15min":1.923},"last":0.376}]},{"osd":5,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84799999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92800000000000005,"5min":1,"15min":1},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77900000000000003,"15min":0.79000000000000004},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89900000000000002,"5min":1.863,"15min":1.863},"last":0.42499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":232783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.48299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.54800000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.747,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.85199999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70999999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91400000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.754},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98899999999999999,"5min":1.089,"15min":1.089},"last":0.76800000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.57399999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93100000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95399999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.42099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":1.018,"15min":1.018},"last":0.56299999999999994}]},{"osd":5,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90900000000000003,"5min":1.133,"15min":1.133},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73799999999999999,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92600000000000005,"5min":1.042,"15min":1.042},"last":0.499}]},{"osd":7,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92700000000000005,"5min":1.196,"15min":1.196},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80200000000000005,"15min":0.81599999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0249999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":569344,"data_stored":232181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.99099999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":1.02,"15min":1.077},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0980000000000001,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.745}]},{"osd":1,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":1.0960000000000001,"15min":1.1519999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.591,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.629},{"interface":"front","average":{"1min":1.111,"5min":1.0269999999999999,"15min":1.0129999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":8.2720000000000002,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.81200000000000006}]},{"osd":2,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.88500000000000001,"15min":0.84299999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.995,"15min":1.0469999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.133,"15min":1.1970000000000001},"min":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.544,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.157,"5min":1.2190000000000001,"15min":1.2290000000000001},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4039999999999999,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.85799999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.96299999999999997,"15min":1.0209999999999999},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.0840000000000001,"15min":1.1379999999999999},"min":{"1min":0.497,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.635,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.94799999999999995,"15min":0.91400000000000003},"min":{"1min":0.54500000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":8.3640000000000008,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":1.9850000000000001,"15min":2.1930000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0009999999999999,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.79800000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":1.204,"15min":1.27},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.679,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2529999999999999,"15min":1.2629999999999999},"min":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":8.4410000000000007,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.89300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":233723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.87}]},{"osd":2,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.51900000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.751,"15min":0.754},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.74199999999999999,"15min":0.73199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.62}]},{"osd":6,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81499999999999995,"15min":0.83199999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0900000000000001,"5min":1.095,"15min":1.095},"last":0.90100000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.82399999999999995,"15min":0.80600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.751}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":577536,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.432,"15min":0.436},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.438},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.62,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65200000000000002,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.67200000000000004,"15min":0.70199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72999999999999998,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.35199999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.86499999999999999,"15min":0.90600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83099999999999996,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89900000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.92800000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.873,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85699999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88700000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.90700000000000003,"15min":0.94699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.85999999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.92800000000000005,"15min":0.97399999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.86199999999999999,"5min":3.476,"15min":3.476},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.81999999999999995,"5min":1.03,"15min":1.03},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":581632,"data_stored":233745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40799999999999997,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.434,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55200000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.54100000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.746,"15min":0.746},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.61599999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.258,"15min":1.258},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1339999999999999,"5min":1.169,"15min":1.169},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0109999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0209999999999999,"5min":1.24,"15min":1.24},"last":0.84799999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0549999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0880000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":569344,"data_stored":232181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54800000000000004,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.51200000000000001,"15min":0.52600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68200000000000005,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.56399999999999995,"15min":0.57899999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68799999999999994,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.748,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.56100000000000005,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.38800000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94299999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93899999999999995,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97999999999999998,"5min":1.329,"15min":1.329},"last":0.625},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.749},"min":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.097,"5min":1.101,"15min":1.101},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84899999999999998,"15min":0.86399999999999999},"min":{"1min":0.58399999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96199999999999997,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0860000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95099999999999996,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0580000000000001,"5min":1.173,"15min":1.173},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":822513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.61399999999999999,"15min":0.65200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73999999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69299999999999995,"5min":2.415,"15min":2.415},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.72299999999999998,"15min":0.76200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":5.234,"15min":5.234},"last":0.38400000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":3.726,"15min":3.726},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.496,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.94299999999999995,"15min":0.98399999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.89100000000000001,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.82499999999999996,"15min":0.84599999999999997},"min":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91100000000000003,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.878,"5min":2.835,"15min":2.835},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.97399999999999998,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.874,"15min":0.90100000000000002},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.755},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":0.86699999999999999},"min":{"1min":0.55100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.59099999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.88100000000000001,"15min":0.90600000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1379999999999999,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.85399999999999998,"15min":0.879},"min":{"1min":0.55900000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.081,"5min":2.798,"15min":2.798},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:20:36.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:20:36.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa098757640 1 Processor -- start 2023-11-26T07:20:36.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa098757640 1 -- start start 2023-11-26T07:20:36.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa098757640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa0900b2160 0x7fa0900d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa098757640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900cf0e0 con 0x7fa09015d6e0 2023-11-26T07:20:36.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa098757640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900ceb20 con 0x7fa0900d1bc0 2023-11-26T07:20:36.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa098757640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09015dac0 con 0x7fa0900b2160 2023-11-26T07:20:36.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa0964f3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa09015d6e0 0x7fa0900d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41924/0 (socket says 172.21.15.70:41924) 2023-11-26T07:20:36.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa0964f3640 1 -- 172.21.15.70:0/1700641388 learned_addr learned my addr 172.21.15.70:0/1700641388 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:36.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa096cf4640 1 --2- 172.21.15.70:0/1700641388 >> v2:172.21.15.70:3300/0 conn(0x7fa0900b2160 0x7fa0900d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa0954f1640 1 -- 172.21.15.70:0/1700641388 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958149272 0 0) 0x7fa0900cf0e0 con 0x7fa09015d6e0 2023-11-26T07:20:36.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa0954f1640 1 -- 172.21.15.70:0/1700641388 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa07c003530 con 0x7fa09015d6e0 2023-11-26T07:20:36.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa096cf4640 1 -- 172.21.15.70:0/1700641388 >> v1:172.21.15.120:6789/0 conn(0x7fa0900d1bc0 legacy=0x7fa0900b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:36.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa096cf4640 1 -- 172.21.15.70:0/1700641388 >> v1:172.21.15.70:6789/0 conn(0x7fa09015d6e0 legacy=0x7fa0900d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.582+0000 7fa096cf4640 1 -- 172.21.15.70:0/1700641388 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900cee00 con 0x7fa0900b2160 2023-11-26T07:20:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa096cf4640 1 --2- 172.21.15.70:0/1700641388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900d0df0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa088009d90 tx=0x7fa08801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819890f6884d6f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa0954f1640 1 -- 172.21.15.70:0/1700641388 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880a58c0 con 0x7fa0900b2160 2023-11-26T07:20:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa0954f1640 1 -- 172.21.15.70:0/1700641388 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0880a5a20 con 0x7fa0900b2160 2023-11-26T07:20:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa0954f1640 1 -- 172.21.15.70:0/1700641388 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880a5db0 con 0x7fa0900b2160 2023-11-26T07:20:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa098757640 1 -- 172.21.15.70:0/1700641388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 msgr2=0x7fa0900d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa098757640 1 --2- 172.21.15.70:0/1700641388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900d0df0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa088009d90 tx=0x7fa08801c910 comp rx=0 tx=0).stop 2023-11-26T07:20:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa098757640 1 -- 172.21.15.70:0/1700641388 shutdown_connections 2023-11-26T07:20:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa098757640 1 --2- 172.21.15.70:0/1700641388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900d0df0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa098757640 1 -- 172.21.15.70:0/1700641388 >> 172.21.15.70:0/1700641388 conn(0x7fa09009c550 msgr2=0x7fa0900d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa098757640 1 -- 172.21.15.70:0/1700641388 shutdown_connections 2023-11-26T07:20:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.586+0000 7fa098757640 1 -- 172.21.15.70:0/1700641388 wait complete. 2023-11-26T07:20:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 Processor -- start 2023-11-26T07:20:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 -- start start 2023-11-26T07:20:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa0900d1bc0 0x7fa0900b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa09015d6e0 0x7fa090153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900b8100 con 0x7fa0900b2160 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900b83e0 con 0x7fa09015d6e0 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0900b86c0 con 0x7fa0900d1bc0 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34212/0 (socket says 172.21.15.70:34212) 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 -- 172.21.15.70:0/2972797222 learned_addr learned my addr 172.21.15.70:0/2972797222 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 -- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa0900d1bc0 msgr2=0x7fa0900b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa095cf2640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa0900d1bc0 0x7fa0900b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa096cf4640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa09015d6e0 0x7fa090153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa0900d1bc0 0x7fa0900b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 -- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa09015d6e0 msgr2=0x7fa090153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa09015d6e0 0x7fa090153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 -- 172.21.15.70:0/2972797222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088009a70 con 0x7fa0900b2160 2023-11-26T07:20:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa095cf2640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa0900d1bc0 0x7fa0900b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa096cf4640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa09015d6e0 0x7fa090153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa0964f3640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900b7550 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c420 tx=0x7fa08c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa086ffd640 1 -- 172.21.15.70:0/2972797222 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c005cf0 con 0x7fa0900b2160 2023-11-26T07:20:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa086ffd640 1 -- 172.21.15.70:0/2972797222 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c005e50 con 0x7fa0900b2160 2023-11-26T07:20:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa086ffd640 1 -- 172.21.15.70:0/2972797222 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c0072d0 con 0x7fa0900b2160 2023-11-26T07:20:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0900b89a0 con 0x7fa0900b2160 2023-11-26T07:20:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa090154530 con 0x7fa0900b2160 2023-11-26T07:20:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.590+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa090067680 con 0x7fa0900b2160 2023-11-26T07:20:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.594+0000 7fa086ffd640 1 -- 172.21.15.70:0/2972797222 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fa08c007430 con 0x7fa0900b2160 2023-11-26T07:20:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.594+0000 7fa086ffd640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa074066740 0x7fa074068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.594+0000 7fa086ffd640 1 -- 172.21.15.70:0/2972797222 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa08c0837f0 con 0x7fa0900b2160 2023-11-26T07:20:36.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.594+0000 7fa095cf2640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa074066740 0x7fa074068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.594+0000 7fa095cf2640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa074066740 0x7fa074068c00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa0900d3660 tx=0x7fa080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.598+0000 7fa086ffd640 1 -- 172.21.15.70:0/2972797222 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa08c050940 con 0x7fa0900b2160 2023-11-26T07:20:36.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.746+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0900b8550 con 0x7fa074066740 2023-11-26T07:20:36.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.754+0000 7fa086ffd640 1 -- 172.21.15.70:0/2972797222 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289158 (secure 0 0 0) 0x7fa0900b8550 con 0x7fa074066740 2023-11-26T07:20:36.758 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:36.762 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:20:36.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa074066740 msgr2=0x7fa074068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa074066740 0x7fa074068c00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa0900d3660 tx=0x7fa080009040 comp rx=0 tx=0).stop 2023-11-26T07:20:36.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 msgr2=0x7fa0900b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900b7550 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c420 tx=0x7fa08c00c8e0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 shutdown_connections 2023-11-26T07:20:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa09015d6e0 0x7fa090153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa0900d1bc0 0x7fa0900b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa074066740 0x7fa074068c00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 --2- 172.21.15.70:0/2972797222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0900b2160 0x7fa0900b7550 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 >> 172.21.15.70:0/2972797222 conn(0x7fa09009c550 msgr2=0x7fa0900b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:36.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 shutdown_connections 2023-11-26T07:20:36.765 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.758+0000 7fa098757640 1 -- 172.21.15.70:0/2972797222 wait complete. 2023-11-26T07:20:36.778 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2023-11-26T07:20:36.023933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242628,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732092,"statfs":{"total":773094113280,"available":772845662208,"internally_reserved":0,"allocated":5775360,"data_stored":3042444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709489"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214620+0000","last_change":"2023-11-26T07:20:32.349236+0000","last_active":"2023-11-26T07:20:34.214620+0000","last_peered":"2023-11-26T07:20:34.214620+0000","last_clean":"2023-11-26T07:20:34.214620+0000","last_became_active":"2023-11-26T07:20:32.348176+0000","last_became_peered":"2023-11-26T07:20:32.348176+0000","last_unstale":"2023-11-26T07:20:34.214620+0000","last_undegraded":"2023-11-26T07:20:34.214620+0000","last_fullsized":"2023-11-26T07:20:34.214620+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:51.468708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831949+0000","last_change":"2023-11-26T07:20:32.350170+0000","last_active":"2023-11-26T07:20:33.831949+0000","last_peered":"2023-11-26T07:20:33.831949+0000","last_clean":"2023-11-26T07:20:33.831949+0000","last_became_active":"2023-11-26T07:20:32.349739+0000","last_became_peered":"2023-11-26T07:20:32.349739+0000","last_unstale":"2023-11-26T07:20:33.831949+0000","last_undegraded":"2023-11-26T07:20:33.831949+0000","last_fullsized":"2023-11-26T07:20:33.831949+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:55.284923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214117+0000","last_change":"2023-11-26T07:20:32.358424+0000","last_active":"2023-11-26T07:20:34.214117+0000","last_peered":"2023-11-26T07:20:34.214117+0000","last_clean":"2023-11-26T07:20:34.214117+0000","last_became_active":"2023-11-26T07:20:32.358138+0000","last_became_peered":"2023-11-26T07:20:32.358138+0000","last_unstale":"2023-11-26T07:20:34.214117+0000","last_undegraded":"2023-11-26T07:20:34.214117+0000","last_fullsized":"2023-11-26T07:20:34.214117+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:26.928757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455933+0000","last_change":"2023-11-26T07:20:32.359170+0000","last_active":"2023-11-26T07:20:33.455933+0000","last_peered":"2023-11-26T07:20:33.455933+0000","last_clean":"2023-11-26T07:20:33.455933+0000","last_became_active":"2023-11-26T07:20:32.358919+0000","last_became_peered":"2023-11-26T07:20:32.358919+0000","last_unstale":"2023-11-26T07:20:33.455933+0000","last_undegraded":"2023-11-26T07:20:33.455933+0000","last_fullsized":"2023-11-26T07:20:33.455933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:06.549419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831726+0000","last_change":"2023-11-26T07:20:32.359502+0000","last_active":"2023-11-26T07:20:33.831726+0000","last_peered":"2023-11-26T07:20:33.831726+0000","last_clean":"2023-11-26T07:20:33.831726+0000","last_became_active":"2023-11-26T07:20:32.359192+0000","last_became_peered":"2023-11-26T07:20:32.359192+0000","last_unstale":"2023-11-26T07:20:33.831726+0000","last_undegraded":"2023-11-26T07:20:33.831726+0000","last_fullsized":"2023-11-26T07:20:33.831726+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:06.549419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347578+0000","last_change":"2023-11-26T07:20:32.354205+0000","last_active":"2023-11-26T07:20:33.347578+0000","last_peered":"2023-11-26T07:20:33.347578+0000","last_clean":"2023-11-26T07:20:33.347578+0000","last_became_active":"2023-11-26T07:20:32.347611+0000","last_became_peered":"2023-11-26T07:20:32.347611+0000","last_unstale":"2023-11-26T07:20:33.347578+0000","last_undegraded":"2023-11-26T07:20:33.347578+0000","last_fullsized":"2023-11-26T07:20:33.347578+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:51:39.726313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215284+0000","last_change":"2023-11-26T07:20:32.344423+0000","last_active":"2023-11-26T07:20:34.215284+0000","last_peered":"2023-11-26T07:20:34.215284+0000","last_clean":"2023-11-26T07:20:34.215284+0000","last_became_active":"2023-11-26T07:20:32.344040+0000","last_became_peered":"2023-11-26T07:20:32.344040+0000","last_unstale":"2023-11-26T07:20:34.215284+0000","last_undegraded":"2023-11-26T07:20:34.215284+0000","last_fullsized":"2023-11-26T07:20:34.215284+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:43:16.302808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455257+0000","last_change":"2023-11-26T07:20:32.354539+0000","last_active":"2023-11-26T07:20:33.455257+0000","last_peered":"2023-11-26T07:20:33.455257+0000","last_clean":"2023-11-26T07:20:33.455257+0000","last_became_active":"2023-11-26T07:20:32.353940+0000","last_became_peered":"2023-11-26T07:20:32.353940+0000","last_unstale":"2023-11-26T07:20:33.455257+0000","last_undegraded":"2023-11-26T07:20:33.455257+0000","last_fullsized":"2023-11-26T07:20:33.455257+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:35.979098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455673+0000","last_change":"2023-11-26T07:20:32.365557+0000","last_active":"2023-11-26T07:20:33.455673+0000","last_peered":"2023-11-26T07:20:33.455673+0000","last_clean":"2023-11-26T07:20:33.455673+0000","last_became_active":"2023-11-26T07:20:32.363218+0000","last_became_peered":"2023-11-26T07:20:32.363218+0000","last_unstale":"2023-11-26T07:20:33.455673+0000","last_undegraded":"2023-11-26T07:20:33.455673+0000","last_fullsized":"2023-11-26T07:20:33.455673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:15.622376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455750+0000","last_change":"2023-11-26T07:20:32.361307+0000","last_active":"2023-11-26T07:20:33.455750+0000","last_peered":"2023-11-26T07:20:33.455750+0000","last_clean":"2023-11-26T07:20:33.455750+0000","last_became_active":"2023-11-26T07:20:32.361024+0000","last_became_peered":"2023-11-26T07:20:32.361024+0000","last_unstale":"2023-11-26T07:20:33.455750+0000","last_undegraded":"2023-11-26T07:20:33.455750+0000","last_fullsized":"2023-11-26T07:20:33.455750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:12.512344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455486+0000","last_change":"2023-11-26T07:20:32.355471+0000","last_active":"2023-11-26T07:20:33.455486+0000","last_peered":"2023-11-26T07:20:33.455486+0000","last_clean":"2023-11-26T07:20:33.455486+0000","last_became_active":"2023-11-26T07:20:32.355199+0000","last_became_peered":"2023-11-26T07:20:32.355199+0000","last_unstale":"2023-11-26T07:20:33.455486+0000","last_undegraded":"2023-11-26T07:20:33.455486+0000","last_fullsized":"2023-11-26T07:20:33.455486+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:53:00.482026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831855+0000","last_change":"2023-11-26T07:20:32.357665+0000","last_active":"2023-11-26T07:20:33.831855+0000","last_peered":"2023-11-26T07:20:33.831855+0000","last_clean":"2023-11-26T07:20:33.831855+0000","last_became_active":"2023-11-26T07:20:32.357238+0000","last_became_peered":"2023-11-26T07:20:32.357238+0000","last_unstale":"2023-11-26T07:20:33.831855+0000","last_undegraded":"2023-11-26T07:20:33.831855+0000","last_fullsized":"2023-11-26T07:20:33.831855+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:48:56.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.346985+0000","last_change":"2023-11-26T07:20:32.346103+0000","last_active":"2023-11-26T07:20:33.346985+0000","last_peered":"2023-11-26T07:20:33.346985+0000","last_clean":"2023-11-26T07:20:33.346985+0000","last_became_active":"2023-11-26T07:20:32.345779+0000","last_became_peered":"2023-11-26T07:20:32.345779+0000","last_unstale":"2023-11-26T07:20:33.346985+0000","last_undegraded":"2023-11-26T07:20:33.346985+0000","last_fullsized":"2023-11-26T07:20:33.346985+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:18.711290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455412+0000","last_change":"2023-11-26T07:20:32.351696+0000","last_active":"2023-11-26T07:20:33.455412+0000","last_peered":"2023-11-26T07:20:33.455412+0000","last_clean":"2023-11-26T07:20:33.455412+0000","last_became_active":"2023-11-26T07:20:32.351437+0000","last_became_peered":"2023-11-26T07:20:32.351437+0000","last_unstale":"2023-11-26T07:20:33.455412+0000","last_undegraded":"2023-11-26T07:20:33.455412+0000","last_fullsized":"2023-11-26T07:20:33.455412+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:15:20.052741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347273+0000","last_change":"2023-11-26T07:20:32.352593+0000","last_active":"2023-11-26T07:20:33.347273+0000","last_peered":"2023-11-26T07:20:33.347273+0000","last_clean":"2023-11-26T07:20:33.347273+0000","last_became_active":"2023-11-26T07:20:32.352333+0000","last_became_peered":"2023-11-26T07:20:32.352333+0000","last_unstale":"2023-11-26T07:20:33.347273+0000","last_undegraded":"2023-11-26T07:20:33.347273+0000","last_fullsized":"2023-11-26T07:20:33.347273+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:25.808089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.213892+0000","last_change":"2023-11-26T07:20:32.356824+0000","last_active":"2023-11-26T07:20:34.213892+0000","last_peered":"2023-11-26T07:20:34.213892+0000","last_clean":"2023-11-26T07:20:34.213892+0000","last_became_active":"2023-11-26T07:20:32.356300+0000","last_became_peered":"2023-11-26T07:20:32.356300+0000","last_unstale":"2023-11-26T07:20:34.213892+0000","last_undegraded":"2023-11-26T07:20:34.213892+0000","last_fullsized":"2023-11-26T07:20:34.213892+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:39.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215327+0000","last_change":"2023-11-26T07:20:32.351805+0000","last_active":"2023-11-26T07:20:34.215327+0000","last_peered":"2023-11-26T07:20:34.215327+0000","last_clean":"2023-11-26T07:20:34.215327+0000","last_became_active":"2023-11-26T07:20:32.351487+0000","last_became_peered":"2023-11-26T07:20:32.351487+0000","last_unstale":"2023-11-26T07:20:34.215327+0000","last_undegraded":"2023-11-26T07:20:34.215327+0000","last_fullsized":"2023-11-26T07:20:34.215327+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:48:56.233385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214230+0000","last_change":"2023-11-26T07:20:32.360617+0000","last_active":"2023-11-26T07:20:34.214230+0000","last_peered":"2023-11-26T07:20:34.214230+0000","last_clean":"2023-11-26T07:20:34.214230+0000","last_became_active":"2023-11-26T07:20:32.360199+0000","last_became_peered":"2023-11-26T07:20:32.360199+0000","last_unstale":"2023-11-26T07:20:34.214230+0000","last_undegraded":"2023-11-26T07:20:34.214230+0000","last_fullsized":"2023-11-26T07:20:34.214230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:46:22.057262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215002+0000","last_change":"2023-11-26T07:20:32.354172+0000","last_active":"2023-11-26T07:20:34.215002+0000","last_peered":"2023-11-26T07:20:34.215002+0000","last_clean":"2023-11-26T07:20:34.215002+0000","last_became_active":"2023-11-26T07:20:32.353733+0000","last_became_peered":"2023-11-26T07:20:32.353733+0000","last_unstale":"2023-11-26T07:20:34.215002+0000","last_undegraded":"2023-11-26T07:20:34.215002+0000","last_fullsized":"2023-11-26T07:20:34.215002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:32.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347400+0000","last_change":"2023-11-26T07:20:32.352549+0000","last_active":"2023-11-26T07:20:33.347400+0000","last_peered":"2023-11-26T07:20:33.347400+0000","last_clean":"2023-11-26T07:20:33.347400+0000","last_became_active":"2023-11-26T07:20:32.352257+0000","last_became_peered":"2023-11-26T07:20:32.352257+0000","last_unstale":"2023-11-26T07:20:33.347400+0000","last_undegraded":"2023-11-26T07:20:33.347400+0000","last_fullsized":"2023-11-26T07:20:33.347400+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:39.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347967+0000","last_change":"2023-11-26T07:20:32.355682+0000","last_active":"2023-11-26T07:20:33.347967+0000","last_peered":"2023-11-26T07:20:33.347967+0000","last_clean":"2023-11-26T07:20:33.347967+0000","last_became_active":"2023-11-26T07:20:32.355415+0000","last_became_peered":"2023-11-26T07:20:32.355415+0000","last_unstale":"2023-11-26T07:20:33.347967+0000","last_undegraded":"2023-11-26T07:20:33.347967+0000","last_fullsized":"2023-11-26T07:20:33.347967+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:44:31.947556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455502+0000","last_change":"2023-11-26T07:20:32.361621+0000","last_active":"2023-11-26T07:20:33.455502+0000","last_peered":"2023-11-26T07:20:33.455502+0000","last_clean":"2023-11-26T07:20:33.455502+0000","last_became_active":"2023-11-26T07:20:32.360558+0000","last_became_peered":"2023-11-26T07:20:32.360558+0000","last_unstale":"2023-11-26T07:20:33.455502+0000","last_undegraded":"2023-11-26T07:20:33.455502+0000","last_fullsized":"2023-11-26T07:20:33.455502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:18:00.866098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214158+0000","last_change":"2023-11-26T07:20:32.346234+0000","last_active":"2023-11-26T07:20:34.214158+0000","last_peered":"2023-11-26T07:20:34.214158+0000","last_clean":"2023-11-26T07:20:34.214158+0000","last_became_active":"2023-11-26T07:20:32.345799+0000","last_became_peered":"2023-11-26T07:20:32.345799+0000","last_unstale":"2023-11-26T07:20:34.214158+0000","last_undegraded":"2023-11-26T07:20:34.214158+0000","last_fullsized":"2023-11-26T07:20:34.214158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:48:56.147691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.213900+0000","last_change":"2023-11-26T07:20:32.357086+0000","last_active":"2023-11-26T07:20:34.213900+0000","last_peered":"2023-11-26T07:20:34.213900+0000","last_clean":"2023-11-26T07:20:34.213900+0000","last_became_active":"2023-11-26T07:20:32.356818+0000","last_became_peered":"2023-11-26T07:20:32.356818+0000","last_unstale":"2023-11-26T07:20:34.213900+0000","last_undegraded":"2023-11-26T07:20:34.213900+0000","last_fullsized":"2023-11-26T07:20:34.213900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:03:13.180733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215034+0000","last_change":"2023-11-26T07:20:32.363265+0000","last_active":"2023-11-26T07:20:34.215034+0000","last_peered":"2023-11-26T07:20:34.215034+0000","last_clean":"2023-11-26T07:20:34.215034+0000","last_became_active":"2023-11-26T07:20:32.363000+0000","last_became_peered":"2023-11-26T07:20:32.363000+0000","last_unstale":"2023-11-26T07:20:34.215034+0000","last_undegraded":"2023-11-26T07:20:34.215034+0000","last_fullsized":"2023-11-26T07:20:34.215034+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:23.534814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347101+0000","last_change":"2023-11-26T07:20:32.344942+0000","last_active":"2023-11-26T07:20:33.347101+0000","last_peered":"2023-11-26T07:20:33.347101+0000","last_clean":"2023-11-26T07:20:33.347101+0000","last_became_active":"2023-11-26T07:20:32.344679+0000","last_became_peered":"2023-11-26T07:20:32.344679+0000","last_unstale":"2023-11-26T07:20:33.347101+0000","last_undegraded":"2023-11-26T07:20:33.347101+0000","last_fullsized":"2023-11-26T07:20:33.347101+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:06:18.740673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214267+0000","last_change":"2023-11-26T07:20:32.350542+0000","last_active":"2023-11-26T07:20:34.214267+0000","last_peered":"2023-11-26T07:20:34.214267+0000","last_clean":"2023-11-26T07:20:34.214267+0000","last_became_active":"2023-11-26T07:20:32.350249+0000","last_became_peered":"2023-11-26T07:20:32.350249+0000","last_unstale":"2023-11-26T07:20:34.214267+0000","last_undegraded":"2023-11-26T07:20:34.214267+0000","last_fullsized":"2023-11-26T07:20:34.214267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:12.512344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831957+0000","last_change":"2023-11-26T07:20:32.348331+0000","last_active":"2023-11-26T07:20:33.831957+0000","last_peered":"2023-11-26T07:20:33.831957+0000","last_clean":"2023-11-26T07:20:33.831957+0000","last_became_active":"2023-11-26T07:20:32.347924+0000","last_became_peered":"2023-11-26T07:20:32.347924+0000","last_unstale":"2023-11-26T07:20:33.831957+0000","last_undegraded":"2023-11-26T07:20:33.831957+0000","last_fullsized":"2023-11-26T07:20:33.831957+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:04:21.912417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214307+0000","last_change":"2023-11-26T07:20:32.354436+0000","last_active":"2023-11-26T07:20:34.214307+0000","last_peered":"2023-11-26T07:20:34.214307+0000","last_clean":"2023-11-26T07:20:34.214307+0000","last_became_active":"2023-11-26T07:20:32.352913+0000","last_became_peered":"2023-11-26T07:20:32.352913+0000","last_unstale":"2023-11-26T07:20:34.214307+0000","last_undegraded":"2023-11-26T07:20:34.214307+0000","last_fullsized":"2023-11-26T07:20:34.214307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:25:40.680896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214195+0000","last_change":"2023-11-26T07:20:32.349921+0000","last_active":"2023-11-26T07:20:34.214195+0000","last_peered":"2023-11-26T07:20:34.214195+0000","last_clean":"2023-11-26T07:20:34.214195+0000","last_became_active":"2023-11-26T07:20:32.349625+0000","last_became_peered":"2023-11-26T07:20:32.349625+0000","last_unstale":"2023-11-26T07:20:34.214195+0000","last_undegraded":"2023-11-26T07:20:34.214195+0000","last_fullsized":"2023-11-26T07:20:34.214195+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:15.622376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347419+0000","last_change":"2023-11-26T07:20:32.351914+0000","last_active":"2023-11-26T07:20:33.347419+0000","last_peered":"2023-11-26T07:20:33.347419+0000","last_clean":"2023-11-26T07:20:33.347419+0000","last_became_active":"2023-11-26T07:20:32.351601+0000","last_became_peered":"2023-11-26T07:20:32.351601+0000","last_unstale":"2023-11-26T07:20:33.347419+0000","last_undegraded":"2023-11-26T07:20:33.347419+0000","last_fullsized":"2023-11-26T07:20:33.347419+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:52:07.666011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.346717+0000","last_change":"2023-11-26T07:20:32.341525+0000","last_active":"2023-11-26T07:20:33.346717+0000","last_peered":"2023-11-26T07:20:33.346717+0000","last_clean":"2023-11-26T07:20:33.346717+0000","last_became_active":"2023-11-26T07:20:32.341240+0000","last_became_peered":"2023-11-26T07:20:32.341240+0000","last_unstale":"2023-11-26T07:20:33.346717+0000","last_undegraded":"2023-11-26T07:20:33.346717+0000","last_fullsized":"2023-11-26T07:20:33.346717+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:43:22.086098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348639+0000","last_change":"2023-11-26T07:20:32.351428+0000","last_active":"2023-11-26T07:20:33.348639+0000","last_peered":"2023-11-26T07:20:33.348639+0000","last_clean":"2023-11-26T07:20:33.348639+0000","last_became_active":"2023-11-26T07:20:32.351222+0000","last_became_peered":"2023-11-26T07:20:32.351222+0000","last_unstale":"2023-11-26T07:20:33.348639+0000","last_undegraded":"2023-11-26T07:20:33.348639+0000","last_fullsized":"2023-11-26T07:20:33.348639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:50.254389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375133+0000","last_change":"2023-11-26T07:20:31.345675+0000","last_active":"2023-11-26T07:20:32.375133+0000","last_peered":"2023-11-26T07:20:32.375133+0000","last_clean":"2023-11-26T07:20:32.375133+0000","last_became_active":"2023-11-26T07:20:31.344584+0000","last_became_peered":"2023-11-26T07:20:31.344584+0000","last_unstale":"2023-11-26T07:20:32.375133+0000","last_undegraded":"2023-11-26T07:20:32.375133+0000","last_fullsized":"2023-11-26T07:20:32.375133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:14:50.462959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215160+0000","last_change":"2023-11-26T07:20:32.353583+0000","last_active":"2023-11-26T07:20:34.215160+0000","last_peered":"2023-11-26T07:20:34.215160+0000","last_clean":"2023-11-26T07:20:34.215160+0000","last_became_active":"2023-11-26T07:20:32.353271+0000","last_became_peered":"2023-11-26T07:20:32.353271+0000","last_unstale":"2023-11-26T07:20:34.215160+0000","last_undegraded":"2023-11-26T07:20:34.215160+0000","last_fullsized":"2023-11-26T07:20:34.215160+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:33:50.254389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373702+0000","last_change":"2023-11-26T07:20:31.343042+0000","last_active":"2023-11-26T07:20:32.373702+0000","last_peered":"2023-11-26T07:20:32.373702+0000","last_clean":"2023-11-26T07:20:32.373702+0000","last_became_active":"2023-11-26T07:20:31.342571+0000","last_became_peered":"2023-11-26T07:20:31.342571+0000","last_unstale":"2023-11-26T07:20:32.373702+0000","last_undegraded":"2023-11-26T07:20:32.373702+0000","last_fullsized":"2023-11-26T07:20:32.373702+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:17:59.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831983+0000","last_change":"2023-11-26T07:20:32.354079+0000","last_active":"2023-11-26T07:20:33.831983+0000","last_peered":"2023-11-26T07:20:33.831983+0000","last_clean":"2023-11-26T07:20:33.831983+0000","last_became_active":"2023-11-26T07:20:32.353761+0000","last_became_peered":"2023-11-26T07:20:32.353761+0000","last_unstale":"2023-11-26T07:20:33.831983+0000","last_undegraded":"2023-11-26T07:20:33.831983+0000","last_fullsized":"2023-11-26T07:20:33.831983+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:43.631106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375053+0000","last_change":"2023-11-26T07:20:31.338674+0000","last_active":"2023-11-26T07:20:32.375053+0000","last_peered":"2023-11-26T07:20:32.375053+0000","last_clean":"2023-11-26T07:20:32.375053+0000","last_became_active":"2023-11-26T07:20:31.338407+0000","last_became_peered":"2023-11-26T07:20:31.338407+0000","last_unstale":"2023-11-26T07:20:32.375053+0000","last_undegraded":"2023-11-26T07:20:32.375053+0000","last_fullsized":"2023-11-26T07:20:32.375053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:31.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348774+0000","last_change":"2023-11-26T07:20:32.353555+0000","last_active":"2023-11-26T07:20:33.348774+0000","last_peered":"2023-11-26T07:20:33.348774+0000","last_clean":"2023-11-26T07:20:33.348774+0000","last_became_active":"2023-11-26T07:20:32.353052+0000","last_became_peered":"2023-11-26T07:20:32.353052+0000","last_unstale":"2023-11-26T07:20:33.348774+0000","last_undegraded":"2023-11-26T07:20:33.348774+0000","last_fullsized":"2023-11-26T07:20:33.348774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:35.979098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373607+0000","last_change":"2023-11-26T07:20:31.330956+0000","last_active":"2023-11-26T07:20:32.373607+0000","last_peered":"2023-11-26T07:20:32.373607+0000","last_clean":"2023-11-26T07:20:32.373607+0000","last_became_active":"2023-11-26T07:20:31.330649+0000","last_became_peered":"2023-11-26T07:20:31.330649+0000","last_unstale":"2023-11-26T07:20:32.373607+0000","last_undegraded":"2023-11-26T07:20:32.373607+0000","last_fullsized":"2023-11-26T07:20:32.373607+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:48:55.227637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214880+0000","last_change":"2023-11-26T07:20:32.358351+0000","last_active":"2023-11-26T07:20:34.214880+0000","last_peered":"2023-11-26T07:20:34.214880+0000","last_clean":"2023-11-26T07:20:34.214880+0000","last_became_active":"2023-11-26T07:20:32.358045+0000","last_became_peered":"2023-11-26T07:20:32.358045+0000","last_unstale":"2023-11-26T07:20:34.214880+0000","last_undegraded":"2023-11-26T07:20:34.214880+0000","last_fullsized":"2023-11-26T07:20:34.214880+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:06.549419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.374882+0000","last_change":"2023-11-26T07:20:31.345663+0000","last_active":"2023-11-26T07:20:32.374882+0000","last_peered":"2023-11-26T07:20:32.374882+0000","last_clean":"2023-11-26T07:20:32.374882+0000","last_became_active":"2023-11-26T07:20:31.345363+0000","last_became_peered":"2023-11-26T07:20:31.345363+0000","last_unstale":"2023-11-26T07:20:32.374882+0000","last_undegraded":"2023-11-26T07:20:32.374882+0000","last_fullsized":"2023-11-26T07:20:32.374882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:46:42.625357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455576+0000","last_change":"2023-11-26T07:20:32.358724+0000","last_active":"2023-11-26T07:20:33.455576+0000","last_peered":"2023-11-26T07:20:33.455576+0000","last_clean":"2023-11-26T07:20:33.455576+0000","last_became_active":"2023-11-26T07:20:32.358438+0000","last_became_peered":"2023-11-26T07:20:32.358438+0000","last_unstale":"2023-11-26T07:20:33.455576+0000","last_undegraded":"2023-11-26T07:20:33.455576+0000","last_fullsized":"2023-11-26T07:20:33.455576+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:46:39.318881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.369898+0000","last_change":"2023-11-26T07:20:31.340363+0000","last_active":"2023-11-26T07:20:32.369898+0000","last_peered":"2023-11-26T07:20:32.369898+0000","last_clean":"2023-11-26T07:20:32.369898+0000","last_became_active":"2023-11-26T07:20:31.339785+0000","last_became_peered":"2023-11-26T07:20:31.339785+0000","last_unstale":"2023-11-26T07:20:32.369898+0000","last_undegraded":"2023-11-26T07:20:32.369898+0000","last_fullsized":"2023-11-26T07:20:32.369898+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:31.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455336+0000","last_change":"2023-11-26T07:20:32.354715+0000","last_active":"2023-11-26T07:20:33.455336+0000","last_peered":"2023-11-26T07:20:33.455336+0000","last_clean":"2023-11-26T07:20:33.455336+0000","last_became_active":"2023-11-26T07:20:32.354281+0000","last_became_peered":"2023-11-26T07:20:32.354281+0000","last_unstale":"2023-11-26T07:20:33.455336+0000","last_undegraded":"2023-11-26T07:20:33.455336+0000","last_fullsized":"2023-11-26T07:20:33.455336+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:19:29.286838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.340345+0000","last_change":"2023-11-26T07:20:31.335203+0000","last_active":"2023-11-26T07:20:32.340345+0000","last_peered":"2023-11-26T07:20:32.340345+0000","last_clean":"2023-11-26T07:20:32.340345+0000","last_became_active":"2023-11-26T07:20:31.334608+0000","last_became_peered":"2023-11-26T07:20:31.334608+0000","last_unstale":"2023-11-26T07:20:32.340345+0000","last_undegraded":"2023-11-26T07:20:32.340345+0000","last_fullsized":"2023-11-26T07:20:32.340345+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:34:11.506595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.213898+0000","last_change":"2023-11-26T07:20:32.352522+0000","last_active":"2023-11-26T07:20:34.213898+0000","last_peered":"2023-11-26T07:20:34.213898+0000","last_clean":"2023-11-26T07:20:34.213898+0000","last_became_active":"2023-11-26T07:20:32.351941+0000","last_became_peered":"2023-11-26T07:20:32.351941+0000","last_unstale":"2023-11-26T07:20:34.213898+0000","last_undegraded":"2023-11-26T07:20:34.213898+0000","last_fullsized":"2023-11-26T07:20:34.213898+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:11:42.255761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.346893+0000","last_change":"2023-11-26T07:20:31.342841+0000","last_active":"2023-11-26T07:20:32.346893+0000","last_peered":"2023-11-26T07:20:32.346893+0000","last_clean":"2023-11-26T07:20:32.346893+0000","last_became_active":"2023-11-26T07:20:31.342390+0000","last_became_peered":"2023-11-26T07:20:31.342390+0000","last_unstale":"2023-11-26T07:20:32.346893+0000","last_undegraded":"2023-11-26T07:20:32.346893+0000","last_fullsized":"2023-11-26T07:20:32.346893+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:22.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214409+0000","last_change":"2023-11-26T07:20:32.360421+0000","last_active":"2023-11-26T07:20:34.214409+0000","last_peered":"2023-11-26T07:20:34.214409+0000","last_clean":"2023-11-26T07:20:34.214409+0000","last_became_active":"2023-11-26T07:20:32.359832+0000","last_became_peered":"2023-11-26T07:20:32.359832+0000","last_unstale":"2023-11-26T07:20:34.214409+0000","last_undegraded":"2023-11-26T07:20:34.214409+0000","last_fullsized":"2023-11-26T07:20:34.214409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:11:22.276923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.340393+0000","last_change":"2023-11-26T07:20:31.338047+0000","last_active":"2023-11-26T07:20:32.340393+0000","last_peered":"2023-11-26T07:20:32.340393+0000","last_clean":"2023-11-26T07:20:32.340393+0000","last_became_active":"2023-11-26T07:20:31.337713+0000","last_became_peered":"2023-11-26T07:20:31.337713+0000","last_unstale":"2023-11-26T07:20:32.340393+0000","last_undegraded":"2023-11-26T07:20:32.340393+0000","last_fullsized":"2023-11-26T07:20:32.340393+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:34.973349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214774+0000","last_change":"2023-11-26T07:20:32.352810+0000","last_active":"2023-11-26T07:20:34.214774+0000","last_peered":"2023-11-26T07:20:34.214774+0000","last_clean":"2023-11-26T07:20:34.214774+0000","last_became_active":"2023-11-26T07:20:32.352532+0000","last_became_peered":"2023-11-26T07:20:32.352532+0000","last_unstale":"2023-11-26T07:20:34.214774+0000","last_undegraded":"2023-11-26T07:20:34.214774+0000","last_fullsized":"2023-11-26T07:20:34.214774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:53.654216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.346167+0000","last_change":"2023-11-26T07:20:31.349927+0000","last_active":"2023-11-26T07:20:32.346167+0000","last_peered":"2023-11-26T07:20:32.346167+0000","last_clean":"2023-11-26T07:20:32.346167+0000","last_became_active":"2023-11-26T07:20:31.349594+0000","last_became_peered":"2023-11-26T07:20:31.349594+0000","last_unstale":"2023-11-26T07:20:32.346167+0000","last_undegraded":"2023-11-26T07:20:32.346167+0000","last_fullsized":"2023-11-26T07:20:32.346167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:53.731327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348559+0000","last_change":"2023-11-26T07:20:32.340748+0000","last_active":"2023-11-26T07:20:33.348559+0000","last_peered":"2023-11-26T07:20:33.348559+0000","last_clean":"2023-11-26T07:20:33.348559+0000","last_became_active":"2023-11-26T07:20:32.340498+0000","last_became_peered":"2023-11-26T07:20:32.340498+0000","last_unstale":"2023-11-26T07:20:33.348559+0000","last_undegraded":"2023-11-26T07:20:33.348559+0000","last_fullsized":"2023-11-26T07:20:33.348559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:06:13.721536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.374153+0000","last_change":"2023-11-26T07:20:31.343317+0000","last_active":"2023-11-26T07:20:32.374153+0000","last_peered":"2023-11-26T07:20:32.374153+0000","last_clean":"2023-11-26T07:20:32.374153+0000","last_became_active":"2023-11-26T07:20:31.342985+0000","last_became_peered":"2023-11-26T07:20:31.342985+0000","last_unstale":"2023-11-26T07:20:32.374153+0000","last_undegraded":"2023-11-26T07:20:32.374153+0000","last_fullsized":"2023-11-26T07:20:32.374153+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:03.506646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215202+0000","last_change":"2023-11-26T07:20:32.341768+0000","last_active":"2023-11-26T07:20:34.215202+0000","last_peered":"2023-11-26T07:20:34.215202+0000","last_clean":"2023-11-26T07:20:34.215202+0000","last_became_active":"2023-11-26T07:20:32.340867+0000","last_became_peered":"2023-11-26T07:20:32.340867+0000","last_unstale":"2023-11-26T07:20:34.215202+0000","last_undegraded":"2023-11-26T07:20:34.215202+0000","last_fullsized":"2023-11-26T07:20:34.215202+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:46:58.298705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.377724+0000","last_change":"2023-11-26T07:20:31.338018+0000","last_active":"2023-11-26T07:20:32.377724+0000","last_peered":"2023-11-26T07:20:32.377724+0000","last_clean":"2023-11-26T07:20:32.377724+0000","last_became_active":"2023-11-26T07:20:31.337739+0000","last_became_peered":"2023-11-26T07:20:31.337739+0000","last_unstale":"2023-11-26T07:20:32.377724+0000","last_undegraded":"2023-11-26T07:20:32.377724+0000","last_fullsized":"2023-11-26T07:20:32.377724+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:16:15.891428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214761+0000","last_change":"2023-11-26T07:20:32.353737+0000","last_active":"2023-11-26T07:20:34.214761+0000","last_peered":"2023-11-26T07:20:34.214761+0000","last_clean":"2023-11-26T07:20:34.214761+0000","last_became_active":"2023-11-26T07:20:32.353374+0000","last_became_peered":"2023-11-26T07:20:32.353374+0000","last_unstale":"2023-11-26T07:20:34.214761+0000","last_undegraded":"2023-11-26T07:20:34.214761+0000","last_fullsized":"2023-11-26T07:20:34.214761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:04:39.120163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373841+0000","last_change":"2023-11-26T07:20:31.349000+0000","last_active":"2023-11-26T07:20:32.373841+0000","last_peered":"2023-11-26T07:20:32.373841+0000","last_clean":"2023-11-26T07:20:32.373841+0000","last_became_active":"2023-11-26T07:20:31.348643+0000","last_became_peered":"2023-11-26T07:20:31.348643+0000","last_unstale":"2023-11-26T07:20:32.373841+0000","last_undegraded":"2023-11-26T07:20:32.373841+0000","last_fullsized":"2023-11-26T07:20:32.373841+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:04:15.425814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455647+0000","last_change":"2023-11-26T07:20:32.358148+0000","last_active":"2023-11-26T07:20:33.455647+0000","last_peered":"2023-11-26T07:20:33.455647+0000","last_clean":"2023-11-26T07:20:33.455647+0000","last_became_active":"2023-11-26T07:20:32.357884+0000","last_became_peered":"2023-11-26T07:20:32.357884+0000","last_unstale":"2023-11-26T07:20:33.455647+0000","last_undegraded":"2023-11-26T07:20:33.455647+0000","last_fullsized":"2023-11-26T07:20:33.455647+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:26.928757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.339132+0000","last_change":"2023-11-26T07:20:31.337492+0000","last_active":"2023-11-26T07:20:32.339132+0000","last_peered":"2023-11-26T07:20:32.339132+0000","last_clean":"2023-11-26T07:20:32.339132+0000","last_became_active":"2023-11-26T07:20:31.337199+0000","last_became_peered":"2023-11-26T07:20:31.337199+0000","last_unstale":"2023-11-26T07:20:32.339132+0000","last_undegraded":"2023-11-26T07:20:32.339132+0000","last_fullsized":"2023-11-26T07:20:32.339132+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:43:41.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347255+0000","last_change":"2023-11-26T07:20:32.342077+0000","last_active":"2023-11-26T07:20:33.347255+0000","last_peered":"2023-11-26T07:20:33.347255+0000","last_clean":"2023-11-26T07:20:33.347255+0000","last_became_active":"2023-11-26T07:20:32.341855+0000","last_became_peered":"2023-11-26T07:20:32.341855+0000","last_unstale":"2023-11-26T07:20:33.347255+0000","last_undegraded":"2023-11-26T07:20:33.347255+0000","last_fullsized":"2023-11-26T07:20:33.347255+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:43:16.302808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336599+0000","last_change":"2023-11-26T07:20:31.347170+0000","last_active":"2023-11-26T07:20:32.336599+0000","last_peered":"2023-11-26T07:20:32.336599+0000","last_clean":"2023-11-26T07:20:32.336599+0000","last_became_active":"2023-11-26T07:20:31.346871+0000","last_became_peered":"2023-11-26T07:20:31.346871+0000","last_unstale":"2023-11-26T07:20:32.336599+0000","last_undegraded":"2023-11-26T07:20:32.336599+0000","last_fullsized":"2023-11-26T07:20:32.336599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:46:57.292956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215426+0000","last_change":"2023-11-26T07:20:32.356987+0000","last_active":"2023-11-26T07:20:34.215426+0000","last_peered":"2023-11-26T07:20:34.215426+0000","last_clean":"2023-11-26T07:20:34.215426+0000","last_became_active":"2023-11-26T07:20:32.356276+0000","last_became_peered":"2023-11-26T07:20:32.356276+0000","last_unstale":"2023-11-26T07:20:34.215426+0000","last_undegraded":"2023-11-26T07:20:34.215426+0000","last_fullsized":"2023-11-26T07:20:34.215426+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:52:07.666011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375590+0000","last_change":"2023-11-26T07:20:31.340365+0000","last_active":"2023-11-26T07:20:32.375590+0000","last_peered":"2023-11-26T07:20:32.375590+0000","last_clean":"2023-11-26T07:20:32.375590+0000","last_became_active":"2023-11-26T07:20:31.340077+0000","last_became_peered":"2023-11-26T07:20:31.340077+0000","last_unstale":"2023-11-26T07:20:32.375590+0000","last_undegraded":"2023-11-26T07:20:32.375590+0000","last_fullsized":"2023-11-26T07:20:32.375590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:04:38.114414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347202+0000","last_change":"2023-11-26T07:20:32.357326+0000","last_active":"2023-11-26T07:20:33.347202+0000","last_peered":"2023-11-26T07:20:33.347202+0000","last_clean":"2023-11-26T07:20:33.347202+0000","last_became_active":"2023-11-26T07:20:32.354403+0000","last_became_peered":"2023-11-26T07:20:32.354403+0000","last_unstale":"2023-11-26T07:20:33.347202+0000","last_undegraded":"2023-11-26T07:20:33.347202+0000","last_fullsized":"2023-11-26T07:20:33.347202+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:20:25.832716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373123+0000","last_change":"2023-11-26T07:20:31.340439+0000","last_active":"2023-11-26T07:20:32.373123+0000","last_peered":"2023-11-26T07:20:32.373123+0000","last_clean":"2023-11-26T07:20:32.373123+0000","last_became_active":"2023-11-26T07:20:31.337633+0000","last_became_peered":"2023-11-26T07:20:31.337633+0000","last_unstale":"2023-11-26T07:20:32.373123+0000","last_undegraded":"2023-11-26T07:20:32.373123+0000","last_fullsized":"2023-11-26T07:20:32.373123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:58:04.264264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455748+0000","last_change":"2023-11-26T07:20:32.361640+0000","last_active":"2023-11-26T07:20:33.455748+0000","last_peered":"2023-11-26T07:20:33.455748+0000","last_clean":"2023-11-26T07:20:33.455748+0000","last_became_active":"2023-11-26T07:20:32.361360+0000","last_became_peered":"2023-11-26T07:20:32.361360+0000","last_unstale":"2023-11-26T07:20:33.455748+0000","last_undegraded":"2023-11-26T07:20:33.455748+0000","last_fullsized":"2023-11-26T07:20:33.455748+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:46:22.057262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.373824+0000","last_change":"2023-11-26T07:20:31.336961+0000","last_active":"2023-11-26T07:20:32.373824+0000","last_peered":"2023-11-26T07:20:32.373824+0000","last_clean":"2023-11-26T07:20:32.373824+0000","last_became_active":"2023-11-26T07:20:31.336663+0000","last_became_peered":"2023-11-26T07:20:31.336663+0000","last_unstale":"2023-11-26T07:20:32.373824+0000","last_undegraded":"2023-11-26T07:20:32.373824+0000","last_fullsized":"2023-11-26T07:20:32.373824+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:52:59.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214166+0000","last_change":"2023-11-26T07:20:32.360174+0000","last_active":"2023-11-26T07:20:34.214166+0000","last_peered":"2023-11-26T07:20:34.214166+0000","last_clean":"2023-11-26T07:20:34.214166+0000","last_became_active":"2023-11-26T07:20:32.359129+0000","last_became_peered":"2023-11-26T07:20:32.359129+0000","last_unstale":"2023-11-26T07:20:34.214166+0000","last_undegraded":"2023-11-26T07:20:34.214166+0000","last_fullsized":"2023-11-26T07:20:34.214166+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:20:03.467443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.371672+0000","last_change":"2023-11-26T07:20:31.330081+0000","last_active":"2023-11-26T07:20:32.371672+0000","last_peered":"2023-11-26T07:20:32.371672+0000","last_clean":"2023-11-26T07:20:32.371672+0000","last_became_active":"2023-11-26T07:20:31.329778+0000","last_became_peered":"2023-11-26T07:20:31.329778+0000","last_unstale":"2023-11-26T07:20:32.371672+0000","last_undegraded":"2023-11-26T07:20:32.371672+0000","last_fullsized":"2023-11-26T07:20:32.371672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:38:25.923008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214758+0000","last_change":"2023-11-26T07:20:32.353121+0000","last_active":"2023-11-26T07:20:34.214758+0000","last_peered":"2023-11-26T07:20:34.214758+0000","last_clean":"2023-11-26T07:20:34.214758+0000","last_became_active":"2023-11-26T07:20:32.352789+0000","last_became_peered":"2023-11-26T07:20:32.352789+0000","last_unstale":"2023-11-26T07:20:34.214758+0000","last_undegraded":"2023-11-26T07:20:34.214758+0000","last_fullsized":"2023-11-26T07:20:34.214758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:54.737076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336176+0000","last_change":"2023-11-26T07:20:31.343251+0000","last_active":"2023-11-26T07:20:32.336176+0000","last_peered":"2023-11-26T07:20:32.336176+0000","last_clean":"2023-11-26T07:20:32.336176+0000","last_became_active":"2023-11-26T07:20:31.342942+0000","last_became_peered":"2023-11-26T07:20:31.342942+0000","last_unstale":"2023-11-26T07:20:32.336176+0000","last_undegraded":"2023-11-26T07:20:32.336176+0000","last_fullsized":"2023-11-26T07:20:32.336176+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:04:20.906669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347687+0000","last_change":"2023-11-26T07:20:32.354734+0000","last_active":"2023-11-26T07:20:33.347687+0000","last_peered":"2023-11-26T07:20:33.347687+0000","last_clean":"2023-11-26T07:20:33.347687+0000","last_became_active":"2023-11-26T07:20:32.354486+0000","last_became_peered":"2023-11-26T07:20:32.354486+0000","last_unstale":"2023-11-26T07:20:33.347687+0000","last_undegraded":"2023-11-26T07:20:33.347687+0000","last_fullsized":"2023-11-26T07:20:33.347687+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:18:33.614661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.375171+0000","last_change":"2023-11-26T07:20:31.341608+0000","last_active":"2023-11-26T07:20:32.375171+0000","last_peered":"2023-11-26T07:20:32.375171+0000","last_clean":"2023-11-26T07:20:32.375171+0000","last_became_active":"2023-11-26T07:20:31.341101+0000","last_became_peered":"2023-11-26T07:20:31.341101+0000","last_unstale":"2023-11-26T07:20:32.375171+0000","last_undegraded":"2023-11-26T07:20:32.375171+0000","last_fullsized":"2023-11-26T07:20:32.375171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:34:52.648467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348267+0000","last_change":"2023-11-26T07:20:32.352865+0000","last_active":"2023-11-26T07:20:33.348267+0000","last_peered":"2023-11-26T07:20:33.348267+0000","last_clean":"2023-11-26T07:20:33.348267+0000","last_became_active":"2023-11-26T07:20:32.352442+0000","last_became_peered":"2023-11-26T07:20:32.352442+0000","last_unstale":"2023-11-26T07:20:33.348267+0000","last_undegraded":"2023-11-26T07:20:33.348267+0000","last_fullsized":"2023-11-26T07:20:33.348267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:23.534814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.338730+0000","last_change":"2023-11-26T07:20:31.339833+0000","last_active":"2023-11-26T07:20:32.338730+0000","last_peered":"2023-11-26T07:20:32.338730+0000","last_clean":"2023-11-26T07:20:32.338730+0000","last_became_active":"2023-11-26T07:20:31.339568+0000","last_became_peered":"2023-11-26T07:20:31.339568+0000","last_unstale":"2023-11-26T07:20:32.338730+0000","last_undegraded":"2023-11-26T07:20:32.338730+0000","last_fullsized":"2023-11-26T07:20:32.338730+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:46:38.313132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.346793+0000","last_change":"2023-11-26T07:20:32.343470+0000","last_active":"2023-11-26T07:20:33.346793+0000","last_peered":"2023-11-26T07:20:33.346793+0000","last_clean":"2023-11-26T07:20:33.346793+0000","last_became_active":"2023-11-26T07:20:32.343198+0000","last_became_peered":"2023-11-26T07:20:32.343198+0000","last_unstale":"2023-11-26T07:20:33.346793+0000","last_undegraded":"2023-11-26T07:20:33.346793+0000","last_fullsized":"2023-11-26T07:20:33.346793+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:49:46.676549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.339892+0000","last_change":"2023-11-26T07:20:31.349908+0000","last_active":"2023-11-26T07:20:32.339892+0000","last_peered":"2023-11-26T07:20:32.339892+0000","last_clean":"2023-11-26T07:20:32.339892+0000","last_became_active":"2023-11-26T07:20:31.349587+0000","last_became_peered":"2023-11-26T07:20:31.349587+0000","last_unstale":"2023-11-26T07:20:32.339892+0000","last_undegraded":"2023-11-26T07:20:32.339892+0000","last_fullsized":"2023-11-26T07:20:32.339892+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:48:38.145444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455350+0000","last_change":"2023-11-26T07:20:32.362306+0000","last_active":"2023-11-26T07:20:33.455350+0000","last_peered":"2023-11-26T07:20:33.455350+0000","last_clean":"2023-11-26T07:20:33.455350+0000","last_became_active":"2023-11-26T07:20:32.361999+0000","last_became_peered":"2023-11-26T07:20:32.361999+0000","last_unstale":"2023-11-26T07:20:33.455350+0000","last_undegraded":"2023-11-26T07:20:33.455350+0000","last_fullsized":"2023-11-26T07:20:33.455350+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:45:56.117030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336628+0000","last_change":"2023-11-26T07:20:31.337638+0000","last_active":"2023-11-26T07:20:32.336628+0000","last_peered":"2023-11-26T07:20:32.336628+0000","last_clean":"2023-11-26T07:20:32.336628+0000","last_became_active":"2023-11-26T07:20:31.337288+0000","last_became_peered":"2023-11-26T07:20:31.337288+0000","last_unstale":"2023-11-26T07:20:32.336628+0000","last_undegraded":"2023-11-26T07:20:32.336628+0000","last_fullsized":"2023-11-26T07:20:32.336628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:11:21.271174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215284+0000","last_change":"2023-11-26T07:20:32.362048+0000","last_active":"2023-11-26T07:20:34.215284+0000","last_peered":"2023-11-26T07:20:34.215284+0000","last_clean":"2023-11-26T07:20:34.215284+0000","last_became_active":"2023-11-26T07:20:32.361558+0000","last_became_peered":"2023-11-26T07:20:32.361558+0000","last_unstale":"2023-11-26T07:20:34.215284+0000","last_undegraded":"2023-11-26T07:20:34.215284+0000","last_fullsized":"2023-11-26T07:20:34.215284+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:22:35.979098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336268+0000","last_change":"2023-11-26T07:20:31.338667+0000","last_active":"2023-11-26T07:20:32.336268+0000","last_peered":"2023-11-26T07:20:32.336268+0000","last_clean":"2023-11-26T07:20:32.336268+0000","last_became_active":"2023-11-26T07:20:31.338353+0000","last_became_peered":"2023-11-26T07:20:31.338353+0000","last_unstale":"2023-11-26T07:20:32.336268+0000","last_undegraded":"2023-11-26T07:20:32.336268+0000","last_fullsized":"2023-11-26T07:20:32.336268+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:43:41.706297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455879+0000","last_change":"2023-11-26T07:20:32.354943+0000","last_active":"2023-11-26T07:20:33.455879+0000","last_peered":"2023-11-26T07:20:33.455879+0000","last_clean":"2023-11-26T07:20:33.455879+0000","last_became_active":"2023-11-26T07:20:32.354667+0000","last_became_peered":"2023-11-26T07:20:32.354667+0000","last_unstale":"2023-11-26T07:20:33.455879+0000","last_undegraded":"2023-11-26T07:20:33.455879+0000","last_fullsized":"2023-11-26T07:20:33.455879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:04.512395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.336669+0000","last_change":"2023-11-26T07:20:31.344903+0000","last_active":"2023-11-26T07:20:32.336669+0000","last_peered":"2023-11-26T07:20:32.336669+0000","last_clean":"2023-11-26T07:20:32.336669+0000","last_became_active":"2023-11-26T07:20:31.342846+0000","last_became_peered":"2023-11-26T07:20:31.342846+0000","last_unstale":"2023-11-26T07:20:32.336669+0000","last_undegraded":"2023-11-26T07:20:32.336669+0000","last_fullsized":"2023-11-26T07:20:32.336669+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:05.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.215353+0000","last_change":"2023-11-26T07:20:32.353352+0000","last_active":"2023-11-26T07:20:34.215353+0000","last_peered":"2023-11-26T07:20:34.215353+0000","last_clean":"2023-11-26T07:20:34.215353+0000","last_became_active":"2023-11-26T07:20:32.353086+0000","last_became_peered":"2023-11-26T07:20:32.353086+0000","last_unstale":"2023-11-26T07:20:34.215353+0000","last_undegraded":"2023-11-26T07:20:34.215353+0000","last_fullsized":"2023-11-26T07:20:34.215353+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:34:25.808089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.334054+0000","last_change":"2023-11-26T07:20:31.338609+0000","last_active":"2023-11-26T07:20:32.334054+0000","last_peered":"2023-11-26T07:20:32.334054+0000","last_clean":"2023-11-26T07:20:32.334054+0000","last_became_active":"2023-11-26T07:20:31.338194+0000","last_became_peered":"2023-11-26T07:20:31.338194+0000","last_unstale":"2023-11-26T07:20:32.334054+0000","last_undegraded":"2023-11-26T07:20:32.334054+0000","last_fullsized":"2023-11-26T07:20:32.334054+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:04:38.114414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.347813+0000","last_change":"2023-11-26T07:20:32.350151+0000","last_active":"2023-11-26T07:20:33.347813+0000","last_peered":"2023-11-26T07:20:33.347813+0000","last_clean":"2023-11-26T07:20:33.347813+0000","last_became_active":"2023-11-26T07:20:32.347182+0000","last_became_peered":"2023-11-26T07:20:32.347182+0000","last_unstale":"2023-11-26T07:20:33.347813+0000","last_undegraded":"2023-11-26T07:20:33.347813+0000","last_fullsized":"2023-11-26T07:20:33.347813+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:04:09.056008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.337045+0000","last_change":"2023-11-26T07:20:31.347117+0000","last_active":"2023-11-26T07:20:32.337045+0000","last_peered":"2023-11-26T07:20:32.337045+0000","last_clean":"2023-11-26T07:20:32.337045+0000","last_became_active":"2023-11-26T07:20:31.346824+0000","last_became_peered":"2023-11-26T07:20:31.346824+0000","last_unstale":"2023-11-26T07:20:32.337045+0000","last_undegraded":"2023-11-26T07:20:32.337045+0000","last_fullsized":"2023-11-26T07:20:32.337045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:54.279174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.348077+0000","last_change":"2023-11-26T07:20:32.352151+0000","last_active":"2023-11-26T07:20:33.348077+0000","last_peered":"2023-11-26T07:20:33.348077+0000","last_clean":"2023-11-26T07:20:33.348077+0000","last_became_active":"2023-11-26T07:20:32.345134+0000","last_became_peered":"2023-11-26T07:20:32.345134+0000","last_unstale":"2023-11-26T07:20:33.348077+0000","last_undegraded":"2023-11-26T07:20:33.348077+0000","last_fullsized":"2023-11-26T07:20:33.348077+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:31:52.555460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.339230+0000","last_change":"2023-11-26T07:20:31.341950+0000","last_active":"2023-11-26T07:20:32.339230+0000","last_peered":"2023-11-26T07:20:32.339230+0000","last_clean":"2023-11-26T07:20:32.339230+0000","last_became_active":"2023-11-26T07:20:31.341681+0000","last_became_peered":"2023-11-26T07:20:31.341681+0000","last_unstale":"2023-11-26T07:20:32.339230+0000","last_undegraded":"2023-11-26T07:20:32.339230+0000","last_fullsized":"2023-11-26T07:20:32.339230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:13:22.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.831624+0000","last_change":"2023-11-26T07:20:32.350202+0000","last_active":"2023-11-26T07:20:33.831624+0000","last_peered":"2023-11-26T07:20:33.831624+0000","last_clean":"2023-11-26T07:20:33.831624+0000","last_became_active":"2023-11-26T07:20:32.349797+0000","last_became_peered":"2023-11-26T07:20:32.349797+0000","last_unstale":"2023-11-26T07:20:33.831624+0000","last_undegraded":"2023-11-26T07:20:33.831624+0000","last_fullsized":"2023-11-26T07:20:33.831624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:04.512395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.333956+0000","last_change":"2023-11-26T07:20:31.343570+0000","last_active":"2023-11-26T07:20:32.333956+0000","last_peered":"2023-11-26T07:20:32.333956+0000","last_clean":"2023-11-26T07:20:32.333956+0000","last_became_active":"2023-11-26T07:20:31.343238+0000","last_became_peered":"2023-11-26T07:20:31.343238+0000","last_unstale":"2023-11-26T07:20:32.333956+0000","last_undegraded":"2023-11-26T07:20:32.333956+0000","last_fullsized":"2023-11-26T07:20:32.333956+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:28:53.731327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:34.214410+0000","last_change":"2023-11-26T07:20:32.351984+0000","last_active":"2023-11-26T07:20:34.214410+0000","last_peered":"2023-11-26T07:20:34.214410+0000","last_clean":"2023-11-26T07:20:34.214410+0000","last_became_active":"2023-11-26T07:20:32.351681+0000","last_became_peered":"2023-11-26T07:20:32.351681+0000","last_unstale":"2023-11-26T07:20:34.214410+0000","last_undegraded":"2023-11-26T07:20:34.214410+0000","last_fullsized":"2023-11-26T07:20:34.214410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:35:04.512395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.346722+0000","last_change":"2023-11-26T07:20:31.342258+0000","last_active":"2023-11-26T07:20:32.346722+0000","last_peered":"2023-11-26T07:20:32.346722+0000","last_clean":"2023-11-26T07:20:32.346722+0000","last_became_active":"2023-11-26T07:20:31.341991+0000","last_became_peered":"2023-11-26T07:20:31.341991+0000","last_unstale":"2023-11-26T07:20:32.346722+0000","last_undegraded":"2023-11-26T07:20:32.346722+0000","last_fullsized":"2023-11-26T07:20:32.346722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:32:31.697798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-11-26T07:20:33.455796+0000","last_change":"2023-11-26T07:20:32.359336+0000","last_active":"2023-11-26T07:20:33.455796+0000","last_peered":"2023-11-26T07:20:33.455796+0000","last_clean":"2023-11-26T07:20:33.455796+0000","last_became_active":"2023-11-26T07:20:32.358622+0000","last_became_peered":"2023-11-26T07:20:32.358622+0000","last_unstale":"2023-11-26T07:20:33.455796+0000","last_undegraded":"2023-11-26T07:20:33.455796+0000","last_fullsized":"2023-11-26T07:20:33.455796+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:31.313570+0000","last_clean_scrub_stamp":"2023-11-26T07:20:31.313570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:11:22.276923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.372456+0000","last_change":"2023-11-26T07:20:31.341968+0000","last_active":"2023-11-26T07:20:32.372456+0000","last_peered":"2023-11-26T07:20:32.372456+0000","last_clean":"2023-11-26T07:20:32.372456+0000","last_became_active":"2023-11-26T07:20:31.341623+0000","last_became_peered":"2023-11-26T07:20:31.341623+0000","last_unstale":"2023-11-26T07:20:32.372456+0000","last_undegraded":"2023-11-26T07:20:32.372456+0000","last_fullsized":"2023-11-26T07:20:32.372456+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:20:30.307821+0000","last_clean_scrub_stamp":"2023-11-26T07:20:30.307821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:18:14.616628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-26T07:20:32.337230+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:20:32.337230+0000","last_peered":"2023-11-26T07:20:32.337230+0000","last_clean":"2023-11-26T07:20:32.337230+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:20:32.337230+0000","last_undegraded":"2023-11-26T07:20:32.337230+0000","last_fullsized":"2023-11-26T07:20:32.337230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":822569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.61299999999999999},"min":{"1min":0.39400000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63,"15min":0.624},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.874,"5min":0.876,"15min":0.876},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83899999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56100000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.90000000000000002,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.877,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89000000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.52300000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.875,"5min":1.923,"15min":1.923},"last":0.376}]},{"osd":5,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84799999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92800000000000005,"5min":1,"15min":1},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77900000000000003,"15min":0.79000000000000004},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89900000000000002,"5min":1.863,"15min":1.863},"last":0.42499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":232783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.48299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.91500000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.54800000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63500000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.747,"15min":0.755},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.85199999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70999999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.495,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91400000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.754},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98899999999999999,"5min":1.089,"15min":1.089},"last":0.76800000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.57399999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93100000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95399999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67800000000000005,"15min":0.68500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.42099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":1.018,"15min":1.018},"last":0.56299999999999994}]},{"osd":5,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90900000000000003,"5min":1.133,"15min":1.133},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73799999999999999,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92600000000000005,"5min":1.042,"15min":1.042},"last":0.499}]},{"osd":7,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92700000000000005,"5min":1.196,"15min":1.196},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.80200000000000005,"15min":0.81599999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0249999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":569344,"data_stored":232181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.99099999999999999,"15min":1.0489999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81299999999999994,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":1.02,"15min":1.077},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0980000000000001,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.745}]},{"osd":1,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":1.0960000000000001,"15min":1.1519999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.591,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.629},{"interface":"front","average":{"1min":1.111,"5min":1.0269999999999999,"15min":1.0129999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":8.2720000000000002,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.81200000000000006}]},{"osd":2,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":0.88500000000000001,"15min":0.84299999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.995,"15min":1.0469999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":1.133,"15min":1.1970000000000001},"min":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.544,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.157,"5min":1.2190000000000001,"15min":1.2290000000000001},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":8.4039999999999999,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.85799999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.96299999999999997,"15min":1.0209999999999999},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.88900000000000001,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.0840000000000001,"15min":1.1379999999999999},"min":{"1min":0.497,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.635,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":0.94799999999999995,"15min":0.91400000000000003},"min":{"1min":0.54500000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":8.3640000000000008,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":1.9850000000000001,"15min":2.1930000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0009999999999999,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.79800000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":1.204,"15min":1.27},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.679,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2529999999999999,"15min":1.2629999999999999},"min":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":8.4410000000000007,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.89300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":233723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.87}]},{"osd":2,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.50600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77000000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.51900000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.751,"15min":0.754},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.74199999999999999,"15min":0.73199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.62}]},{"osd":6,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.81499999999999995,"15min":0.83199999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0900000000000001,"5min":1.095,"15min":1.095},"last":0.90100000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.82399999999999995,"15min":0.80600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":5.1520000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.751}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":577536,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.432,"15min":0.436},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.436,"15min":0.438},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.47499999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.62,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65200000000000002,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.67200000000000004,"15min":0.70199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72999999999999998,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.35199999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.86499999999999999,"15min":0.90600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83099999999999996,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89900000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.92800000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.873,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85699999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88700000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.90700000000000003,"15min":0.94699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.85999999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.92800000000000005,"15min":0.97399999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.86199999999999999,"5min":3.476,"15min":3.476},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.81999999999999995,"5min":1.03,"15min":1.03},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":581632,"data_stored":233745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40799999999999997,"15min":0.41399999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.434,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.309,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55200000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.47899999999999998,"15min":0.48999999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.54100000000000004,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53000000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.746,"15min":0.746},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.61599999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.258,"15min":1.258},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1339999999999999,"5min":1.169,"15min":1.169},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.51000000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0109999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.60399999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0209999999999999,"5min":1.24,"15min":1.24},"last":0.84799999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0549999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0880000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":569344,"data_stored":232181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.49399999999999999,"15min":0.51200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54800000000000004,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.51200000000000001,"15min":0.52600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68200000000000005,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.371},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.56399999999999995,"15min":0.57899999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68799999999999994,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.748,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.56100000000000005,"15min":0.57299999999999995},"min":{"1min":0.39100000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.38800000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94299999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93899999999999995,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97999999999999998,"5min":1.329,"15min":1.329},"last":0.625},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.749},"min":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.097,"5min":1.101,"15min":1.101},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.84899999999999998,"15min":0.86399999999999999},"min":{"1min":0.58399999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96199999999999997,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0860000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95099999999999996,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0580000000000001,"5min":1.173,"15min":1.173},"last":0.52800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1163264,"data_stored":822513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.61399999999999999,"15min":0.65200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.747,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54900000000000004,"15min":0.56299999999999994},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73999999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.56399999999999995,"15min":0.58199999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69299999999999995,"5min":2.415,"15min":2.415},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.72299999999999998,"15min":0.76200000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":5.234,"15min":5.234},"last":0.38400000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.59799999999999998,"15min":0.62},"min":{"1min":0.34999999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85399999999999998,"5min":3.726,"15min":3.726},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.496,"5min":0.77200000000000002,"15min":0.81799999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.94299999999999995,"15min":0.98399999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.89100000000000001,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.82499999999999996,"15min":0.84599999999999997},"min":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91100000000000003,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.878,"5min":2.835,"15min":2.835},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.877,"15min":0.90500000000000003},"min":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.97399999999999998,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.874,"15min":0.90100000000000002},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.93100000000000005,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.755},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":0.86699999999999999},"min":{"1min":0.55100000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.163,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.59099999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:19:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.88100000000000001,"15min":0.90600000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1379999999999999,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.85399999999999998,"15min":0.879},"min":{"1min":0.55900000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.081,"5min":2.798,"15min":2.798},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:20:36.784 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:20:36.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:20:36.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.958+0000 7f2c55f1d640 1 Processor -- start 2023-11-26T07:20:36.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.958+0000 7f2c55f1d640 1 -- start start 2023-11-26T07:20:36.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c55f1d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2c500ce630 0x7f2c50168340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c55f1d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5006ddb0 con 0x7f2c5015d280 2023-11-26T07:20:36.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c55f1d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5006e090 con 0x7f2c50161ae0 2023-11-26T07:20:36.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c55f1d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5006e370 con 0x7f2c500ce630 2023-11-26T07:20:36.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4f7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2c5015d280 0x7f2c500cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41934/0 (socket says 172.21.15.70:41934) 2023-11-26T07:20:36.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4f7fe640 1 -- 172.21.15.70:0/3788834189 learned_addr learned my addr 172.21.15.70:0/3788834189 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927545034 0 0) 0x7f2c5006ddb0 con 0x7f2c5015d280 2023-11-26T07:20:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4ffff640 1 --2- 172.21.15.70:0/3788834189 >> v2:172.21.15.120:3300/0 conn(0x7f2c500ce630 0x7f2c50168340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c3c003530 con 0x7f2c5015d280 2023-11-26T07:20:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2052211976 0 0) 0x7f2c3c003530 con 0x7f2c5015d280 2023-11-26T07:20:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 >> v2:172.21.15.120:3300/0 conn(0x7f2c500ce630 msgr2=0x7f2c50168340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 --2- 172.21.15.70:0/3788834189 >> v2:172.21.15.120:3300/0 conn(0x7f2c500ce630 0x7f2c50168340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 >> v1:172.21.15.120:6789/0 conn(0x7f2c50161ae0 legacy=0x7f2c50070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5006e650 con 0x7f2c5015d280 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f2c40001680 con 0x7f2c5015d280 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 >> v1:172.21.15.70:6789/0 conn(0x7f2c5015d280 legacy=0x7f2c500cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c3c003980 0x7f2c3c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c3c0047d0 0x7f2c3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5006e370 con 0x7f2c3c005190 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c00c030 con 0x7f2c3c003980 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c00c1f0 con 0x7f2c3c0047d0 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4ffff640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4f7fe640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c3c003980 0x7f2c3c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c47fff640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c3c0047d0 0x7f2c3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4ffff640 1 -- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c3c0047d0 msgr2=0x7f2c3c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4ffff640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c3c0047d0 0x7f2c3c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4ffff640 1 -- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c3c003980 msgr2=0x7f2c3c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4ffff640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c3c003980 0x7f2c3c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.962+0000 7f2c4ffff640 1 -- 172.21.15.70:0/3788834189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c003530 con 0x7f2c3c005190 2023-11-26T07:20:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c4ffff640 1 -- 172.21.15.70:0/3788834189 reap_dead start 2023-11-26T07:20:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c4ffff640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c3c00b990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009f90 tx=0x7f2c4801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fdaca76ab16d61 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c480a5c70 con 0x7f2c3c005190 2023-11-26T07:20:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4800f040 con 0x7f2c3c005190 2023-11-26T07:20:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c4effd640 1 -- 172.21.15.70:0/3788834189 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c480039a0 con 0x7f2c3c005190 2023-11-26T07:20:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3788834189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 msgr2=0x7f2c3c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c3c00b990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009f90 tx=0x7f2c4801cc60 comp rx=0 tx=0).stop 2023-11-26T07:20:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3788834189 shutdown_connections 2023-11-26T07:20:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3788834189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c3c00b990 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3788834189 >> 172.21.15.70:0/3788834189 conn(0x7f2c500b1a40 msgr2=0x7f2c500cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3788834189 shutdown_connections 2023-11-26T07:20:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3788834189 wait complete. 2023-11-26T07:20:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.966+0000 7f2c55f1d640 1 Processor -- start 2023-11-26T07:20:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 -- start start 2023-11-26T07:20:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c501538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c5014a600 0x7f2c50154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c50152b20 0x7f2c50152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c501534e0 con 0x7f2c3c005190 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50157f90 con 0x7f2c50152b20 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50158420 con 0x7f2c5014a600 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c501538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c501538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34224/0 (socket says 172.21.15.70:34224) 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 -- 172.21.15.70:0/3937765960 learned_addr learned my addr 172.21.15.70:0/3937765960 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4ffff640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c50152b20 0x7f2c50152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c47fff640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c5014a600 0x7f2c50154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 -- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c5014a600 msgr2=0x7f2c50154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c5014a600 0x7f2c50154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 -- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c50152b20 msgr2=0x7f2c50152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c50152b20 0x7f2c50152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 -- 172.21.15.70:0/3937765960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50152190 con 0x7f2c3c005190 2023-11-26T07:20:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c47fff640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c5014a600 0x7f2c50154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4f7fe640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c501538f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2c40007290 tx=0x7f2c40007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4cff9640 1 -- 172.21.15.70:0/3937765960 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40001650 con 0x7f2c3c005190 2023-11-26T07:20:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4cff9640 1 -- 172.21.15.70:0/3937765960 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000f9c0 con 0x7f2c3c005190 2023-11-26T07:20:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c50152470 con 0x7f2c3c005190 2023-11-26T07:20:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c4cff9640 1 -- 172.21.15.70:0/3937765960 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000fd90 con 0x7f2c3c005190 2023-11-26T07:20:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c50154d60 con 0x7f2c3c005190 2023-11-26T07:20:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.970+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c50067720 con 0x7f2c3c005190 2023-11-26T07:20:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.974+0000 7f2c4cff9640 1 -- 172.21.15.70:0/3937765960 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f2c4001d460 con 0x7f2c3c005190 2023-11-26T07:20:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.974+0000 7f2c4cff9640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c30066770 0x7f2c30068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.974+0000 7f2c4cff9640 1 -- 172.21.15.70:0/3937765960 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c40084290 con 0x7f2c3c005190 2023-11-26T07:20:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.974+0000 7f2c47fff640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c30066770 0x7f2c30068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:36.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.974+0000 7f2c47fff640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c30066770 0x7f2c30068c30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000c10 tx=0x7f2c38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:36.978+0000 7f2c4cff9640 1 -- 172.21.15.70:0/3937765960 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c40051510 con 0x7f2c3c005190 2023-11-26T07:20:37.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.178+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2c500cfe00 con 0x7f2c3c005190 2023-11-26T07:20:37.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c4cff9640 1 -- 172.21.15.70:0/3937765960 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2c40054b30 con 0x7f2c3c005190 2023-11-26T07:20:37.185 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-11-26T07:20:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA== 2023-11-26T07:20:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: caps mds = "allow" 2023-11-26T07:20:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: caps mon = "allow r" 2023-11-26T07:20:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:20:37.186 INFO:teuthology.orchestra.run.smithi070.stderr:updated caps for client.0 2023-11-26T07:20:37.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c30066770 msgr2=0x7f2c30068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c30066770 0x7f2c30068c30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000c10 tx=0x7f2c38009040 comp rx=0 tx=0).stop 2023-11-26T07:20:37.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 msgr2=0x7f2c501538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c501538f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2c40007290 tx=0x7f2c40007750 comp rx=0 tx=0).stop 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 shutdown_connections 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2c50152b20 0x7f2c50152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2c5014a600 0x7f2c50154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2c30066770 0x7f2c30068c30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 --2- 172.21.15.70:0/3937765960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c3c005190 0x7f2c501538f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 >> 172.21.15.70:0/3937765960 conn(0x7f2c500b1a40 msgr2=0x7f2c500b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 shutdown_connections 2023-11-26T07:20:37.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.182+0000 7f2c55f1d640 1 -- 172.21.15.70:0/3937765960 wait complete. 2023-11-26T07:20:37.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:20:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.338+0000 7f9e3025a640 1 Processor -- start 2023-11-26T07:20:37.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e3025a640 1 -- start start 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e3025a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9e280cf990 0x7f9e2815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e3025a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e2815f4e0 0x7f9e280cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e3025a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2806c520 con 0x7f9e2813e290 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e3025a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2806c800 con 0x7f9e2815f4e0 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e3025a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2806cae0 con 0x7f9e280cf990 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2dff6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9e2813e290 0x7f9e280cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41950/0 (socket says 172.21.15.70:41950) 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2dff6640 1 -- 172.21.15.70:0/3789697795 learned_addr learned my addr 172.21.15.70:0/3789697795 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:37.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2e7f7640 1 --2- 172.21.15.70:0/3789697795 >> v2:172.21.15.70:3300/0 conn(0x7f9e2815f4e0 0x7f9e280cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:37.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2d7f5640 1 --2- 172.21.15.70:0/3789697795 >> v2:172.21.15.120:3300/0 conn(0x7f9e280cf990 0x7f9e2815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:37.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2cff4640 1 -- 172.21.15.70:0/3789697795 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385530826 0 0) 0x7f9e2806c520 con 0x7f9e2813e290 2023-11-26T07:20:37.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2cff4640 1 -- 172.21.15.70:0/3789697795 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e14003530 con 0x7f9e2813e290 2023-11-26T07:20:37.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2e7f7640 1 -- 172.21.15.70:0/3789697795 >> v2:172.21.15.120:3300/0 conn(0x7f9e280cf990 msgr2=0x7f9e2815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:37.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2e7f7640 1 --2- 172.21.15.70:0/3789697795 >> v2:172.21.15.120:3300/0 conn(0x7f9e280cf990 0x7f9e2815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2e7f7640 1 -- 172.21.15.70:0/3789697795 >> v1:172.21.15.70:6789/0 conn(0x7f9e2813e290 legacy=0x7f9e280cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2e7f7640 1 -- 172.21.15.70:0/3789697795 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2806cdc0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.342+0000 7f9e2d7f5640 1 --2- 172.21.15.70:0/3789697795 >> v2:172.21.15.120:3300/0 conn(0x7f9e280cf990 0x7f9e2815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:37.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e2e7f7640 1 --2- 172.21.15.70:0/3789697795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e280cd7b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9e280cfe40 tx=0x7f9e2001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf65caf1ca76633 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:37.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e2cff4640 1 -- 172.21.15.70:0/3789697795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2815fb60 con 0x7f9e2815f4e0 2023-11-26T07:20:37.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e2cff4640 1 -- 172.21.15.70:0/3789697795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e200a59c0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e2cff4640 1 -- 172.21.15.70:0/3789697795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200a5d50 con 0x7f9e2815f4e0 2023-11-26T07:20:37.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 -- 172.21.15.70:0/3789697795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 msgr2=0x7f9e280cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 --2- 172.21.15.70:0/3789697795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e280cd7b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9e280cfe40 tx=0x7f9e2001c8e0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 -- 172.21.15.70:0/3789697795 shutdown_connections 2023-11-26T07:20:37.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 --2- 172.21.15.70:0/3789697795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e280cd7b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 --2- 172.21.15.70:0/3789697795 >> v2:172.21.15.120:3300/0 conn(0x7f9e280cf990 0x7f9e2815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 -- 172.21.15.70:0/3789697795 >> 172.21.15.70:0/3789697795 conn(0x7f9e2806a890 msgr2=0x7f9e2806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:37.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 -- 172.21.15.70:0/3789697795 shutdown_connections 2023-11-26T07:20:37.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 -- 172.21.15.70:0/3789697795 wait complete. 2023-11-26T07:20:37.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.346+0000 7f9e3025a640 1 Processor -- start 2023-11-26T07:20:37.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 -- start start 2023-11-26T07:20:37.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e280cf990 0x7f9e280b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e2813e290 0x7f9e28154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e2813c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280b09d0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280b19e0 con 0x7f9e2813e290 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2815e980 con 0x7f9e280cf990 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e2813c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e2813c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34252/0 (socket says 172.21.15.70:34252) 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 -- 172.21.15.70:0/2937627515 learned_addr learned my addr 172.21.15.70:0/2937627515 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2d7f5640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e2813e290 0x7f9e28154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:37.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2dff6640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e280cf990 0x7f9e280b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:37.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 -- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e280cf990 msgr2=0x7f9e280b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e280cf990 0x7f9e280b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 -- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e2813e290 msgr2=0x7f9e28154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e2813e290 0x7f9e28154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 -- 172.21.15.70:0/2937627515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20009a70 con 0x7f9e2815f4e0 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e2e7f7640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e2813c720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9e200194f0 tx=0x7f9e20019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e1e7fc640 1 -- 172.21.15.70:0/2937627515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200b9860 con 0x7f9e2815f4e0 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e1e7fc640 1 -- 172.21.15.70:0/2937627515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e200b99c0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e1e7fc640 1 -- 172.21.15.70:0/2937627515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200b9d70 con 0x7f9e2815f4e0 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e280afc10 con 0x7f9e2815f4e0 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e280b01d0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.350+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e28067680 con 0x7f9e2815f4e0 2023-11-26T07:20:37.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.354+0000 7f9e1e7fc640 1 -- 172.21.15.70:0/2937627515 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f9e200c4460 con 0x7f9e2815f4e0 2023-11-26T07:20:37.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.354+0000 7f9e1e7fc640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e0c066740 0x7f9e0c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:37.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.354+0000 7f9e1e7fc640 1 -- 172.21.15.70:0/2937627515 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e2011f620 con 0x7f9e2815f4e0 2023-11-26T07:20:37.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.354+0000 7f9e2dff6640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e0c066740 0x7f9e0c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:37.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.354+0000 7f9e2dff6640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e0c066740 0x7f9e0c068c00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9e240011f0 tx=0x7f9e24007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:37.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.358+0000 7f9e1e7fc640 1 -- 172.21.15.70:0/2937627515 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e200ec7c0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.538+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e28165de0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.538+0000 7f9e1e7fc640 1 -- 172.21.15.70:0/2937627515 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f9e200efde0 con 0x7f9e2815f4e0 2023-11-26T07:20:37.543 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:20:37.543 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3372803527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3372803527},{"type":"v1","addr":"172.21.15.120:6833","nonce":3372803527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5671,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2241396376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2241396376},{"type":"v1","addr":"172.21.15.120:6835","nonce":2241396376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1311811000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1311811000},{"type":"v1","addr":"172.21.15.70:6835","nonce":1311811000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:31.700041+0000","modified":"2023-11-26T07:20:34.716588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/1491316829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":1491316829},{"type":"v1","addr":"172.21.15.70:6837","nonce":1491316829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:20:37.543 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2023-11-26T07:20:37.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e0c066740 msgr2=0x7f9e0c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e0c066740 0x7f9e0c068c00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9e240011f0 tx=0x7f9e24007d40 comp rx=0 tx=0).stop 2023-11-26T07:20:37.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 msgr2=0x7f9e2813c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:37.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e2813c720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9e200194f0 tx=0x7f9e20019680 comp rx=0 tx=0).stop 2023-11-26T07:20:37.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 shutdown_connections 2023-11-26T07:20:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e0c066740 0x7f9e0c068c00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e2815f4e0 0x7f9e2813c720 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e2813e290 0x7f9e28154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 --2- 172.21.15.70:0/2937627515 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e280cf990 0x7f9e280b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 >> 172.21.15.70:0/2937627515 conn(0x7f9e2806a890 msgr2=0x7f9e28070950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 shutdown_connections 2023-11-26T07:20:37.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:37.542+0000 7f9e3025a640 1 -- 172.21.15.70:0/2937627515 wait complete. 2023-11-26T07:20:37.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:20:31.700041+0000', 'modified': '2023-11-26T07:20:34.716588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5784}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5784': {'gid': 5784, 'name': 'c', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.70:6837/1491316829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6836', 'nonce': 1491316829}, {'type': 'v1', 'addr': '172.21.15.70:6837', 'nonce': 1491316829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:20:37.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:20:37.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-26T07:20:38.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd44d7c1640 1 Processor -- start 2023-11-26T07:20:38.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd44d7c1640 1 -- start start 2023-11-26T07:20:38.109 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd44d7c1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4480b2160 0x7fd4480d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd44d7c1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4480cf0e0 con 0x7fd44815d6e0 2023-11-26T07:20:38.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd44d7c1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4480ceb20 con 0x7fd4480d1bc0 2023-11-26T07:20:38.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd44d7c1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44815dac0 con 0x7fd4480b2160 2023-11-26T07:20:38.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd446ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd44815d6e0 0x7fd4480d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41958/0 (socket says 172.21.15.70:41958) 2023-11-26T07:20:38.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd446ffd640 1 -- 172.21.15.70:0/759653923 learned_addr learned my addr 172.21.15.70:0/759653923 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:38.110 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd4477fe640 1 --2- 172.21.15.70:0/759653923 >> v2:172.21.15.120:3300/0 conn(0x7fd4480b2160 0x7fd4480d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd4467fc640 1 -- 172.21.15.70:0/759653923 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335777899 0 0) 0x7fd4480cf0e0 con 0x7fd44815d6e0 2023-11-26T07:20:38.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd4467fc640 1 -- 172.21.15.70:0/759653923 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd434003530 con 0x7fd44815d6e0 2023-11-26T07:20:38.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd4477fe640 1 -- 172.21.15.70:0/759653923 >> v1:172.21.15.120:6789/0 conn(0x7fd4480d1bc0 legacy=0x7fd4480b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd4477fe640 1 -- 172.21.15.70:0/759653923 >> v1:172.21.15.70:6789/0 conn(0x7fd44815d6e0 legacy=0x7fd4480d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.106+0000 7fd4477fe640 1 -- 172.21.15.70:0/759653923 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4480cee00 con 0x7fd4480b2160 2023-11-26T07:20:38.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd4477fe640 1 --2- 172.21.15.70:0/759653923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480b2160 0x7fd4480d0df0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd440009d90 tx=0x7fd44001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12edaf60197326d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd4467fc640 1 -- 172.21.15.70:0/759653923 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400a5900 con 0x7fd4480b2160 2023-11-26T07:20:38.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd4467fc640 1 -- 172.21.15.70:0/759653923 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4400a5a60 con 0x7fd4480b2160 2023-11-26T07:20:38.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd4467fc640 1 -- 172.21.15.70:0/759653923 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400a5dd0 con 0x7fd4480b2160 2023-11-26T07:20:38.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd44d7c1640 1 -- 172.21.15.70:0/759653923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480b2160 msgr2=0x7fd4480d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/759653923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480b2160 0x7fd4480d0df0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd440009d90 tx=0x7fd44001c950 comp rx=0 tx=0).stop 2023-11-26T07:20:38.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd44d7c1640 1 -- 172.21.15.70:0/759653923 shutdown_connections 2023-11-26T07:20:38.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/759653923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480b2160 0x7fd4480d0df0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd44d7c1640 1 -- 172.21.15.70:0/759653923 >> 172.21.15.70:0/759653923 conn(0x7fd44809c550 msgr2=0x7fd4480d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd44d7c1640 1 -- 172.21.15.70:0/759653923 shutdown_connections 2023-11-26T07:20:38.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.110+0000 7fd44d7c1640 1 -- 172.21.15.70:0/759653923 wait complete. 2023-11-26T07:20:38.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 Processor -- start 2023-11-26T07:20:38.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 -- start start 2023-11-26T07:20:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4480b2160 0x7fd448154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480d1bc0 0x7fd4480ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd44815d6e0 0x7fd4480cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480cd510 con 0x7fd4480b2160 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480cbd00 con 0x7fd4480d1bc0 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4480ccb40 con 0x7fd44815d6e0 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4480b2160 0x7fd448154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4480b2160 0x7fd448154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34260/0 (socket says 172.21.15.70:34260) 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 -- 172.21.15.70:0/3579128214 learned_addr learned my addr 172.21.15.70:0/3579128214 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd4477fe640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd44815d6e0 0x7fd4480cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480d1bc0 0x7fd4480ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 -- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd44815d6e0 msgr2=0x7fd4480cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd44815d6e0 0x7fd4480cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 -- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480d1bc0 msgr2=0x7fd4480ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480d1bc0 0x7fd4480ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 -- 172.21.15.70:0/3579128214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440009a70 con 0x7fd4480b2160 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd446ffd640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4480b2160 0x7fd448154640 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd43800c420 tx=0x7fd43800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd43ffff640 1 -- 172.21.15.70:0/3579128214 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438005cf0 con 0x7fd4480b2160 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd43ffff640 1 -- 172.21.15.70:0/3579128214 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd438005e50 con 0x7fd4480b2160 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd43ffff640 1 -- 172.21.15.70:0/3579128214 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4380072d0 con 0x7fd4480b2160 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4480cbf30 con 0x7fd4480b2160 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.114+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4480cc4f0 con 0x7fd4480b2160 2023-11-26T07:20:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd43ffff640 1 -- 172.21.15.70:0/3579128214 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fd438007430 con 0x7fd4480b2160 2023-11-26T07:20:38.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd43ffff640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd428066740 0x7fd428068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd43ffff640 1 -- 172.21.15.70:0/3579128214 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd438083810 con 0x7fd4480b2160 2023-11-26T07:20:38.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd428066740 0x7fd428068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 Processor -- start 2023-11-26T07:20:38.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 -- start start 2023-11-26T07:20:38.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd428066740 0x7fd428068c00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd4481f9510 tx=0x7fd430009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 0x55a097c21de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c22700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a097a8c130 con 0x55a097c6bc90 2023-11-26T07:20:38.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a097a799a0 con 0x55a097c22320 2023-11-26T07:20:38.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.118+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a097a76ed0 con 0x55a097c6c5b0 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34264/0 (socket says 172.21.15.70:34264) 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 -- 172.21.15.70:0/2279924189 learned_addr learned my addr 172.21.15.70:0/2279924189 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd4477fe640 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c22700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 0x55a097c21de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 -- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 msgr2=0x55a097c21de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 0x55a097c21de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 -- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 msgr2=0x55a097c22700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c22700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 -- 172.21.15.70:0/2279924189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09776a890 con 0x55a097c6bc90 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd4477fe640 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c22700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd446ffd640 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6c070 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd438007fd0 tx=0x7fd4380547f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25ef28fe59535e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd43cff9640 1 -- 172.21.15.70:0/2279924189 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438052870 con 0x55a097c6bc90 2023-11-26T07:20:38.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd43cff9640 1 -- 172.21.15.70:0/2279924189 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd438050d80 con 0x55a097c6bc90 2023-11-26T07:20:38.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd43cff9640 1 -- 172.21.15.70:0/2279924189 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43805c630 con 0x55a097c6bc90 2023-11-26T07:20:38.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- 172.21.15.70:0/2279924189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 msgr2=0x55a097c6c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6c070 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd438007fd0 tx=0x7fd4380547f0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- 172.21.15.70:0/2279924189 shutdown_connections 2023-11-26T07:20:38.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c22700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 0x55a097c21de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 --2- 172.21.15.70:0/2279924189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6c070 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- 172.21.15.70:0/2279924189 >> 172.21.15.70:0/2279924189 conn(0x55a097c1e2d0 msgr2=0x55a097c206c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- 172.21.15.70:0/2279924189 shutdown_connections 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- 172.21.15.70:0/2279924189 wait complete. 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- start start 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 Processor -- start 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c22320 0x55a097c50ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c50ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c51530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a097a727c0 con 0x55a097c6bc90 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a097a2abf0 con 0x55a097c6c5b0 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a097a30a90 con 0x55a097c22320 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd450b20000 10 client.0 _ll_register_callbacks cb 0x55a097c0d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd43e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c50ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd43e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c50ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34276/0 (socket says 172.21.15.70:34276) 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.122+0000 7fd43e7fc640 1 -- 172.21.15.70:0/3980450300 learned_addr learned my addr 172.21.15.70:0/3980450300 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd446ffd640 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c22320 0x55a097c50ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd4477fe640 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c51530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd43e7fc640 1 -- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c22320 msgr2=0x55a097c50ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c22320 0x55a097c50ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd43e7fc640 1 -- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 msgr2=0x55a097c51530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c51530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd43e7fc640 1 -- 172.21.15.70:0/3980450300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4480cc4f0 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c50ff0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd430003900 tx=0x7fd430000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a260eebc8a3d32a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 1 -- 172.21.15.70:0/3980450300 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430003e80 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 1 -- 172.21.15.70:0/3980450300 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd43000ec90 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a097a34470 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 1 -- 172.21.15.70:0/3980450300 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43000ee50 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 10 client.5925 fetch_fsmap learned FSMap version 28 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55a097a33190 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 1 -- 172.21.15.70:0/3980450300 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a097a34470 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 1 -- 172.21.15.70:0/3980450300 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd430013420 con 0x55a097c6bc90 2023-11-26T07:20:38.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 10 client.5925 fetch_fsmap finished waiting for FSMap version 28 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 10 client.5925 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 20 client.5925 populate_metadata read hostname 'smithi070' 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097c51f40 0x55a097c7df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 4 client.5925 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 --> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a097a37b50 con 0x55a097c51f40 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd446ffd640 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097c51f40 0x55a097c7df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 10 client.5925 ms_handle_connect on v2:172.21.15.70:6836/1491316829 2023-11-26T07:20:38.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd446ffd640 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097c51f40 0x55a097c7df50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e4e6f79e5ba1531 server_cookie=266e73c0a129a1dd in_seq=0 out_seq=0 2023-11-26T07:20:38.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 1 -- 172.21.15.70:0/3980450300 <== mds.0 v2:172.21.15.70:6836/1491316829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a097a37b50 con 0x55a097c51f40 2023-11-26T07:20:38.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 10 client.5925 handle_command_reply: tid=0 2023-11-26T07:20:38.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 client.5925 shutdown 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 msgr2=0x55a097c50ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c50ff0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd430003900 tx=0x7fd430000bd0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 shutdown_connections 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097c51f40 0x55a097c7df50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c50ff0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c51530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd425ffb640 0 client.5925 ms_handle_reset on v2:172.21.15.70:6836/1491316829 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 --2- 172.21.15.70:0/3980450300 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c22320 0x55a097c50ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 >> 172.21.15.70:0/3980450300 conn(0x55a097c1e2d0 msgr2=0x55a097c206c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 shutdown_connections 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 1 -- 172.21.15.70:0/3980450300 wait complete. 2023-11-26T07:20:38.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.126+0000 7fd450b20000 20 client.5925 trim_cache size 0 max 16384 2023-11-26T07:20:38.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 Processor -- start 2023-11-26T07:20:38.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 -- start start 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c6b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 0x55a097c6a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09772b940 con 0x55a097c6bc90 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a097a27760 con 0x55a097c22320 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a097af9fa0 con 0x55a097c6c5b0 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd43e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd43e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34280/0 (socket says 172.21.15.70:34280) 2023-11-26T07:20:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.142+0000 7fd43e7fc640 1 -- 172.21.15.70:0/554200114 learned_addr learned my addr 172.21.15.70:0/554200114 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43e7fc640 1 -- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 msgr2=0x55a097c6a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 0x55a097c6a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43e7fc640 1 -- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 msgr2=0x55a097c6b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c6b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c6b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43e7fc640 1 -- 172.21.15.70:0/554200114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a097a19490 con 0x55a097c6bc90 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c6b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6a3e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd4300036a0 tx=0x7fd43001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8baeb90ec970bc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43d7fa640 1 -- 172.21.15.70:0/554200114 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430003e80 con 0x55a097c6bc90 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43d7fa640 1 -- 172.21.15.70:0/554200114 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000e8d0 con 0x55a097c6bc90 2023-11-26T07:20:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43d7fa640 1 -- 172.21.15.70:0/554200114 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430013420 con 0x55a097c6bc90 2023-11-26T07:20:38.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- 172.21.15.70:0/554200114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 msgr2=0x55a097c6a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6a3e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd4300036a0 tx=0x7fd43001f000 comp rx=0 tx=0).stop 2023-11-26T07:20:38.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- 172.21.15.70:0/554200114 shutdown_connections 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c6bc90 0x55a097c6a3e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6c5b0 0x55a097c6a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 --2- 172.21.15.70:0/554200114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c22320 0x55a097c6b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- 172.21.15.70:0/554200114 >> 172.21.15.70:0/554200114 conn(0x55a097c1e2d0 msgr2=0x55a097c79280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- 172.21.15.70:0/554200114 shutdown_connections 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- 172.21.15.70:0/554200114 wait complete. 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- start start 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 Processor -- start 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c22320 0x55a097c23a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6bc90 0x55a097c7efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c7f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09776b1b0 con 0x55a097c22320 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a097c24a50 con 0x55a097c6c5b0 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a097a3c6c0 con 0x55a097c6bc90 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd450b20000 10 client.0 _ll_register_callbacks cb 0x55a097ac0c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c22320 0x55a097c23a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c22320 0x55a097c23a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34290/0 (socket says 172.21.15.70:34290) 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 -- 172.21.15.70:0/356186402 learned_addr learned my addr 172.21.15.70:0/356186402 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6bc90 0x55a097c7efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd4477fe640 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c7f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 -- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6bc90 msgr2=0x55a097c7efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6bc90 0x55a097c7efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 -- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 msgr2=0x55a097c7f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c7f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.146+0000 7fd446ffd640 1 -- 172.21.15.70:0/356186402 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a097a33190 con 0x55a097c22320 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd446ffd640 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c22320 0x55a097c23a90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd438081a30 tx=0x7fd43800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03086bba2fc9ccc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 1 -- 172.21.15.70:0/356186402 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438080070 con 0x55a097c22320 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 1 -- 172.21.15.70:0/356186402 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd43805c430 con 0x55a097c22320 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a097a71110 con 0x55a097c22320 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 1 -- 172.21.15.70:0/356186402 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43805c5f0 con 0x55a097c22320 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 10 client.5931 fetch_fsmap learned FSMap version 28 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55a09776acc0 con 0x55a097c22320 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 1 -- 172.21.15.70:0/356186402 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a097a71110 con 0x55a097c22320 2023-11-26T07:20:38.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 1 -- 172.21.15.70:0/356186402 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd438071030 con 0x55a097c22320 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 10 client.5931 fetch_fsmap finished waiting for FSMap version 28 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 10 client.5931 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 20 client.5931 populate_metadata read hostname 'smithi070' 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097ccbe00 0x55a097ccc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 4 client.5931 mds_command: new command op to 5784 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 --> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a097aa09a0 con 0x55a097ccbe00 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097ccbe00 0x55a097ccc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 10 client.5931 ms_handle_connect on v2:172.21.15.70:6836/1491316829 2023-11-26T07:20:38.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd43e7fc640 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097ccbe00 0x55a097ccc1e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad2290a53c04fd7a server_cookie=75c29da2a0ed7982 in_seq=0 out_seq=0 2023-11-26T07:20:38.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 1 -- 172.21.15.70:0/356186402 <== mds.0 v2:172.21.15.70:6836/1491316829 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a097aa09a0 con 0x55a097ccbe00 2023-11-26T07:20:38.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 10 client.5931 handle_command_reply: tid=0 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 client.5931 shutdown 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c22320 msgr2=0x55a097c23a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c22320 0x55a097c23a90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd438081a30 tx=0x7fd43800cf90 comp rx=0 tx=0).stop 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 shutdown_connections 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:6836/1491316829,v1:172.21.15.70:6837/1491316829] conn(0x55a097ccbe00 0x55a097ccc1e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a097c6c5b0 0x55a097c7f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55a097c6bc90 0x55a097c7efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 --2- 172.21.15.70:0/356186402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a097c22320 0x55a097c23a90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd425ffb640 0 client.5931 ms_handle_reset on v2:172.21.15.70:6836/1491316829 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 >> 172.21.15.70:0/356186402 conn(0x55a097c1e2d0 msgr2=0x55a097c206c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 shutdown_connections 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 1 -- 172.21.15.70:0/356186402 wait complete. 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd450b20000 20 client.5931 trim_cache size 0 max 16384 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "35961970-1319-4bbb-b3aa-e783ca1e0d4a", 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 5784, 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-11-26T07:20:38.159 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-11-26T07:20:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 5.8126929799999996, 2023-11-26T07:20:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 28, 2023-11-26T07:20:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 48, 2023-11-26T07:20:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 48, 2023-11-26T07:20:38.160 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 10.731104952000001 2023-11-26T07:20:38.160 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd428066740 msgr2=0x7fd428068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd428066740 0x7fd428068c00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd4481f9510 tx=0x7fd430009040 comp rx=0 tx=0).stop 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4480b2160 msgr2=0x7fd448154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4480b2160 0x7fd448154640 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd43800c420 tx=0x7fd43800c8e0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 shutdown_connections 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd44815d6e0 0x7fd4480cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4480d1bc0 0x7fd4480ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd428066740 0x7fd428068c00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 --2- 172.21.15.70:0/3579128214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4480b2160 0x7fd448154640 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 >> 172.21.15.70:0/3579128214 conn(0x7fd44809c550 msgr2=0x7fd4480b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 shutdown_connections 2023-11-26T07:20:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.150+0000 7fd44d7c1640 1 -- 172.21.15.70:0/3579128214 wait complete. 2023-11-26T07:20:38.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:20:38.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.306+0000 7f1a07f72640 1 Processor -- start 2023-11-26T07:20:38.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.306+0000 7f1a07f72640 1 -- start start 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a07f72640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1a001614b0 0x7f1a000cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a07f72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00071970 0x7f1a00161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a07f72640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a00070ba0 0x7f1a00071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a07f72640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a00071570 con 0x7f1a001614b0 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a07f72640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0015d970 con 0x7f1a00070ba0 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a07f72640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a00161dd0 con 0x7f1a00071970 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1a001614b0 0x7f1a000cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1a001614b0 0x7f1a000cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34306/0 (socket says 172.21.15.70:34306) 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 -- 172.21.15.70:0/615622958 learned_addr learned my addr 172.21.15.70:0/615622958 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a0550d640 1 --2- 172.21.15.70:0/615622958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00071970 0x7f1a00161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a0650f640 1 --2- 172.21.15.70:0/615622958 >> v2:172.21.15.120:3300/0 conn(0x7f1a00070ba0 0x7f1a00071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 -- 172.21.15.70:0/615622958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00071970 msgr2=0x7f1a00161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 --2- 172.21.15.70:0/615622958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00071970 0x7f1a00161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 -- 172.21.15.70:0/615622958 >> v2:172.21.15.120:3300/0 conn(0x7f1a00070ba0 msgr2=0x7f1a00071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:38.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 --2- 172.21.15.70:0/615622958 >> v2:172.21.15.120:3300/0 conn(0x7f1a00070ba0 0x7f1a00071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.310+0000 7f1a05d0e640 1 -- 172.21.15.70:0/615622958 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0015dc30 con 0x7f1a001614b0 2023-11-26T07:20:38.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a05d0e640 1 --2- 172.21.15.70:0/615622958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a000cd610 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1a00072560 tx=0x7f19fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271fc5679133b1d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a04d0c640 1 -- 172.21.15.70:0/615622958 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0aa5f0 con 0x7f1a001614b0 2023-11-26T07:20:38.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a04d0c640 1 -- 172.21.15.70:0/615622958 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0aa750 con 0x7f1a001614b0 2023-11-26T07:20:38.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a04d0c640 1 -- 172.21.15.70:0/615622958 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0aaae0 con 0x7f1a001614b0 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 -- 172.21.15.70:0/615622958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 msgr2=0x7f1a000cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 --2- 172.21.15.70:0/615622958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a000cd610 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1a00072560 tx=0x7f19fc01c4d0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 -- 172.21.15.70:0/615622958 shutdown_connections 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 --2- 172.21.15.70:0/615622958 >> v2:172.21.15.120:3300/0 conn(0x7f1a00070ba0 0x7f1a00071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 --2- 172.21.15.70:0/615622958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00071970 0x7f1a00161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 --2- 172.21.15.70:0/615622958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a000cd610 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 -- 172.21.15.70:0/615622958 >> 172.21.15.70:0/615622958 conn(0x7f1a000cf710 msgr2=0x7f1a000cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 -- 172.21.15.70:0/615622958 shutdown_connections 2023-11-26T07:20:38.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 -- 172.21.15.70:0/615622958 wait complete. 2023-11-26T07:20:38.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 Processor -- start 2023-11-26T07:20:38.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.314+0000 7f1a07f72640 1 -- start start 2023-11-26T07:20:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00070ba0 0x7f1a000b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a00071970 0x7f1a0015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a00152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b0770 con 0x7f1a001614b0 2023-11-26T07:20:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b2570 con 0x7f1a00071970 2023-11-26T07:20:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b01b0 con 0x7f1a00070ba0 2023-11-26T07:20:38.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a00152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a00152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34314/0 (socket says 172.21.15.70:34314) 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 -- 172.21.15.70:0/2092070386 learned_addr learned my addr 172.21.15.70:0/2092070386 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0550d640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a00071970 0x7f1a0015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a05d0e640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00070ba0 0x7f1a000b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 -- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00070ba0 msgr2=0x7f1a000b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00070ba0 0x7f1a000b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 -- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a00071970 msgr2=0x7f1a0015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a00071970 0x7f1a0015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 -- 172.21.15.70:0/2092070386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0094d0 con 0x7f1a001614b0 2023-11-26T07:20:38.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a0650f640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a00152f60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f19f800efc0 tx=0x7f19f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f19f67fc640 1 -- 172.21.15.70:0/2092070386 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8009ba0 con 0x7f1a001614b0 2023-11-26T07:20:38.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f19f67fc640 1 -- 172.21.15.70:0/2092070386 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f800f040 con 0x7f1a001614b0 2023-11-26T07:20:38.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a000b0490 con 0x7f1a001614b0 2023-11-26T07:20:38.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f19f67fc640 1 -- 172.21.15.70:0/2092070386 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80146c0 con 0x7f1a001614b0 2023-11-26T07:20:38.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0014df20 con 0x7f1a001614b0 2023-11-26T07:20:38.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0014daa0 con 0x7f1a001614b0 2023-11-26T07:20:38.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.318+0000 7f19f67fc640 1 -- 172.21.15.70:0/2092070386 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f19f8014820 con 0x7f1a001614b0 2023-11-26T07:20:38.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.322+0000 7f19f67fc640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19e4066740 0x7f19e4068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:38.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.322+0000 7f19f67fc640 1 -- 172.21.15.70:0/2092070386 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19f8084d60 con 0x7f1a001614b0 2023-11-26T07:20:38.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.322+0000 7f1a05d0e640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19e4066740 0x7f19e4068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:38.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.322+0000 7f1a05d0e640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19e4066740 0x7f19e4068c00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae000 tx=0x7f19fc0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:38.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.326+0000 7f19f67fc640 1 -- 172.21.15.70:0/2092070386 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a0014daa0 con 0x7f1a001614b0 2023-11-26T07:20:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a0014daa0 con 0x7f1a001614b0 2023-11-26T07:20:38.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f19f67fc640 1 -- 172.21.15.70:0/2092070386 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a0014daa0 con 0x7f1a001614b0 2023-11-26T07:20:38.512 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:20:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19e4066740 msgr2=0x7f19e4068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19e4066740 0x7f19e4068c00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae000 tx=0x7f19fc0b5040 comp rx=0 tx=0).stop 2023-11-26T07:20:38.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 msgr2=0x7f1a00152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a00152f60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f19f800efc0 tx=0x7f19f800c490 comp rx=0 tx=0).stop 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 shutdown_connections 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19e4066740 0x7f19e4068c00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a001614b0 0x7f1a00152f60 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a00071970 0x7f1a0015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 --2- 172.21.15.70:0/2092070386 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a00070ba0 0x7f1a000b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 >> 172.21.15.70:0/2092070386 conn(0x7f1a000cf710 msgr2=0x7f1a00160240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 shutdown_connections 2023-11-26T07:20:38.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:38.510+0000 7f1a07f72640 1 -- 172.21.15.70:0/2092070386 wait complete. 2023-11-26T07:20:38.533 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:20:38.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:20:38.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-11-26T07:20:38.533 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:20:38.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:38.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:20:38.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:20:38.534 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:20:38.534 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:20:38.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.534 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:20:38.544 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42254sec preferred_lft 42254sec 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 02:42:99:81:d5:52 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:38.545 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:20:38.546 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run.smithi070.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:38.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.547 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:20:38.609 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-11-26T07:20:38.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.611 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-11-26T07:20:38.665 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:20:38.666 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:20:38.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.667 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:20:38.667 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:20:38.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:20:38.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:20:38.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:20:38.667 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:20:38.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.761 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:20:38.770 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:20:38.770 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:20:38.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:38.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2023-11-26T07:20:38.835 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-26T07:20:38.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:38.835 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:38.887 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:20:38.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:38.887 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:38.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:20:39.003 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:20:39.057 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:20:39.057 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:20:39.057 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:20:39.057 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:20:39.057 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:20:39.057 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:20:39.058 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:20:39.059 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:20:39.060 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:20:39.060 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:20:39.060 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:20:39.060 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:20:39.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.061 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:20:39.111 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:20:39.111 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-26T07:20:39.161 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:20:39.183 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:20:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:20:39.238 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:20:39.239 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:20:39.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.240 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:20:39.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2023-11-26T07:20:39.254+0000 7f4e24e46580 -1 init, newargv = 0x55e723c9e3c0 newargc=15 2023-11-26T07:20:39.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[50137]: starting ceph client 2023-11-26T07:20:39.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[50137]: starting fuse 2023-11-26T07:20:39.265 INFO:teuthology.orchestra.run.smithi070.stdout:43 2023-11-26T07:20:39.265 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> import re 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> import os 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-26T07:20:39.266 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:20:39.267 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:20:39.268 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2023-11-26T07:20:39.268 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2023-11-26T07:20:39.268 DEBUG:teuthology.orchestra.run.smithi070:> return f 2023-11-26T07:20:39.268 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:20:39.268 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:20:39.268 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2023-11-26T07:20:39.268 DEBUG:teuthology.orchestra.run.smithi070:> ' 2023-11-26T07:20:39.391 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.50137.asok 2023-11-26T07:20:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:20:39.402 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50137.asok 2023-11-26T07:20:39.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50137.asok status 2023-11-26T07:20:39.574 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:20:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2023-11-26T07:20:39.574 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "50137", 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 5946, 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2023-11-26T07:20:39.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 5946 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2806484475 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:20:39.576 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2806484475 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.5946 192.168.0.1:0/2806484475", 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/2806484475", 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 28, 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 48, 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2023-11-26T07:20:39.577 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:20:39.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.590 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2023-11-26T07:20:39.590 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:39.599 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2023-11-26T07:20:39.599 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:39.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:39.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:20:39.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:20:39.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f853132a640 1 Processor -- start 2023-11-26T07:20:39.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f853132a640 1 -- start start 2023-11-26T07:20:39.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f853132a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:39.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f853132a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f852c0708b0 0x7f852c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:39.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f853132a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c0cfbf0 con 0x7f852c0cf7c0 2023-11-26T07:20:39.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f853132a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c143ea0 con 0x7f852c0708b0 2023-11-26T07:20:39.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f853132a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0cc730 con 0x7f852c143ac0 2023-11-26T07:20:39.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f85227fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f852c0708b0 0x7f852c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:39.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f85227fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f852c0708b0 0x7f852c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34324/0 (socket says 172.21.15.70:34324) 2023-11-26T07:20:39.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f85227fc640 1 -- 172.21.15.70:0/2890038346 learned_addr learned my addr 172.21.15.70:0/2890038346 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:39.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f852affd640 1 --2- 172.21.15.70:0/2890038346 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:39.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f85227fc640 1 -- 172.21.15.70:0/2890038346 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 msgr2=0x7f852c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:39.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f85227fc640 1 --2- 172.21.15.70:0/2890038346 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:39.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f85227fc640 1 -- 172.21.15.70:0/2890038346 >> v1:172.21.15.120:6789/0 conn(0x7f852c0cf7c0 legacy=0x7f852c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:39.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.846+0000 7f85227fc640 1 -- 172.21.15.70:0/2890038346 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c070ee0 con 0x7f852c0708b0 2023-11-26T07:20:39.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f85227fc640 1 --2- 172.21.15.70:0/2890038346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0708b0 0x7f852c0cf280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f852c0cfec0 tx=0x7f851401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f597fa0042e053b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:39.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f852a7fc640 1 -- 172.21.15.70:0/2890038346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140a5720 con 0x7f852c0708b0 2023-11-26T07:20:39.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f852a7fc640 1 -- 172.21.15.70:0/2890038346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85140a5880 con 0x7f852c0708b0 2023-11-26T07:20:39.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f852a7fc640 1 -- 172.21.15.70:0/2890038346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140a5c10 con 0x7f852c0708b0 2023-11-26T07:20:39.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 -- 172.21.15.70:0/2890038346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0708b0 msgr2=0x7f852c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:39.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 --2- 172.21.15.70:0/2890038346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0708b0 0x7f852c0cf280 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f852c0cfec0 tx=0x7f851401c990 comp rx=0 tx=0).stop 2023-11-26T07:20:39.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 -- 172.21.15.70:0/2890038346 shutdown_connections 2023-11-26T07:20:39.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 --2- 172.21.15.70:0/2890038346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0708b0 0x7f852c0cf280 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:39.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 --2- 172.21.15.70:0/2890038346 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:39.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 -- 172.21.15.70:0/2890038346 >> 172.21.15.70:0/2890038346 conn(0x7f852c06a890 msgr2=0x7f852c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 -- 172.21.15.70:0/2890038346 shutdown_connections 2023-11-26T07:20:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.850+0000 7f853132a640 1 -- 172.21.15.70:0/2890038346 wait complete. 2023-11-26T07:20:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 Processor -- start 2023-11-26T07:20:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 -- start start 2023-11-26T07:20:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f852c0708b0 0x7f852c153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0cf7c0 0x7f852c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c13af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c15a050 con 0x7f852c0cf7c0 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c13df50 con 0x7f852c0708b0 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c1372e0 con 0x7f852c143ac0 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0cf7c0 0x7f852c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0cf7c0 0x7f852c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34334/0 (socket says 172.21.15.70:34334) 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 -- 172.21.15.70:0/1177079558 learned_addr learned my addr 172.21.15.70:0/1177079558 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f852affd640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f852c0708b0 0x7f852c153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f852b7fe640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c13af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 -- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 msgr2=0x7f852c13af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c13af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 -- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f852c0708b0 msgr2=0x7f852c153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f852c0708b0 0x7f852c153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 -- 172.21.15.70:0/1177079558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514009b30 con 0x7f852c0cf7c0 2023-11-26T07:20:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f85227fc640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0cf7c0 0x7f852c159b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f85140af040 tx=0x7f8514019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f8523fff640 1 -- 172.21.15.70:0/1177079558 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140b8670 con 0x7f852c0cf7c0 2023-11-26T07:20:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f8523fff640 1 -- 172.21.15.70:0/1177079558 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85140b8810 con 0x7f852c0cf7c0 2023-11-26T07:20:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f8523fff640 1 -- 172.21.15.70:0/1177079558 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140b8bc0 con 0x7f852c0cf7c0 2023-11-26T07:20:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c1375c0 con 0x7f852c0cf7c0 2023-11-26T07:20:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c137b80 con 0x7f852c0cf7c0 2023-11-26T07:20:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.854+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c137d70 con 0x7f852c0cf7c0 2023-11-26T07:20:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.858+0000 7f8523fff640 1 -- 172.21.15.70:0/1177079558 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f85140b8d20 con 0x7f852c0cf7c0 2023-11-26T07:20:39.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.858+0000 7f8523fff640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f850c066740 0x7f850c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:39.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.858+0000 7f8523fff640 1 -- 172.21.15.70:0/1177079558 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f851411f670 con 0x7f852c0cf7c0 2023-11-26T07:20:39.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.858+0000 7f852affd640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f850c066740 0x7f850c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:39.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.858+0000 7f852affd640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f850c066740 0x7f850c068c00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f852c13bae0 tx=0x7f851c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:39.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:39.862+0000 7f8523fff640 1 -- 172.21.15.70:0/1177079558 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85140ec810 con 0x7f852c0cf7c0 2023-11-26T07:20:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.046+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f852c137d70 con 0x7f852c0cf7c0 2023-11-26T07:20:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.046+0000 7f8523fff640 1 -- 172.21.15.70:0/1177079558 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7f85140efe30 con 0x7f852c0cf7c0 2023-11-26T07:20:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f850c066740 msgr2=0x7f850c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f850c066740 0x7f850c068c00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f852c13bae0 tx=0x7f851c008040 comp rx=0 tx=0).stop 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0cf7c0 msgr2=0x7f852c159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0cf7c0 0x7f852c159b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f85140af040 tx=0x7f8514019730 comp rx=0 tx=0).stop 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 shutdown_connections 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f850c066740 0x7f850c068c00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f852c0cf7c0 0x7f852c159b10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f852c143ac0 0x7f852c13af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 --2- 172.21.15.70:0/1177079558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f852c0708b0 0x7f852c153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:40.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 >> 172.21.15.70:0/1177079558 conn(0x7f852c06a890 msgr2=0x7f852c15ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:40.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 shutdown_connections 2023-11-26T07:20:40.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:40.050+0000 7f853132a640 1 -- 172.21.15.70:0/1177079558 wait complete. 2023-11-26T07:20:40.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:20:40.071 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:20:40.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2023-11-26T07:20:40.072 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:20:40.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:40.072 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:20:40.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:20:40.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:20:40.072 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:20:40.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.072 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2023-11-26T07:20:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:20:40.083 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:20:40.083 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:20:40.083 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.083 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:20:40.083 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42249sec preferred_lft 42249sec 2023-11-26T07:20:40.084 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:29:fb:62:88 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:40.085 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:20:40.086 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:20:40.086 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.086 INFO:teuthology.orchestra.run.smithi120.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:20:40.086 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:20:40.086 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:20:40.086 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:20:40.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.086 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:20:40.151 INFO:teuthology.orchestra.run.smithi120.stdout:1 2023-11-26T07:20:40.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.153 DEBUG:teuthology.orchestra.run.smithi120:> route 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:20:40.207 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:20:40.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.208 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:20:40.208 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:20:40.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:20:40.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:20:40.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:20:40.208 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:20:40.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.309 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:20:40.318 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:20:40.318 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:20:40.319 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:20:40.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.319 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2023-11-26T07:20:40.386 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-26T07:20:40.386 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:40.386 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:40.435 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:20:40.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:20:40.435 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:40.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:20:40.552 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:20:40.604 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:20:40.604 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:20:40.604 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:20:40.605 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:20:40.606 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:20:40.607 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:20:40.607 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:20:40.607 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:20:40.607 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:20:40.607 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:20:40.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.608 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:20:40.662 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:20:40.663 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-26T07:20:40.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:20:40.732 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:20:40.784 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:20:40.784 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:20:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:20:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:20:40.787 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:20:40.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.788 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:20:40.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:2023-11-26T07:20:40.802+0000 7fd151136580 -1 init, newargv = 0x559746315270 newargc=15 2023-11-26T07:20:40.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44329]: starting ceph client 2023-11-26T07:20:40.816 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44329]: starting fuse 2023-11-26T07:20:40.817 INFO:teuthology.orchestra.run.smithi120.stdout:43 2023-11-26T07:20:40.818 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:20:40.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:20:40.818 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2023-11-26T07:20:40.818 DEBUG:teuthology.orchestra.run.smithi120:> import re 2023-11-26T07:20:40.818 DEBUG:teuthology.orchestra.run.smithi120:> import os 2023-11-26T07:20:40.818 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2023-11-26T07:20:40.818 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:20:40.818 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:20:40.819 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> return f 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.1")) 2023-11-26T07:20:40.820 DEBUG:teuthology.orchestra.run.smithi120:> ' 2023-11-26T07:20:40.942 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.1.44329.asok 2023-11-26T07:20:40.946 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:20:40.953 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44329.asok 2023-11-26T07:20:40.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:40.954 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44329.asok status 2023-11-26T07:20:41.126 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-11-26T07:20:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2023-11-26T07:20:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:20:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:20:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "1", 2023-11-26T07:20:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2023-11-26T07:20:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "44329", 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5354, 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2023-11-26T07:20:41.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 5354 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2363559659 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:20:41.128 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2363559659 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.5354 192.168.0.1:0/2363559659", 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/2363559659", 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 28, 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 48, 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2023-11-26T07:20:41.129 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2023-11-26T07:20:41.130 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-11-26T07:20:41.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.142 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2023-11-26T07:20:41.142 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:41.152 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2023-11-26T07:20:41.152 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:41.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:41.152 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:20:41.214 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:20:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.362+0000 7fccec7c1640 1 Processor -- start 2023-11-26T07:20:41.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.362+0000 7fccec7c1640 1 -- start start 2023-11-26T07:20:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fccec7c1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcce413e290 0x7fcce40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fccec7c1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcce40cf7c0 0x7fcce415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fccec7c1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce406c520 con 0x7fcce415f4e0 2023-11-26T07:20:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fccec7c1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40cfc40 con 0x7fcce40cf7c0 2023-11-26T07:20:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fccec7c1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce406c800 con 0x7fcce413e290 2023-11-26T07:20:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcce40cf7c0 0x7fcce415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcce40cf7c0 0x7fcce415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34340/0 (socket says 172.21.15.70:34340) 2023-11-26T07:20:41.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 -- 172.21.15.70:0/3036731938 learned_addr learned my addr 172.21.15.70:0/3036731938 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:41.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fccea55d640 1 --2- 172.21.15.70:0/3036731938 >> v2:172.21.15.120:3300/0 conn(0x7fcce413e290 0x7fcce40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 -- 172.21.15.70:0/3036731938 >> v2:172.21.15.120:3300/0 conn(0x7fcce413e290 msgr2=0x7fcce40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:41.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 --2- 172.21.15.70:0/3036731938 >> v2:172.21.15.120:3300/0 conn(0x7fcce413e290 0x7fcce40cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 -- 172.21.15.70:0/3036731938 >> v1:172.21.15.120:6789/0 conn(0x7fcce415f4e0 legacy=0x7fcce41408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 -- 172.21.15.70:0/3036731938 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce406cae0 con 0x7fcce40cf7c0 2023-11-26T07:20:41.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce9d5c640 1 --2- 172.21.15.70:0/3036731938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40cf7c0 0x7fcce415efa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcce40725a0 tx=0x7fccd401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63af01125e2433b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:41.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce955b640 1 -- 172.21.15.70:0/3036731938 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40aa430 con 0x7fcce40cf7c0 2023-11-26T07:20:41.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce955b640 1 -- 172.21.15.70:0/3036731938 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd40aa590 con 0x7fcce40cf7c0 2023-11-26T07:20:41.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.366+0000 7fcce955b640 1 -- 172.21.15.70:0/3036731938 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40aa920 con 0x7fcce40cf7c0 2023-11-26T07:20:41.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- 172.21.15.70:0/3036731938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40cf7c0 msgr2=0x7fcce415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 --2- 172.21.15.70:0/3036731938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40cf7c0 0x7fcce415efa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcce40725a0 tx=0x7fccd401c4d0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- 172.21.15.70:0/3036731938 shutdown_connections 2023-11-26T07:20:41.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 --2- 172.21.15.70:0/3036731938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce40cf7c0 0x7fcce415efa0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 --2- 172.21.15.70:0/3036731938 >> v2:172.21.15.120:3300/0 conn(0x7fcce413e290 0x7fcce40cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- 172.21.15.70:0/3036731938 >> 172.21.15.70:0/3036731938 conn(0x7fcce406a890 msgr2=0x7fcce406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:41.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- 172.21.15.70:0/3036731938 shutdown_connections 2023-11-26T07:20:41.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- 172.21.15.70:0/3036731938 wait complete. 2023-11-26T07:20:41.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 Processor -- start 2023-11-26T07:20:41.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- start start 2023-11-26T07:20:41.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce40cf7c0 0x7fcce41f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce413e290 0x7fcce413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415f4e0 0x7fcce413ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41424e0 con 0x7fcce415f4e0 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4142900 con 0x7fcce413e290 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccec7c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41418f0 con 0x7fcce40cf7c0 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccead5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415f4e0 0x7fcce413ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccea55d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce40cf7c0 0x7fcce41f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fcce9d5c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce413e290 0x7fcce413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccead5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415f4e0 0x7fcce413ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34346/0 (socket says 172.21.15.70:34346) 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.370+0000 7fccead5e640 1 -- 172.21.15.70:0/652895746 learned_addr learned my addr 172.21.15.70:0/652895746 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccead5e640 1 -- 172.21.15.70:0/652895746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce40cf7c0 msgr2=0x7fcce41f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccead5e640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce40cf7c0 0x7fcce41f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccead5e640 1 -- 172.21.15.70:0/652895746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce413e290 msgr2=0x7fcce413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccead5e640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce413e290 0x7fcce413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccead5e640 1 -- 172.21.15.70:0/652895746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40094d0 con 0x7fcce415f4e0 2023-11-26T07:20:41.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccead5e640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415f4e0 0x7fcce413ce20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c760 tx=0x7fccdc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:41.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccdaffd640 1 -- 172.21.15.70:0/652895746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc003ba0 con 0x7fcce415f4e0 2023-11-26T07:20:41.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccdaffd640 1 -- 172.21.15.70:0/652895746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc003d00 con 0x7fcce415f4e0 2023-11-26T07:20:41.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccdaffd640 1 -- 172.21.15.70:0/652895746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00aa90 con 0x7fcce415f4e0 2023-11-26T07:20:41.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4141b40 con 0x7fcce415f4e0 2023-11-26T07:20:41.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4142100 con 0x7fcce415f4e0 2023-11-26T07:20:41.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce4142620 con 0x7fcce415f4e0 2023-11-26T07:20:41.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.374+0000 7fccdaffd640 1 -- 172.21.15.70:0/652895746 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fccdc00abf0 con 0x7fcce415f4e0 2023-11-26T07:20:41.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.378+0000 7fccdaffd640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc8066740 0x7fccc8068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.378+0000 7fccdaffd640 1 -- 172.21.15.70:0/652895746 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccdc083e80 con 0x7fcce415f4e0 2023-11-26T07:20:41.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.378+0000 7fccea55d640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc8066740 0x7fccc8068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.378+0000 7fccea55d640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc8066740 0x7fccc8068c00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007a60 tx=0x7fcce0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:41.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.382+0000 7fccdaffd640 1 -- 172.21.15.70:0/652895746 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcce4142620 con 0x7fcce415f4e0 2023-11-26T07:20:41.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.562+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcce4142620 con 0x7fcce415f4e0 2023-11-26T07:20:41.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.614+0000 7fccdaffd640 1 -- 172.21.15.70:0/652895746 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 136+0+0 (secure 0 0 0) 0x7fcce4142620 con 0x7fcce415f4e0 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc8066740 msgr2=0x7fccc8068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc8066740 0x7fccc8068c00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007a60 tx=0x7fcce0008040 comp rx=0 tx=0).stop 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415f4e0 msgr2=0x7fcce413ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415f4e0 0x7fcce413ce20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c760 tx=0x7fccdc00cc20 comp rx=0 tx=0).stop 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 shutdown_connections 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccc8066740 0x7fccc8068c00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce415f4e0 0x7fcce413ce20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcce413e290 0x7fcce413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 --2- 172.21.15.70:0/652895746 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcce40cf7c0 0x7fcce41f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 >> 172.21.15.70:0/652895746 conn(0x7fcce406a890 msgr2=0x7fcce40ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:41.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 shutdown_connections 2023-11-26T07:20:41.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.618+0000 7fccec7c1640 1 -- 172.21.15.70:0/652895746 wait complete. 2023-11-26T07:20:41.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:20:41.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba87a5a640 1 Processor -- start 2023-11-26T07:20:41.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba87a5a640 1 -- start start 2023-11-26T07:20:41.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba87a5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fba8014b1e0 0x7fba800cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba87a5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba80070fd0 0x7fba80162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba87a5a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba800cfc20 con 0x7fba800cf7c0 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba87a5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba80162080 con 0x7fba8014b1e0 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba87a5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba80161d70 con 0x7fba80070fd0 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba857f6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fba8014b1e0 0x7fba800cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba84ff5640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fba800cf7c0 0x7fba800708c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41964/0 (socket says 172.21.15.70:41964) 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba857f6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fba8014b1e0 0x7fba800cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34352/0 (socket says 172.21.15.70:34352) 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba84ff5640 1 -- 172.21.15.70:0/189409749 learned_addr learned my addr 172.21.15.70:0/189409749 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba85ff7640 1 --2- 172.21.15.70:0/189409749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba80070fd0 0x7fba80162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba857f6640 1 -- 172.21.15.70:0/189409749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba80070fd0 msgr2=0x7fba80162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:41.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba857f6640 1 --2- 172.21.15.70:0/189409749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba80070fd0 0x7fba80162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba857f6640 1 -- 172.21.15.70:0/189409749 >> v1:172.21.15.70:6789/0 conn(0x7fba800cf7c0 legacy=0x7fba800708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba77fff640 1 -- 172.21.15.70:0/189409749 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057022168 0 0) 0x7fba800cfc20 con 0x7fba800cf7c0 2023-11-26T07:20:41.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.782+0000 7fba857f6640 1 -- 172.21.15.70:0/189409749 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8014b5c0 con 0x7fba8014b1e0 2023-11-26T07:20:41.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba857f6640 1 --2- 172.21.15.70:0/189409749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba8014b1e0 0x7fba800cf280 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0097c0 tx=0x7fba7c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a4aa7ee4db5f49 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:41.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba77fff640 1 -- 172.21.15.70:0/189409749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0ab650 con 0x7fba8014b1e0 2023-11-26T07:20:41.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba77fff640 1 -- 172.21.15.70:0/189409749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0ab7b0 con 0x7fba8014b1e0 2023-11-26T07:20:41.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba77fff640 1 -- 172.21.15.70:0/189409749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0abb40 con 0x7fba8014b1e0 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 -- 172.21.15.70:0/189409749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba8014b1e0 msgr2=0x7fba800cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 --2- 172.21.15.70:0/189409749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba8014b1e0 0x7fba800cf280 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0097c0 tx=0x7fba7c01c450 comp rx=0 tx=0).stop 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 -- 172.21.15.70:0/189409749 shutdown_connections 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 --2- 172.21.15.70:0/189409749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba80070fd0 0x7fba80162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 --2- 172.21.15.70:0/189409749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba8014b1e0 0x7fba800cf280 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 -- 172.21.15.70:0/189409749 >> 172.21.15.70:0/189409749 conn(0x7fba8006a890 msgr2=0x7fba8006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 -- 172.21.15.70:0/189409749 shutdown_connections 2023-11-26T07:20:41.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.786+0000 7fba87a5a640 1 -- 172.21.15.70:0/189409749 wait complete. 2023-11-26T07:20:41.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 Processor -- start 2023-11-26T07:20:41.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 -- start start 2023-11-26T07:20:41.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba80070fd0 0x7fba80143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba800cf7c0 0x7fba8014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8014b1e0 0x7fba800b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8014e7e0 con 0x7fba80070fd0 2023-11-26T07:20:41.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8014bcc0 con 0x7fba8014b1e0 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8014e220 con 0x7fba800cf7c0 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba80070fd0 0x7fba80143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba80070fd0 0x7fba80143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34368/0 (socket says 172.21.15.70:34368) 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 -- 172.21.15.70:0/3579252779 learned_addr learned my addr 172.21.15.70:0/3579252779 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba84ff5640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba800cf7c0 0x7fba8014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba85ff7640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8014b1e0 0x7fba800b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 -- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba800cf7c0 msgr2=0x7fba8014d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba800cf7c0 0x7fba8014d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 -- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8014b1e0 msgr2=0x7fba800b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8014b1e0 0x7fba800b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 -- 172.21.15.70:0/3579252779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c009420 con 0x7fba80070fd0 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba85ff7640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8014b1e0 0x7fba800b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:41.795 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba857f6640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba80070fd0 0x7fba80143fc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ad040 tx=0x7fba7c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:41.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba75ffb640 1 -- 172.21.15.70:0/3579252779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b5810 con 0x7fba80070fd0 2023-11-26T07:20:41.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba75ffb640 1 -- 172.21.15.70:0/3579252779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0b5990 con 0x7fba80070fd0 2023-11-26T07:20:41.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba75ffb640 1 -- 172.21.15.70:0/3579252779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b5d40 con 0x7fba80070fd0 2023-11-26T07:20:41.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8014e500 con 0x7fba80070fd0 2023-11-26T07:20:41.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba80144500 con 0x7fba80070fd0 2023-11-26T07:20:41.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.790+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8014b750 con 0x7fba80070fd0 2023-11-26T07:20:41.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.794+0000 7fba75ffb640 1 -- 172.21.15.70:0/3579252779 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fba7c0b4390 con 0x7fba80070fd0 2023-11-26T07:20:41.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.794+0000 7fba75ffb640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba64066740 0x7fba64068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:41.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.794+0000 7fba75ffb640 1 -- 172.21.15.70:0/3579252779 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba7c11e9c0 con 0x7fba80070fd0 2023-11-26T07:20:41.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.794+0000 7fba84ff5640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba64066740 0x7fba64068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:41.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.794+0000 7fba84ff5640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba64066740 0x7fba64068c00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fba80161b30 tx=0x7fba70007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:41.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.798+0000 7fba75ffb640 1 -- 172.21.15.70:0/3579252779 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba7c0ebc80 con 0x7fba80070fd0 2023-11-26T07:20:41.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.966+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fba801446f0 con 0x7fba64066740 2023-11-26T07:20:41.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.966+0000 7fba75ffb640 1 -- 172.21.15.70:0/3579252779 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fba801446f0 con 0x7fba64066740 2023-11-26T07:20:41.971 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:20:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:20:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephfs" 2023-11-26T07:20:41.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:20:41.971 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:20:41.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba64066740 msgr2=0x7fba64068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba64066740 0x7fba64068c00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fba80161b30 tx=0x7fba70007d60 comp rx=0 tx=0).stop 2023-11-26T07:20:41.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba80070fd0 msgr2=0x7fba80143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:41.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba80070fd0 0x7fba80143fc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ad040 tx=0x7fba7c01ac90 comp rx=0 tx=0).stop 2023-11-26T07:20:41.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 shutdown_connections 2023-11-26T07:20:41.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba8014b1e0 0x7fba800b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba800cf7c0 0x7fba8014d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba64066740 0x7fba64068c00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 --2- 172.21.15.70:0/3579252779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba80070fd0 0x7fba80143fc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:41.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 >> 172.21.15.70:0/3579252779 conn(0x7fba8006a890 msgr2=0x7fba8014a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:41.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 shutdown_connections 2023-11-26T07:20:41.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:41.970+0000 7fba87a5a640 1 -- 172.21.15.70:0/3579252779 wait complete. 2023-11-26T07:20:41.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:20:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9810b57640 1 Processor -- start 2023-11-26T07:20:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9810b57640 1 -- start start 2023-11-26T07:20:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9810b57640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f980c13e290 0x7f980c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9810b57640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f980c0cf7c0 0x7f980c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9810b57640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c06c520 con 0x7f980c15f4e0 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9810b57640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0cfc40 con 0x7f980c13e290 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9810b57640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c06c800 con 0x7f980c0cf7c0 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f980a59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f980c13e290 0x7f980c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f980ad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f980c15f4e0 0x7f980c1408e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41972/0 (socket says 172.21.15.70:41972) 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f980ad9d640 1 -- 172.21.15.70:0/2151931573 learned_addr learned my addr 172.21.15.70:0/2151931573 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:20:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f9801d9b640 1 --2- 172.21.15.70:0/2151931573 >> v2:172.21.15.120:3300/0 conn(0x7f980c0cf7c0 0x7f980c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.130+0000 7f980a59c640 1 -- 172.21.15.70:0/2151931573 >> v2:172.21.15.120:3300/0 conn(0x7f980c0cf7c0 msgr2=0x7f980c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f980a59c640 1 --2- 172.21.15.70:0/2151931573 >> v2:172.21.15.120:3300/0 conn(0x7f980c0cf7c0 0x7f980c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f980a59c640 1 -- 172.21.15.70:0/2151931573 >> v1:172.21.15.70:6789/0 conn(0x7f980c15f4e0 legacy=0x7f980c1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9809d9b640 1 -- 172.21.15.70:0/2151931573 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988435494 0 0) 0x7f980c06c520 con 0x7f980c15f4e0 2023-11-26T07:20:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f980a59c640 1 -- 172.21.15.70:0/2151931573 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c06cae0 con 0x7f980c13e290 2023-11-26T07:20:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9801d9b640 1 --2- 172.21.15.70:0/2151931573 >> v2:172.21.15.120:3300/0 conn(0x7f980c0cf7c0 0x7f980c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f980a59c640 1 --2- 172.21.15.70:0/2151931573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c13e290 0x7f980c0cf280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f980c0cfe40 tx=0x7f97f401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2309a724163d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9809d9b640 1 -- 172.21.15.70:0/2151931573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40a7070 con 0x7f980c13e290 2023-11-26T07:20:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9809d9b640 1 -- 172.21.15.70:0/2151931573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40ab430 con 0x7f980c13e290 2023-11-26T07:20:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9809d9b640 1 -- 172.21.15.70:0/2151931573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40ab7c0 con 0x7f980c13e290 2023-11-26T07:20:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9810b57640 1 -- 172.21.15.70:0/2151931573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c13e290 msgr2=0x7f980c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9810b57640 1 --2- 172.21.15.70:0/2151931573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c13e290 0x7f980c0cf280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f980c0cfe40 tx=0x7f97f401c430 comp rx=0 tx=0).stop 2023-11-26T07:20:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9810b57640 1 -- 172.21.15.70:0/2151931573 shutdown_connections 2023-11-26T07:20:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9810b57640 1 --2- 172.21.15.70:0/2151931573 >> v2:172.21.15.120:3300/0 conn(0x7f980c0cf7c0 0x7f980c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9810b57640 1 --2- 172.21.15.70:0/2151931573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c13e290 0x7f980c0cf280 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.134+0000 7f9810b57640 1 -- 172.21.15.70:0/2151931573 >> 172.21.15.70:0/2151931573 conn(0x7f980c06a890 msgr2=0x7f980c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 -- 172.21.15.70:0/2151931573 shutdown_connections 2023-11-26T07:20:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 -- 172.21.15.70:0/2151931573 wait complete. 2023-11-26T07:20:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 Processor -- start 2023-11-26T07:20:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 -- start start 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c0cf7c0 0x7f980c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f980c13e290 0x7f980c15d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980c15f4e0 0x7f980c1396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1418f0 con 0x7f980c0cf7c0 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c141bd0 con 0x7f980c15f4e0 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9810b57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c15e000 con 0x7f980c13e290 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c0cf7c0 0x7f980c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c0cf7c0 0x7f980c15b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34388/0 (socket says 172.21.15.70:34388) 2023-11-26T07:20:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 -- 172.21.15.70:0/481572858 learned_addr learned my addr 172.21.15.70:0/481572858 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f9801d9b640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f980c13e290 0x7f980c15d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980ad9d640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980c15f4e0 0x7f980c1396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 -- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f980c13e290 msgr2=0x7f980c15d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f980c13e290 0x7f980c15d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 -- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980c15f4e0 msgr2=0x7f980c1396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980c15f4e0 0x7f980c1396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980a59c640 1 -- 172.21.15.70:0/481572858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4009420 con 0x7f980c0cf7c0 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.138+0000 7f980ad9d640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980c15f4e0 0x7f980c1396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:20:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f980a59c640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c0cf7c0 0x7f980c15b510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ad040 tx=0x7f97f401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f98037fe640 1 -- 172.21.15.70:0/481572858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4004230 con 0x7f980c0cf7c0 2023-11-26T07:20:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f98037fe640 1 -- 172.21.15.70:0/481572858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40b9070 con 0x7f980c0cf7c0 2023-11-26T07:20:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c15e2e0 con 0x7f980c0cf7c0 2023-11-26T07:20:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f98037fe640 1 -- 172.21.15.70:0/481572858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4006e20 con 0x7f980c0cf7c0 2023-11-26T07:20:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c15dcf0 con 0x7f980c0cf7c0 2023-11-26T07:20:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c067680 con 0x7f980c0cf7c0 2023-11-26T07:20:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f98037fe640 1 -- 172.21.15.70:0/481572858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f97f4003620 con 0x7f980c0cf7c0 2023-11-26T07:20:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f98037fe640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f97ec066740 0x7f97ec068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f98037fe640 1 -- 172.21.15.70:0/481572858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97f40bb070 con 0x7f980c0cf7c0 2023-11-26T07:20:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.142+0000 7f9801d9b640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f97ec066740 0x7f97ec068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.146+0000 7f9801d9b640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f97ec066740 0x7f97ec068c00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f980c0b3f20 tx=0x7f97fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.146+0000 7f98037fe640 1 -- 172.21.15.70:0/481572858 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97f40ec000 con 0x7f980c0cf7c0 2023-11-26T07:20:42.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f980c06df50 con 0x7f980c0cf7c0 2023-11-26T07:20:42.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f98037fe640 1 -- 172.21.15.70:0/481572858 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97f40c4070 con 0x7f980c0cf7c0 2023-11-26T07:20:42.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f97ec066740 msgr2=0x7f97ec068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f97ec066740 0x7f97ec068c00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f980c0b3f20 tx=0x7f97fc008040 comp rx=0 tx=0).stop 2023-11-26T07:20:42.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c0cf7c0 msgr2=0x7f980c15b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c0cf7c0 0x7f980c15b510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ad040 tx=0x7f97f401ac70 comp rx=0 tx=0).stop 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 shutdown_connections 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f980c15f4e0 0x7f980c1396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f980c13e290 0x7f980c15d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f97ec066740 0x7f97ec068c00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 --2- 172.21.15.70:0/481572858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f980c0cf7c0 0x7f980c15b510 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 >> 172.21.15.70:0/481572858 conn(0x7f980c06a890 msgr2=0x7f980c0b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 shutdown_connections 2023-11-26T07:20:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.298+0000 7f9810b57640 1 -- 172.21.15.70:0/481572858 wait complete. 2023-11-26T07:20:42.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol9390 --mode=777 2023-11-26T07:20:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.458+0000 7f7491bf5640 1 Processor -- start 2023-11-26T07:20:42.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.458+0000 7f7491bf5640 1 -- start start 2023-11-26T07:20:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f7491bf5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f748c143ac0 0x7f748c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f7491bf5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f748c0cf990 0x7f748c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.464 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f7491bf5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0cc730 con 0x7f748c0708b0 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f7491bf5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c143ea0 con 0x7f748c143ac0 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f7491bf5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c070ee0 con 0x7f748c0cf990 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f748c143ac0 0x7f748c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f748c143ac0 0x7f748c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34398/0 (socket says 172.21.15.70:34398) 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748b7fe640 1 -- 172.21.15.70:0/125052513 learned_addr learned my addr 172.21.15.70:0/125052513 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748bfff640 1 --2- 172.21.15.70:0/125052513 >> v2:172.21.15.120:3300/0 conn(0x7f748c0cf990 0x7f748c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748b7fe640 1 -- 172.21.15.70:0/125052513 >> v2:172.21.15.120:3300/0 conn(0x7f748c0cf990 msgr2=0x7f748c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748b7fe640 1 --2- 172.21.15.70:0/125052513 >> v2:172.21.15.120:3300/0 conn(0x7f748c0cf990 0x7f748c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748b7fe640 1 -- 172.21.15.70:0/125052513 >> v1:172.21.15.70:6789/0 conn(0x7f748c0708b0 legacy=0x7f748c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748b7fe640 1 -- 172.21.15.70:0/125052513 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0711c0 con 0x7f748c143ac0 2023-11-26T07:20:42.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748a7fc640 1 -- 172.21.15.70:0/125052513 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905683888 0 0) 0x7f748c0cc730 con 0x7f748c0708b0 2023-11-26T07:20:42.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.462+0000 7f748bfff640 1 --2- 172.21.15.70:0/125052513 >> v2:172.21.15.120:3300/0 conn(0x7f748c0cf990 0x7f748c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:42.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f748b7fe640 1 --2- 172.21.15.70:0/125052513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c143ac0 0x7f748c070370 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f748c06e570 tx=0x7f747c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714ebfea0cf9f41c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f748a7fc640 1 -- 172.21.15.70:0/125052513 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0ab610 con 0x7f748c143ac0 2023-11-26T07:20:42.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f748a7fc640 1 -- 172.21.15.70:0/125052513 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c0ab770 con 0x7f748c143ac0 2023-11-26T07:20:42.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f748a7fc640 1 -- 172.21.15.70:0/125052513 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0abb00 con 0x7f748c143ac0 2023-11-26T07:20:42.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- 172.21.15.70:0/125052513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c143ac0 msgr2=0x7f748c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 --2- 172.21.15.70:0/125052513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c143ac0 0x7f748c070370 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f748c06e570 tx=0x7f747c01c500 comp rx=0 tx=0).stop 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- 172.21.15.70:0/125052513 shutdown_connections 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 --2- 172.21.15.70:0/125052513 >> v2:172.21.15.120:3300/0 conn(0x7f748c0cf990 0x7f748c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 --2- 172.21.15.70:0/125052513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c143ac0 0x7f748c070370 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- 172.21.15.70:0/125052513 >> 172.21.15.70:0/125052513 conn(0x7f748c06a890 msgr2=0x7f748c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- 172.21.15.70:0/125052513 shutdown_connections 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- 172.21.15.70:0/125052513 wait complete. 2023-11-26T07:20:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 Processor -- start 2023-11-26T07:20:42.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- start start 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f748c0708b0 0x7f748c159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c0cf990 0x7f748c0b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f748c143ac0 0x7f748c13c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0b3180 con 0x7f748c0cf990 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0b2500 con 0x7f748c0708b0 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.466+0000 7f7491bf5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0b27e0 con 0x7f748c143ac0 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c0cf990 0x7f748c0b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c0cf990 0x7f748c0b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34412/0 (socket says 172.21.15.70:34412) 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 -- 172.21.15.70:0/3481196112 learned_addr learned my addr 172.21.15.70:0/3481196112 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:42.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748bfff640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f748c143ac0 0x7f748c13c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748b7fe640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f748c0708b0 0x7f748c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 -- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f748c143ac0 msgr2=0x7f748c13c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f748c143ac0 0x7f748c13c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 -- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f748c0708b0 msgr2=0x7f748c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f748c0708b0 0x7f748c159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 -- 172.21.15.70:0/3481196112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0094d0 con 0x7f748c0cf990 2023-11-26T07:20:42.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f748affd640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c0cf990 0x7f748c0b1cb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f748000c4d0 tx=0x7f748000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f7473fff640 1 -- 172.21.15.70:0/3481196112 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480005480 con 0x7f748c0cf990 2023-11-26T07:20:42.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f7473fff640 1 -- 172.21.15.70:0/3481196112 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480003600 con 0x7f748c0cf990 2023-11-26T07:20:42.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c0b2ac0 con 0x7f748c0cf990 2023-11-26T07:20:42.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f7473fff640 1 -- 172.21.15.70:0/3481196112 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800039b0 con 0x7f748c0cf990 2023-11-26T07:20:42.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c159750 con 0x7f748c0cf990 2023-11-26T07:20:42.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c0b32c0 con 0x7f748c0cf990 2023-11-26T07:20:42.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.470+0000 7f7473fff640 1 -- 172.21.15.70:0/3481196112 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7f7480003b10 con 0x7f748c0cf990 2023-11-26T07:20:42.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.474+0000 7f7473fff640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7478066740 0x7f7478068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.474+0000 7f7473fff640 1 -- 172.21.15.70:0/3481196112 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74800837c0 con 0x7f748c0cf990 2023-11-26T07:20:42.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.474+0000 7f748b7fe640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7478066740 0x7f7478068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.474+0000 7f748b7fe640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7478066740 0x7f7478068c00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f747c0af000 tx=0x7f747c0b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.478+0000 7f7473fff640 1 -- 172.21.15.70:0/3481196112 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f748c0b32c0 con 0x7f748c0cf990 2023-11-26T07:20:42.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.650+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol9390", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f748c0b32c0 con 0x7f7478066740 2023-11-26T07:20:42.658 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:42.654+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:42.658 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:42.654+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:42.658 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:42.654+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:42.658 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:42.654+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:42.658 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:20:42.654+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:20:42.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7473fff640 1 -- 172.21.15.70:0/3481196112 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f748c0b32c0 con 0x7f7478066740 2023-11-26T07:20:42.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7478066740 msgr2=0x7f7478068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7478066740 0x7f7478068c00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f747c0af000 tx=0x7f747c0b6040 comp rx=0 tx=0).stop 2023-11-26T07:20:42.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c0cf990 msgr2=0x7f748c0b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c0cf990 0x7f748c0b1cb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f748000c4d0 tx=0x7f748000c990 comp rx=0 tx=0).stop 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 shutdown_connections 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7478066740 0x7f7478068c00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f748c0cf990 0x7f748c0b1cb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f748c143ac0 0x7f748c13c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 --2- 172.21.15.70:0/3481196112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f748c0708b0 0x7f748c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 >> 172.21.15.70:0/3481196112 conn(0x7f748c06a890 msgr2=0x7f748c15ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 shutdown_connections 2023-11-26T07:20:42.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.690+0000 7f7491bf5640 1 -- 172.21.15.70:0/3481196112 wait complete. 2023-11-26T07:20:42.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol9390 2023-11-26T07:20:42.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.850+0000 7fd5a7ebb640 1 Processor -- start 2023-11-26T07:20:42.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a7ebb640 1 -- start start 2023-11-26T07:20:42.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a7ebb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd5a006cd50 0x7fd5a00b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a7ebb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a015b2f0 con 0x7fd5a00cf280 2023-11-26T07:20:42.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a7ebb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a006c5c0 con 0x7fd5a0070d10 2023-11-26T07:20:42.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a7ebb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a015e1a0 con 0x7fd5a006cd50 2023-11-26T07:20:42.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a6458640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd5a006cd50 0x7fd5a00b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a6458640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd5a006cd50 0x7fd5a00b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34450/0 (socket says 172.21.15.70:34450) 2023-11-26T07:20:42.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a6458640 1 -- 172.21.15.70:0/82325457 learned_addr learned my addr 172.21.15.70:0/82325457 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:42.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a5c57640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd5a00cf280 0x7fd5a00cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41992/0 (socket says 172.21.15.70:41992) 2023-11-26T07:20:42.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a6458640 1 -- 172.21.15.70:0/82325457 >> v1:172.21.15.120:6789/0 conn(0x7fd5a0070d10 legacy=0x7fd5a015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a6458640 1 -- 172.21.15.70:0/82325457 >> v1:172.21.15.70:6789/0 conn(0x7fd5a00cf280 legacy=0x7fd5a00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a4c55640 1 -- 172.21.15.70:0/82325457 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152279408 0 0) 0x7fd59c001120 con 0x7fd5a00cf280 2023-11-26T07:20:42.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.854+0000 7fd5a6458640 1 -- 172.21.15.70:0/82325457 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a015e480 con 0x7fd5a006cd50 2023-11-26T07:20:42.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a6458640 1 --2- 172.21.15.70:0/82325457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a006cd50 0x7fd5a00b2180 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd598009e50 tx=0x7fd59801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79019164c819414 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a4c55640 1 -- 172.21.15.70:0/82325457 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980af400 con 0x7fd5a006cd50 2023-11-26T07:20:42.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a4c55640 1 -- 172.21.15.70:0/82325457 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5980ab050 con 0x7fd5a006cd50 2023-11-26T07:20:42.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a4c55640 1 -- 172.21.15.70:0/82325457 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980af780 con 0x7fd5a006cd50 2023-11-26T07:20:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/82325457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a006cd50 msgr2=0x7fd5a00b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/82325457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a006cd50 0x7fd5a00b2180 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd598009e50 tx=0x7fd59801f1f0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/82325457 shutdown_connections 2023-11-26T07:20:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/82325457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a006cd50 0x7fd5a00b2180 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/82325457 >> 172.21.15.70:0/82325457 conn(0x7fd5a006a890 msgr2=0x7fd5a006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/82325457 shutdown_connections 2023-11-26T07:20:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/82325457 wait complete. 2023-11-26T07:20:42.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 Processor -- start 2023-11-26T07:20:42.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.858+0000 7fd5a7ebb640 1 -- start start 2023-11-26T07:20:42.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a006cd50 0x7fd5a0153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a0070d10 0x7fd5a015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd5a00cf280 0x7fd5a00cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01573c0 con 0x7fd5a0070d10 2023-11-26T07:20:42.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00cc810 con 0x7fd5a006cd50 2023-11-26T07:20:42.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00ccaf0 con 0x7fd5a00cf280 2023-11-26T07:20:42.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a0070d10 0x7fd5a015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a0070d10 0x7fd5a015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34460/0 (socket says 172.21.15.70:34460) 2023-11-26T07:20:42.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 -- 172.21.15.70:0/3663033798 learned_addr learned my addr 172.21.15.70:0/3663033798 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:20:42.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 -- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd5a00cf280 msgr2=0x7fd5a00cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd5a00cf280 0x7fd5a00cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 -- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a006cd50 msgr2=0x7fd5a0153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5c57640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a006cd50 0x7fd5a0153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a006cd50 0x7fd5a0153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 -- 172.21.15.70:0/3663033798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598009b30 con 0x7fd5a0070d10 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5c57640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a006cd50 0x7fd5a0153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a5456640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a0070d10 0x7fd5a015a020 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd59000c500 tx=0x7fd59000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5967fc640 1 -- 172.21.15.70:0/3663033798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590005220 con 0x7fd5a0070d10 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5967fc640 1 -- 172.21.15.70:0/3663033798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590005380 con 0x7fd5a0070d10 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5967fc640 1 -- 172.21.15.70:0/3663033798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590007270 con 0x7fd5a0070d10 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a00ccdd0 con 0x7fd5a0070d10 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a0153ab0 con 0x7fd5a0070d10 2023-11-26T07:20:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.862+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0067680 con 0x7fd5a0070d10 2023-11-26T07:20:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.866+0000 7fd5967fc640 1 -- 172.21.15.70:0/3663033798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) v1 ==== 86107+0+0 (secure 0 0 0) 0x7fd5900073d0 con 0x7fd5a0070d10 2023-11-26T07:20:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.866+0000 7fd5967fc640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd584066740 0x7fd584068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:20:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.866+0000 7fd5967fc640 1 -- 172.21.15.70:0/3663033798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd590083c30 con 0x7fd5a0070d10 2023-11-26T07:20:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.866+0000 7fd5a5c57640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd584066740 0x7fd584068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:20:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.866+0000 7fd5a5c57640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd584066740 0x7fd584068c00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd59c000f70 tx=0x7fd59c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:20:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:42.870+0000 7fd5967fc640 1 -- 172.21.15.70:0/3663033798 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd590050d70 con 0x7fd5a0070d10 2023-11-26T07:20:43.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.046+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol9390", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5a00ae6f0 con 0x7fd584066740 2023-11-26T07:20:43.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5967fc640 1 -- 172.21.15.70:0/3663033798 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fd59c001c90 con 0x7fd584066740 2023-11-26T07:20:43.053 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd584066740 msgr2=0x7fd584068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd584066740 0x7fd584068c00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd59c000f70 tx=0x7fd59c009040 comp rx=0 tx=0).stop 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a0070d10 msgr2=0x7fd5a015a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a0070d10 0x7fd5a015a020 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd59000c500 tx=0x7fd59000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 shutdown_connections 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd584066740 0x7fd584068c00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a0070d10 0x7fd5a015a020 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd5a00cf280 0x7fd5a00cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:43.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 --2- 172.21.15.70:0/3663033798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5a006cd50 0x7fd5a0153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:20:43.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 >> 172.21.15.70:0/3663033798 conn(0x7fd5a006a890 msgr2=0x7fd5a00aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:20:43.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 shutdown_connections 2023-11-26T07:20:43.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:20:43.050+0000 7fd5a7ebb640 1 -- 172.21.15.70:0/3663033798 wait complete. 2023-11-26T07:20:43.073 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol9390 with 200 files each 1MB size under directory volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a 2023-11-26T07:20:43.074 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.074 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.083 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.167 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:43.167 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:43.167 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193117 s, 54.3 MB/s 2023-11-26T07:20:43.168 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.168 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.220 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187987 s, 55.8 MB/s 2023-11-26T07:20:43.294 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.294 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.344 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.417 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:43.417 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:43.417 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156793 s, 66.9 MB/s 2023-11-26T07:20:43.418 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.418 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.472 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:43.548 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149022 s, 70.4 MB/s 2023-11-26T07:20:43.549 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.549 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.600 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145022 s, 72.3 MB/s 2023-11-26T07:20:43.677 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.677 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.732 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.805 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:43.805 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:43.805 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015553 s, 67.4 MB/s 2023-11-26T07:20:43.806 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.807 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.860 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159215 s, 65.9 MB/s 2023-11-26T07:20:43.935 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:43.935 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:43.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:43.988 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.069 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186802 s, 56.1 MB/s 2023-11-26T07:20:44.069 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.070 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.119 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.193 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153723 s, 68.2 MB/s 2023-11-26T07:20:44.194 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.194 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.244 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146792 s, 71.4 MB/s 2023-11-26T07:20:44.317 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.317 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.368 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.440 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.440 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.440 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142197 s, 73.7 MB/s 2023-11-26T07:20:44.441 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.441 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.495 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.567 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.567 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.567 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131963 s, 79.5 MB/s 2023-11-26T07:20:44.568 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.568 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.620 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151175 s, 69.4 MB/s 2023-11-26T07:20:44.698 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.698 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.747 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.825 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192864 s, 54.4 MB/s 2023-11-26T07:20:44.826 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.826 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:44.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:44.880 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:44.953 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:44.953 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:44.954 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015012 s, 69.8 MB/s 2023-11-26T07:20:44.954 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:44.955 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.008 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.080 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.080 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.080 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147281 s, 71.2 MB/s 2023-11-26T07:20:45.081 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.081 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.136 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.212 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.212 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.212 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148028 s, 70.8 MB/s 2023-11-26T07:20:45.213 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.213 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.264 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.333 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.334 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.334 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125156 s, 83.8 MB/s 2023-11-26T07:20:45.335 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.335 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.384 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145595 s, 72.0 MB/s 2023-11-26T07:20:45.457 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.457 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.508 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.584 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.584 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.584 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149913 s, 69.9 MB/s 2023-11-26T07:20:45.585 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.585 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.636 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.706 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.706 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.706 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125969 s, 83.2 MB/s 2023-11-26T07:20:45.707 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.707 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.761 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.840 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167435 s, 62.6 MB/s 2023-11-26T07:20:45.841 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.841 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:45.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:45.895 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:45.968 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:45.969 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:45.969 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140246 s, 74.8 MB/s 2023-11-26T07:20:45.970 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:45.970 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.020 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.091 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.091 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.091 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013427 s, 78.1 MB/s 2023-11-26T07:20:46.092 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.092 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.143 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.217 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.217 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.217 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161462 s, 64.9 MB/s 2023-11-26T07:20:46.218 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.218 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.267 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.339 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.339 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.340 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140191 s, 74.8 MB/s 2023-11-26T07:20:46.340 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.340 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.395 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.468 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.469 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140694 s, 74.5 MB/s 2023-11-26T07:20:46.469 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.470 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.519 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.592 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.592 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.592 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149011 s, 70.4 MB/s 2023-11-26T07:20:46.593 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.593 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.643 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.716 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.716 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.716 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150583 s, 69.6 MB/s 2023-11-26T07:20:46.717 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.717 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.768 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.845 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.845 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.846 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174774 s, 60.0 MB/s 2023-11-26T07:20:46.846 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.847 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:46.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:46.900 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:46.974 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:46.974 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:46.974 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158775 s, 66.0 MB/s 2023-11-26T07:20:46.975 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:46.975 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.032 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146398 s, 71.6 MB/s 2023-11-26T07:20:47.105 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.105 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.160 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.234 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.234 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.235 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017115 s, 61.3 MB/s 2023-11-26T07:20:47.235 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.236 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.287 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.358 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.358 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.359 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013102 s, 80.0 MB/s 2023-11-26T07:20:47.359 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.359 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.412 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.481 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.481 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.481 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134755 s, 77.8 MB/s 2023-11-26T07:20:47.482 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.482 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.531 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.604 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.605 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.605 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145591 s, 72.0 MB/s 2023-11-26T07:20:47.606 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.606 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.656 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.729 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162904 s, 64.4 MB/s 2023-11-26T07:20:47.730 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.730 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.779 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.854 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.854 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.854 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147481 s, 71.1 MB/s 2023-11-26T07:20:47.855 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.855 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:47.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:47.908 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015742 s, 66.6 MB/s 2023-11-26T07:20:47.987 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:47.987 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.040 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.117 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.117 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.117 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148514 s, 70.6 MB/s 2023-11-26T07:20:48.118 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:48.118 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.168 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.238 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.238 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.238 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130149 s, 80.6 MB/s 2023-11-26T07:20:48.239 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:48.239 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.292 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151514 s, 69.2 MB/s 2023-11-26T07:20:48.367 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:48.367 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.424 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149886 s, 70.0 MB/s 2023-11-26T07:20:48.501 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:48.501 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.552 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.622 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.623 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.623 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132646 s, 79.1 MB/s 2023-11-26T07:20:48.624 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:48.624 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.676 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.747 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.747 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.747 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137567 s, 76.2 MB/s 2023-11-26T07:20:48.748 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:48.749 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.800 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.872 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.872 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.872 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145161 s, 72.2 MB/s 2023-11-26T07:20:48.873 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:48.873 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:48.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:48.928 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:48.999 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135571 s, 77.3 MB/s 2023-11-26T07:20:49.000 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.000 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.056 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149282 s, 70.2 MB/s 2023-11-26T07:20:49.129 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.129 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.180 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:49.255 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012911 s, 81.2 MB/s 2023-11-26T07:20:49.255 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.256 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.312 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.385 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:49.386 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:49.386 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143527 s, 73.1 MB/s 2023-11-26T07:20:49.387 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.387 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.439 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.514 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:49.514 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:49.514 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163797 s, 64.0 MB/s 2023-11-26T07:20:49.515 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.515 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.567 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.642 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:49.642 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:49.642 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151814 s, 69.1 MB/s 2023-11-26T07:20:49.643 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.643 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.700 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130818 s, 80.2 MB/s 2023-11-26T07:20:49.772 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.772 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.824 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:49.898 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:49.898 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:49.898 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162978 s, 64.3 MB/s 2023-11-26T07:20:49.899 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:49.899 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:49.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:49.952 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.027 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.027 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.027 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176804 s, 59.3 MB/s 2023-11-26T07:20:50.028 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.028 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.080 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.154 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.155 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.155 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167061 s, 62.8 MB/s 2023-11-26T07:20:50.156 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.156 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.207 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.284 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.284 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.284 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169433 s, 61.9 MB/s 2023-11-26T07:20:50.285 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.285 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.335 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.411 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159069 s, 65.9 MB/s 2023-11-26T07:20:50.412 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.412 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.463 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.537 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.537 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.537 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159343 s, 65.8 MB/s 2023-11-26T07:20:50.538 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.538 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.588 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141714 s, 74.0 MB/s 2023-11-26T07:20:50.661 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.661 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.712 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.785 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.785 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.785 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150298 s, 69.8 MB/s 2023-11-26T07:20:50.786 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.786 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.836 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:50.913 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:50.913 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:50.913 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144447 s, 72.6 MB/s 2023-11-26T07:20:50.914 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:50.914 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:50.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:50.967 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.046 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.047 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.047 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169419 s, 61.9 MB/s 2023-11-26T07:20:51.048 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.048 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.099 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.172 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146001 s, 71.8 MB/s 2023-11-26T07:20:51.173 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.173 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.223 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.300 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.300 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.300 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142994 s, 73.3 MB/s 2023-11-26T07:20:51.301 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.301 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.351 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.423 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.423 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.423 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140502 s, 74.6 MB/s 2023-11-26T07:20:51.424 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.424 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.476 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141932 s, 73.9 MB/s 2023-11-26T07:20:51.548 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.548 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.599 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.676 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149054 s, 70.3 MB/s 2023-11-26T07:20:51.677 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.678 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.732 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.809 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015408 s, 68.1 MB/s 2023-11-26T07:20:51.810 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.810 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.860 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:51.932 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:51.933 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:51.933 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148319 s, 70.7 MB/s 2023-11-26T07:20:51.934 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:51.934 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:51.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:51.983 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.056 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014425 s, 72.7 MB/s 2023-11-26T07:20:52.057 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.057 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.108 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.180 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.180 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.180 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150836 s, 69.5 MB/s 2023-11-26T07:20:52.181 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.181 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.231 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.305 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.306 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.306 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153097 s, 68.5 MB/s 2023-11-26T07:20:52.307 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.307 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.360 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.432 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.432 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.432 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014069 s, 74.5 MB/s 2023-11-26T07:20:52.433 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.433 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.483 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.557 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146553 s, 71.5 MB/s 2023-11-26T07:20:52.558 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.558 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.607 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.679 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.679 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.679 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139768 s, 75.0 MB/s 2023-11-26T07:20:52.680 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.680 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.731 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145999 s, 71.8 MB/s 2023-11-26T07:20:52.809 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.809 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.859 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:52.936 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:52.937 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:52.937 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179761 s, 58.3 MB/s 2023-11-26T07:20:52.938 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:52.938 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:52.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:52.988 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.059 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.059 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.059 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135428 s, 77.4 MB/s 2023-11-26T07:20:53.060 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.060 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.112 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.186 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163922 s, 64.0 MB/s 2023-11-26T07:20:53.187 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.187 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.244 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.316 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.317 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.317 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147464 s, 71.1 MB/s 2023-11-26T07:20:53.318 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.318 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.368 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.438 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.438 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.439 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132105 s, 79.4 MB/s 2023-11-26T07:20:53.439 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.440 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.491 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.568 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.568 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.568 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149304 s, 70.2 MB/s 2023-11-26T07:20:53.569 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.569 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.623 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136554 s, 76.8 MB/s 2023-11-26T07:20:53.696 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.696 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.751 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.824 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.825 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.825 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148523 s, 70.6 MB/s 2023-11-26T07:20:53.825 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.826 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:53.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:53.879 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:53.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:53.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:53.957 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147252 s, 71.2 MB/s 2023-11-26T07:20:53.958 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:53.958 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.012 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145126 s, 72.3 MB/s 2023-11-26T07:20:54.085 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.085 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.136 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.205 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.205 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.206 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123429 s, 85.0 MB/s 2023-11-26T07:20:54.206 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.207 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.256 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.327 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013375 s, 78.4 MB/s 2023-11-26T07:20:54.328 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.328 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.384 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.459 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.460 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.460 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142828 s, 73.4 MB/s 2023-11-26T07:20:54.461 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.461 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.511 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.585 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.586 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.586 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160409 s, 65.4 MB/s 2023-11-26T07:20:54.587 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.587 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.635 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.710 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.710 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.711 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128012 s, 81.9 MB/s 2023-11-26T07:20:54.711 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.711 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.767 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.845 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.845 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.845 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015425 s, 68.0 MB/s 2023-11-26T07:20:54.846 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.846 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:54.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:54.895 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:54.969 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:54.969 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:54.969 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138777 s, 75.6 MB/s 2023-11-26T07:20:54.970 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:54.970 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.019 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.094 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.094 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.094 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153356 s, 68.4 MB/s 2023-11-26T07:20:55.095 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.095 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.147 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.220 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.220 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.220 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140776 s, 74.5 MB/s 2023-11-26T07:20:55.221 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.221 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.276 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.354 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151159 s, 69.4 MB/s 2023-11-26T07:20:55.355 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.355 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.407 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.480 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.480 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.480 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145297 s, 72.2 MB/s 2023-11-26T07:20:55.481 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.481 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.531 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.603 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.603 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.603 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143607 s, 73.0 MB/s 2023-11-26T07:20:55.605 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.605 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.655 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140767 s, 74.5 MB/s 2023-11-26T07:20:55.728 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.728 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.779 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.852 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.852 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.852 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014441 s, 72.6 MB/s 2023-11-26T07:20:55.853 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.853 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:55.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:55.903 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:55.975 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:55.975 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:55.975 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139022 s, 75.4 MB/s 2023-11-26T07:20:55.976 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:55.976 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.027 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.100 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145307 s, 72.2 MB/s 2023-11-26T07:20:56.101 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.101 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.152 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.222 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121211 s, 86.5 MB/s 2023-11-26T07:20:56.222 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.222 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.272 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.343 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.343 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.343 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125743 s, 83.4 MB/s 2023-11-26T07:20:56.344 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.344 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.395 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.465 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.465 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.466 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119341 s, 87.9 MB/s 2023-11-26T07:20:56.466 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.467 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.515 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.589 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.589 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.589 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148974 s, 70.4 MB/s 2023-11-26T07:20:56.590 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.590 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.640 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.711 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126741 s, 82.7 MB/s 2023-11-26T07:20:56.711 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.712 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.768 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149227 s, 70.3 MB/s 2023-11-26T07:20:56.846 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.846 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:56.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:56.899 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152471 s, 68.8 MB/s 2023-11-26T07:20:56.974 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:56.974 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.023 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.098 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:57.099 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:57.099 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166478 s, 63.0 MB/s 2023-11-26T07:20:57.100 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:57.100 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.155 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137019 s, 76.5 MB/s 2023-11-26T07:20:57.229 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:57.229 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.279 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.354 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:57.354 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:57.354 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157498 s, 66.6 MB/s 2023-11-26T07:20:57.355 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:57.355 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.411 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.483 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:57.484 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:57.484 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127956 s, 81.9 MB/s 2023-11-26T07:20:57.484 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:57.485 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.540 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:57.614 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123168 s, 85.1 MB/s 2023-11-26T07:20:57.615 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:57.615 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.668 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158806 s, 66.0 MB/s 2023-11-26T07:20:57.746 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:57.746 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.795 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141181 s, 74.3 MB/s 2023-11-26T07:20:57.872 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:57.872 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:57.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:57.927 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149978 s, 69.9 MB/s 2023-11-26T07:20:58.002 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.002 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.052 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.126 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.126 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.126 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01604 s, 65.4 MB/s 2023-11-26T07:20:58.127 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.127 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.179 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016317 s, 64.3 MB/s 2023-11-26T07:20:58.255 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.255 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.308 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.381 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.381 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.381 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147039 s, 71.3 MB/s 2023-11-26T07:20:58.382 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.382 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.436 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.510 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.510 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.510 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012229 s, 85.7 MB/s 2023-11-26T07:20:58.511 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.511 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.563 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.635 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.636 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.636 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014092 s, 74.4 MB/s 2023-11-26T07:20:58.636 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.637 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.688 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.762 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.762 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.762 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166824 s, 62.9 MB/s 2023-11-26T07:20:58.764 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.764 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.815 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143112 s, 73.3 MB/s 2023-11-26T07:20:58.889 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:58.889 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:58.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:58.943 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.016 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.016 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.016 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145469 s, 72.1 MB/s 2023-11-26T07:20:59.017 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.017 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.067 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.142 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.142 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.142 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160008 s, 65.5 MB/s 2023-11-26T07:20:59.143 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.143 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.195 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.269 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142421 s, 73.6 MB/s 2023-11-26T07:20:59.270 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.270 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.320 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:59.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:20:59.394 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.394 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.394 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154128 s, 68.0 MB/s 2023-11-26T07:20:59.395 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.395 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.447 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137349 s, 76.3 MB/s 2023-11-26T07:20:59.520 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.521 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.572 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.643 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.643 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.643 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138817 s, 75.5 MB/s 2023-11-26T07:20:59.644 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.644 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.696 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.767 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.768 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.768 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140985 s, 74.4 MB/s 2023-11-26T07:20:59.769 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.769 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.820 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:20:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:20:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:20:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143188 s, 73.2 MB/s 2023-11-26T07:20:59.893 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:20:59.893 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:20:59.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:20:59.944 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.018 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.018 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.018 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01496 s, 70.1 MB/s 2023-11-26T07:21:00.019 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.019 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.071 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.143 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.143 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134078 s, 78.2 MB/s 2023-11-26T07:21:00.144 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.145 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.195 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.269 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150486 s, 69.7 MB/s 2023-11-26T07:21:00.270 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.270 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.320 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.397 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.397 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.397 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150193 s, 69.8 MB/s 2023-11-26T07:21:00.398 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.398 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.448 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.519 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138111 s, 75.9 MB/s 2023-11-26T07:21:00.520 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.520 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.575 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.647 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.647 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.647 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142704 s, 73.5 MB/s 2023-11-26T07:21:00.648 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.648 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.699 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.778 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.778 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.779 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171788 s, 61.0 MB/s 2023-11-26T07:21:00.779 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.780 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.831 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:00.904 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:00.904 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:00.905 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149967 s, 69.9 MB/s 2023-11-26T07:21:00.906 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:00.906 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:00.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:00.960 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.095 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.095 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015279 s, 68.6 MB/s 2023-11-26T07:21:01.096 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.096 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:01.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:01.148 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.219 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.219 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.219 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133405 s, 78.6 MB/s 2023-11-26T07:21:01.220 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.220 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:01.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:01.272 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.345 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150885 s, 69.5 MB/s 2023-11-26T07:21:01.347 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.347 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:01.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:01.395 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.471 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.472 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.472 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145429 s, 72.1 MB/s 2023-11-26T07:21:01.473 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.473 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:01.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:01.530 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.602 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.603 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.603 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017418 s, 60.2 MB/s 2023-11-26T07:21:01.604 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.604 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:01.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:01.659 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.729 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.730 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124609 s, 84.1 MB/s 2023-11-26T07:21:01.730 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.731 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:01.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:01.784 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.856 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.856 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.856 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148292 s, 70.7 MB/s 2023-11-26T07:21:01.857 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.857 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:01.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:01.907 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:01.983 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:01.983 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:01.984 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145531 s, 72.1 MB/s 2023-11-26T07:21:01.984 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:01.985 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.036 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:02.109 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147444 s, 71.1 MB/s 2023-11-26T07:21:02.109 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:02.110 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.164 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:02.240 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:02.240 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:02.240 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014847 s, 70.6 MB/s 2023-11-26T07:21:02.241 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:02.241 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.292 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:02.366 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:02.366 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:02.366 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137245 s, 76.4 MB/s 2023-11-26T07:21:02.367 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:02.367 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.420 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:02.493 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:02.494 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143339 s, 73.2 MB/s 2023-11-26T07:21:02.495 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:02.495 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.548 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:02.621 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:02.621 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:02.621 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158221 s, 66.3 MB/s 2023-11-26T07:21:02.622 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:02.622 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.671 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:02.742 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:02.742 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:02.742 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132314 s, 79.2 MB/s 2023-11-26T07:21:02.743 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:02.743 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.800 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:02.872 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:02.872 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:02.872 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149429 s, 70.2 MB/s 2023-11-26T07:21:02.873 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:02.873 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:02.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:02.929 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.000 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.000 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.000 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143527 s, 73.1 MB/s 2023-11-26T07:21:03.001 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.001 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.051 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146732 s, 71.5 MB/s 2023-11-26T07:21:03.125 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.125 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.175 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.247 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.247 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.248 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01417 s, 74.0 MB/s 2023-11-26T07:21:03.249 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.249 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.300 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.375 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.375 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.375 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129901 s, 80.7 MB/s 2023-11-26T07:21:03.376 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.377 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.431 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.506 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.506 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.506 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160854 s, 65.2 MB/s 2023-11-26T07:21:03.507 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.507 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.560 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.631 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143314 s, 73.2 MB/s 2023-11-26T07:21:03.633 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.634 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.684 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.756 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146627 s, 71.5 MB/s 2023-11-26T07:21:03.757 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.758 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.808 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:03.885 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:03.885 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:03.885 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148891 s, 70.4 MB/s 2023-11-26T07:21:03.886 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:03.886 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:03.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:03.935 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.012 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.012 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.012 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148713 s, 70.5 MB/s 2023-11-26T07:21:04.013 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.013 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.067 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.142 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.142 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.142 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129395 s, 81.0 MB/s 2023-11-26T07:21:04.143 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.143 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.195 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.268 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.269 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147534 s, 71.1 MB/s 2023-11-26T07:21:04.269 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.270 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.320 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.393 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.393 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.393 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139021 s, 75.4 MB/s 2023-11-26T07:21:04.394 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.394 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.444 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.520 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.520 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.520 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149364 s, 70.2 MB/s 2023-11-26T07:21:04.521 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.521 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.571 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140451 s, 74.7 MB/s 2023-11-26T07:21:04.645 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.645 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.700 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.771 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.771 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.771 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137235 s, 76.4 MB/s 2023-11-26T07:21:04.772 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.772 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.824 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:04.896 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:04.896 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:04.896 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146598 s, 71.5 MB/s 2023-11-26T07:21:04.897 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:04.898 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:04.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:04.947 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.023 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170103 s, 61.6 MB/s 2023-11-26T07:21:05.024 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.024 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.075 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.154 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.154 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.154 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168197 s, 62.3 MB/s 2023-11-26T07:21:05.155 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.155 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.207 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.280 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143614 s, 73.0 MB/s 2023-11-26T07:21:05.281 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.281 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.332 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143946 s, 72.8 MB/s 2023-11-26T07:21:05.410 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.410 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.460 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.531 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.531 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.531 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137356 s, 76.3 MB/s 2023-11-26T07:21:05.532 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.532 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.583 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.654 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.654 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.654 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127879 s, 82.0 MB/s 2023-11-26T07:21:05.655 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.655 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.708 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.783 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139937 s, 74.9 MB/s 2023-11-26T07:21:05.784 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.784 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.835 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145954 s, 71.8 MB/s 2023-11-26T07:21:05.913 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:05.913 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:05.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:05.964 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.036 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143858 s, 72.9 MB/s 2023-11-26T07:21:06.037 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.037 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:06.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:06.088 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.163 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.163 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.163 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130514 s, 80.3 MB/s 2023-11-26T07:21:06.164 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.164 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:06.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:06.221 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.303 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.304 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125 s, 83.9 MB/s 2023-11-26T07:21:06.305 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.305 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:06.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:06.362 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.441 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.441 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.441 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144359 s, 72.6 MB/s 2023-11-26T07:21:06.442 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.442 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:06.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:06.498 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127798 s, 82.0 MB/s 2023-11-26T07:21:06.573 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.573 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:06.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:06.624 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.695 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135618 s, 77.3 MB/s 2023-11-26T07:21:06.696 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.696 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:06.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:06.753 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.826 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.826 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.826 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141565 s, 74.1 MB/s 2023-11-26T07:21:06.827 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.827 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:06.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:06.879 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:06.956 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:06.956 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:06.956 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149714 s, 70.0 MB/s 2023-11-26T07:21:06.957 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:06.958 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.007 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147035 s, 71.3 MB/s 2023-11-26T07:21:07.081 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.081 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.132 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.211 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.211 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.211 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216813 s, 48.4 MB/s 2023-11-26T07:21:07.212 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.212 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.265 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.335 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.336 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.336 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133779 s, 78.4 MB/s 2023-11-26T07:21:07.337 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.337 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.391 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.462 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.462 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.462 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137785 s, 76.1 MB/s 2023-11-26T07:21:07.463 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.463 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.520 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134516 s, 78.0 MB/s 2023-11-26T07:21:07.593 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.593 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.645 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.715 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.716 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.716 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135789 s, 77.2 MB/s 2023-11-26T07:21:07.717 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.717 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.767 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.841 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147132 s, 71.3 MB/s 2023-11-26T07:21:07.842 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.842 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:07.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:07.891 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:07.964 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:07.964 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:07.964 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137657 s, 76.2 MB/s 2023-11-26T07:21:07.965 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:07.965 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:08.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:08.016 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:08.090 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:08.090 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:08.090 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156059 s, 67.2 MB/s 2023-11-26T07:21:08.091 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:08.092 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:08.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:08.147 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131707 s, 79.6 MB/s 2023-11-26T07:21:08.224 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:08.225 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:08.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:08.280 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:08.358 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015002 s, 69.9 MB/s 2023-11-26T07:21:08.359 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:08.359 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:08.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:08.411 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol9390/2b17b532-68f3-47f0-994c-30b038bfe95a/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:21:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:21:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:21:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135974 s, 77.1 MB/s 2023-11-26T07:21:08.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol9390 subvol_snap78440 2023-11-26T07:21:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb1afe7640 1 Processor -- start 2023-11-26T07:21:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb1afe7640 1 -- start start 2023-11-26T07:21:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb1afe7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcb1413e290 0x7fcb140cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb1afe7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcb140cf7c0 0x7fcb1415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb1afe7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1406c520 con 0x7fcb1415f4e0 2023-11-26T07:21:08.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb1afe7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb140cfc40 con 0x7fcb1413e290 2023-11-26T07:21:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb1afe7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1406c800 con 0x7fcb140cf7c0 2023-11-26T07:21:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb18d83640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcb1413e290 0x7fcb140cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb19584640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcb1415f4e0 0x7fcb141408e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57134/0 (socket says 172.21.15.70:57134) 2023-11-26T07:21:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb19584640 1 -- 172.21.15.70:0/4248936614 learned_addr learned my addr 172.21.15.70:0/4248936614 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb0bfff640 1 --2- 172.21.15.70:0/4248936614 >> v2:172.21.15.120:3300/0 conn(0x7fcb140cf7c0 0x7fcb1415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb18d83640 1 -- 172.21.15.70:0/4248936614 >> v2:172.21.15.120:3300/0 conn(0x7fcb140cf7c0 msgr2=0x7fcb1415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:08.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb18d83640 1 --2- 172.21.15.70:0/4248936614 >> v2:172.21.15.120:3300/0 conn(0x7fcb140cf7c0 0x7fcb1415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb18d83640 1 -- 172.21.15.70:0/4248936614 >> v1:172.21.15.70:6789/0 conn(0x7fcb1415f4e0 legacy=0x7fcb141408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb18d83640 1 -- 172.21.15.70:0/4248936614 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1406cae0 con 0x7fcb1413e290 2023-11-26T07:21:08.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.665+0000 7fcb0bfff640 1 --2- 172.21.15.70:0/4248936614 >> v2:172.21.15.120:3300/0 conn(0x7fcb140cf7c0 0x7fcb1415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:08.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb18d83640 1 --2- 172.21.15.70:0/4248936614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb1413e290 0x7fcb140cf280 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcb140cfe40 tx=0x7fcb1001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b3cd54360c9f3f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb0b7fe640 1 -- 172.21.15.70:0/4248936614 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100a7070 con 0x7fcb1413e290 2023-11-26T07:21:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb0b7fe640 1 -- 172.21.15.70:0/4248936614 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb100ab430 con 0x7fcb1413e290 2023-11-26T07:21:08.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb0b7fe640 1 -- 172.21.15.70:0/4248936614 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100ab7c0 con 0x7fcb1413e290 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4248936614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb1413e290 msgr2=0x7fcb140cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4248936614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb1413e290 0x7fcb140cf280 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcb140cfe40 tx=0x7fcb1001c430 comp rx=0 tx=0).stop 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4248936614 shutdown_connections 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4248936614 >> v2:172.21.15.120:3300/0 conn(0x7fcb140cf7c0 0x7fcb1415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4248936614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb1413e290 0x7fcb140cf280 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4248936614 >> 172.21.15.70:0/4248936614 conn(0x7fcb1406a890 msgr2=0x7fcb1406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4248936614 shutdown_connections 2023-11-26T07:21:08.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.669+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4248936614 wait complete. 2023-11-26T07:21:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 Processor -- start 2023-11-26T07:21:08.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 -- start start 2023-11-26T07:21:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb140cf7c0 0x7fcb141522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1413e290 0x7fcb1415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb1415f4e0 0x7fcb1413cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1413aec0 con 0x7fcb140cf7c0 2023-11-26T07:21:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14152b60 con 0x7fcb1413e290 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1413a4b0 con 0x7fcb1415f4e0 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb140cf7c0 0x7fcb141522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb140cf7c0 0x7fcb141522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55770/0 (socket says 172.21.15.70:55770) 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 -- 172.21.15.70:0/4071811511 learned_addr learned my addr 172.21.15.70:0/4071811511 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb0bfff640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1413e290 0x7fcb1415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb19584640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb1415f4e0 0x7fcb1413cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 -- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb1415f4e0 msgr2=0x7fcb1413cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb1415f4e0 0x7fcb1413cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 -- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1413e290 msgr2=0x7fcb1415b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1413e290 0x7fcb1415b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 -- 172.21.15.70:0/4071811511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009420 con 0x7fcb140cf7c0 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb19584640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb1415f4e0 0x7fcb1413cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb18d83640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb140cf7c0 0x7fcb141522d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb100ad040 tx=0x7fcb1001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb097fa640 1 -- 172.21.15.70:0/4071811511 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100b5810 con 0x7fcb140cf7c0 2023-11-26T07:21:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb097fa640 1 -- 172.21.15.70:0/4071811511 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb100b5990 con 0x7fcb140cf7c0 2023-11-26T07:21:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb097fa640 1 -- 172.21.15.70:0/4071811511 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100b5d40 con 0x7fcb140cf7c0 2023-11-26T07:21:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1413a790 con 0x7fcb140cf7c0 2023-11-26T07:21:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.673+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb14153090 con 0x7fcb140cf7c0 2023-11-26T07:21:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.677+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb140b1b20 con 0x7fcb140cf7c0 2023-11-26T07:21:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.677+0000 7fcb097fa640 1 -- 172.21.15.70:0/4071811511 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) v1 ==== 86158+0+0 (secure 0 0 0) 0x7fcb100b4390 con 0x7fcb140cf7c0 2023-11-26T07:21:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.677+0000 7fcb097fa640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb000667d0 0x7fcb00068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.677+0000 7fcb097fa640 1 -- 172.21.15.70:0/4071811511 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcb1011ef40 con 0x7fcb140cf7c0 2023-11-26T07:21:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.677+0000 7fcb0bfff640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb000667d0 0x7fcb00068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:08.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.677+0000 7fcb0bfff640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb000667d0 0x7fcb00068c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcb1413dcb0 tx=0x7fcb04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:08.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.681+0000 7fcb097fa640 1 -- 172.21.15.70:0/4071811511 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb100ebf60 con 0x7fcb140cf7c0 2023-11-26T07:21:08.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.857+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol9390", "snap_name": "subvol_snap78440", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb1415fb00 con 0x7fcb000667d0 2023-11-26T07:21:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.873+0000 7fcb097fa640 1 -- 172.21.15.70:0/4071811511 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcb0400a670 con 0x7fcb000667d0 2023-11-26T07:21:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb000667d0 msgr2=0x7fcb00068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb000667d0 0x7fcb00068c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcb1413dcb0 tx=0x7fcb04008040 comp rx=0 tx=0).stop 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb140cf7c0 msgr2=0x7fcb141522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb140cf7c0 0x7fcb141522d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb100ad040 tx=0x7fcb1001ac70 comp rx=0 tx=0).stop 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 shutdown_connections 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcb1415f4e0 0x7fcb1413cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1413e290 0x7fcb1415b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcb000667d0 0x7fcb00068c90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 --2- 172.21.15.70:0/4071811511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb140cf7c0 0x7fcb141522d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 >> 172.21.15.70:0/4071811511 conn(0x7fcb1406a890 msgr2=0x7fcb1406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 shutdown_connections 2023-11-26T07:21:08.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:08.877+0000 7fcb1afe7640 1 -- 172.21.15.70:0/4071811511 wait complete. 2023-11-26T07:21:08.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:21:09.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 Processor -- start 2023-11-26T07:21:09.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 -- start start 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a415d6e0 0x7ff5a40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5a40b2160 0x7ff5a40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff5a40d19f0 0x7ff5a40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a415dac0 con 0x7ff5a40b2160 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40d1e80 con 0x7ff5a40d19f0 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5ac772640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40cf0e0 con 0x7ff5a415d6e0 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5a40b2160 0x7ff5a40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5a40b2160 0x7ff5a40d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55776/0 (socket says 172.21.15.70:55776) 2023-11-26T07:21:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 -- 172.21.15.70:0/3012587198 learned_addr learned my addr 172.21.15.70:0/3012587198 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5aad0f640 1 --2- 172.21.15.70:0/3012587198 >> v2:172.21.15.120:3300/0 conn(0x7ff5a40d19f0 0x7ff5a40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5aa50e640 1 --2- 172.21.15.70:0/3012587198 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a415d6e0 0x7ff5a40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 -- 172.21.15.70:0/3012587198 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a415d6e0 msgr2=0x7ff5a40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 --2- 172.21.15.70:0/3012587198 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a415d6e0 0x7ff5a40d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 -- 172.21.15.70:0/3012587198 >> v2:172.21.15.120:3300/0 conn(0x7ff5a40d19f0 msgr2=0x7ff5a40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 --2- 172.21.15.70:0/3012587198 >> v2:172.21.15.120:3300/0 conn(0x7ff5a40d19f0 0x7ff5a40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.037+0000 7ff5a9d0d640 1 -- 172.21.15.70:0/3012587198 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40ceb20 con 0x7ff5a40b2160 2023-11-26T07:21:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5a9d0d640 1 --2- 172.21.15.70:0/3012587198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a40d14b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff5a408d820 tx=0x7ff59401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a02115293a020c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5a950c640 1 -- 172.21.15.70:0/3012587198 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940ab600 con 0x7ff5a40b2160 2023-11-26T07:21:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5a950c640 1 -- 172.21.15.70:0/3012587198 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5940a7050 con 0x7ff5a40b2160 2023-11-26T07:21:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5a950c640 1 -- 172.21.15.70:0/3012587198 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940ab980 con 0x7ff5a40b2160 2023-11-26T07:21:09.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 -- 172.21.15.70:0/3012587198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 msgr2=0x7ff5a40d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 --2- 172.21.15.70:0/3012587198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a40d14b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff5a408d820 tx=0x7ff59401c240 comp rx=0 tx=0).stop 2023-11-26T07:21:09.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 -- 172.21.15.70:0/3012587198 shutdown_connections 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 --2- 172.21.15.70:0/3012587198 >> v2:172.21.15.120:3300/0 conn(0x7ff5a40d19f0 0x7ff5a40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 --2- 172.21.15.70:0/3012587198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a40d14b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 --2- 172.21.15.70:0/3012587198 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a415d6e0 0x7ff5a40d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 -- 172.21.15.70:0/3012587198 >> 172.21.15.70:0/3012587198 conn(0x7ff5a409c550 msgr2=0x7ff5a40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 -- 172.21.15.70:0/3012587198 shutdown_connections 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.041+0000 7ff5ac772640 1 -- 172.21.15.70:0/3012587198 wait complete. 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 Processor -- start 2023-11-26T07:21:09.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 -- start start 2023-11-26T07:21:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a41544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a40d19f0 0x7ff5a40b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a415d6e0 0x7ff5a40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40b7770 con 0x7ff5a40b2160 2023-11-26T07:21:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4156440 con 0x7ff5a415d6e0 2023-11-26T07:21:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4156720 con 0x7ff5a40d19f0 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a41544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a41544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55778/0 (socket says 172.21.15.70:55778) 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 -- 172.21.15.70:0/254705290 learned_addr learned my addr 172.21.15.70:0/254705290 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aad0f640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a415d6e0 0x7ff5a40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5a9d0d640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a40d19f0 0x7ff5a40b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 -- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a40d19f0 msgr2=0x7ff5a40b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a40d19f0 0x7ff5a40b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 -- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a415d6e0 msgr2=0x7ff5a40b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a415d6e0 0x7ff5a40b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 -- 172.21.15.70:0/254705290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940094d0 con 0x7ff5a40b2160 2023-11-26T07:21:09.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5aa50e640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a41544e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000d5f0 tx=0x7ff5a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff59affd640 1 -- 172.21.15.70:0/254705290 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00125f0 con 0x7ff5a40b2160 2023-11-26T07:21:09.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff59affd640 1 -- 172.21.15.70:0/254705290 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0012750 con 0x7ff5a40b2160 2023-11-26T07:21:09.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff59affd640 1 -- 172.21.15.70:0/254705290 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0012ae0 con 0x7ff5a40b2160 2023-11-26T07:21:09.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4156a00 con 0x7ff5a40b2160 2023-11-26T07:21:09.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.045+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4157200 con 0x7ff5a40b2160 2023-11-26T07:21:09.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.049+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4067680 con 0x7ff5a40b2160 2023-11-26T07:21:09.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.049+0000 7ff59affd640 1 -- 172.21.15.70:0/254705290 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) v1 ==== 86158+0+0 (secure 0 0 0) 0x7ff5a0012c40 con 0x7ff5a40b2160 2023-11-26T07:21:09.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.049+0000 7ff59affd640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff5880667d0 0x7ff588068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.049+0000 7ff59affd640 1 -- 172.21.15.70:0/254705290 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff5a00847a0 con 0x7ff5a40b2160 2023-11-26T07:21:09.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.049+0000 7ff5a9d0d640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff5880667d0 0x7ff588068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.049+0000 7ff5a9d0d640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff5880667d0 0x7ff588068c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff5940ad000 tx=0x7ff5940a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.053+0000 7ff59affd640 1 -- 172.21.15.70:0/254705290 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5a0051860 con 0x7ff5a40b2160 2023-11-26T07:21:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.205+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7ff5a40c9ed0 con 0x7ff5a40b2160 2023-11-26T07:21:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.209+0000 7ff59affd640 1 -- 172.21.15.70:0/254705290 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v15)=0 v15) v1 ==== 130+0+0 (secure 0 0 0) 0x7ff5a0054e80 con 0x7ff5a40b2160 2023-11-26T07:21:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff5880667d0 msgr2=0x7ff588068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff5880667d0 0x7ff588068c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff5940ad000 tx=0x7ff5940a6000 comp rx=0 tx=0).stop 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 msgr2=0x7ff5a41544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a41544e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000d5f0 tx=0x7ff5a000dab0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 shutdown_connections 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5a415d6e0 0x7ff5a40b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff5a40d19f0 0x7ff5a40b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff5880667d0 0x7ff588068c90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 --2- 172.21.15.70:0/254705290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5a40b2160 0x7ff5a41544e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 >> 172.21.15.70:0/254705290 conn(0x7ff5a409c550 msgr2=0x7ff5a40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 shutdown_connections 2023-11-26T07:21:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.213+0000 7ff5ac772640 1 -- 172.21.15.70:0/254705290 wait complete. 2023-11-26T07:21:09.226 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.221+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.226 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.221+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.226 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.221+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.226 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.221+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.227 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.221+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol9390 subvol_snap78440 subvol_clone73650 2023-11-26T07:21:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.381+0000 7f12927ec640 1 Processor -- start 2023-11-26T07:21:09.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.381+0000 7f12927ec640 1 -- start start 2023-11-26T07:21:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f12927ec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c13e290 0x7f128c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f12927ec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f128c15f6b0 0x7f128c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f12927ec640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c06c520 con 0x7f128c0cf7c0 2023-11-26T07:21:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f12927ec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c0cfc40 con 0x7f128c15f6b0 2023-11-26T07:21:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f12927ec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15fb40 con 0x7f128c13e290 2023-11-26T07:21:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f128b7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f128c0cf7c0 0x7f128c15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:57138/0 (socket says 172.21.15.70:57138) 2023-11-26T07:21:09.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f128b7fe640 1 -- 172.21.15.70:0/816171264 learned_addr learned my addr 172.21.15.70:0/816171264 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f128bfff640 1 --2- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c13e290 0x7f128c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f1290d89640 1 --2- 172.21.15.70:0/816171264 >> v2:172.21.15.120:3300/0 conn(0x7f128c15f6b0 0x7f128c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f128affd640 1 -- 172.21.15.70:0/816171264 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773978223 0 0) 0x7f128c06c520 con 0x7f128c0cf7c0 2023-11-26T07:21:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f128affd640 1 -- 172.21.15.70:0/816171264 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1274003530 con 0x7f128c0cf7c0 2023-11-26T07:21:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f1290d89640 1 -- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c13e290 msgr2=0x7f128c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f1290d89640 1 --2- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c13e290 0x7f128c0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f1290d89640 1 -- 172.21.15.70:0/816171264 >> v1:172.21.15.70:6789/0 conn(0x7f128c0cf7c0 legacy=0x7f128c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.385+0000 7f1290d89640 1 -- 172.21.15.70:0/816171264 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c06c800 con 0x7f128c15f6b0 2023-11-26T07:21:09.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f1290d89640 1 --2- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c0cd7b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1284009d90 tx=0x7f128401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c64a4be5566d1ff server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f128affd640 1 -- 172.21.15.70:0/816171264 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840a59e0 con 0x7f128c15f6b0 2023-11-26T07:21:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f128affd640 1 -- 172.21.15.70:0/816171264 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12840a5b40 con 0x7f128c15f6b0 2023-11-26T07:21:09.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f128affd640 1 -- 172.21.15.70:0/816171264 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840ad440 con 0x7f128c15f6b0 2023-11-26T07:21:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 -- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 msgr2=0x7f128c0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 --2- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c0cd7b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1284009d90 tx=0x7f128401c920 comp rx=0 tx=0).stop 2023-11-26T07:21:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 -- 172.21.15.70:0/816171264 shutdown_connections 2023-11-26T07:21:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 --2- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c0cd7b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 --2- 172.21.15.70:0/816171264 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c13e290 0x7f128c0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 -- 172.21.15.70:0/816171264 >> 172.21.15.70:0/816171264 conn(0x7f128c06a890 msgr2=0x7f128c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 -- 172.21.15.70:0/816171264 shutdown_connections 2023-11-26T07:21:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 -- 172.21.15.70:0/816171264 wait complete. 2023-11-26T07:21:09.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 Processor -- start 2023-11-26T07:21:09.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.389+0000 7f12927ec640 1 -- start start 2023-11-26T07:21:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c0cf7c0 0x7f128c152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c13e290 0x7f128c15df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15b6b0 con 0x7f128c13e290 2023-11-26T07:21:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15b990 con 0x7f128c15f6b0 2023-11-26T07:21:09.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c15bc70 con 0x7f128c0cf7c0 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c13e290 0x7f128c15df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c13e290 0x7f128c15df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55816/0 (socket says 172.21.15.70:55816) 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 -- 172.21.15.70:0/264185399 learned_addr learned my addr 172.21.15.70:0/264185399 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f1290d89640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128bfff640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c0cf7c0 0x7f128c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 -- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c0cf7c0 msgr2=0x7f128c152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c0cf7c0 0x7f128c152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 -- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 msgr2=0x7f128c138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c138310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 -- 172.21.15.70:0/264185399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284009a70 con 0x7f128c13e290 2023-11-26T07:21:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f1290d89640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128bfff640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c0cf7c0 0x7f128c152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f128b7fe640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c13e290 0x7f128c15df70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f128000c4d0 tx=0x7f128000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f1288ff9640 1 -- 172.21.15.70:0/264185399 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280005cf0 con 0x7f128c13e290 2023-11-26T07:21:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f1288ff9640 1 -- 172.21.15.70:0/264185399 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1280005e50 con 0x7f128c13e290 2023-11-26T07:21:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f1288ff9640 1 -- 172.21.15.70:0/264185399 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280007270 con 0x7f128c13e290 2023-11-26T07:21:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c15bf50 con 0x7f128c13e290 2023-11-26T07:21:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c152ec0 con 0x7f128c13e290 2023-11-26T07:21:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.393+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c067680 con 0x7f128c13e290 2023-11-26T07:21:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.397+0000 7f1288ff9640 1 -- 172.21.15.70:0/264185399 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) v1 ==== 86158+0+0 (secure 0 0 0) 0x7f12800073d0 con 0x7f128c13e290 2023-11-26T07:21:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.397+0000 7f1288ff9640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1278066800 0x7f1278068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.397+0000 7f1288ff9640 1 -- 172.21.15.70:0/264185399 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f12800839b0 con 0x7f128c13e290 2023-11-26T07:21:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.397+0000 7f128bfff640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1278066800 0x7f1278068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.397+0000 7f128bfff640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1278066800 0x7f1278068cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f127c009bb0 tx=0x7f127c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.401+0000 7f1288ff9640 1 -- 172.21.15.70:0/264185399 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1280050950 con 0x7f128c13e290 2023-11-26T07:21:09.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.577+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol9390", "snap_name": "subvol_snap78440", "target_sub_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7f128c13d930 con 0x7f1278066800 2023-11-26T07:21:09.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.629+0000 7f1288ff9640 1 -- 172.21.15.70:0/264185399 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f128c13d930 con 0x7f1278066800 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1278066800 msgr2=0x7f1278068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1278066800 0x7f1278068cc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f127c009bb0 tx=0x7f127c008040 comp rx=0 tx=0).stop 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c13e290 msgr2=0x7f128c15df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c13e290 0x7f128c15df70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f128000c4d0 tx=0x7f128000c990 comp rx=0 tx=0).stop 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 shutdown_connections 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1278066800 0x7f1278068cc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c13e290 0x7f128c15df70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f128c15f6b0 0x7f128c138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 --2- 172.21.15.70:0/264185399 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f128c0cf7c0 0x7f128c152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 >> 172.21.15.70:0/264185399 conn(0x7f128c06a890 msgr2=0x7f128c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 shutdown_connections 2023-11-26T07:21:09.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.633+0000 7f12927ec640 1 -- 172.21.15.70:0/264185399 wait complete. 2023-11-26T07:21:09.641 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.637+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.641 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.637+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.641 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.637+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.641 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.637+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.641 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.637+0000 7ff294918640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.660 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.657+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.660 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.657+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.660 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.657+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.660 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.657+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.660 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:09.657+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:09.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone73650 2023-11-26T07:21:09.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 Processor -- start 2023-11-26T07:21:09.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 -- start start 2023-11-26T07:21:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2eec13e290 0x7f2eec0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec0cf7c0 0x7f2eec15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2eec15f4e0 0x7f2eec1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec0cfc40 con 0x7f2eec13e290 2023-11-26T07:21:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec06c520 con 0x7f2eec15f4e0 2023-11-26T07:21:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2ef131d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec06c800 con 0x7f2eec0cf7c0 2023-11-26T07:21:09.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eeaffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2eec13e290 0x7f2eec0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eea7fc640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec0cf7c0 0x7f2eec15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eeb7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2eec15f4e0 0x7f2eec1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eeb7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2eec15f4e0 0x7f2eec1408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:48274/0 (socket says 172.21.15.70:48274) 2023-11-26T07:21:09.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eeb7fe640 1 -- 172.21.15.70:0/3932442507 learned_addr learned my addr 172.21.15.70:0/3932442507 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:09.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eeaffd640 1 --2- 172.21.15.70:0/3932442507 >> v2:172.21.15.70:3300/0 conn(0x7f2eec13e290 0x7f2eec0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55860/0 (socket says 172.21.15.70:55860) 2023-11-26T07:21:09.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eea7fc640 1 -- 172.21.15.70:0/3932442507 >> v2:172.21.15.120:3300/0 conn(0x7f2eec15f4e0 msgr2=0x7f2eec1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eea7fc640 1 --2- 172.21.15.70:0/3932442507 >> v2:172.21.15.120:3300/0 conn(0x7f2eec15f4e0 0x7f2eec1408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eea7fc640 1 -- 172.21.15.70:0/3932442507 >> v2:172.21.15.70:3300/0 conn(0x7f2eec13e290 msgr2=0x7f2eec0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:09.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eea7fc640 1 --2- 172.21.15.70:0/3932442507 >> v2:172.21.15.70:3300/0 conn(0x7f2eec13e290 0x7f2eec0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eea7fc640 1 -- 172.21.15.70:0/3932442507 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec06cae0 con 0x7f2eec0cf7c0 2023-11-26T07:21:09.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.801+0000 7f2eeaffd640 1 --2- 172.21.15.70:0/3932442507 >> v2:172.21.15.70:3300/0 conn(0x7f2eec13e290 0x7f2eec0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:09.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2eea7fc640 1 --2- 172.21.15.70:0/3932442507 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec0cf7c0 0x7f2eec15efa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2eec072660 tx=0x7f2ee001c170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5488a2a45af1b0d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ee9ffb640 1 -- 172.21.15.70:0/3932442507 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00ab600 con 0x7f2eec0cf7c0 2023-11-26T07:21:09.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ee9ffb640 1 -- 172.21.15.70:0/3932442507 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee00a7050 con 0x7f2eec0cf7c0 2023-11-26T07:21:09.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ee9ffb640 1 -- 172.21.15.70:0/3932442507 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00ab980 con 0x7f2eec0cf7c0 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 -- 172.21.15.70:0/3932442507 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec0cf7c0 msgr2=0x7f2eec15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 --2- 172.21.15.70:0/3932442507 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec0cf7c0 0x7f2eec15efa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2eec072660 tx=0x7f2ee001c170 comp rx=0 tx=0).stop 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 -- 172.21.15.70:0/3932442507 shutdown_connections 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 --2- 172.21.15.70:0/3932442507 >> v2:172.21.15.120:3300/0 conn(0x7f2eec15f4e0 0x7f2eec1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 --2- 172.21.15.70:0/3932442507 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec0cf7c0 0x7f2eec15efa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 --2- 172.21.15.70:0/3932442507 >> v2:172.21.15.70:3300/0 conn(0x7f2eec13e290 0x7f2eec0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 -- 172.21.15.70:0/3932442507 >> 172.21.15.70:0/3932442507 conn(0x7f2eec06a890 msgr2=0x7f2eec06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 -- 172.21.15.70:0/3932442507 shutdown_connections 2023-11-26T07:21:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.805+0000 7f2ef131d640 1 -- 172.21.15.70:0/3932442507 wait complete. 2023-11-26T07:21:09.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 Processor -- start 2023-11-26T07:21:09.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 -- start start 2023-11-26T07:21:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eec0cf7c0 0x7f2eec135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eec13e290 0x7f2eec137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec15f4e0 0x7f2eec150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0b2b30 con 0x7f2eec13e290 2023-11-26T07:21:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0b3060 con 0x7f2eec0cf7c0 2023-11-26T07:21:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2ef131d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0b3340 con 0x7f2eec15f4e0 2023-11-26T07:21:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eec13e290 0x7f2eec137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eec13e290 0x7f2eec137720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55870/0 (socket says 172.21.15.70:55870) 2023-11-26T07:21:09.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 -- 172.21.15.70:0/913741533 learned_addr learned my addr 172.21.15.70:0/913741533 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:09.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eeaffd640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eec0cf7c0 0x7f2eec135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eeb7fe640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec15f4e0 0x7f2eec150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 -- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec15f4e0 msgr2=0x7f2eec150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec15f4e0 0x7f2eec150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 -- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eec0cf7c0 msgr2=0x7f2eec135ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eec0cf7c0 0x7f2eec135ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 -- 172.21.15.70:0/913741533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009420 con 0x7f2eec13e290 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eeaffd640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eec0cf7c0 0x7f2eec135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.809+0000 7f2eea7fc640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eec13e290 0x7f2eec137720 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00ae040 tx=0x7f2ee0018f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ed37fe640 1 -- 172.21.15.70:0/913741533 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00abe70 con 0x7f2eec13e290 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ed37fe640 1 -- 172.21.15.70:0/913741533 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee00b4430 con 0x7f2eec13e290 2023-11-26T07:21:09.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee0009420 con 0x7f2eec13e290 2023-11-26T07:21:09.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ed37fe640 1 -- 172.21.15.70:0/913741533 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00b4800 con 0x7f2eec13e290 2023-11-26T07:21:09.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec0b3900 con 0x7f2eec13e290 2023-11-26T07:21:09.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eec0b3af0 con 0x7f2eec13e290 2023-11-26T07:21:09.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ed37fe640 1 -- 172.21.15.70:0/913741533 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) v1 ==== 86158+0+0 (secure 0 0 0) 0x7f2ee00b2040 con 0x7f2eec13e290 2023-11-26T07:21:09.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ed37fe640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2ed8066800 0x7f2ed8068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:09.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2ed37fe640 1 -- 172.21.15.70:0/913741533 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2ee011e270 con 0x7f2eec13e290 2023-11-26T07:21:09.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.813+0000 7f2eeaffd640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2ed8066800 0x7f2ed8068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:09.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.817+0000 7f2eeaffd640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2ed8066800 0x7f2ed8068cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2eec13dc50 tx=0x7f2edc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:09.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.817+0000 7f2ed37fe640 1 -- 172.21.15.70:0/913741533 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ee00eb200 con 0x7f2eec13e290 2023-11-26T07:21:09.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:09.993+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7f2eec0b31d0 con 0x7f2ed8066800 2023-11-26T07:21:10.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.001+0000 7f2ed37fe640 1 -- 172.21.15.70:0/913741533 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7f2eec0b31d0 con 0x7f2ed8066800 2023-11-26T07:21:10.006 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:21:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:21:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:21:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:21:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:21:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol9390", 2023-11-26T07:21:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78440" 2023-11-26T07:21:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:10.007 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:21:10.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2ed8066800 msgr2=0x7f2ed8068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:10.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2ed8066800 0x7f2ed8068cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2eec13dc50 tx=0x7f2edc009190 comp rx=0 tx=0).stop 2023-11-26T07:21:10.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eec13e290 msgr2=0x7f2eec137720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:10.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eec13e290 0x7f2eec137720 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00ae040 tx=0x7f2ee0018f10 comp rx=0 tx=0).stop 2023-11-26T07:21:10.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 shutdown_connections 2023-11-26T07:21:10.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2ed8066800 0x7f2ed8068cc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:10.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eec13e290 0x7f2eec137720 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:10.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2eec15f4e0 0x7f2eec150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:10.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 --2- 172.21.15.70:0/913741533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2eec0cf7c0 0x7f2eec135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:10.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 >> 172.21.15.70:0/913741533 conn(0x7f2eec06a890 msgr2=0x7f2eec139aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:10.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 shutdown_connections 2023-11-26T07:21:10.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:10.005+0000 7f2ef131d640 1 -- 172.21.15.70:0/913741533 wait complete. 2023-11-26T07:21:11.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone73650 2023-11-26T07:21:11.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 Processor -- start 2023-11-26T07:21:11.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 -- start start 2023-11-26T07:21:11.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f10cc13e290 0x7f10cc0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:11.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc0cf7c0 0x7f10cc15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10cc15f4e0 0x7f10cc1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc0cfc40 con 0x7f10cc15f4e0 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc06c520 con 0x7f10cc13e290 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.169+0000 7f10d0ba1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc06c800 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10cc15f4e0 0x7f10cc1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10cc15f4e0 0x7f10cc1408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55876/0 (socket says 172.21.15.70:55876) 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 -- 172.21.15.70:0/4197910878 learned_addr learned my addr 172.21.15.70:0/4197910878 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10ca59c640 1 --2- 172.21.15.70:0/4197910878 >> v2:172.21.15.120:3300/0 conn(0x7f10cc13e290 0x7f10cc0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10c3fff640 1 --2- 172.21.15.70:0/4197910878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc0cf7c0 0x7f10cc15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 -- 172.21.15.70:0/4197910878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc0cf7c0 msgr2=0x7f10cc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 --2- 172.21.15.70:0/4197910878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc0cf7c0 0x7f10cc15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 -- 172.21.15.70:0/4197910878 >> v2:172.21.15.120:3300/0 conn(0x7f10cc13e290 msgr2=0x7f10cc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:11.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 --2- 172.21.15.70:0/4197910878 >> v2:172.21.15.120:3300/0 conn(0x7f10cc13e290 0x7f10cc0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 -- 172.21.15.70:0/4197910878 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc06cae0 con 0x7f10cc15f4e0 2023-11-26T07:21:11.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10cad9d640 1 --2- 172.21.15.70:0/4197910878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc15f4e0 0x7f10cc1408e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0725a0 tx=0x7f10c401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6df4a33bf8729de server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:11.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10c9d9b640 1 -- 172.21.15.70:0/4197910878 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40a5560 con 0x7f10cc15f4e0 2023-11-26T07:21:11.178 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10c9d9b640 1 -- 172.21.15.70:0/4197910878 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40a56c0 con 0x7f10cc15f4e0 2023-11-26T07:21:11.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.173+0000 7f10c9d9b640 1 -- 172.21.15.70:0/4197910878 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40a5a50 con 0x7f10cc15f4e0 2023-11-26T07:21:11.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- 172.21.15.70:0/4197910878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc15f4e0 msgr2=0x7f10cc1408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:11.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/4197910878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc15f4e0 0x7f10cc1408e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0725a0 tx=0x7f10c401c6e0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- 172.21.15.70:0/4197910878 shutdown_connections 2023-11-26T07:21:11.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/4197910878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc15f4e0 0x7f10cc1408e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/4197910878 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc0cf7c0 0x7f10cc15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/4197910878 >> v2:172.21.15.120:3300/0 conn(0x7f10cc13e290 0x7f10cc0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- 172.21.15.70:0/4197910878 >> 172.21.15.70:0/4197910878 conn(0x7f10cc06a890 msgr2=0x7f10cc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:11.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- 172.21.15.70:0/4197910878 shutdown_connections 2023-11-26T07:21:11.180 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- 172.21.15.70:0/4197910878 wait complete. 2023-11-26T07:21:11.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 Processor -- start 2023-11-26T07:21:11.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- start start 2023-11-26T07:21:11.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc0cf7c0 0x7f10cc136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:11.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10cc13e290 0x7f10cc071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:11.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc15f4e0 0x7f10cc15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:11.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc072270 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0718a0 con 0x7f10cc13e290 2023-11-26T07:21:11.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10d0ba1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc070c90 con 0x7f10cc15f4e0 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc0cf7c0 0x7f10cc136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10ca59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc0cf7c0 0x7f10cc136ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55878/0 (socket says 172.21.15.70:55878) 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10ca59c640 1 -- 172.21.15.70:0/3210066153 learned_addr learned my addr 172.21.15.70:0/3210066153 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10c3fff640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10cc13e290 0x7f10cc071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.177+0000 7f10cad9d640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc15f4e0 0x7f10cc15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10ca59c640 1 -- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc15f4e0 msgr2=0x7f10cc15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10ca59c640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc15f4e0 0x7f10cc15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10ca59c640 1 -- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10cc13e290 msgr2=0x7f10cc071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10ca59c640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10cc13e290 0x7f10cc071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10ca59c640 1 -- 172.21.15.70:0/3210066153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4009b30 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10ca59c640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc0cf7c0 0x7f10cc136ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00d800 tx=0x7f10bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:11.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10c2ffd640 1 -- 172.21.15.70:0/3210066153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00b6c0 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10c2ffd640 1 -- 172.21.15.70:0/3210066153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00b820 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc070f70 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10c2ffd640 1 -- 172.21.15.70:0/3210066153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00bb90 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc071530 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc067680 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10c2ffd640 1 -- 172.21.15.70:0/3210066153 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7f10bc00bcf0 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10c2ffd640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ac066980 0x7f10ac068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:11.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10c2ffd640 1 -- 172.21.15.70:0/3210066153 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f10bc084ae0 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.181+0000 7f10c3fff640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ac066980 0x7f10ac068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:11.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.185+0000 7f10c3fff640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ac066980 0x7f10ac068e40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0ccfa0 tx=0x7f10b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:11.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.185+0000 7f10c2ffd640 1 -- 172.21.15.70:0/3210066153 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10bc051980 con 0x7f10cc0cf7c0 2023-11-26T07:21:11.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.373+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7f10cc0719e0 con 0x7f10ac066980 2023-11-26T07:21:11.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.381+0000 7f10c2ffd640 1 -- 172.21.15.70:0/3210066153 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7f10b4004240 con 0x7f10ac066980 2023-11-26T07:21:11.385 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol9390", 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78440" 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:11.386 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:21:11.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ac066980 msgr2=0x7f10ac068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:11.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ac066980 0x7f10ac068e40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0ccfa0 tx=0x7f10b4008040 comp rx=0 tx=0).stop 2023-11-26T07:21:11.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc0cf7c0 msgr2=0x7f10cc136ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:11.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc0cf7c0 0x7f10cc136ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00d800 tx=0x7f10bc00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 shutdown_connections 2023-11-26T07:21:11.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10cc15f4e0 0x7f10cc15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10cc13e290 0x7f10cc071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10ac066980 0x7f10ac068e40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 --2- 172.21.15.70:0/3210066153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10cc0cf7c0 0x7f10cc136ed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:11.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 >> 172.21.15.70:0/3210066153 conn(0x7f10cc06a890 msgr2=0x7f10cc140680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:11.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 shutdown_connections 2023-11-26T07:21:11.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:11.385+0000 7f10d0ba1640 1 -- 172.21.15.70:0/3210066153 wait complete. 2023-11-26T07:21:12.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone73650 2023-11-26T07:21:12.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.557+0000 7f8d8bfec640 1 Processor -- start 2023-11-26T07:21:12.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d8bfec640 1 -- start start 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d8bfec640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8d841596d0 0x7f8d84071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d8bfec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8d840b2f80 0x7f8d8406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d8bfec640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8406c750 con 0x7f8d840ce680 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d8bfec640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840cbe00 con 0x7f8d841596d0 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d8bfec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840b3550 con 0x7f8d840b2f80 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d89d88640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8d841596d0 0x7f8d84071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d89d88640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8d841596d0 0x7f8d84071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55882/0 (socket says 172.21.15.70:55882) 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d89d88640 1 -- 172.21.15.70:0/3190472108 learned_addr learned my addr 172.21.15.70:0/3190472108 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:12.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d89d88640 1 -- 172.21.15.70:0/3190472108 >> v2:172.21.15.120:3300/0 conn(0x7f8d840b2f80 msgr2=0x7f8d8406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:12.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d89d88640 1 --2- 172.21.15.70:0/3190472108 >> v2:172.21.15.120:3300/0 conn(0x7f8d840b2f80 0x7f8d8406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d89d88640 1 -- 172.21.15.70:0/3190472108 >> v1:172.21.15.120:6789/0 conn(0x7f8d840ce680 legacy=0x7f8d840b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:12.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.561+0000 7f8d89d88640 1 -- 172.21.15.70:0/3190472108 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84071e80 con 0x7f8d841596d0 2023-11-26T07:21:12.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d89d88640 1 --2- 172.21.15.70:0/3190472108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841596d0 0x7f8d84071850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8d8406e860 tx=0x7f8d8001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a346966651647a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:12.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d88d86640 1 -- 172.21.15.70:0/3190472108 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800ab600 con 0x7f8d841596d0 2023-11-26T07:21:12.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d88d86640 1 -- 172.21.15.70:0/3190472108 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d800a7050 con 0x7f8d841596d0 2023-11-26T07:21:12.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d88d86640 1 -- 172.21.15.70:0/3190472108 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800ab980 con 0x7f8d841596d0 2023-11-26T07:21:12.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 -- 172.21.15.70:0/3190472108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841596d0 msgr2=0x7f8d84071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:12.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/3190472108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841596d0 0x7f8d84071850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8d8406e860 tx=0x7f8d8001c4c0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 -- 172.21.15.70:0/3190472108 shutdown_connections 2023-11-26T07:21:12.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/3190472108 >> v2:172.21.15.120:3300/0 conn(0x7f8d840b2f80 0x7f8d8406cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/3190472108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841596d0 0x7f8d84071850 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 -- 172.21.15.70:0/3190472108 >> 172.21.15.70:0/3190472108 conn(0x7f8d8406a890 msgr2=0x7f8d8406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 -- 172.21.15.70:0/3190472108 shutdown_connections 2023-11-26T07:21:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 -- 172.21.15.70:0/3190472108 wait complete. 2023-11-26T07:21:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 Processor -- start 2023-11-26T07:21:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.565+0000 7f8d8bfec640 1 -- start start 2023-11-26T07:21:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d840b2f80 0x7f8d84143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8d840ce680 0x7f8d841441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d841596d0 0x7f8d840afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84159cc0 con 0x7f8d840b2f80 2023-11-26T07:21:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84144700 con 0x7f8d841596d0 2023-11-26T07:21:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84143ee0 con 0x7f8d840ce680 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d840b2f80 0x7f8d84143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d840b2f80 0x7f8d84143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55886/0 (socket says 172.21.15.70:55886) 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 -- 172.21.15.70:0/1210222206 learned_addr learned my addr 172.21.15.70:0/1210222206 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 -- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8d840ce680 msgr2=0x7f8d841441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8a589640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d841596d0 0x7f8d840afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89587640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8d840ce680 0x7f8d841441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8d840ce680 0x7f8d841441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 -- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d841596d0 msgr2=0x7f8d840afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d841596d0 0x7f8d840afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 -- 172.21.15.70:0/1210222206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800094d0 con 0x7f8d840b2f80 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8a589640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d841596d0 0x7f8d840afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89587640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8d840ce680 0x7f8d841441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d89d88640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d840b2f80 0x7f8d84143870 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8d80000c10 tx=0x7f8d80019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d7a7fc640 1 -- 172.21.15.70:0/1210222206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800b5600 con 0x7f8d840b2f80 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d7a7fc640 1 -- 172.21.15.70:0/1210222206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d800b5780 con 0x7f8d840b2f80 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d7a7fc640 1 -- 172.21.15.70:0/1210222206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800b5b30 con 0x7f8d840b2f80 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d841466e0 con 0x7f8d840b2f80 2023-11-26T07:21:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d84146ca0 con 0x7f8d840b2f80 2023-11-26T07:21:12.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d84146540 con 0x7f8d840b2f80 2023-11-26T07:21:12.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.569+0000 7f8d7a7fc640 1 -- 172.21.15.70:0/1210222206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7f8d800b5c90 con 0x7f8d840b2f80 2023-11-26T07:21:12.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.573+0000 7f8d7a7fc640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8d68066980 0x7f8d68068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:12.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.573+0000 7f8d7a7fc640 1 -- 172.21.15.70:0/1210222206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8d8011ee80 con 0x7f8d840b2f80 2023-11-26T07:21:12.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.573+0000 7f8d89587640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8d68066980 0x7f8d68068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:12.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.573+0000 7f8d89587640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8d68066980 0x7f8d68068e40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d8415cd40 tx=0x7f8d74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:12.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.577+0000 7f8d7a7fc640 1 -- 172.21.15.70:0/1210222206 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d84146540 con 0x7f8d840b2f80 2023-11-26T07:21:12.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.757+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d84146540 con 0x7f8d68066980 2023-11-26T07:21:12.767 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d7a7fc640 1 -- 172.21.15.70:0/1210222206 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7f8d84146540 con 0x7f8d68066980 2023-11-26T07:21:12.767 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:21:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:21:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:21:12.767 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:21:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:21:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol9390", 2023-11-26T07:21:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78440" 2023-11-26T07:21:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:12.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:12.768 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:21:12.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8d68066980 msgr2=0x7f8d68068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:12.769 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8d68066980 0x7f8d68068e40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d8415cd40 tx=0x7f8d74009040 comp rx=0 tx=0).stop 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d840b2f80 msgr2=0x7f8d84143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d840b2f80 0x7f8d84143870 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8d80000c10 tx=0x7f8d80019260 comp rx=0 tx=0).stop 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 shutdown_connections 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d841596d0 0x7f8d840afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8d840ce680 0x7f8d841441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8d68066980 0x7f8d68068e40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 --2- 172.21.15.70:0/1210222206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d840b2f80 0x7f8d84143870 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 >> 172.21.15.70:0/1210222206 conn(0x7f8d8406a890 msgr2=0x7f8d840cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 shutdown_connections 2023-11-26T07:21:12.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:12.765+0000 7f8d8bfec640 1 -- 172.21.15.70:0/1210222206 wait complete. 2023-11-26T07:21:13.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone73650 2023-11-26T07:21:13.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5319f5640 1 Processor -- start 2023-11-26T07:21:13.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5319f5640 1 -- start start 2023-11-26T07:21:13.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5319f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe52c13e290 0x7fe52c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5319f5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c15fb20 con 0x7fe52c0cf7c0 2023-11-26T07:21:13.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5319f5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c06c520 con 0x7fe52c15f6b0 2023-11-26T07:21:13.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5319f5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0cfc40 con 0x7fe52c13e290 2023-11-26T07:21:13.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5227fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe52c0cf7c0 0x7fe52c15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36950/0 (socket says 172.21.15.70:36950) 2023-11-26T07:21:13.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5227fc640 1 -- 172.21.15.70:0/3030208522 learned_addr learned my addr 172.21.15.70:0/3030208522 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52affd640 1 --2- 172.21.15.70:0/3030208522 >> v2:172.21.15.120:3300/0 conn(0x7fe52c13e290 0x7fe52c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836681143 0 0) 0x7fe51c001120 con 0x7fe52c0cf7c0 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe518003530 con 0x7fe52c0cf7c0 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130389944 0 0) 0x7fe52c06c520 con 0x7fe52c15f6b0 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe51c001120 con 0x7fe52c15f6b0 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 563441487 0 0) 0x7fe518003530 con 0x7fe52c0cf7c0 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 >> v2:172.21.15.120:3300/0 conn(0x7fe52c13e290 msgr2=0x7fe52c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:13.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 --2- 172.21.15.70:0/3030208522 >> v2:172.21.15.120:3300/0 conn(0x7fe52c13e290 0x7fe52c0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 >> v1:172.21.15.120:6789/0 conn(0x7fe52c15f6b0 legacy=0x7fe52c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c06c800 con 0x7fe52c0cf7c0 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fe51c001830 con 0x7fe52c0cf7c0 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 >> v1:172.21.15.70:6789/0 conn(0x7fe52c0cf7c0 legacy=0x7fe52c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518003b60 0x7fe518003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5180047d0 0x7fe518004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe518005190 0x7fe51800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0cfc40 con 0x7fe518005190 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51800c060 con 0x7fe518003b60 2023-11-26T07:21:13.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51800c220 con 0x7fe5180047d0 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52b7fe640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe518005190 0x7fe51800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe52affd640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518003b60 0x7fe518003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.937+0000 7fe5227fc640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5180047d0 0x7fe518004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52b7fe640 1 -- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5180047d0 msgr2=0x7fe518004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52b7fe640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe5180047d0 0x7fe518004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52b7fe640 1 -- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518003b60 msgr2=0x7fe518003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52b7fe640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518003b60 0x7fe518003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:13.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52b7fe640 1 -- 172.21.15.70:0/3030208522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518003530 con 0x7fe518005190 2023-11-26T07:21:13.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52b7fe640 1 -- 172.21.15.70:0/3030208522 reap_dead start 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52b7fe640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe518005190 0x7fe51800b990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe524001fd0 tx=0x7fe52401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e639addf90a95f65 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524003b80 con 0x7fe518005190 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524003ce0 con 0x7fe518005190 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe52a7fc640 1 -- 172.21.15.70:0/3030208522 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524005310 con 0x7fe518005190 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe5319f5640 1 -- 172.21.15.70:0/3030208522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe518005190 msgr2=0x7fe51800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe5319f5640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe518005190 0x7fe51800b990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe524001fd0 tx=0x7fe52401c8e0 comp rx=0 tx=0).stop 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe5319f5640 1 -- 172.21.15.70:0/3030208522 shutdown_connections 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe5319f5640 1 --2- 172.21.15.70:0/3030208522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe518005190 0x7fe51800b990 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe5319f5640 1 -- 172.21.15.70:0/3030208522 >> 172.21.15.70:0/3030208522 conn(0x7fe52c06a890 msgr2=0x7fe52c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe5319f5640 1 -- 172.21.15.70:0/3030208522 shutdown_connections 2023-11-26T07:21:13.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.941+0000 7fe5319f5640 1 -- 172.21.15.70:0/3030208522 wait complete. 2023-11-26T07:21:13.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 Processor -- start 2023-11-26T07:21:13.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 -- start start 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518005190 0x7fe52c0a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe52c15adf0 0x7fe52c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe52c0a9430 0x7fe52c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c070850 con 0x7fe52c15adf0 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0a98f0 con 0x7fe518005190 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c070ac0 con 0x7fe52c0a9430 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe52c15adf0 0x7fe52c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe52c15adf0 0x7fe52c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36436/0 (socket says 172.21.15.70:36436) 2023-11-26T07:21:13.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 -- 172.21.15.70:0/536582300 learned_addr learned my addr 172.21.15.70:0/536582300 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 -- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe52c0a9430 msgr2=0x7fe52c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe52c0a9430 0x7fe52c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 -- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518005190 msgr2=0x7fe52c0a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe52affd640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518005190 0x7fe52c0a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518005190 0x7fe52c0a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 -- 172.21.15.70:0/536582300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c070da0 con 0x7fe52c15adf0 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe52affd640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518005190 0x7fe52c0a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5227fc640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe52c15adf0 0x7fe52c15d8c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe51c012490 tx=0x7fe51c012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe528ff9640 1 -- 172.21.15.70:0/536582300 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c014750 con 0x7fe52c15adf0 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe528ff9640 1 -- 172.21.15.70:0/536582300 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c0148b0 con 0x7fe52c15adf0 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe528ff9640 1 -- 172.21.15.70:0/536582300 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c014c60 con 0x7fe52c15adf0 2023-11-26T07:21:13.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.945+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c071080 con 0x7fe52c15adf0 2023-11-26T07:21:13.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.949+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c1f2520 con 0x7fe52c15adf0 2023-11-26T07:21:13.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.949+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c067680 con 0x7fe52c15adf0 2023-11-26T07:21:13.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.949+0000 7fe528ff9640 1 -- 172.21.15.70:0/536582300 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7fe51c0153e0 con 0x7fe52c15adf0 2023-11-26T07:21:13.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.949+0000 7fe528ff9640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe50c066980 0x7fe50c068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:13.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.949+0000 7fe528ff9640 1 -- 172.21.15.70:0/536582300 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe51c086f00 con 0x7fe52c15adf0 2023-11-26T07:21:13.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.949+0000 7fe52affd640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe50c066980 0x7fe50c068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:13.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.949+0000 7fe52affd640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe50c066980 0x7fe50c068e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe5140093f0 tx=0x7fe514008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:13.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:13.953+0000 7fe528ff9640 1 -- 172.21.15.70:0/536582300 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe51c0577d0 con 0x7fe52c15adf0 2023-11-26T07:21:14.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.137+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7fe52c06d0a0 con 0x7fe50c066980 2023-11-26T07:21:14.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe528ff9640 1 -- 172.21.15.70:0/536582300 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+164 (secure 0 0 0) 0x7fe514009710 con 0x7fe50c066980 2023-11-26T07:21:14.145 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:21:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:21:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:21:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:21:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:21:14.145 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol9390", 2023-11-26T07:21:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78440" 2023-11-26T07:21:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:14.146 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:21:14.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe50c066980 msgr2=0x7fe50c068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:14.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe50c066980 0x7fe50c068e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe5140093f0 tx=0x7fe514008040 comp rx=0 tx=0).stop 2023-11-26T07:21:14.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe52c15adf0 msgr2=0x7fe52c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:14.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe52c15adf0 0x7fe52c15d8c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe51c012490 tx=0x7fe51c012950 comp rx=0 tx=0).stop 2023-11-26T07:21:14.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 shutdown_connections 2023-11-26T07:21:14.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe50c066980 0x7fe50c068e40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:14.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe52c15adf0 0x7fe52c15d8c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:14.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe52c0a9430 0x7fe52c15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:14.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 --2- 172.21.15.70:0/536582300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe518005190 0x7fe52c0a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:14.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.141+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 >> 172.21.15.70:0/536582300 conn(0x7fe52c06a890 msgr2=0x7fe52c0b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:14.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.145+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 shutdown_connections 2023-11-26T07:21:14.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:14.145+0000 7fe5319f5640 1 -- 172.21.15.70:0/536582300 wait complete. 2023-11-26T07:21:15.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone73650 2023-11-26T07:21:15.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f2701be7640 1 Processor -- start 2023-11-26T07:21:15.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f2701be7640 1 -- start start 2023-11-26T07:21:15.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f2701be7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc143ac0 0x7f26fc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f2701be7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f26fc0708b0 0x7f26fc0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f2701be7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26fc0cfbf0 con 0x7f26fc0cf7c0 2023-11-26T07:21:15.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f2701be7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26fc143ea0 con 0x7f26fc0708b0 2023-11-26T07:21:15.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f2701be7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc0cc730 con 0x7f26fc143ac0 2023-11-26T07:21:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26faffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f26fc0708b0 0x7f26fc0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26fbfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f26fc0cf7c0 0x7f26fc0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36962/0 (socket says 172.21.15.70:36962) 2023-11-26T07:21:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26fbfff640 1 -- 172.21.15.70:0/3436161875 learned_addr learned my addr 172.21.15.70:0/3436161875 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:15.314 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26fb7fe640 1 --2- 172.21.15.70:0/3436161875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc143ac0 0x7f26fc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26faffd640 1 -- 172.21.15.70:0/3436161875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc143ac0 msgr2=0x7f26fc070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26faffd640 1 --2- 172.21.15.70:0/3436161875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc143ac0 0x7f26fc070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26faffd640 1 -- 172.21.15.70:0/3436161875 >> v1:172.21.15.70:6789/0 conn(0x7f26fc0cf7c0 legacy=0x7f26fc0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26faffd640 1 -- 172.21.15.70:0/3436161875 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc070ee0 con 0x7f26fc0708b0 2023-11-26T07:21:15.315 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.309+0000 7f26fa7fc640 1 -- 172.21.15.70:0/3436161875 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774192912 0 0) 0x7f26fc0cfbf0 con 0x7f26fc0cf7c0 2023-11-26T07:21:15.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f26faffd640 1 --2- 172.21.15.70:0/3436161875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc0708b0 0x7f26fc0cf280 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f26f00097c0 tx=0x7f26f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4981688377e4d282 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f26fa7fc640 1 -- 172.21.15.70:0/3436161875 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00ad640 con 0x7f26fc0708b0 2023-11-26T07:21:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f26fa7fc640 1 -- 172.21.15.70:0/3436161875 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f00ad7a0 con 0x7f26fc0708b0 2023-11-26T07:21:15.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f26fa7fc640 1 -- 172.21.15.70:0/3436161875 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00adb30 con 0x7f26fc0708b0 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 -- 172.21.15.70:0/3436161875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc0708b0 msgr2=0x7f26fc0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 --2- 172.21.15.70:0/3436161875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc0708b0 0x7f26fc0cf280 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f26f00097c0 tx=0x7f26f001c480 comp rx=0 tx=0).stop 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 -- 172.21.15.70:0/3436161875 shutdown_connections 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 --2- 172.21.15.70:0/3436161875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc0708b0 0x7f26fc0cf280 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 --2- 172.21.15.70:0/3436161875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc143ac0 0x7f26fc070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 -- 172.21.15.70:0/3436161875 >> 172.21.15.70:0/3436161875 conn(0x7f26fc06a890 msgr2=0x7f26fc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 -- 172.21.15.70:0/3436161875 shutdown_connections 2023-11-26T07:21:15.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.313+0000 7f2701be7640 1 -- 172.21.15.70:0/3436161875 wait complete. 2023-11-26T07:21:15.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 Processor -- start 2023-11-26T07:21:15.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 -- start start 2023-11-26T07:21:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc0708b0 0x7f26fc0a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26fc0cf7c0 0x7f26fc0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc143ac0 0x7f26fc159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc15a050 con 0x7f26fc143ac0 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc13b320 con 0x7f26fc0cf7c0 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26fc13b5c0 con 0x7f26fc0708b0 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc143ac0 0x7f26fc159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc143ac0 0x7f26fc159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36444/0 (socket says 172.21.15.70:36444) 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 -- 172.21.15.70:0/1976745252 learned_addr learned my addr 172.21.15.70:0/1976745252 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fb7fe640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc0708b0 0x7f26fc0a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26faffd640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26fc0cf7c0 0x7f26fc0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 -- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc0708b0 msgr2=0x7f26fc0a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc0708b0 0x7f26fc0a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 -- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26fc0cf7c0 msgr2=0x7f26fc0af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26fc0cf7c0 0x7f26fc0af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 -- 172.21.15.70:0/1976745252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f0009420 con 0x7f26fc143ac0 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26fbfff640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc143ac0 0x7f26fc159b10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f26f400cb30 tx=0x7f26f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26e3fff640 1 -- 172.21.15.70:0/1976745252 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400aca0 con 0x7f26fc143ac0 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26e3fff640 1 -- 172.21.15.70:0/1976745252 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f400ae20 con 0x7f26fc143ac0 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f26e3fff640 1 -- 172.21.15.70:0/1976745252 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4012640 con 0x7f26fc143ac0 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26fc13b8a0 con 0x7f26fc143ac0 2023-11-26T07:21:15.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26fc0af9f0 con 0x7f26fc143ac0 2023-11-26T07:21:15.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.317+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26fc06e1b0 con 0x7f26fc143ac0 2023-11-26T07:21:15.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.321+0000 7f26e3fff640 1 -- 172.21.15.70:0/1976745252 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7f26f4007070 con 0x7f26fc143ac0 2023-11-26T07:21:15.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.321+0000 7f26e3fff640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26e8066980 0x7f26e8068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:15.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.321+0000 7f26e3fff640 1 -- 172.21.15.70:0/1976745252 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f26f40845b0 con 0x7f26fc143ac0 2023-11-26T07:21:15.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.321+0000 7f26fb7fe640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26e8066980 0x7f26e8068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:15.325 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.321+0000 7f26fb7fe640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26e8066980 0x7f26e8068e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f26ec007a60 tx=0x7f26ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:15.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.325+0000 7f26e3fff640 1 -- 172.21.15.70:0/1976745252 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26f40514a0 con 0x7f26fc143ac0 2023-11-26T07:21:15.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:15.505+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7f26fc071bd0 con 0x7f26e8066980 2023-11-26T07:21:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.437+0000 7f26e3fff640 1 -- 172.21.15.70:0/1976745252 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+168 (secure 0 0 0) 0x7f26fc071bd0 con 0x7f26e8066980 2023-11-26T07:21:17.443 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:21:17.443 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:21:17.443 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "in-progress", 2023-11-26T07:21:17.443 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:21:17.444 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:21:17.444 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol9390", 2023-11-26T07:21:17.444 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78440" 2023-11-26T07:21:17.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:17.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:17.444 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26e8066980 msgr2=0x7f26e8068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26e8066980 0x7f26e8068e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f26ec007a60 tx=0x7f26ec008040 comp rx=0 tx=0).stop 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc143ac0 msgr2=0x7f26fc159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc143ac0 0x7f26fc159b10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f26f400cb30 tx=0x7f26f400a060 comp rx=0 tx=0).stop 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 shutdown_connections 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26e8066980 0x7f26e8068e40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26fc143ac0 0x7f26fc159b10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26fc0cf7c0 0x7f26fc0af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 --2- 172.21.15.70:0/1976745252 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f26fc0708b0 0x7f26fc0a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 >> 172.21.15.70:0/1976745252 conn(0x7f26fc06a890 msgr2=0x7f26fc15c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 shutdown_connections 2023-11-26T07:21:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.441+0000 7f2701be7640 1 -- 172.21.15.70:0/1976745252 wait complete. 2023-11-26T07:21:17.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone73650 2023-11-26T07:21:17.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.633+0000 7f3870a79640 1 Processor -- start 2023-11-26T07:21:17.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.633+0000 7f3870a79640 1 -- start start 2023-11-26T07:21:17.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3870a79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 0x7f386c161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3870a79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c0cf260 con 0x7f386c06f000 2023-11-26T07:21:17.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3870a79640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c09a010 con 0x7f386c099a70 2023-11-26T07:21:17.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3870a79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c09a2f0 con 0x7f386c06f3e0 2023-11-26T07:21:17.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386a59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f386c06f000 0x7f386c06d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36976/0 (socket says 172.21.15.70:36976) 2023-11-26T07:21:17.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386a59c640 1 -- 172.21.15.70:0/2206331344 learned_addr learned my addr 172.21.15.70:0/2206331344 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:17.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302469863 0 0) 0x7f386c0cf260 con 0x7f386c06f000 2023-11-26T07:21:17.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3869d9b640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 0x7f386c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3854003530 con 0x7f386c06f000 2023-11-26T07:21:17.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4233129623 0 0) 0x7f3854003530 con 0x7f386c06f000 2023-11-26T07:21:17.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 msgr2=0x7f386c161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 0x7f386c161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 >> v1:172.21.15.120:6789/0 conn(0x7f386c099a70 legacy=0x7f386c161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c09a5d0 con 0x7f386c06f000 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f385c001680 con 0x7f386c06f000 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 >> v1:172.21.15.70:6789/0 conn(0x7f386c06f000 legacy=0x7f386c06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38540039b0 0x7f3854003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854004360 0x7f3854004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 0x7f3854005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c09a2f0 con 0x7f3854004360 2023-11-26T07:21:17.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385400ba40 con 0x7f38540039b0 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385400bc00 con 0x7f386c06f3e0 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3869d9b640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854004360 0x7f3854004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386a59c640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38540039b0 0x7f3854003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386ad9d640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 0x7f3854005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3869d9b640 1 -- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 msgr2=0x7f3854005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3869d9b640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c06f3e0 0x7f3854005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3869d9b640 1 -- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38540039b0 msgr2=0x7f3854003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:17.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3869d9b640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38540039b0 0x7f3854003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f3869d9b640 1 -- 172.21.15.70:0/2206331344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3854003530 con 0x7f3854004360 2023-11-26T07:21:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.637+0000 7f386a59c640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38540039b0 0x7f3854003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f3869d9b640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854004360 0x7f3854004810 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3860009ae0 tx=0x7f386001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c893031635168496 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600a5640 con 0x7f3854004360 2023-11-26T07:21:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38600a57a0 con 0x7f3854004360 2023-11-26T07:21:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f386959a640 1 -- 172.21.15.70:0/2206331344 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600a5b50 con 0x7f3854004360 2023-11-26T07:21:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f3870a79640 1 -- 172.21.15.70:0/2206331344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854004360 msgr2=0x7f3854004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f3870a79640 1 --2- 172.21.15.70:0/2206331344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3854004360 0x7f3854004810 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3860009ae0 tx=0x7f386001ca50 comp rx=0 tx=0).stop 2023-11-26T07:21:17.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f386ad9d640 1 -- 172.21.15.70:0/2206331344 reap_dead start 2023-11-26T07:21:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f3870a79640 1 -- 172.21.15.70:0/2206331344 shutdown_connections 2023-11-26T07:21:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f3870a79640 1 -- 172.21.15.70:0/2206331344 >> 172.21.15.70:0/2206331344 conn(0x7f386c0b2d10 msgr2=0x7f386c0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f3870a79640 1 -- 172.21.15.70:0/2206331344 shutdown_connections 2023-11-26T07:21:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.641+0000 7f3870a79640 1 -- 172.21.15.70:0/2206331344 wait complete. 2023-11-26T07:21:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 Processor -- start 2023-11-26T07:21:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 -- start start 2023-11-26T07:21:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3854004360 0x7f386c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c1586d0 0x7f386c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386c15fb60 0x7f386c160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c14bc00 con 0x7f386c15fb60 2023-11-26T07:21:17.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c161030 con 0x7f3854004360 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f3870a79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c15e4d0 con 0x7f386c1586d0 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f386ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386c15fb60 0x7f386c160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f386ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386c15fb60 0x7f386c160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36458/0 (socket says 172.21.15.70:36458) 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.645+0000 7f386ad9d640 1 -- 172.21.15.70:0/1638279715 learned_addr learned my addr 172.21.15.70:0/1638279715 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f386a59c640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3854004360 0x7f386c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f3869d9b640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c1586d0 0x7f386c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f386ad9d640 1 -- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c1586d0 msgr2=0x7f386c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f386ad9d640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c1586d0 0x7f386c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f386ad9d640 1 -- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3854004360 msgr2=0x7f386c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f386ad9d640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3854004360 0x7f386c15def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f386ad9d640 1 -- 172.21.15.70:0/1638279715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c1609e0 con 0x7f386c15fb60 2023-11-26T07:21:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f3869d9b640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c1586d0 0x7f386c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f386ad9d640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386c15fb60 0x7f386c160010 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f386c071760 tx=0x7f3864011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f385affd640 1 -- 172.21.15.70:0/1638279715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864003b90 con 0x7f386c15fb60 2023-11-26T07:21:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f385affd640 1 -- 172.21.15.70:0/1638279715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864003cf0 con 0x7f386c15fb60 2023-11-26T07:21:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c160cc0 con 0x7f386c15fb60 2023-11-26T07:21:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f385affd640 1 -- 172.21.15.70:0/1638279715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864005310 con 0x7f386c15fb60 2023-11-26T07:21:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c158e50 con 0x7f386c15fb60 2023-11-26T07:21:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c160e50 con 0x7f386c15fb60 2023-11-26T07:21:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.649+0000 7f385affd640 1 -- 172.21.15.70:0/1638279715 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7f3864005470 con 0x7f386c15fb60 2023-11-26T07:21:17.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.653+0000 7f385affd640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f384c0669b0 0x7f384c068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:17.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.653+0000 7f385affd640 1 -- 172.21.15.70:0/1638279715 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3864087ad0 con 0x7f386c15fb60 2023-11-26T07:21:17.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.653+0000 7f386a59c640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f384c0669b0 0x7f384c068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:17.656 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.653+0000 7f386a59c640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f384c0669b0 0x7f384c068e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f385c001000 tx=0x7f385c000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.657+0000 7f385affd640 1 -- 172.21.15.70:0/1638279715 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3864054950 con 0x7f386c15fb60 2023-11-26T07:21:17.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.889+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7f386c0d09c0 con 0x7f384c0669b0 2023-11-26T07:21:17.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.977+0000 7f385affd640 1 -- 172.21.15.70:0/1638279715 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f385c0085d0 con 0x7f384c0669b0 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f384c0669b0 msgr2=0x7f384c068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f384c0669b0 0x7f384c068e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f385c001000 tx=0x7f385c000bd0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386c15fb60 msgr2=0x7f386c160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386c15fb60 0x7f386c160010 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f386c071760 tx=0x7f3864011f30 comp rx=0 tx=0).stop 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 shutdown_connections 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f384c0669b0 0x7f384c068e70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f386c15fb60 0x7f386c160010 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f386c1586d0 0x7f386c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 --2- 172.21.15.70:0/1638279715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3854004360 0x7f386c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:17.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 >> 172.21.15.70:0/1638279715 conn(0x7f386c0b2d10 msgr2=0x7f386c0c4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:17.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 shutdown_connections 2023-11-26T07:21:17.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:17.981+0000 7f3870a79640 1 -- 172.21.15.70:0/1638279715 wait complete. 2023-11-26T07:21:18.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone73650 2023-11-26T07:21:18.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.141+0000 7f01b13e7640 1 Processor -- start 2023-11-26T07:21:18.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.141+0000 7f01b13e7640 1 -- start start 2023-11-26T07:21:18.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.141+0000 7f01b13e7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.141+0000 7f01b13e7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f01ac0708b0 0x7f01ac0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.141+0000 7f01b13e7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac0cfbf0 con 0x7f01ac0cf7c0 2023-11-26T07:21:18.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.141+0000 7f01b13e7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac143ea0 con 0x7f01ac0708b0 2023-11-26T07:21:18.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.141+0000 7f01b13e7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0cc730 con 0x7f01ac143ac0 2023-11-26T07:21:18.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01ab7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f01ac0cf7c0 0x7f01ac0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36980/0 (socket says 172.21.15.70:36980) 2023-11-26T07:21:18.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01ab7fe640 1 -- 172.21.15.70:0/3880053426 learned_addr learned my addr 172.21.15.70:0/3880053426 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:18.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01aaffd640 1 --2- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01a27fc640 1 --2- 172.21.15.70:0/3880053426 >> v2:172.21.15.120:3300/0 conn(0x7f01ac0708b0 0x7f01ac0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01aa7fc640 1 -- 172.21.15.70:0/3880053426 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338833369 0 0) 0x7f01ac0cfbf0 con 0x7f01ac0cf7c0 2023-11-26T07:21:18.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01aa7fc640 1 -- 172.21.15.70:0/3880053426 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0198003530 con 0x7f01ac0cf7c0 2023-11-26T07:21:18.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01a27fc640 1 -- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 msgr2=0x7f01ac070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:18.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01a27fc640 1 --2- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01a27fc640 1 -- 172.21.15.70:0/3880053426 >> v1:172.21.15.70:6789/0 conn(0x7f01ac0cf7c0 legacy=0x7f01ac0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01a27fc640 1 -- 172.21.15.70:0/3880053426 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac070ee0 con 0x7f01ac0708b0 2023-11-26T07:21:18.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01aaffd640 1 --2- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:18.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.145+0000 7f01a27fc640 1 --2- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0708b0 0x7f01ac0cf280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0194009d90 tx=0x7f019401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28a2a72afab9083 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01aa7fc640 1 -- 172.21.15.70:0/3880053426 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940a5920 con 0x7f01ac0708b0 2023-11-26T07:21:18.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01aa7fc640 1 -- 172.21.15.70:0/3880053426 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940a5a80 con 0x7f01ac0708b0 2023-11-26T07:21:18.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01aa7fc640 1 -- 172.21.15.70:0/3880053426 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940a5e10 con 0x7f01ac0708b0 2023-11-26T07:21:18.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0708b0 msgr2=0x7f01ac0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 --2- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0708b0 0x7f01ac0cf280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0194009d90 tx=0x7f019401c950 comp rx=0 tx=0).stop 2023-11-26T07:21:18.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- 172.21.15.70:0/3880053426 shutdown_connections 2023-11-26T07:21:18.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 --2- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0708b0 0x7f01ac0cf280 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 --2- 172.21.15.70:0/3880053426 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- 172.21.15.70:0/3880053426 >> 172.21.15.70:0/3880053426 conn(0x7f01ac06a890 msgr2=0x7f01ac06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:18.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- 172.21.15.70:0/3880053426 shutdown_connections 2023-11-26T07:21:18.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- 172.21.15.70:0/3880053426 wait complete. 2023-11-26T07:21:18.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 Processor -- start 2023-11-26T07:21:18.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- start start 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01ac0708b0 0x7f01ac159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0cf7c0 0x7f01ac158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac15a240 con 0x7f01ac0708b0 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac158990 con 0x7f01ac0cf7c0 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01b13e7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac158c60 con 0x7f01ac143ac0 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01aaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01ac0708b0 0x7f01ac159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01aaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01ac0708b0 0x7f01ac159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36474/0 (socket says 172.21.15.70:36474) 2023-11-26T07:21:18.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.149+0000 7f01aaffd640 1 -- 172.21.15.70:0/2189163401 learned_addr learned my addr 172.21.15.70:0/2189163401 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:18.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01aaffd640 1 -- 172.21.15.70:0/2189163401 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 msgr2=0x7f01ac0b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01aaffd640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01aaffd640 1 -- 172.21.15.70:0/2189163401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0cf7c0 msgr2=0x7f01ac158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01aaffd640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0cf7c0 0x7f01ac158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01aaffd640 1 -- 172.21.15.70:0/2189163401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c009420 con 0x7f01ac0708b0 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01aaffd640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01ac0708b0 0x7f01ac159d00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f019c00e980 tx=0x7f019c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01a3fff640 1 -- 172.21.15.70:0/2189163401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c00ca00 con 0x7f01ac0708b0 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01a3fff640 1 -- 172.21.15.70:0/2189163401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c00cb60 con 0x7f01ac0708b0 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01a3fff640 1 -- 172.21.15.70:0/2189163401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c013470 con 0x7f01ac0708b0 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194009a70 con 0x7f01ac0708b0 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac159220 con 0x7f01ac0708b0 2023-11-26T07:21:18.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac067680 con 0x7f01ac0708b0 2023-11-26T07:21:18.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01a3fff640 1 -- 172.21.15.70:0/2189163401 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7f019c0135d0 con 0x7f01ac0708b0 2023-11-26T07:21:18.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01a3fff640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f018c066980 0x7f018c068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:18.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01a3fff640 1 -- 172.21.15.70:0/2189163401 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f019c084990 con 0x7f01ac0708b0 2023-11-26T07:21:18.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.153+0000 7f01a27fc640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f018c066980 0x7f018c068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:18.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.157+0000 7f01a27fc640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f018c066980 0x7f018c068e40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f01940af000 tx=0x7f0194004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:18.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.157+0000 7f01a3fff640 1 -- 172.21.15.70:0/2189163401 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f019c051780 con 0x7f01ac0708b0 2023-11-26T07:21:18.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.341+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone73650", "target": ["mon-mgr", ""]}) v1 -- 0x7f01ac071c30 con 0x7f018c066980 2023-11-26T07:21:18.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01a3fff640 1 -- 172.21.15.70:0/2189163401 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+263 (secure 0 0 0) 0x7f01940a58c0 con 0x7f018c066980 2023-11-26T07:21:18.992 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:21:18.992 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:21:18.992 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "canceled", 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol9390", 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78440" 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: "failure": { 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: "errno": "4", 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: "error_msg": "user interrupted clone operation" 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:18.993 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:21:18.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f018c066980 msgr2=0x7f018c068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f018c066980 0x7f018c068e40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f01940af000 tx=0x7f0194004ac0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01ac0708b0 msgr2=0x7f01ac159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01ac0708b0 0x7f01ac159d00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f019c00e980 tx=0x7f019c00ee40 comp rx=0 tx=0).stop 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 shutdown_connections 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f01ac143ac0 0x7f01ac0b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01ac0cf7c0 0x7f01ac158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f018c066980 0x7f018c068e40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 --2- 172.21.15.70:0/2189163401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01ac0708b0 0x7f01ac159d00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 >> 172.21.15.70:0/2189163401 conn(0x7f01ac06a890 msgr2=0x7f01ac13b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 shutdown_connections 2023-11-26T07:21:18.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:18.989+0000 7f01b13e7640 1 -- 172.21.15.70:0/2189163401 wait complete. 2023-11-26T07:21:19.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone73650 --force 2023-11-26T07:21:19.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3d017640 1 Processor -- start 2023-11-26T07:21:19.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3d017640 1 -- start start 2023-11-26T07:21:19.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3d017640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 0x7f5e38070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3d017640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5e380708b0 0x7f5e380cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3d017640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380cfbf0 con 0x7f5e380cf7c0 2023-11-26T07:21:19.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3d017640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e38143ea0 con 0x7f5e380708b0 2023-11-26T07:21:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3d017640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380cc730 con 0x7f5e38143ac0 2023-11-26T07:21:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3759e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5e380cf7c0 0x7f5e380b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36992/0 (socket says 172.21.15.70:36992) 2023-11-26T07:21:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3759e640 1 -- 172.21.15.70:0/2968211851 learned_addr learned my addr 172.21.15.70:0/2968211851 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:19.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e3659c640 1 --2- 172.21.15.70:0/2968211851 >> v2:172.21.15.120:3300/0 conn(0x7f5e380708b0 0x7f5e380cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 0x7f5e38070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.153+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324265385 0 0) 0x7f5e380cfbf0 con 0x7f5e380cf7c0 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e20005740 con 0x7f5e380cf7c0 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2204919716 0 0) 0x7f5e20005740 con 0x7f5e380cf7c0 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 msgr2=0x7f5e38070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 0x7f5e38070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 >> v2:172.21.15.120:3300/0 conn(0x7f5e380708b0 msgr2=0x7f5e380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 --2- 172.21.15.70:0/2968211851 >> v2:172.21.15.120:3300/0 conn(0x7f5e380708b0 0x7f5e380cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38070ee0 con 0x7f5e380cf7c0 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f5e30001a20 con 0x7f5e380cf7c0 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 >> v1:172.21.15.70:6789/0 conn(0x7f5e380cf7c0 legacy=0x7f5e380b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e20005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 0x7f5e200069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e20006f20 0x7f5e200073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380cc730 con 0x7f5e20005b90 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000dba0 con 0x7f5e20006f20 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000dce0 con 0x7f5e38143ac0 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e3659c640 1 --2- 172.21.15.70:0/2968211851 >> v2:172.21.15.120:3300/0 conn(0x7f5e380708b0 0x7f5e380cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e20005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e3759e640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e20006f20 0x7f5e200073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e3659c640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 0x7f5e200069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e36d9d640 1 -- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 msgr2=0x7f5e200069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e38143ac0 0x7f5e200069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e36d9d640 1 -- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e20006f20 msgr2=0x7f5e200073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e20006f20 0x7f5e200073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.157+0000 7f5e36d9d640 1 -- 172.21.15.70:0/2968211851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20005740 con 0x7f5e20005b90 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e20005fb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009ae0 tx=0x7f5e2801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d372579c21e59079 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280a5530 con 0x7f5e20005b90 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e280a5690 con 0x7f5e20005b90 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e35d9b640 1 -- 172.21.15.70:0/2968211851 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280a5a40 con 0x7f5e20005b90 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- 172.21.15.70:0/2968211851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 msgr2=0x7f5e20005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 --2- 172.21.15.70:0/2968211851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e20005fb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009ae0 tx=0x7f5e2801ca50 comp rx=0 tx=0).stop 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3759e640 1 -- 172.21.15.70:0/2968211851 reap_dead start 2023-11-26T07:21:19.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- 172.21.15.70:0/2968211851 shutdown_connections 2023-11-26T07:21:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- 172.21.15.70:0/2968211851 >> 172.21.15.70:0/2968211851 conn(0x7f5e3806a890 msgr2=0x7f5e3806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- 172.21.15.70:0/2968211851 shutdown_connections 2023-11-26T07:21:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- 172.21.15.70:0/2968211851 wait complete. 2023-11-26T07:21:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 Processor -- start 2023-11-26T07:21:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- start start 2023-11-26T07:21:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e381e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e3813a720 0x7f5e38140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e38153710 0x7f5e38153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381e8800 con 0x7f5e20005b90 2023-11-26T07:21:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381e8240 con 0x7f5e38153710 2023-11-26T07:21:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.161+0000 7f5e3d017640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381e8520 con 0x7f5e3813a720 2023-11-26T07:21:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e36d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e381e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3659c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e3813a720 0x7f5e38140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e36d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e381e7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36506/0 (socket says 172.21.15.70:36506) 2023-11-26T07:21:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e36d9d640 1 -- 172.21.15.70:0/3712427364 learned_addr learned my addr 172.21.15.70:0/3712427364 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3759e640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e38153710 0x7f5e38153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3659c640 1 -- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e38153710 msgr2=0x7f5e38153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3659c640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e38153710 0x7f5e38153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3659c640 1 -- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 msgr2=0x7f5e381e7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3659c640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e381e7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3659c640 1 -- 172.21.15.70:0/3712427364 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380aec60 con 0x7f5e3813a720 2023-11-26T07:21:19.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e381e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:19.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3659c640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e3813a720 0x7f5e38140090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c011a80 tx=0x7f5e2c011f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e1f7fe640 1 -- 172.21.15.70:0/3712427364 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00fcd0 con 0x7f5e3813a720 2023-11-26T07:21:19.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e1f7fe640 1 -- 172.21.15.70:0/3712427364 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00fe30 con 0x7f5e3813a720 2023-11-26T07:21:19.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380aef40 con 0x7f5e3813a720 2023-11-26T07:21:19.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e1f7fe640 1 -- 172.21.15.70:0/3712427364 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c004270 con 0x7f5e3813a720 2023-11-26T07:21:19.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e381540d0 con 0x7f5e3813a720 2023-11-26T07:21:19.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e380af180 con 0x7f5e3813a720 2023-11-26T07:21:19.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.165+0000 7f5e1f7fe640 1 -- 172.21.15.70:0/3712427364 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7f5e2c0043d0 con 0x7f5e3813a720 2023-11-26T07:21:19.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.169+0000 7f5e1f7fe640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5e24066980 0x7f5e24068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.169+0000 7f5e1f7fe640 1 -- 172.21.15.70:0/3712427364 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5e2c084c50 con 0x7f5e3813a720 2023-11-26T07:21:19.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.169+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5e24066980 0x7f5e24068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.169+0000 7f5e36d9d640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5e24066980 0x7f5e24068e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e2801c880 tx=0x7f5e280046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.173+0000 7f5e1f7fe640 1 -- 172.21.15.70:0/3712427364 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e380af180 con 0x7f5e3813a720 2023-11-26T07:21:19.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.345+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone73650", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5e38071c30 con 0x7f5e24066980 2023-11-26T07:21:19.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.357+0000 7f5e1f7fe640 1 -- 172.21.15.70:0/3712427364 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5e280a5bb0 con 0x7f5e24066980 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5e24066980 msgr2=0x7f5e24068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5e24066980 0x7f5e24068e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e2801c880 tx=0x7f5e280046d0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e3813a720 msgr2=0x7f5e38140090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e3813a720 0x7f5e38140090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c011a80 tx=0x7f5e2c011f40 comp rx=0 tx=0).stop 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 shutdown_connections 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5e38153710 0x7f5e38153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5e3813a720 0x7f5e38140090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5e24066980 0x7f5e24068e40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 --2- 172.21.15.70:0/3712427364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e20005b90 0x7f5e381e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 >> 172.21.15.70:0/3712427364 conn(0x7f5e3806a890 msgr2=0x7f5e38140bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 shutdown_connections 2023-11-26T07:21:19.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.361+0000 7f5e3d017640 1 -- 172.21.15.70:0/3712427364 wait complete. 2023-11-26T07:21:19.374 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:19.369+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:19.374 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:19.369+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:19.374 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:19.369+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:19.374 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:19.369+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:19.374 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:21:19.369+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:21:19.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol9390 subvol_snap78440 2023-11-26T07:21:19.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.545+0000 7f95a0aa9640 1 Processor -- start 2023-11-26T07:21:19.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.545+0000 7f95a0aa9640 1 -- start start 2023-11-26T07:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.545+0000 7f95a0aa9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f959c143ac0 0x7f959c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.545+0000 7f95a0aa9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0708b0 0x7f959c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.545+0000 7f95a0aa9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c0cfbf0 con 0x7f959c0cf7c0 2023-11-26T07:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f95a0aa9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c143ea0 con 0x7f959c143ac0 2023-11-26T07:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f95a0aa9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0cc730 con 0x7f959c0708b0 2023-11-26T07:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f959c143ac0 0x7f959c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f959c143ac0 0x7f959c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36524/0 (socket says 172.21.15.70:36524) 2023-11-26T07:21:19.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 -- 172.21.15.70:0/3402859498 learned_addr learned my addr 172.21.15.70:0/3402859498 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:19.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f9591d9b640 1 --2- 172.21.15.70:0/3402859498 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0708b0 0x7f959c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 -- 172.21.15.70:0/3402859498 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0708b0 msgr2=0x7f959c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 --2- 172.21.15.70:0/3402859498 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0708b0 0x7f959c0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 -- 172.21.15.70:0/3402859498 >> v1:172.21.15.120:6789/0 conn(0x7f959c0cf7c0 legacy=0x7f959c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 -- 172.21.15.70:0/3402859498 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c070ee0 con 0x7f959c143ac0 2023-11-26T07:21:19.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f959a59c640 1 --2- 172.21.15.70:0/3402859498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c070370 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f958c00d150 tx=0x7f958c01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b786e7a91721e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f9599d9b640 1 -- 172.21.15.70:0/3402859498 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00b2d0 con 0x7f959c143ac0 2023-11-26T07:21:19.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f9599d9b640 1 -- 172.21.15.70:0/3402859498 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c00b430 con 0x7f959c143ac0 2023-11-26T07:21:19.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.549+0000 7f9599d9b640 1 -- 172.21.15.70:0/3402859498 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0a7c10 con 0x7f959c143ac0 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3402859498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 msgr2=0x7f959c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3402859498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c070370 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f958c00d150 tx=0x7f958c01ec10 comp rx=0 tx=0).stop 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3402859498 shutdown_connections 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3402859498 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0708b0 0x7f959c0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3402859498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c070370 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3402859498 >> 172.21.15.70:0/3402859498 conn(0x7f959c06a890 msgr2=0x7f959c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3402859498 shutdown_connections 2023-11-26T07:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3402859498 wait complete. 2023-11-26T07:21:19.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 Processor -- start 2023-11-26T07:21:19.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- start start 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f959c0708b0 0x7f959c1383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0cf7c0 0x7f959c06ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c15af40 con 0x7f959c143ac0 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0af520 con 0x7f959c0708b0 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.553+0000 7f95a0aa9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0b1a00 con 0x7f959c0cf7c0 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f959c0708b0 0x7f959c1383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f959c0708b0 0x7f959c1383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:55636/0 (socket says 172.21.15.70:55636) 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 -- 172.21.15.70:0/3945114496 learned_addr learned my addr 172.21.15.70:0/3945114496 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f9591d9b640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0cf7c0 0x7f959c06ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 -- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0cf7c0 msgr2=0x7f959c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0cf7c0 0x7f959c06ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 -- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 msgr2=0x7f959c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c06cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 -- 172.21.15.70:0/3945114496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c00bd40 con 0x7f959c0708b0 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959ad9d640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f959a59c640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f959c0708b0 0x7f959c1383c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f958c01d2c0 tx=0x7f958c01b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95937fe640 1 -- 172.21.15.70:0/3945114496 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c009800 con 0x7f959c0708b0 2023-11-26T07:21:19.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95937fe640 1 -- 172.21.15.70:0/3945114496 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c009980 con 0x7f959c0708b0 2023-11-26T07:21:19.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95937fe640 1 -- 172.21.15.70:0/3945114496 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c009d30 con 0x7f959c0708b0 2023-11-26T07:21:19.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c0b1720 con 0x7f959c0708b0 2023-11-26T07:21:19.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c15ab60 con 0x7f959c0708b0 2023-11-26T07:21:19.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c067680 con 0x7f959c0708b0 2023-11-26T07:21:19.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95937fe640 1 -- 172.21.15.70:0/3945114496 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7f958c0c3460 con 0x7f959c0708b0 2023-11-26T07:21:19.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.557+0000 7f95937fe640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f957c066980 0x7f957c068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.561+0000 7f95937fe640 1 -- 172.21.15.70:0/3945114496 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f958c11fbf0 con 0x7f959c0708b0 2023-11-26T07:21:19.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.561+0000 7f9591d9b640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f957c066980 0x7f957c068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.561+0000 7f9591d9b640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f957c066980 0x7f957c068e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f959c13c850 tx=0x7f9584008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.565+0000 7f95937fe640 1 -- 172.21.15.70:0/3945114496 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f958c0eca50 con 0x7f959c0708b0 2023-11-26T07:21:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.741+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol9390", "snap_name": "subvol_snap78440", "target": ["mon-mgr", ""]}) v1 -- 0x7f959c071c30 con 0x7f957c066980 2023-11-26T07:21:19.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.769+0000 7f95937fe640 1 -- 172.21.15.70:0/3945114496 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9584010960 con 0x7f957c066980 2023-11-26T07:21:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f957c066980 msgr2=0x7f957c068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f957c066980 0x7f957c068e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f959c13c850 tx=0x7f9584008040 comp rx=0 tx=0).stop 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f959c0708b0 msgr2=0x7f959c1383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f959c0708b0 0x7f959c1383c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f958c01d2c0 tx=0x7f958c01b9b0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 shutdown_connections 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f957c066980 0x7f957c068e40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f959c143ac0 0x7f959c06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f959c0cf7c0 0x7f959c06ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 --2- 172.21.15.70:0/3945114496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f959c0708b0 0x7f959c1383c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 >> 172.21.15.70:0/3945114496 conn(0x7f959c06a890 msgr2=0x7f959c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 shutdown_connections 2023-11-26T07:21:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.773+0000 7f95a0aa9640 1 -- 172.21.15.70:0/3945114496 wait complete. 2023-11-26T07:21:19.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol9390 2023-11-26T07:21:19.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.929+0000 7fe797a79640 1 Processor -- start 2023-11-26T07:21:19.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.929+0000 7fe797a79640 1 -- start start 2023-11-26T07:21:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe797a79640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7900cf990 0x7fe79015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe797a79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79006c520 con 0x7fe79013e290 2023-11-26T07:21:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe797a79640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79006c800 con 0x7fe79015f4e0 2023-11-26T07:21:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe797a79640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79006cae0 con 0x7fe7900cf990 2023-11-26T07:21:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795815640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe79013e290 0x7fe7900cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:37002/0 (socket says 172.21.15.70:37002) 2023-11-26T07:21:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795815640 1 -- 172.21.15.70:0/677892625 learned_addr learned my addr 172.21.15.70:0/677892625 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:19.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795014640 1 --2- 172.21.15.70:0/677892625 >> v2:172.21.15.120:3300/0 conn(0x7fe7900cf990 0x7fe79015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161549547 0 0) 0x7fe79006c520 con 0x7fe79013e290 2023-11-26T07:21:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe77c003530 con 0x7fe79013e290 2023-11-26T07:21:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 787584096 0 0) 0x7fe77c003530 con 0x7fe79013e290 2023-11-26T07:21:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 >> v2:172.21.15.120:3300/0 conn(0x7fe7900cf990 msgr2=0x7fe79015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 --2- 172.21.15.70:0/677892625 >> v2:172.21.15.120:3300/0 conn(0x7fe7900cf990 0x7fe79015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 >> v1:172.21.15.120:6789/0 conn(0x7fe79015f4e0 legacy=0x7fe7900cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79006cdc0 con 0x7fe79013e290 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fe78c001680 con 0x7fe79013e290 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 >> v1:172.21.15.70:6789/0 conn(0x7fe79013e290 legacy=0x7fe7900cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c003980 0x7fe77c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77c0047d0 0x7fe77c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77c005190 0x7fe77c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79006cae0 con 0x7fe77c0047d0 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00c030 con 0x7fe77c005190 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00c1f0 con 0x7fe77c003980 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795014640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77c0047d0 0x7fe77c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795815640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c003980 0x7fe77c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe796016640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77c005190 0x7fe77c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795014640 1 -- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c003980 msgr2=0x7fe77c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795014640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c003980 0x7fe77c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795014640 1 -- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77c005190 msgr2=0x7fe77c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795014640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe77c005190 0x7fe77c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe796016640 1 -- 172.21.15.70:0/677892625 reap_dead start 2023-11-26T07:21:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795014640 1 -- 172.21.15.70:0/677892625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c003530 con 0x7fe77c0047d0 2023-11-26T07:21:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.933+0000 7fe795815640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c003980 0x7fe77c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe795014640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77c0047d0 0x7fe77c004c50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe780009ae0 tx=0x7fe78001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1be7c289a9c04d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800a5530 con 0x7fe77c0047d0 2023-11-26T07:21:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7800a5690 con 0x7fe77c0047d0 2023-11-26T07:21:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe794813640 1 -- 172.21.15.70:0/677892625 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800a5a40 con 0x7fe77c0047d0 2023-11-26T07:21:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe797a79640 1 -- 172.21.15.70:0/677892625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77c0047d0 msgr2=0x7fe77c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe797a79640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77c0047d0 0x7fe77c004c50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe780009ae0 tx=0x7fe78001ca50 comp rx=0 tx=0).stop 2023-11-26T07:21:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe797a79640 1 -- 172.21.15.70:0/677892625 shutdown_connections 2023-11-26T07:21:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe797a79640 1 --2- 172.21.15.70:0/677892625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77c0047d0 0x7fe77c004c50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe797a79640 1 -- 172.21.15.70:0/677892625 >> 172.21.15.70:0/677892625 conn(0x7fe79006a890 msgr2=0x7fe79006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe797a79640 1 -- 172.21.15.70:0/677892625 shutdown_connections 2023-11-26T07:21:19.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.937+0000 7fe797a79640 1 -- 172.21.15.70:0/677892625 wait complete. 2023-11-26T07:21:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 Processor -- start 2023-11-26T07:21:19.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 -- start start 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c0047d0 0x7fe79015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7900706d0 0x7fe79015c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790071c30 0x7fe790154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe790070b90 con 0x7fe7900706d0 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe790070e70 con 0x7fe790071c30 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe790071150 con 0x7fe77c0047d0 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7900706d0 0x7fe79015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7900706d0 0x7fe79015c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36558/0 (socket says 172.21.15.70:36558) 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 -- 172.21.15.70:0/3374032932 learned_addr learned my addr 172.21.15.70:0/3374032932 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795815640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c0047d0 0x7fe79015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe796016640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790071c30 0x7fe790154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 -- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c0047d0 msgr2=0x7fe79015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c0047d0 0x7fe79015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 -- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790071c30 msgr2=0x7fe790154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790071c30 0x7fe790154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 -- 172.21.15.70:0/3374032932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe790071430 con 0x7fe7900706d0 2023-11-26T07:21:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe796016640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790071c30 0x7fe790154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:19.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe795014640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7900706d0 0x7fe79015c740 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe78001c880 tx=0x7fe7800197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe7867fc640 1 -- 172.21.15.70:0/3374032932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800bd070 con 0x7fe7900706d0 2023-11-26T07:21:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe7867fc640 1 -- 172.21.15.70:0/3374032932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000f080 con 0x7fe7900706d0 2023-11-26T07:21:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe790071710 con 0x7fe7900706d0 2023-11-26T07:21:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe7867fc640 1 -- 172.21.15.70:0/3374032932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780004260 con 0x7fe7900706d0 2023-11-26T07:21:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79015a900 con 0x7fe7900706d0 2023-11-26T07:21:19.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.941+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7900718a0 con 0x7fe7900706d0 2023-11-26T07:21:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.945+0000 7fe7867fc640 1 -- 172.21.15.70:0/3374032932 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 10) v1 ==== 86311+0+0 (secure 0 0 0) 0x7fe7800b4070 con 0x7fe7900706d0 2023-11-26T07:21:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.945+0000 7fe7867fc640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe7740669d0 0x7fe774068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.945+0000 7fe7867fc640 1 -- 172.21.15.70:0/3374032932 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe78011e6e0 con 0x7fe7900706d0 2023-11-26T07:21:19.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.945+0000 7fe795815640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe7740669d0 0x7fe774068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:19.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.945+0000 7fe795815640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe7740669d0 0x7fe774068e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe78c000c10 tx=0x7fe78c001480 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:19.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:19.949+0000 7fe7867fc640 1 -- 172.21.15.70:0/3374032932 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7800eb5a0 con 0x7fe7900706d0 2023-11-26T07:21:20.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.125+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol9390", "target": ["mon-mgr", ""]}) v1 -- 0x7fe79015efa0 con 0x7fe7740669d0 2023-11-26T07:21:20.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.141+0000 7fe7867fc640 1 -- 172.21.15.70:0/3374032932 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe78c014a70 con 0x7fe7740669d0 2023-11-26T07:21:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.141+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe7740669d0 msgr2=0x7fe774068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.141+0000 7fe797a79640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe7740669d0 0x7fe774068e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe78c000c10 tx=0x7fe78c001480 comp rx=0 tx=0).stop 2023-11-26T07:21:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.141+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7900706d0 msgr2=0x7fe79015c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.141+0000 7fe797a79640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7900706d0 0x7fe79015c740 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe78001c880 tx=0x7fe7800197f0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 shutdown_connections 2023-11-26T07:21:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe7740669d0 0x7fe774068e90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe7900706d0 0x7fe79015c740 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790071c30 0x7fe790154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 --2- 172.21.15.70:0/3374032932 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe77c0047d0 0x7fe79015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 >> 172.21.15.70:0/3374032932 conn(0x7fe79006a890 msgr2=0x7fe7900b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 shutdown_connections 2023-11-26T07:21:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:20.145+0000 7fe797a79640 1 -- 172.21.15.70:0/3374032932 wait complete. 2023-11-26T07:21:20.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:20.172 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:21:20.189 INFO:teuthology.orchestra.run.smithi070.stdout:3 2023-11-26T07:21:25.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:27.492 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:21:27.508 INFO:teuthology.orchestra.run.smithi070.stdout:2 2023-11-26T07:21:27.509 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:21:27.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:27.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:27.697 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:21:27.697 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:27.697 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:27.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:27.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e2f80640 1 Processor -- start 2023-11-26T07:21:27.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e2f80640 1 -- start start 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e2f80640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8dc0cf280 0x7fe8dc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e2f80640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cd1b0 0x7fe8dc0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e2f80640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc0cc730 con 0x7fe8dc143ac0 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e2f80640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc143ea0 con 0x7fe8dc0cf280 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e2f80640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc0cfc50 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8d3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8dc0cf280 0x7fe8dc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e0d1c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe8dc143ac0 0x7fe8dc070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35084/0 (socket says 172.21.15.70:35084) 2023-11-26T07:21:27.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8e0d1c640 1 -- 172.21.15.70:0/3461429991 learned_addr learned my addr 172.21.15.70:0/3461429991 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8d3fff640 1 -- 172.21.15.70:0/3461429991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cd1b0 msgr2=0x7fe8dc0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8d3fff640 1 --2- 172.21.15.70:0/3461429991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cd1b0 0x7fe8dc0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8d3fff640 1 -- 172.21.15.70:0/3461429991 >> v1:172.21.15.70:6789/0 conn(0x7fe8dc143ac0 legacy=0x7fe8dc070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.897+0000 7fe8d3fff640 1 -- 172.21.15.70:0/3461429991 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc070ee0 con 0x7fe8dc0cf280 2023-11-26T07:21:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8d3fff640 1 --2- 172.21.15.70:0/3461429991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cf280 0x7fe8dc0cf710 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0097c0 tx=0x7fe8cc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf73757e0c96d65 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8d37fe640 1 -- 172.21.15.70:0/3461429991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0ab600 con 0x7fe8dc0cf280 2023-11-26T07:21:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8d37fe640 1 -- 172.21.15.70:0/3461429991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc0a7050 con 0x7fe8dc0cf280 2023-11-26T07:21:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8d37fe640 1 -- 172.21.15.70:0/3461429991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0ab980 con 0x7fe8dc0cf280 2023-11-26T07:21:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 -- 172.21.15.70:0/3461429991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cf280 msgr2=0x7fe8dc0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/3461429991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cf280 0x7fe8dc0cf710 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0097c0 tx=0x7fe8cc01c310 comp rx=0 tx=0).stop 2023-11-26T07:21:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 -- 172.21.15.70:0/3461429991 shutdown_connections 2023-11-26T07:21:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/3461429991 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cd1b0 0x7fe8dc0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/3461429991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cf280 0x7fe8dc0cf710 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 -- 172.21.15.70:0/3461429991 >> 172.21.15.70:0/3461429991 conn(0x7fe8dc06a890 msgr2=0x7fe8dc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 -- 172.21.15.70:0/3461429991 shutdown_connections 2023-11-26T07:21:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.901+0000 7fe8e2f80640 1 -- 172.21.15.70:0/3461429991 wait complete. 2023-11-26T07:21:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 Processor -- start 2023-11-26T07:21:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 -- start start 2023-11-26T07:21:27.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cd1b0 0x7fe8dc13c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cf280 0x7fe8dc133180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8dc143ac0 0x7fe8dc15b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc0ac8e0 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc1596d0 con 0x7fe8dc143ac0 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc1599b0 con 0x7fe8dc0cf280 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cd1b0 0x7fe8dc13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cd1b0 0x7fe8dc13c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36222/0 (socket says 172.21.15.70:36222) 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 -- 172.21.15.70:0/726472242 learned_addr learned my addr 172.21.15.70:0/726472242 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8d3fff640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cf280 0x7fe8dc133180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e151d640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8dc143ac0 0x7fe8dc15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 -- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cf280 msgr2=0x7fe8dc133180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cf280 0x7fe8dc133180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 -- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8dc143ac0 msgr2=0x7fe8dc15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8dc143ac0 0x7fe8dc15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 -- 172.21.15.70:0/726472242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc009420 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e0d1c640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cd1b0 0x7fe8dc13c130 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c780 tx=0x7fe8d800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8d17fa640 1 -- 172.21.15.70:0/726472242 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8005ac0 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8d17fa640 1 -- 172.21.15.70:0/726472242 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d8005c40 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8d17fa640 1 -- 172.21.15.70:0/726472242 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8007070 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc0acb30 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.905+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc13c670 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.909+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc067680 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.909+0000 7fe8d17fa640 1 -- 172.21.15.70:0/726472242 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fe8d80071d0 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.909+0000 7fe8d17fa640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c8066a10 0x7fe8c8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:27.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.909+0000 7fe8d17fa640 1 -- 172.21.15.70:0/726472242 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5823+0+0 (secure 0 0 0) 0x7fe8d80840a0 con 0x7fe8dc0cd1b0 2023-11-26T07:21:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.909+0000 7fe8d3fff640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c8066a10 0x7fe8c8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.909+0000 7fe8d3fff640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c8066a10 0x7fe8c8068ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0ad000 tx=0x7fe8cc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:27.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:27.913+0000 7fe8d17fa640 1 -- 172.21.15.70:0/726472242 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8d8050c90 con 0x7fe8dc0cd1b0 2023-11-26T07:21:28.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.069+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8dc06ae80 con 0x7fe8dc0cd1b0 2023-11-26T07:21:28.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.069+0000 7fe8d17fa640 1 -- 172.21.15.70:0/726472242 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16773 (secure 0 0 0) 0x7fe8d8017020 con 0x7fe8dc0cd1b0 2023-11-26T07:21:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:28.074 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":51,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:22.824365+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c8066a10 msgr2=0x7fe8c8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c8066a10 0x7fe8c8068ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0ad000 tx=0x7fe8cc0a6000 comp rx=0 tx=0).stop 2023-11-26T07:21:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cd1b0 msgr2=0x7fe8dc13c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cd1b0 0x7fe8dc13c130 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800c780 tx=0x7fe8d800cc40 comp rx=0 tx=0).stop 2023-11-26T07:21:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 shutdown_connections 2023-11-26T07:21:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8dc143ac0 0x7fe8dc15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8dc0cf280 0x7fe8dc133180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c8066a10 0x7fe8c8068ed0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 --2- 172.21.15.70:0/726472242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8dc0cd1b0 0x7fe8dc13c130 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 >> 172.21.15.70:0/726472242 conn(0x7fe8dc06a890 msgr2=0x7fe8dc1409b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 shutdown_connections 2023-11-26T07:21:28.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.073+0000 7fe8e2f80640 1 -- 172.21.15.70:0/726472242 wait complete. 2023-11-26T07:21:28.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:20:30.063697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:20:30.697996+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:28.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:28.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.233+0000 7f71e1baa640 1 Processor -- start 2023-11-26T07:21:28.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.233+0000 7f71e1baa640 1 -- start start 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.233+0000 7f71e1baa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71dc15d6e0 0x7f71dc0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.233+0000 7f71e1baa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71dc0d1bc0 0x7f71dc0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.233+0000 7f71e1baa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0cf0e0 con 0x7f71dc0b2160 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.233+0000 7f71e1baa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc15dac0 con 0x7f71dc0d1bc0 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.233+0000 7f71e1baa640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0ceb20 con 0x7f71dc15d6e0 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71dc0d1bc0 0x7f71dc0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71dc0d1bc0 0x7f71dc0b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36234/0 (socket says 172.21.15.70:36234) 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 -- 172.21.15.70:0/4159402376 learned_addr learned my addr 172.21.15.70:0/4159402376 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:28.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71daffd640 1 --1- 172.21.15.70:0/4159402376 >> v1:172.21.15.70:6789/0 conn(0x7f71dc0b2160 0x7f71dc0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35098/0 (socket says 172.21.15.70:35098) 2023-11-26T07:21:28.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71db7fe640 1 --2- 172.21.15.70:0/4159402376 >> v2:172.21.15.120:3300/0 conn(0x7f71dc15d6e0 0x7f71dc0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 -- 172.21.15.70:0/4159402376 >> v2:172.21.15.120:3300/0 conn(0x7f71dc15d6e0 msgr2=0x7f71dc0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 --2- 172.21.15.70:0/4159402376 >> v2:172.21.15.120:3300/0 conn(0x7f71dc15d6e0 0x7f71dc0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 -- 172.21.15.70:0/4159402376 >> v1:172.21.15.70:6789/0 conn(0x7f71dc0b2160 legacy=0x7f71dc0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 -- 172.21.15.70:0/4159402376 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0cee00 con 0x7f71dc0d1bc0 2023-11-26T07:21:28.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71dbfff640 1 --2- 172.21.15.70:0/4159402376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc0d1bc0 0x7f71dc0b0750 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0b5db0 tx=0x7f71d401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47956fe0297346c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71da7fc640 1 -- 172.21.15.70:0/4159402376 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40a5780 con 0x7f71dc0d1bc0 2023-11-26T07:21:28.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71da7fc640 1 -- 172.21.15.70:0/4159402376 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40a58e0 con 0x7f71dc0d1bc0 2023-11-26T07:21:28.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.237+0000 7f71da7fc640 1 -- 172.21.15.70:0/4159402376 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40a5c70 con 0x7f71dc0d1bc0 2023-11-26T07:21:28.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- 172.21.15.70:0/4159402376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc0d1bc0 msgr2=0x7f71dc0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 --2- 172.21.15.70:0/4159402376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc0d1bc0 0x7f71dc0b0750 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0b5db0 tx=0x7f71d401c9d0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- 172.21.15.70:0/4159402376 shutdown_connections 2023-11-26T07:21:28.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 --2- 172.21.15.70:0/4159402376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc0d1bc0 0x7f71dc0b0750 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 --2- 172.21.15.70:0/4159402376 >> v2:172.21.15.120:3300/0 conn(0x7f71dc15d6e0 0x7f71dc0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- 172.21.15.70:0/4159402376 >> 172.21.15.70:0/4159402376 conn(0x7f71dc09c550 msgr2=0x7f71dc0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- 172.21.15.70:0/4159402376 shutdown_connections 2023-11-26T07:21:28.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- 172.21.15.70:0/4159402376 wait complete. 2023-11-26T07:21:28.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 Processor -- start 2023-11-26T07:21:28.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- start start 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71dc0b2160 0x7f71dc15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71dc0d1bc0 0x7f71dc160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc15d6e0 0x7f71dc15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc142dd0 con 0x7f71dc15d6e0 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0ccac0 con 0x7f71dc0b2160 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71e1baa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0ccda0 con 0x7f71dc0d1bc0 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc15d6e0 0x7f71dc15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc15d6e0 0x7f71dc15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36246/0 (socket says 172.21.15.70:36246) 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 -- 172.21.15.70:0/310543743 learned_addr learned my addr 172.21.15.70:0/310543743 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:28.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71db7fe640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71dc0b2160 0x7f71dc15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71daffd640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71dc0d1bc0 0x7f71dc160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 -- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71dc0d1bc0 msgr2=0x7f71dc160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71dc0d1bc0 0x7f71dc160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 -- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71dc0b2160 msgr2=0x7f71dc15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71dc0b2160 0x7f71dc15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71dbfff640 1 -- 172.21.15.70:0/310543743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009b30 con 0x7f71dc15d6e0 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.241+0000 7f71db7fe640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71dc0b2160 0x7f71dc15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71dbfff640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc15d6e0 0x7f71dc15a520 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f71d40af040 tx=0x7f71d4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71c3fff640 1 -- 172.21.15.70:0/310543743 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b8670 con 0x7f71dc15d6e0 2023-11-26T07:21:28.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71c3fff640 1 -- 172.21.15.70:0/310543743 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40b87d0 con 0x7f71dc15d6e0 2023-11-26T07:21:28.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71c3fff640 1 -- 172.21.15.70:0/310543743 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b8b80 con 0x7f71dc15d6e0 2023-11-26T07:21:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0cd080 con 0x7f71dc15d6e0 2023-11-26T07:21:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc160860 con 0x7f71dc15d6e0 2023-11-26T07:21:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc160a50 con 0x7f71dc15d6e0 2023-11-26T07:21:28.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71c3fff640 1 -- 172.21.15.70:0/310543743 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f71d40b8ce0 con 0x7f71dc15d6e0 2023-11-26T07:21:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71c3fff640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c8066a10 0x7f71c8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71c3fff640 1 -- 172.21.15.70:0/310543743 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f71d411ff60 con 0x7f71dc15d6e0 2023-11-26T07:21:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.245+0000 7f71db7fe640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c8066a10 0x7f71c8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.249+0000 7f71db7fe640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c8066a10 0x7f71c8068ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00b9f0 tx=0x7f71cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.249+0000 7f71c3fff640 1 -- 172.21.15.70:0/310543743 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71d40ecca0 con 0x7f71dc15d6e0 2023-11-26T07:21:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71dc067680 con 0x7f71dc15d6e0 2023-11-26T07:21:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71c3fff640 1 -- 172.21.15.70:0/310543743 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71d41210a0 con 0x7f71dc15d6e0 2023-11-26T07:21:28.412 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:21:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c8066a10 msgr2=0x7f71c8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c8066a10 0x7f71c8068ed0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00b9f0 tx=0x7f71cc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc15d6e0 msgr2=0x7f71dc15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc15d6e0 0x7f71dc15a520 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f71d40af040 tx=0x7f71d4019770 comp rx=0 tx=0).stop 2023-11-26T07:21:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 shutdown_connections 2023-11-26T07:21:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c8066a10 0x7f71c8068ed0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71dc15d6e0 0x7f71dc15a520 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71dc0d1bc0 0x7f71dc160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 --2- 172.21.15.70:0/310543743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71dc0b2160 0x7f71dc15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 >> 172.21.15.70:0/310543743 conn(0x7f71dc09c550 msgr2=0x7f71dc06c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 shutdown_connections 2023-11-26T07:21:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.409+0000 7f71e1baa640 1 -- 172.21.15.70:0/310543743 wait complete. 2023-11-26T07:21:28.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:21:28.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e76e91640 1 Processor -- start 2023-11-26T07:21:28.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e76e91640 1 -- start start 2023-11-26T07:21:28.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e76e91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9e7013e290 0x7f9e700cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e76e91640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e700cf7c0 0x7f9e7015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e76e91640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7006c520 con 0x7f9e7015f4e0 2023-11-26T07:21:28.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e76e91640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e700cfc40 con 0x7f9e700cf7c0 2023-11-26T07:21:28.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e76e91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7006c800 con 0x7f9e7013e290 2023-11-26T07:21:28.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e6ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e700cf7c0 0x7f9e7015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e6ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e700cf7c0 0x7f9e7015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36256/0 (socket says 172.21.15.70:36256) 2023-11-26T07:21:28.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e6ffff640 1 -- 172.21.15.70:0/848476435 learned_addr learned my addr 172.21.15.70:0/848476435 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:28.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e74c2d640 1 --2- 172.21.15.70:0/848476435 >> v2:172.21.15.120:3300/0 conn(0x7f9e7013e290 0x7f9e700cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e6ffff640 1 -- 172.21.15.70:0/848476435 >> v2:172.21.15.120:3300/0 conn(0x7f9e7013e290 msgr2=0x7f9e700cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e6ffff640 1 --2- 172.21.15.70:0/848476435 >> v2:172.21.15.120:3300/0 conn(0x7f9e7013e290 0x7f9e700cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e6ffff640 1 -- 172.21.15.70:0/848476435 >> v1:172.21.15.120:6789/0 conn(0x7f9e7015f4e0 legacy=0x7f9e701408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.569+0000 7f9e6ffff640 1 -- 172.21.15.70:0/848476435 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7006cae0 con 0x7f9e700cf7c0 2023-11-26T07:21:28.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e6ffff640 1 --2- 172.21.15.70:0/848476435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e700cf7c0 0x7f9e7015efa0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9e700cfe40 tx=0x7f9e5c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d5cbbca10f051f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e6f7fe640 1 -- 172.21.15.70:0/848476435 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0ab670 con 0x7f9e700cf7c0 2023-11-26T07:21:28.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e6f7fe640 1 -- 172.21.15.70:0/848476435 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c0ab7d0 con 0x7f9e700cf7c0 2023-11-26T07:21:28.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e6f7fe640 1 -- 172.21.15.70:0/848476435 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0abb60 con 0x7f9e700cf7c0 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 -- 172.21.15.70:0/848476435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e700cf7c0 msgr2=0x7f9e7015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 --2- 172.21.15.70:0/848476435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e700cf7c0 0x7f9e7015efa0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9e700cfe40 tx=0x7f9e5c01c470 comp rx=0 tx=0).stop 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 -- 172.21.15.70:0/848476435 shutdown_connections 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 --2- 172.21.15.70:0/848476435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e700cf7c0 0x7f9e7015efa0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 --2- 172.21.15.70:0/848476435 >> v2:172.21.15.120:3300/0 conn(0x7f9e7013e290 0x7f9e700cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 -- 172.21.15.70:0/848476435 >> 172.21.15.70:0/848476435 conn(0x7f9e7006a890 msgr2=0x7f9e7006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 -- 172.21.15.70:0/848476435 shutdown_connections 2023-11-26T07:21:28.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.573+0000 7f9e76e91640 1 -- 172.21.15.70:0/848476435 wait complete. 2023-11-26T07:21:28.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 Processor -- start 2023-11-26T07:21:28.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 -- start start 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e700cf7c0 0x7f9e700ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e7013e290 0x7f9e70154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e7015f4e0 0x7f9e701f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7014e320 con 0x7f9e7015f4e0 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e701511e0 con 0x7f9e7013e290 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70131470 con 0x7f9e700cf7c0 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e7015f4e0 0x7f9e701f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e7015f4e0 0x7f9e701f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36268/0 (socket says 172.21.15.70:36268) 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 -- 172.21.15.70:0/3289638988 learned_addr learned my addr 172.21.15.70:0/3289638988 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e6ffff640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e7013e290 0x7f9e70154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e74c2d640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e700cf7c0 0x7f9e700ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 -- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e700cf7c0 msgr2=0x7f9e700ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e700cf7c0 0x7f9e700ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 -- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e7013e290 msgr2=0x7f9e70154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e7013e290 0x7f9e70154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 -- 172.21.15.70:0/3289638988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c0094d0 con 0x7f9e7015f4e0 2023-11-26T07:21:28.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e74c2d640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e700cf7c0 0x7f9e700ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:28.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e7542e640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e7015f4e0 0x7f9e701f5220 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b970 tx=0x7f9e6800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e6d7fa640 1 -- 172.21.15.70:0/3289638988 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800cb40 con 0x7f9e7015f4e0 2023-11-26T07:21:28.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e6d7fa640 1 -- 172.21.15.70:0/3289638988 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6800cca0 con 0x7f9e7015f4e0 2023-11-26T07:21:28.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e700b1060 con 0x7f9e7015f4e0 2023-11-26T07:21:28.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e6d7fa640 1 -- 172.21.15.70:0/3289638988 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68014680 con 0x7f9e7015f4e0 2023-11-26T07:21:28.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e700b1620 con 0x7f9e7015f4e0 2023-11-26T07:21:28.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.577+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e70067680 con 0x7f9e7015f4e0 2023-11-26T07:21:28.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.581+0000 7f9e6d7fa640 1 -- 172.21.15.70:0/3289638988 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f9e6801d3b0 con 0x7f9e7015f4e0 2023-11-26T07:21:28.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.581+0000 7f9e6d7fa640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e54066a10 0x7f9e54068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.581+0000 7f9e6d7fa640 1 -- 172.21.15.70:0/3289638988 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5823+0+0 (secure 0 0 0) 0x7f9e680846e0 con 0x7f9e7015f4e0 2023-11-26T07:21:28.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.581+0000 7f9e74c2d640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e54066a10 0x7f9e54068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.581+0000 7f9e74c2d640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e54066a10 0x7f9e54068ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9e64007a70 tx=0x7f9e64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.585+0000 7f9e6d7fa640 1 -- 172.21.15.70:0/3289638988 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e68051440 con 0x7f9e7015f4e0 2023-11-26T07:21:28.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e70138410 con 0x7f9e7015f4e0 2023-11-26T07:21:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e6d7fa640 1 -- 172.21.15.70:0/3289638988 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e68054a60 con 0x7f9e7015f4e0 2023-11-26T07:21:28.740 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:21:28.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e54066a10 msgr2=0x7f9e54068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e54066a10 0x7f9e54068ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9e64007a70 tx=0x7f9e64008040 comp rx=0 tx=0).stop 2023-11-26T07:21:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e7015f4e0 msgr2=0x7f9e701f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e7015f4e0 0x7f9e701f5220 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800b970 tx=0x7f9e6800be30 comp rx=0 tx=0).stop 2023-11-26T07:21:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 shutdown_connections 2023-11-26T07:21:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e54066a10 0x7f9e54068ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e7015f4e0 0x7f9e701f5220 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e7013e290 0x7f9e70154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 --2- 172.21.15.70:0/3289638988 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e700cf7c0 0x7f9e700ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 >> 172.21.15.70:0/3289638988 conn(0x7f9e7006a890 msgr2=0x7f9e700b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 shutdown_connections 2023-11-26T07:21:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.737+0000 7f9e76e91640 1 -- 172.21.15.70:0/3289638988 wait complete. 2023-11-26T07:21:28.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:21:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.901+0000 7fe4f4f72640 1 Processor -- start 2023-11-26T07:21:28.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.901+0000 7fe4f4f72640 1 -- start start 2023-11-26T07:21:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4f4f72640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe4f013e290 0x7fe4f00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4f4f72640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe4f015f6b0 0x7fe4f00cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4f4f72640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f015fb20 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4f4f72640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00cfc40 con 0x7fe4f015f6b0 2023-11-26T07:21:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4f4f72640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f006c520 con 0x7fe4f013e290 2023-11-26T07:21:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4eed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe4f015f6b0 0x7fe4f00cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4eed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe4f015f6b0 0x7fe4f00cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36276/0 (socket says 172.21.15.70:36276) 2023-11-26T07:21:28.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4eed9d640 1 -- 172.21.15.70:0/568928050 learned_addr learned my addr 172.21.15.70:0/568928050 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:28.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4ee59c640 1 --2- 172.21.15.70:0/568928050 >> v2:172.21.15.120:3300/0 conn(0x7fe4f013e290 0x7fe4f00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4eed9d640 1 -- 172.21.15.70:0/568928050 >> v2:172.21.15.120:3300/0 conn(0x7fe4f013e290 msgr2=0x7fe4f00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4eed9d640 1 --2- 172.21.15.70:0/568928050 >> v2:172.21.15.120:3300/0 conn(0x7fe4f013e290 0x7fe4f00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4eed9d640 1 -- 172.21.15.70:0/568928050 >> v1:172.21.15.120:6789/0 conn(0x7fe4f00cf7c0 legacy=0x7fe4f015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:28.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.905+0000 7fe4eed9d640 1 -- 172.21.15.70:0/568928050 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f006c800 con 0x7fe4f015f6b0 2023-11-26T07:21:28.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4eed9d640 1 --2- 172.21.15.70:0/568928050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f015f6b0 0x7fe4f00cd7b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe4f006e780 tx=0x7fe4e801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f9c31689083661 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4edd9b640 1 -- 172.21.15.70:0/568928050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a5800 con 0x7fe4f015f6b0 2023-11-26T07:21:28.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4edd9b640 1 -- 172.21.15.70:0/568928050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e80a5960 con 0x7fe4f015f6b0 2023-11-26T07:21:28.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4edd9b640 1 -- 172.21.15.70:0/568928050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a5cf0 con 0x7fe4f015f6b0 2023-11-26T07:21:28.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 -- 172.21.15.70:0/568928050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f015f6b0 msgr2=0x7fe4f00cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/568928050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f015f6b0 0x7fe4f00cd7b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe4f006e780 tx=0x7fe4e801c940 comp rx=0 tx=0).stop 2023-11-26T07:21:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 -- 172.21.15.70:0/568928050 shutdown_connections 2023-11-26T07:21:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/568928050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f015f6b0 0x7fe4f00cd7b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/568928050 >> v2:172.21.15.120:3300/0 conn(0x7fe4f013e290 0x7fe4f00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 -- 172.21.15.70:0/568928050 >> 172.21.15.70:0/568928050 conn(0x7fe4f006a890 msgr2=0x7fe4f006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 -- 172.21.15.70:0/568928050 shutdown_connections 2023-11-26T07:21:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 -- 172.21.15.70:0/568928050 wait complete. 2023-11-26T07:21:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 Processor -- start 2023-11-26T07:21:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.909+0000 7fe4f4f72640 1 -- start start 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f00cf7c0 0x7fe4f00b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f013e290 0x7fe4f0137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4f015f6b0 0x7fe4f015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0153ec0 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01541a0 con 0x7fe4f013e290 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0154480 con 0x7fe4f015f6b0 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f00cf7c0 0x7fe4f00b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f00cf7c0 0x7fe4f00b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36288/0 (socket says 172.21.15.70:36288) 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 -- 172.21.15.70:0/2131184344 learned_addr learned my addr 172.21.15.70:0/2131184344 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4e7fff640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f013e290 0x7fe4f0137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4eed9d640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4f015f6b0 0x7fe4f015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 -- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4f015f6b0 msgr2=0x7fe4f015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4f015f6b0 0x7fe4f015ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 -- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f013e290 msgr2=0x7fe4f0137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f013e290 0x7fe4f0137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 -- 172.21.15.70:0/2131184344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8009b30 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4ee59c640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f00cf7c0 0x7fe4f00b1290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000d800 tx=0x7fe4e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4e6ffd640 1 -- 172.21.15.70:0/2131184344 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000b6c0 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4e6ffd640 1 -- 172.21.15.70:0/2131184344 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e000b820 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f0154760 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4e6ffd640 1 -- 172.21.15.70:0/2131184344 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000bb90 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f0155200 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0067680 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.913+0000 7fe4e6ffd640 1 -- 172.21.15.70:0/2131184344 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fe4e000bcf0 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.917+0000 7fe4e6ffd640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4d0066a10 0x7fe4d0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.917+0000 7fe4e6ffd640 1 -- 172.21.15.70:0/2131184344 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe4e0084ed0 con 0x7fe4f00cf7c0 2023-11-26T07:21:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.917+0000 7fe4e7fff640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4d0066a10 0x7fe4d0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.917+0000 7fe4e7fff640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4d0066a10 0x7fe4d0068ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe4f006b290 tx=0x7fe4d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:28.921+0000 7fe4e6ffd640 1 -- 172.21.15.70:0/2131184344 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4e0051ad0 con 0x7fe4f00cf7c0 2023-11-26T07:21:29.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4f0154000 con 0x7fe4f00cf7c0 2023-11-26T07:21:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4e6ffd640 1 -- 172.21.15.70:0/2131184344 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4f0154000 con 0x7fe4f00cf7c0 2023-11-26T07:21:29.077 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:21:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4d0066a10 msgr2=0x7fe4d0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4d0066a10 0x7fe4d0068ed0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe4f006b290 tx=0x7fe4d8009040 comp rx=0 tx=0).stop 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f00cf7c0 msgr2=0x7fe4f00b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f00cf7c0 0x7fe4f00b1290 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000d800 tx=0x7fe4e000dcc0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 shutdown_connections 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe4f015f6b0 0x7fe4f015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4f013e290 0x7fe4f0137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe4d0066a10 0x7fe4d0068ed0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 --2- 172.21.15.70:0/2131184344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4f00cf7c0 0x7fe4f00b1290 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 >> 172.21.15.70:0/2131184344 conn(0x7fe4f006a890 msgr2=0x7fe4f0138310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 shutdown_connections 2023-11-26T07:21:29.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.073+0000 7fe4f4f72640 1 -- 172.21.15.70:0/2131184344 wait complete. 2023-11-26T07:21:29.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:21:29.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.233+0000 7f68f8632640 1 Processor -- start 2023-11-26T07:21:29.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.233+0000 7f68f8632640 1 -- start start 2023-11-26T07:21:29.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.233+0000 7f68f8632640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f68f006f000 0x7f68f006d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.233+0000 7f68f8632640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68f0099a70 0x7f68f006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.233+0000 7f68f8632640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00cf260 con 0x7f68f006f3e0 2023-11-26T07:21:29.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.233+0000 7f68f8632640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f006d570 con 0x7f68f0099a70 2023-11-26T07:21:29.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.233+0000 7f68f8632640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f009a010 con 0x7f68f006f000 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68f0099a70 0x7f68f006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68f0099a70 0x7f68f006bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36300/0 (socket says 172.21.15.70:36300) 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 -- 172.21.15.70:0/305073460 learned_addr learned my addr 172.21.15.70:0/305073460 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f63ce640 1 --2- 172.21.15.70:0/305073460 >> v2:172.21.15.120:3300/0 conn(0x7f68f006f000 0x7f68f006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 -- 172.21.15.70:0/305073460 >> v2:172.21.15.120:3300/0 conn(0x7f68f006f000 msgr2=0x7f68f006d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 --2- 172.21.15.70:0/305073460 >> v2:172.21.15.120:3300/0 conn(0x7f68f006f000 0x7f68f006d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 -- 172.21.15.70:0/305073460 >> v1:172.21.15.120:6789/0 conn(0x7f68f006f3e0 legacy=0x7f68f006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 -- 172.21.15.70:0/305073460 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f009a2f0 con 0x7f68f0099a70 2023-11-26T07:21:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f6bcf640 1 --2- 172.21.15.70:0/305073460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f0099a70 0x7f68f006bcb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f68f0071b70 tx=0x7f68e801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140b99bcbb067dd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f53cc640 1 -- 172.21.15.70:0/305073460 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e80af400 con 0x7f68f0099a70 2023-11-26T07:21:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f53cc640 1 -- 172.21.15.70:0/305073460 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e80ab050 con 0x7f68f0099a70 2023-11-26T07:21:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.237+0000 7f68f53cc640 1 -- 172.21.15.70:0/305073460 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e80af780 con 0x7f68f0099a70 2023-11-26T07:21:29.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- 172.21.15.70:0/305073460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f0099a70 msgr2=0x7f68f006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 --2- 172.21.15.70:0/305073460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f0099a70 0x7f68f006bcb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f68f0071b70 tx=0x7f68e801f1c0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- 172.21.15.70:0/305073460 shutdown_connections 2023-11-26T07:21:29.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 --2- 172.21.15.70:0/305073460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f0099a70 0x7f68f006bcb0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 --2- 172.21.15.70:0/305073460 >> v2:172.21.15.120:3300/0 conn(0x7f68f006f000 0x7f68f006d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- 172.21.15.70:0/305073460 >> 172.21.15.70:0/305073460 conn(0x7f68f00b2d10 msgr2=0x7f68f00b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:29.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- 172.21.15.70:0/305073460 shutdown_connections 2023-11-26T07:21:29.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- 172.21.15.70:0/305073460 wait complete. 2023-11-26T07:21:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 Processor -- start 2023-11-26T07:21:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- start start 2023-11-26T07:21:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f006f000 0x7f68f014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f006f3e0 0x7f68f01f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68f0099a70 0x7f68f01f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f01f4200 con 0x7f68f006f000 2023-11-26T07:21:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f014cb30 con 0x7f68f006f3e0 2023-11-26T07:21:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f8632640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00b5d10 con 0x7f68f0099a70 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f006f000 0x7f68f014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f006f000 0x7f68f014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36304/0 (socket says 172.21.15.70:36304) 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 -- 172.21.15.70:0/3821466814 learned_addr learned my addr 172.21.15.70:0/3821466814 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f5bcd640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f006f3e0 0x7f68f01f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f6bcf640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68f0099a70 0x7f68f01f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 -- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68f0099a70 msgr2=0x7f68f01f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68f0099a70 0x7f68f01f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 -- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f006f3e0 msgr2=0x7f68f01f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f006f3e0 0x7f68f01f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 -- 172.21.15.70:0/3821466814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009b30 con 0x7f68f006f000 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.241+0000 7f68f63ce640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f006f000 0x7f68f014c5f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e930 tx=0x7f68ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68e6ffd640 1 -- 172.21.15.70:0/3821466814 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec009690 con 0x7f68f006f000 2023-11-26T07:21:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68e6ffd640 1 -- 172.21.15.70:0/3821466814 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00ca00 con 0x7f68f006f000 2023-11-26T07:21:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68e6ffd640 1 -- 172.21.15.70:0/3821466814 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00cd70 con 0x7f68f006f000 2023-11-26T07:21:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f00b5ff0 con 0x7f68f006f000 2023-11-26T07:21:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f00b65b0 con 0x7f68f006f000 2023-11-26T07:21:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f0067680 con 0x7f68f006f000 2023-11-26T07:21:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68e6ffd640 1 -- 172.21.15.70:0/3821466814 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f68ec013470 con 0x7f68f006f000 2023-11-26T07:21:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68e6ffd640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68d4066a10 0x7f68d4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68e6ffd640 1 -- 172.21.15.70:0/3821466814 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f68ec084bb0 con 0x7f68f006f000 2023-11-26T07:21:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.245+0000 7f68f5bcd640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68d4066a10 0x7f68d4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.249+0000 7f68f5bcd640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68d4066a10 0x7f68d4068ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f68f015cec0 tx=0x7f68e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.249+0000 7f68e6ffd640 1 -- 172.21.15.70:0/3821466814 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68ec051890 con 0x7f68f006f000 2023-11-26T07:21:29.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f68f00cd550 con 0x7f68f006f000 2023-11-26T07:21:29.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68e6ffd640 1 -- 172.21.15.70:0/3821466814 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) v1 ==== 80+0+0 (secure 0 0 0) 0x7f68ec017080 con 0x7f68f006f000 2023-11-26T07:21:29.420 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:21:29.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68d4066a10 msgr2=0x7f68d4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68d4066a10 0x7f68d4068ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f68f015cec0 tx=0x7f68e0009040 comp rx=0 tx=0).stop 2023-11-26T07:21:29.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f006f000 msgr2=0x7f68f014c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f006f000 0x7f68f014c5f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e930 tx=0x7f68ec00edf0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 shutdown_connections 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f68f0099a70 0x7f68f01f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68f006f3e0 0x7f68f01f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f68d4066a10 0x7f68d4068ed0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 --2- 172.21.15.70:0/3821466814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f006f000 0x7f68f014c5f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 >> 172.21.15.70:0/3821466814 conn(0x7f68f00b2d10 msgr2=0x7f68f0160a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 shutdown_connections 2023-11-26T07:21:29.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.417+0000 7f68f8632640 1 -- 172.21.15.70:0/3821466814 wait complete. 2023-11-26T07:21:29.441 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2023-11-26T07:21:29.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:29.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-26T07:21:29.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:21:29.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:29.463 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:21:29.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[50137]: fuse finished with error 0 and tester_r 0 2023-11-26T07:21:29.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:29.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:29.625 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:21:29.625 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:29.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:29.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.801+0000 7f7c33908640 1 Processor -- start 2023-11-26T07:21:29.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.801+0000 7f7c33908640 1 -- start start 2023-11-26T07:21:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c33908640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7c2c0cf990 0x7f7c2c0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c33908640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c33908640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c162080 con 0x7f7c2c14b1e0 2023-11-26T07:21:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c33908640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c161d70 con 0x7f7c2c0cf990 2023-11-26T07:21:29.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c33908640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c14b5c0 con 0x7f7c2c070e00 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c30ea3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7c2c0cf990 0x7f7c2c0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c31ea5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c30ea3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7c2c0cf990 0x7f7c2c0708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:34388/0 (socket says 172.21.15.70:34388) 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c30ea3640 1 -- 172.21.15.70:0/1975429129 learned_addr learned my addr 172.21.15.70:0/1975429129 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c316a4640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7c2c14b1e0 0x7f7c2c0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:51076/0 (socket says 172.21.15.70:51076) 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c30ea3640 1 -- 172.21.15.70:0/1975429129 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 msgr2=0x7f7c2c162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c30ea3640 1 --2- 172.21.15.70:0/1975429129 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c30ea3640 1 -- 172.21.15.70:0/1975429129 >> v1:172.21.15.120:6789/0 conn(0x7f7c2c14b1e0 legacy=0x7f7c2c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.805+0000 7f7c30ea3640 1 -- 172.21.15.70:0/1975429129 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c071580 con 0x7f7c2c0cf990 2023-11-26T07:21:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c30ea3640 1 --2- 172.21.15.70:0/1975429129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c0708c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009870 tx=0x7f7c1c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b59c31816ecd74 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c23fff640 1 -- 172.21.15.70:0/1975429129 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0aa670 con 0x7f7c2c0cf990 2023-11-26T07:21:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c23fff640 1 -- 172.21.15.70:0/1975429129 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0aa7d0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c23fff640 1 -- 172.21.15.70:0/1975429129 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0aab60 con 0x7f7c2c0cf990 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 -- 172.21.15.70:0/1975429129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c0cf990 msgr2=0x7f7c2c0708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 --2- 172.21.15.70:0/1975429129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c0708c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009870 tx=0x7f7c1c01c510 comp rx=0 tx=0).stop 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 -- 172.21.15.70:0/1975429129 shutdown_connections 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 --2- 172.21.15.70:0/1975429129 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 --2- 172.21.15.70:0/1975429129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c0708c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 -- 172.21.15.70:0/1975429129 >> 172.21.15.70:0/1975429129 conn(0x7f7c2c06a890 msgr2=0x7f7c2c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 -- 172.21.15.70:0/1975429129 shutdown_connections 2023-11-26T07:21:29.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 -- 172.21.15.70:0/1975429129 wait complete. 2023-11-26T07:21:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 Processor -- start 2023-11-26T07:21:29.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.809+0000 7f7c33908640 1 -- start start 2023-11-26T07:21:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c1fae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c14b1e0 0x7f7c2c1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c1fb810 con 0x7f7c2c0cf990 2023-11-26T07:21:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c1fbaf0 con 0x7f7c2c14b1e0 2023-11-26T07:21:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c1fbdd0 con 0x7f7c2c070e00 2023-11-26T07:21:29.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c1fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c1fae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36310/0 (socket says 172.21.15.70:36310) 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 -- 172.21.15.70:0/4204487204 learned_addr learned my addr 172.21.15.70:0/4204487204 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c31ea5640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c14b1e0 0x7f7c2c1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c316a4640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 -- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 msgr2=0x7f7c2c149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 -- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c14b1e0 msgr2=0x7f7c2c1425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c14b1e0 0x7f7c2c1425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 -- 172.21.15.70:0/4204487204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0094d0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c30ea3640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c1fae80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ac040 tx=0x7f7c1c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c21ffb640 1 -- 172.21.15.70:0/4204487204 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0aa670 con 0x7f7c2c0cf990 2023-11-26T07:21:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c21ffb640 1 -- 172.21.15.70:0/4204487204 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0b3820 con 0x7f7c2c0cf990 2023-11-26T07:21:29.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c1fc0b0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c21ffb640 1 -- 172.21.15.70:0/4204487204 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0b3bd0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c1499d0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c149bc0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.813+0000 7f7c21ffb640 1 -- 172.21.15.70:0/4204487204 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f7c1c0b3d30 con 0x7f7c2c0cf990 2023-11-26T07:21:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.817+0000 7f7c21ffb640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c10066a10 0x7f7c10068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.817+0000 7f7c21ffb640 1 -- 172.21.15.70:0/4204487204 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7c1c11f590 con 0x7f7c2c0cf990 2023-11-26T07:21:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.817+0000 7f7c316a4640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c10066a10 0x7f7c10068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:29.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.817+0000 7f7c316a4640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c10066a10 0x7f7c10068ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c28000f70 tx=0x7f7c28007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:29.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.821+0000 7f7c21ffb640 1 -- 172.21.15.70:0/4204487204 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c2c149bc0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.969+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c2c149bc0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.969+0000 7f7c21ffb640 1 -- 172.21.15.70:0/4204487204 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16730 (secure 0 0 0) 0x7f7c2c149bc0 con 0x7f7c2c0cf990 2023-11-26T07:21:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:29.974 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":52,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:28.813599+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:29.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c10066a10 msgr2=0x7f7c10068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c10066a10 0x7f7c10068ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c28000f70 tx=0x7f7c28007e50 comp rx=0 tx=0).stop 2023-11-26T07:21:29.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c0cf990 msgr2=0x7f7c2c1fae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:29.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c1fae80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ac040 tx=0x7f7c1c01ad50 comp rx=0 tx=0).stop 2023-11-26T07:21:29.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 shutdown_connections 2023-11-26T07:21:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7c10066a10 0x7f7c10068ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c2c0cf990 0x7f7c2c1fae80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7c2c14b1e0 0x7f7c2c1425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 --2- 172.21.15.70:0/4204487204 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7c2c070e00 0x7f7c2c149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 >> 172.21.15.70:0/4204487204 conn(0x7f7c2c06a890 msgr2=0x7f7c2c143b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 shutdown_connections 2023-11-26T07:21:29.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:29.973+0000 7f7c33908640 1 -- 172.21.15.70:0/4204487204 wait complete. 2023-11-26T07:21:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:20:30.063697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:20:30.697996+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:29.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:30.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b3dfe7640 1 Processor -- start 2023-11-26T07:21:30.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b3dfe7640 1 -- start start 2023-11-26T07:21:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b3dfe7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b3815d6e0 0x7f6b380d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b3dfe7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b380b2160 0x7f6b380d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b3dfe7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b380cf0e0 con 0x7f6b380d19f0 2023-11-26T07:21:30.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b3dfe7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3815dac0 con 0x7f6b3815d6e0 2023-11-26T07:21:30.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b3dfe7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380d1e80 con 0x7f6b380b2160 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b37fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6b380d19f0 0x7f6b380cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35102/0 (socket says 172.21.15.70:35102) 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b37fff640 1 -- 172.21.15.70:0/602818488 learned_addr learned my addr 172.21.15.70:0/602818488 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b377fe640 1 --2- 172.21.15.70:0/602818488 >> v2:172.21.15.120:3300/0 conn(0x7f6b3815d6e0 0x7f6b380d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b36ffd640 1 --2- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b380b2160 0x7f6b380d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b367fc640 1 -- 172.21.15.70:0/602818488 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323418572 0 0) 0x7f6b380cf0e0 con 0x7f6b380d19f0 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b367fc640 1 -- 172.21.15.70:0/602818488 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b20003530 con 0x7f6b380d19f0 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b377fe640 1 -- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b380b2160 msgr2=0x7f6b380d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b377fe640 1 --2- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b380b2160 0x7f6b380d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b377fe640 1 -- 172.21.15.70:0/602818488 >> v1:172.21.15.70:6789/0 conn(0x7f6b380d19f0 legacy=0x7f6b380cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.137+0000 7f6b377fe640 1 -- 172.21.15.70:0/602818488 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380ceb20 con 0x7f6b3815d6e0 2023-11-26T07:21:30.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b377fe640 1 --2- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b3815d6e0 0x7f6b380d0df0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b280097c0 tx=0x7f6b2801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1003050a2cae1b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b367fc640 1 -- 172.21.15.70:0/602818488 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b280ab600 con 0x7f6b3815d6e0 2023-11-26T07:21:30.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b367fc640 1 -- 172.21.15.70:0/602818488 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b280a7050 con 0x7f6b3815d6e0 2023-11-26T07:21:30.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b367fc640 1 -- 172.21.15.70:0/602818488 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b280ab980 con 0x7f6b3815d6e0 2023-11-26T07:21:30.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b3815d6e0 msgr2=0x7f6b380d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b3815d6e0 0x7f6b380d0df0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b280097c0 tx=0x7f6b2801c480 comp rx=0 tx=0).stop 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/602818488 shutdown_connections 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b380b2160 0x7f6b380d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/602818488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b3815d6e0 0x7f6b380d0df0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/602818488 >> 172.21.15.70:0/602818488 conn(0x7f6b3809c550 msgr2=0x7f6b380d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/602818488 shutdown_connections 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/602818488 wait complete. 2023-11-26T07:21:30.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.141+0000 7f6b3dfe7640 1 Processor -- start 2023-11-26T07:21:30.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 -- start start 2023-11-26T07:21:30.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b380b2160 0x7f6b3815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b380d19f0 0x7f6b3815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b3815d6e0 0x7f6b380c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3815ba00 con 0x7f6b380b2160 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3815c260 con 0x7f6b380d19f0 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3815bca0 con 0x7f6b3815d6e0 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b380b2160 0x7f6b3815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b380b2160 0x7f6b3815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36312/0 (socket says 172.21.15.70:36312) 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 -- 172.21.15.70:0/203490082 learned_addr learned my addr 172.21.15.70:0/203490082 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b36ffd640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b380d19f0 0x7f6b3815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b37fff640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b3815d6e0 0x7f6b380c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 -- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b3815d6e0 msgr2=0x7f6b380c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b3815d6e0 0x7f6b380c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 -- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b380d19f0 msgr2=0x7f6b3815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b380d19f0 0x7f6b3815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 -- 172.21.15.70:0/203490082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28009420 con 0x7f6b380b2160 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b377fe640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b380b2160 0x7f6b3815cae0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6b2801a0b0 tx=0x7f6b28019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b1ffff640 1 -- 172.21.15.70:0/203490082 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b280b4410 con 0x7f6b380b2160 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b1ffff640 1 -- 172.21.15.70:0/203490082 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b280b4590 con 0x7f6b380b2160 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3815bf80 con 0x7f6b380b2160 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b1ffff640 1 -- 172.21.15.70:0/203490082 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b280b4940 con 0x7f6b380b2160 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b38154040 con 0x7f6b380b2160 2023-11-26T07:21:30.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.145+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b38154230 con 0x7f6b380b2160 2023-11-26T07:21:30.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.149+0000 7f6b1ffff640 1 -- 172.21.15.70:0/203490082 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f6b280b2040 con 0x7f6b380b2160 2023-11-26T07:21:30.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.149+0000 7f6b1ffff640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b24066a40 0x7f6b24068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.149+0000 7f6b1ffff640 1 -- 172.21.15.70:0/203490082 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6b2811e700 con 0x7f6b380b2160 2023-11-26T07:21:30.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.149+0000 7f6b36ffd640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b24066a40 0x7f6b24068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.149+0000 7f6b36ffd640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b24066a40 0x7f6b24068f00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6b381503f0 tx=0x7f6b2c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.153+0000 7f6b1ffff640 1 -- 172.21.15.70:0/203490082 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b280eb250 con 0x7f6b380b2160 2023-11-26T07:21:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.301+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b38067680 con 0x7f6b380b2160 2023-11-26T07:21:30.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.301+0000 7f6b1ffff640 1 -- 172.21.15.70:0/203490082 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b280b00a0 con 0x7f6b380b2160 2023-11-26T07:21:30.306 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:21:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b24066a40 msgr2=0x7f6b24068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b24066a40 0x7f6b24068f00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6b381503f0 tx=0x7f6b2c009190 comp rx=0 tx=0).stop 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b380b2160 msgr2=0x7f6b3815cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b380b2160 0x7f6b3815cae0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6b2801a0b0 tx=0x7f6b28019220 comp rx=0 tx=0).stop 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 shutdown_connections 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6b3815d6e0 0x7f6b380c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b380d19f0 0x7f6b3815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6b24066a40 0x7f6b24068f00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 --2- 172.21.15.70:0/203490082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b380b2160 0x7f6b3815cae0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 >> 172.21.15.70:0/203490082 conn(0x7f6b3809c550 msgr2=0x7f6b38156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 shutdown_connections 2023-11-26T07:21:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.305+0000 7f6b3dfe7640 1 -- 172.21.15.70:0/203490082 wait complete. 2023-11-26T07:21:30.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:21:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8893ec640 1 Processor -- start 2023-11-26T07:21:30.469 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8893ec640 1 -- start start 2023-11-26T07:21:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8893ec640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb8840cf280 0x7fb8840cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8893ec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb8840cd1b0 0x7fb8840cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8893ec640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8840cc730 con 0x7fb884143ac0 2023-11-26T07:21:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8893ec640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb884143ea0 con 0x7fb8840cf280 2023-11-26T07:21:30.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8893ec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8840cfc50 con 0x7fb8840cd1b0 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8827fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb8840cf280 0x7fb8840cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8827fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb8840cf280 0x7fb8840cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36326/0 (socket says 172.21.15.70:36326) 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8827fc640 1 -- 172.21.15.70:0/2605709569 learned_addr learned my addr 172.21.15.70:0/2605709569 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.465+0000 7fb8837fe640 1 --2- 172.21.15.70:0/2605709569 >> v2:172.21.15.120:3300/0 conn(0x7fb8840cd1b0 0x7fb8840cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8827fc640 1 -- 172.21.15.70:0/2605709569 >> v2:172.21.15.120:3300/0 conn(0x7fb8840cd1b0 msgr2=0x7fb8840cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8827fc640 1 --2- 172.21.15.70:0/2605709569 >> v2:172.21.15.120:3300/0 conn(0x7fb8840cd1b0 0x7fb8840cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8827fc640 1 -- 172.21.15.70:0/2605709569 >> v1:172.21.15.120:6789/0 conn(0x7fb884143ac0 legacy=0x7fb884070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8827fc640 1 -- 172.21.15.70:0/2605709569 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884070ee0 con 0x7fb8840cf280 2023-11-26T07:21:30.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8827fc640 1 --2- 172.21.15.70:0/2605709569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cf280 0x7fb8840cf710 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb88406e570 tx=0x7fb87801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4fa3fbc3f124a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb881ffb640 1 -- 172.21.15.70:0/2605709569 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780aa660 con 0x7fb8840cf280 2023-11-26T07:21:30.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb881ffb640 1 -- 172.21.15.70:0/2605709569 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8780aa7c0 con 0x7fb8840cf280 2023-11-26T07:21:30.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb881ffb640 1 -- 172.21.15.70:0/2605709569 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780aab50 con 0x7fb8840cf280 2023-11-26T07:21:30.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8893ec640 1 -- 172.21.15.70:0/2605709569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cf280 msgr2=0x7fb8840cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8893ec640 1 --2- 172.21.15.70:0/2605709569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cf280 0x7fb8840cf710 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb88406e570 tx=0x7fb87801c500 comp rx=0 tx=0).stop 2023-11-26T07:21:30.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8893ec640 1 -- 172.21.15.70:0/2605709569 shutdown_connections 2023-11-26T07:21:30.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8893ec640 1 --2- 172.21.15.70:0/2605709569 >> v2:172.21.15.120:3300/0 conn(0x7fb8840cd1b0 0x7fb8840cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.469+0000 7fb8893ec640 1 --2- 172.21.15.70:0/2605709569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cf280 0x7fb8840cf710 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 -- 172.21.15.70:0/2605709569 >> 172.21.15.70:0/2605709569 conn(0x7fb88406a890 msgr2=0x7fb88406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 -- 172.21.15.70:0/2605709569 shutdown_connections 2023-11-26T07:21:30.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 -- 172.21.15.70:0/2605709569 wait complete. 2023-11-26T07:21:30.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 Processor -- start 2023-11-26T07:21:30.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 -- start start 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cd1b0 0x7fb8840aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb8840cf280 0x7fb88415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb884143ac0 0x7fb8841561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb884159800 con 0x7fb8840cd1b0 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb884159aa0 con 0x7fb884143ac0 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8893ec640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8840b1190 con 0x7fb8840cf280 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cd1b0 0x7fb8840aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cd1b0 0x7fb8840aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36338/0 (socket says 172.21.15.70:36338) 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 -- 172.21.15.70:0/1926924698 learned_addr learned my addr 172.21.15.70:0/1926924698 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8827fc640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb8840cf280 0x7fb88415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8837fe640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb884143ac0 0x7fb8841561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 -- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb8840cf280 msgr2=0x7fb88415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb8840cf280 0x7fb88415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 -- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb884143ac0 msgr2=0x7fb8841561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb884143ac0 0x7fb8841561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 -- 172.21.15.70:0/1926924698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8780094d0 con 0x7fb8840cd1b0 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb8837fe640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb884143ac0 0x7fb8841561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.473+0000 7fb882ffd640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cd1b0 0x7fb8840aeb60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c500 tx=0x7fb87400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb86b7fe640 1 -- 172.21.15.70:0/1926924698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874005220 con 0x7fb8840cd1b0 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb86b7fe640 1 -- 172.21.15.70:0/1926924698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874005380 con 0x7fb8840cd1b0 2023-11-26T07:21:30.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb86b7fe640 1 -- 172.21.15.70:0/1926924698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874007270 con 0x7fb8840cd1b0 2023-11-26T07:21:30.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8840b1470 con 0x7fb8840cd1b0 2023-11-26T07:21:30.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb884159d80 con 0x7fb8840cd1b0 2023-11-26T07:21:30.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb884067680 con 0x7fb8840cd1b0 2023-11-26T07:21:30.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb86b7fe640 1 -- 172.21.15.70:0/1926924698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb8740073d0 con 0x7fb8840cd1b0 2023-11-26T07:21:30.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb86b7fe640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb870066a10 0x7fb870068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb86b7fe640 1 -- 172.21.15.70:0/1926924698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb874084230 con 0x7fb8840cd1b0 2023-11-26T07:21:30.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.477+0000 7fb8827fc640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb870066a10 0x7fb870068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.481+0000 7fb8827fc640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb870066a10 0x7fb870068ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb8780ae000 tx=0x7fb8780b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.481+0000 7fb86b7fe640 1 -- 172.21.15.70:0/1926924698 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb874050db0 con 0x7fb8840cd1b0 2023-11-26T07:21:30.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.629+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb88413b380 con 0x7fb8840cd1b0 2023-11-26T07:21:30.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb86b7fe640 1 -- 172.21.15.70:0/1926924698 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8740543d0 con 0x7fb8840cd1b0 2023-11-26T07:21:30.635 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:21:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb870066a10 msgr2=0x7fb870068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb870066a10 0x7fb870068ed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb8780ae000 tx=0x7fb8780b5040 comp rx=0 tx=0).stop 2023-11-26T07:21:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cd1b0 msgr2=0x7fb8840aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cd1b0 0x7fb8840aeb60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c500 tx=0x7fb87400c9c0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 shutdown_connections 2023-11-26T07:21:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb884143ac0 0x7fb8841561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb8840cf280 0x7fb88415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb870066a10 0x7fb870068ed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 --2- 172.21.15.70:0/1926924698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8840cd1b0 0x7fb8840aeb60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 >> 172.21.15.70:0/1926924698 conn(0x7fb88406a890 msgr2=0x7fb88406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 shutdown_connections 2023-11-26T07:21:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.633+0000 7fb8893ec640 1 -- 172.21.15.70:0/1926924698 wait complete. 2023-11-26T07:21:30.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:21:30.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dd112a640 1 Processor -- start 2023-11-26T07:21:30.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dd112a640 1 -- start start 2023-11-26T07:21:30.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dd112a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8dcc15d6e0 0x7f8dcc0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dd112a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dd112a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc0cf0e0 con 0x7f8dcc0d19f0 2023-11-26T07:21:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dd112a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dcc15dac0 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dd112a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0d1e80 con 0x7f8dcc0b2160 2023-11-26T07:21:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dcad9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8dcc15d6e0 0x7f8dcc0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dcad9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8dcc15d6e0 0x7f8dcc0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36342/0 (socket says 172.21.15.70:36342) 2023-11-26T07:21:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dcad9d640 1 -- 172.21.15.70:0/3151823935 learned_addr learned my addr 172.21.15.70:0/3151823935 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dc259c640 1 --2- 172.21.15.70:0/3151823935 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dcad9d640 1 -- 172.21.15.70:0/3151823935 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 msgr2=0x7f8dcc0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dcad9d640 1 --2- 172.21.15.70:0/3151823935 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dcad9d640 1 -- 172.21.15.70:0/3151823935 >> v1:172.21.15.120:6789/0 conn(0x7f8dcc0d19f0 legacy=0x7f8dcc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dcad9d640 1 -- 172.21.15.70:0/3151823935 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0ceb20 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.793+0000 7f8dc259c640 1 --2- 172.21.15.70:0/3151823935 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:30.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dcad9d640 1 --2- 172.21.15.70:0/3151823935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc0d0df0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009e50 tx=0x7f8dbc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4d6b35aa3ec66 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dca59c640 1 -- 172.21.15.70:0/3151823935 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0a57d0 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dca59c640 1 -- 172.21.15.70:0/3151823935 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc0a5930 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dca59c640 1 -- 172.21.15.70:0/3151823935 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0a5cc0 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 -- 172.21.15.70:0/3151823935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 msgr2=0x7f8dcc0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3151823935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc0d0df0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009e50 tx=0x7f8dbc01ca10 comp rx=0 tx=0).stop 2023-11-26T07:21:30.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 -- 172.21.15.70:0/3151823935 shutdown_connections 2023-11-26T07:21:30.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3151823935 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3151823935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc0d0df0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 -- 172.21.15.70:0/3151823935 >> 172.21.15.70:0/3151823935 conn(0x7f8dcc09c550 msgr2=0x7f8dcc0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 -- 172.21.15.70:0/3151823935 shutdown_connections 2023-11-26T07:21:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.797+0000 7f8dd112a640 1 -- 172.21.15.70:0/3151823935 wait complete. 2023-11-26T07:21:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 Processor -- start 2023-11-26T07:21:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 -- start start 2023-11-26T07:21:30.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dcc0d19f0 0x7f8dcc1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0b9090 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc155040 con 0x7f8dcc0d19f0 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc154430 con 0x7f8dcc0b2160 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcad9d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc15b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36354/0 (socket says 172.21.15.70:36354) 2023-11-26T07:21:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 -- 172.21.15.70:0/3379307394 learned_addr learned my addr 172.21.15.70:0/3379307394 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dc259c640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dcc0d19f0 0x7f8dcc1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 -- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 msgr2=0x7f8dcc0b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 -- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dcc0d19f0 msgr2=0x7f8dcc1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dcc0d19f0 0x7f8dcc1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 -- 172.21.15.70:0/3379307394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc009b30 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcad9d640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dcb59e640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc15b660 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c430 tx=0x7f8dc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dc3fff640 1 -- 172.21.15.70:0/3379307394 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4005220 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dc3fff640 1 -- 172.21.15.70:0/3379307394 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4005380 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc154710 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dc3fff640 1 -- 172.21.15.70:0/3379307394 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4007270 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.801+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc154cd0 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.805+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc1551d0 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.805+0000 7f8dc3fff640 1 -- 172.21.15.70:0/3379307394 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f8dc40073d0 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.805+0000 7f8dc3fff640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8dac066a10 0x7f8dac068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.805+0000 7f8dc3fff640 1 -- 172.21.15.70:0/3379307394 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8dc4083de0 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.805+0000 7f8dcad9d640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8dac066a10 0x7f8dac068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.805+0000 7f8dcad9d640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8dac066a10 0x7f8dac068ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0ae000 tx=0x7f8dbc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.809+0000 7f8dc3fff640 1 -- 172.21.15.70:0/3379307394 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8dc4089020 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dcc067680 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dc3fff640 1 -- 172.21.15.70:0/3379307394 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8dc4050a00 con 0x7f8dcc15d6e0 2023-11-26T07:21:30.964 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8dac066a10 msgr2=0x7f8dac068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8dac066a10 0x7f8dac068ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0ae000 tx=0x7f8dbc0a7070 comp rx=0 tx=0).stop 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 msgr2=0x7f8dcc15b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc15b660 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400c430 tx=0x7f8dc400c8f0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 shutdown_connections 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8dac066a10 0x7f8dac068ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8dcc15d6e0 0x7f8dcc15b660 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dcc0d19f0 0x7f8dcc1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 --2- 172.21.15.70:0/3379307394 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8dcc0b2160 0x7f8dcc0b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 >> 172.21.15.70:0/3379307394 conn(0x7f8dcc09c550 msgr2=0x7f8dcc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:30.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 shutdown_connections 2023-11-26T07:21:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:30.961+0000 7f8dd112a640 1 -- 172.21.15.70:0/3379307394 wait complete. 2023-11-26T07:21:30.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:21:31.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9456a79640 1 Processor -- start 2023-11-26T07:21:31.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9456a79640 1 -- start start 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9456a79640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f945015d6e0 0x7f94500d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9456a79640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f94500b2160 0x7f94500d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9456a79640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500cf0e0 con 0x7f94500d19f0 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9456a79640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945015dac0 con 0x7f94500b2160 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9456a79640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500d1e80 con 0x7f945015d6e0 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f944ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f94500b2160 0x7f94500d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f944ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f94500b2160 0x7f94500d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36356/0 (socket says 172.21.15.70:36356) 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f944ffff640 1 -- 172.21.15.70:0/3403957191 learned_addr learned my addr 172.21.15.70:0/3403957191 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f9454815640 1 --2- 172.21.15.70:0/3403957191 >> v2:172.21.15.120:3300/0 conn(0x7f945015d6e0 0x7f94500d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f944ffff640 1 -- 172.21.15.70:0/3403957191 >> v2:172.21.15.120:3300/0 conn(0x7f945015d6e0 msgr2=0x7f94500d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:31.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f944ffff640 1 --2- 172.21.15.70:0/3403957191 >> v2:172.21.15.120:3300/0 conn(0x7f945015d6e0 0x7f94500d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f944ffff640 1 -- 172.21.15.70:0/3403957191 >> v1:172.21.15.120:6789/0 conn(0x7f94500d19f0 legacy=0x7f94500cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.121+0000 7f944ffff640 1 -- 172.21.15.70:0/3403957191 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500ceb20 con 0x7f94500b2160 2023-11-26T07:21:31.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f944ffff640 1 --2- 172.21.15.70:0/3403957191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f94500d14b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f94500b5db0 tx=0x7f943c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b21d55987f5cc09 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f944f7fe640 1 -- 172.21.15.70:0/3403957191 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c0ab5f0 con 0x7f94500b2160 2023-11-26T07:21:31.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f944f7fe640 1 -- 172.21.15.70:0/3403957191 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c0ab750 con 0x7f94500b2160 2023-11-26T07:21:31.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f944f7fe640 1 -- 172.21.15.70:0/3403957191 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c0abae0 con 0x7f94500b2160 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 -- 172.21.15.70:0/3403957191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 msgr2=0x7f94500d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 --2- 172.21.15.70:0/3403957191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f94500d14b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f94500b5db0 tx=0x7f943c01c500 comp rx=0 tx=0).stop 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 -- 172.21.15.70:0/3403957191 shutdown_connections 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 --2- 172.21.15.70:0/3403957191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f94500d14b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 --2- 172.21.15.70:0/3403957191 >> v2:172.21.15.120:3300/0 conn(0x7f945015d6e0 0x7f94500d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 -- 172.21.15.70:0/3403957191 >> 172.21.15.70:0/3403957191 conn(0x7f945009c550 msgr2=0x7f94500d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 -- 172.21.15.70:0/3403957191 shutdown_connections 2023-11-26T07:21:31.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.125+0000 7f9456a79640 1 -- 172.21.15.70:0/3403957191 wait complete. 2023-11-26T07:21:31.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 Processor -- start 2023-11-26T07:21:31.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 -- start start 2023-11-26T07:21:31.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f9450155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94500d19f0 0x7f94500cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f945015d6e0 0x7f94500cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501565a0 con 0x7f94500b2160 2023-11-26T07:21:31.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9450156880 con 0x7f94500d19f0 2023-11-26T07:21:31.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9450156b60 con 0x7f945015d6e0 2023-11-26T07:21:31.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f9450155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f9450155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36366/0 (socket says 172.21.15.70:36366) 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 -- 172.21.15.70:0/2096784557 learned_addr learned my addr 172.21.15.70:0/2096784557 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f944ffff640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94500d19f0 0x7f94500cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9455016640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f945015d6e0 0x7f94500cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 -- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f945015d6e0 msgr2=0x7f94500cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f945015d6e0 0x7f94500cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 -- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94500d19f0 msgr2=0x7f94500cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94500d19f0 0x7f94500cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 -- 172.21.15.70:0/2096784557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0094d0 con 0x7f94500b2160 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9454815640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f9450155020 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f944400e870 tx=0x7f944400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f944d7fa640 1 -- 172.21.15.70:0/2096784557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444009510 con 0x7f94500b2160 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f944d7fa640 1 -- 172.21.15.70:0/2096784557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400eec0 con 0x7f94500b2160 2023-11-26T07:21:31.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f944d7fa640 1 -- 172.21.15.70:0/2096784557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400cb40 con 0x7f94500b2160 2023-11-26T07:21:31.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9450158310 con 0x7f94500b2160 2023-11-26T07:21:31.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.129+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9450155560 con 0x7f94500b2160 2023-11-26T07:21:31.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.133+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9450158120 con 0x7f94500b2160 2023-11-26T07:21:31.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.133+0000 7f944d7fa640 1 -- 172.21.15.70:0/2096784557 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f944400cca0 con 0x7f94500b2160 2023-11-26T07:21:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.133+0000 7f944d7fa640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9434066a10 0x7f9434068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.133+0000 7f944d7fa640 1 -- 172.21.15.70:0/2096784557 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9444084a90 con 0x7f94500b2160 2023-11-26T07:21:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.133+0000 7f944ffff640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9434066a10 0x7f9434068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.133+0000 7f944ffff640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9434066a10 0x7f9434068ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f943c0af000 tx=0x7f943c0b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.137+0000 7f944d7fa640 1 -- 172.21.15.70:0/2096784557 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9444051630 con 0x7f94500b2160 2023-11-26T07:21:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.297+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9450067680 con 0x7f94500b2160 2023-11-26T07:21:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.297+0000 7f944d7fa640 1 -- 172.21.15.70:0/2096784557 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9444054c50 con 0x7f94500b2160 2023-11-26T07:21:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:21:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9434066a10 msgr2=0x7f9434068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9434066a10 0x7f9434068ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f943c0af000 tx=0x7f943c0b6040 comp rx=0 tx=0).stop 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 msgr2=0x7f9450155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f9450155020 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f944400e870 tx=0x7f944400ec70 comp rx=0 tx=0).stop 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 shutdown_connections 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f945015d6e0 0x7f94500cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94500d19f0 0x7f94500cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9434066a10 0x7f9434068ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 --2- 172.21.15.70:0/2096784557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94500b2160 0x7f9450155020 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 >> 172.21.15.70:0/2096784557 conn(0x7f945009c550 msgr2=0x7f94500cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 shutdown_connections 2023-11-26T07:21:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.301+0000 7f9456a79640 1 -- 172.21.15.70:0/2096784557 wait complete. 2023-11-26T07:21:31.326 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2023-11-26T07:21:31.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:31.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-26T07:21:31.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44329]: fuse finished with error 0 and tester_r 0 2023-11-26T07:21:31.350 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:21:31.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:31.350 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:21:31.463 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:31.464 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:31.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:21:31.473 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:21:31.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:31.473 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-26T07:21:31.522 INFO:teuthology.orchestra.run.smithi070.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-26T07:21:31.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:21:31.523 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:21:31.523 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:31.533 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:21:31.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:21:31.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:21:31.533 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-26T07:21:31.583 INFO:teuthology.orchestra.run.smithi120.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-26T07:21:31.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:21:31.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:31.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.717+0000 7f10f2006640 1 Processor -- start 2023-11-26T07:21:31.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.717+0000 7f10f2006640 1 -- start start 2023-11-26T07:21:31.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10f2006640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f10ec0cf990 0x7f10ec0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10f2006640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10ec070e00 0x7f10ec162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10f2006640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec162080 con 0x7f10ec14b1e0 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10f2006640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec161d70 con 0x7f10ec070e00 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10f2006640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec14b5c0 con 0x7f10ec0cf990 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10ec070e00 0x7f10ec162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10ec070e00 0x7f10ec162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36374/0 (socket says 172.21.15.70:36374) 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 -- 172.21.15.70:0/788396269 learned_addr learned my addr 172.21.15.70:0/788396269 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10e3fff640 1 --2- 172.21.15.70:0/788396269 >> v2:172.21.15.120:3300/0 conn(0x7f10ec0cf990 0x7f10ec0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 -- 172.21.15.70:0/788396269 >> v2:172.21.15.120:3300/0 conn(0x7f10ec0cf990 msgr2=0x7f10ec0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:31.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 --2- 172.21.15.70:0/788396269 >> v2:172.21.15.120:3300/0 conn(0x7f10ec0cf990 0x7f10ec0708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 -- 172.21.15.70:0/788396269 >> v1:172.21.15.70:6789/0 conn(0x7f10ec14b1e0 legacy=0x7f10ec0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 -- 172.21.15.70:0/788396269 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec071580 con 0x7f10ec070e00 2023-11-26T07:21:31.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10ebfff640 1 --2- 172.21.15.70:0/788396269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec070e00 0x7f10ec162510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f10ec06dfa0 tx=0x7f10e401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3a4372e35c09ef server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.721+0000 7f10eaffd640 1 -- 172.21.15.70:0/788396269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40a5860 con 0x7f10ec070e00 2023-11-26T07:21:31.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10eaffd640 1 -- 172.21.15.70:0/788396269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e40a59c0 con 0x7f10ec070e00 2023-11-26T07:21:31.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10eaffd640 1 -- 172.21.15.70:0/788396269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40a5d50 con 0x7f10ec070e00 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- 172.21.15.70:0/788396269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec070e00 msgr2=0x7f10ec162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 --2- 172.21.15.70:0/788396269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec070e00 0x7f10ec162510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f10ec06dfa0 tx=0x7f10e401c9a0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- 172.21.15.70:0/788396269 shutdown_connections 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 --2- 172.21.15.70:0/788396269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec070e00 0x7f10ec162510 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 --2- 172.21.15.70:0/788396269 >> v2:172.21.15.120:3300/0 conn(0x7f10ec0cf990 0x7f10ec0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- 172.21.15.70:0/788396269 >> 172.21.15.70:0/788396269 conn(0x7f10ec06a890 msgr2=0x7f10ec06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- 172.21.15.70:0/788396269 shutdown_connections 2023-11-26T07:21:31.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- 172.21.15.70:0/788396269 wait complete. 2023-11-26T07:21:31.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 Processor -- start 2023-11-26T07:21:31.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- start start 2023-11-26T07:21:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10ec070e00 0x7f10ec16b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10ec0cf990 0x7f10ec14b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec14b1e0 0x7f10ec14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec163a00 con 0x7f10ec14b1e0 2023-11-26T07:21:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec14bfe0 con 0x7f10ec0cf990 2023-11-26T07:21:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10f2006640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec14c2c0 con 0x7f10ec070e00 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10ebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec14b1e0 0x7f10ec14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10ebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec14b1e0 0x7f10ec14d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36382/0 (socket says 172.21.15.70:36382) 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.725+0000 7f10ebfff640 1 -- 172.21.15.70:0/690362641 learned_addr learned my addr 172.21.15.70:0/690362641 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10e3fff640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10ec0cf990 0x7f10ec14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10ebfff640 1 -- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10ec070e00 msgr2=0x7f10ec16b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10eb7fe640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10ec070e00 0x7f10ec16b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10ebfff640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10ec070e00 0x7f10ec16b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10ebfff640 1 -- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10ec0cf990 msgr2=0x7f10ec14b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10ebfff640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10ec0cf990 0x7f10ec14b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10ebfff640 1 -- 172.21.15.70:0/690362641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4009b30 con 0x7f10ec14b1e0 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10e3fff640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10ec0cf990 0x7f10ec14b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10ebfff640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec14b1e0 0x7f10ec14d080 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f10e40195b0 tx=0x7f10e4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10e8ff9640 1 -- 172.21.15.70:0/690362641 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40b8670 con 0x7f10ec14b1e0 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10e8ff9640 1 -- 172.21.15.70:0/690362641 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e40b8810 con 0x7f10ec14b1e0 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10e8ff9640 1 -- 172.21.15.70:0/690362641 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40b8bc0 con 0x7f10ec14b1e0 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec14c5a0 con 0x7f10ec14b1e0 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec14cb60 con 0x7f10ec14b1e0 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec14cd50 con 0x7f10ec14b1e0 2023-11-26T07:21:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.729+0000 7f10e8ff9640 1 -- 172.21.15.70:0/690362641 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f10e40b8d20 con 0x7f10ec14b1e0 2023-11-26T07:21:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.733+0000 7f10e8ff9640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10cc066a10 0x7f10cc068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.733+0000 7f10e8ff9640 1 -- 172.21.15.70:0/690362641 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f10e4120040 con 0x7f10ec14b1e0 2023-11-26T07:21:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.733+0000 7f10eb7fe640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10cc066a10 0x7f10cc068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:31.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.733+0000 7f10eb7fe640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10cc066a10 0x7f10cc068ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f10dc000f70 tx=0x7f10dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.737+0000 7f10e8ff9640 1 -- 172.21.15.70:0/690362641 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10e40ecb70 con 0x7f10ec14b1e0 2023-11-26T07:21:31.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10ec067680 con 0x7f10ec14b1e0 2023-11-26T07:21:31.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10e8ff9640 1 -- 172.21.15.70:0/690362641 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f10e40f0190 con 0x7f10ec14b1e0 2023-11-26T07:21:31.920 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:31.920 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3372803527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3372803527},{"type":"v1","addr":"172.21.15.120:6833","nonce":3372803527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5671,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2241396376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2241396376},{"type":"v1","addr":"172.21.15.120:6835","nonce":2241396376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1311811000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1311811000},{"type":"v1","addr":"172.21.15.70:6835","nonce":1311811000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:31.700041+0000","modified":"2023-11-26T07:20:34.716588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/1491316829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":1491316829},{"type":"v1","addr":"172.21.15.70:6837","nonce":1491316829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:31.921 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2023-11-26T07:21:31.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10cc066a10 msgr2=0x7f10cc068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10cc066a10 0x7f10cc068ed0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f10dc000f70 tx=0x7f10dc009040 comp rx=0 tx=0).stop 2023-11-26T07:21:31.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec14b1e0 msgr2=0x7f10ec14d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec14b1e0 0x7f10ec14d080 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f10e40195b0 tx=0x7f10e4019740 comp rx=0 tx=0).stop 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 shutdown_connections 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f10cc066a10 0x7f10cc068ed0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10ec14b1e0 0x7f10ec14d080 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f10ec0cf990 0x7f10ec14b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 --2- 172.21.15.70:0/690362641 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10ec070e00 0x7f10ec16b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 >> 172.21.15.70:0/690362641 conn(0x7f10ec06a890 msgr2=0x7f10ec0cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 shutdown_connections 2023-11-26T07:21:31.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:31.917+0000 7f10f2006640 1 -- 172.21.15.70:0/690362641 wait complete. 2023-11-26T07:21:31.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:32.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 Processor -- start 2023-11-26T07:21:32.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 -- start start 2023-11-26T07:21:32.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f04dc143ac0 0x7f04dc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f04dc0708b0 0x7f04dc0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc0cf7c0 0x7f04dc0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc143ea0 con 0x7f04dc143ac0 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0cc730 con 0x7f04dc0708b0 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.077+0000 7f04e451d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0cfbd0 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f04dc143ac0 0x7f04dc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f04dc143ac0 0x7f04dc070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36384/0 (socket says 172.21.15.70:36384) 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 -- 172.21.15.70:0/3820197253 learned_addr learned my addr 172.21.15.70:0/3820197253 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e1ab8640 1 --2- 172.21.15.70:0/3820197253 >> v2:172.21.15.120:3300/0 conn(0x7f04dc0708b0 0x7f04dc0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e2aba640 1 --2- 172.21.15.70:0/3820197253 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc0cf7c0 0x7f04dc0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 -- 172.21.15.70:0/3820197253 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc0cf7c0 msgr2=0x7f04dc0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 --2- 172.21.15.70:0/3820197253 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc0cf7c0 0x7f04dc0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 -- 172.21.15.70:0/3820197253 >> v2:172.21.15.120:3300/0 conn(0x7f04dc0708b0 msgr2=0x7f04dc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 --2- 172.21.15.70:0/3820197253 >> v2:172.21.15.120:3300/0 conn(0x7f04dc0708b0 0x7f04dc0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 -- 172.21.15.70:0/3820197253 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc070ee0 con 0x7f04dc143ac0 2023-11-26T07:21:32.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e22b9640 1 --2- 172.21.15.70:0/3820197253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc143ac0 0x7f04dc070370 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0aeb10 tx=0x7f04d801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f91c1cef64fb757 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e12b7640 1 -- 172.21.15.70:0/3820197253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80ab600 con 0x7f04dc143ac0 2023-11-26T07:21:32.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e12b7640 1 -- 172.21.15.70:0/3820197253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80a7050 con 0x7f04dc143ac0 2023-11-26T07:21:32.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.081+0000 7f04e12b7640 1 -- 172.21.15.70:0/3820197253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80ab980 con 0x7f04dc143ac0 2023-11-26T07:21:32.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- 172.21.15.70:0/3820197253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc143ac0 msgr2=0x7f04dc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 --2- 172.21.15.70:0/3820197253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc143ac0 0x7f04dc070370 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0aeb10 tx=0x7f04d801c240 comp rx=0 tx=0).stop 2023-11-26T07:21:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- 172.21.15.70:0/3820197253 shutdown_connections 2023-11-26T07:21:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 --2- 172.21.15.70:0/3820197253 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc0cf7c0 0x7f04dc0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 --2- 172.21.15.70:0/3820197253 >> v2:172.21.15.120:3300/0 conn(0x7f04dc0708b0 0x7f04dc0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 --2- 172.21.15.70:0/3820197253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc143ac0 0x7f04dc070370 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- 172.21.15.70:0/3820197253 >> 172.21.15.70:0/3820197253 conn(0x7f04dc06a890 msgr2=0x7f04dc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- 172.21.15.70:0/3820197253 shutdown_connections 2023-11-26T07:21:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- 172.21.15.70:0/3820197253 wait complete. 2023-11-26T07:21:32.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 Processor -- start 2023-11-26T07:21:32.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- start start 2023-11-26T07:21:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc0708b0 0x7f04dc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc0cf7c0 0x7f04dc159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc143ac0 0x7f04dc13dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0b12e0 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0ce3b0 con 0x7f04dc0708b0 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e451d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0b0660 con 0x7f04dc143ac0 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc0cf7c0 0x7f04dc159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc0cf7c0 0x7f04dc159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36394/0 (socket says 172.21.15.70:36394) 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 -- 172.21.15.70:0/1959382574 learned_addr learned my addr 172.21.15.70:0/1959382574 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e22b9640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc0708b0 0x7f04dc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e2aba640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc143ac0 0x7f04dc13dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 -- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc143ac0 msgr2=0x7f04dc13dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc143ac0 0x7f04dc13dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 -- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc0708b0 msgr2=0x7f04dc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc0708b0 0x7f04dc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.085+0000 7f04e1ab8640 1 -- 172.21.15.70:0/1959382574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80094d0 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04e1ab8640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc0cf7c0 0x7f04dc159b10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d800 tx=0x7f04cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04d2ffd640 1 -- 172.21.15.70:0/1959382574 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0096a0 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04d2ffd640 1 -- 172.21.15.70:0/1959382574 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc009800 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04d2ffd640 1 -- 172.21.15.70:0/1959382574 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc009b70 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc0b0940 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc0b0f00 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc067680 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04d2ffd640 1 -- 172.21.15.70:0/1959382574 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f04cc009cd0 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04d2ffd640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f04c0066a40 0x7f04c0068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04d2ffd640 1 -- 172.21.15.70:0/1959382574 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f04cc084f40 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04e22b9640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f04c0066a40 0x7f04c0068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.089+0000 7f04e22b9640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f04c0066a40 0x7f04c0068f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04d80ad000 tx=0x7f04d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.093+0000 7f04d2ffd640 1 -- 172.21.15.70:0/1959382574 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04cc051b60 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.245+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04dc067cb0 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.245+0000 7f04d2ffd640 1 -- 172.21.15.70:0/1959382574 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16730 (secure 0 0 0) 0x7f04cc055180 con 0x7f04dc0cf7c0 2023-11-26T07:21:32.250 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:32.250 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":52,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:28.813599+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f04c0066a40 msgr2=0x7f04c0068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f04c0066a40 0x7f04c0068f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04d80ad000 tx=0x7f04d8008040 comp rx=0 tx=0).stop 2023-11-26T07:21:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc0cf7c0 msgr2=0x7f04dc159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc0cf7c0 0x7f04dc159b10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d800 tx=0x7f04cc00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 shutdown_connections 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f04c0066a40 0x7f04c0068f00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04dc0cf7c0 0x7f04dc159b10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f04dc143ac0 0x7f04dc13dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 --2- 172.21.15.70:0/1959382574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04dc0708b0 0x7f04dc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 >> 172.21.15.70:0/1959382574 conn(0x7f04dc06a890 msgr2=0x7f04dc0cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 shutdown_connections 2023-11-26T07:21:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.249+0000 7f04e451d640 1 -- 172.21.15.70:0/1959382574 wait complete. 2023-11-26T07:21:32.272 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:20:30.063697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:20:30.697996+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:32.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:32.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.469+0000 7fc70de5a640 1 Processor -- start 2023-11-26T07:21:32.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.469+0000 7fc70de5a640 1 -- start start 2023-11-26T07:21:32.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc70de5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc70813e290 0x7fc7080cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.476 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc70de5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc7080cf7c0 0x7fc70815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc70de5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc70815f4e0 0x7fc7081408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc70de5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080cfc40 con 0x7fc70813e290 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc70de5a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70806c520 con 0x7fc70815f4e0 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc70de5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70806c800 con 0x7fc7080cf7c0 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc70813e290 0x7fc7080cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc70813e290 0x7fc7080cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36404/0 (socket says 172.21.15.70:36404) 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 -- 172.21.15.70:0/1796136044 learned_addr learned my addr 172.21.15.70:0/1796136044 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc707fff640 1 --2- 172.21.15.70:0/1796136044 >> v2:172.21.15.120:3300/0 conn(0x7fc70815f4e0 0x7fc7081408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc706ffd640 1 --2- 172.21.15.70:0/1796136044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc7080cf7c0 0x7fc70815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 -- 172.21.15.70:0/1796136044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc7080cf7c0 msgr2=0x7fc70815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 --2- 172.21.15.70:0/1796136044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc7080cf7c0 0x7fc70815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 -- 172.21.15.70:0/1796136044 >> v2:172.21.15.120:3300/0 conn(0x7fc70815f4e0 msgr2=0x7fc7081408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 --2- 172.21.15.70:0/1796136044 >> v2:172.21.15.120:3300/0 conn(0x7fc70815f4e0 0x7fc7081408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc7077fe640 1 -- 172.21.15.70:0/1796136044 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70806cae0 con 0x7fc70813e290 2023-11-26T07:21:32.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc707fff640 1 --2- 172.21.15.70:0/1796136044 >> v2:172.21.15.120:3300/0 conn(0x7fc70815f4e0 0x7fc7081408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:32.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.473+0000 7fc706ffd640 1 --2- 172.21.15.70:0/1796136044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc7080cf7c0 0x7fc70815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc7077fe640 1 --2- 172.21.15.70:0/1796136044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc70813e290 0x7fc7080cf280 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc708072660 tx=0x7fc6f801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62af846c57b33a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc7067fc640 1 -- 172.21.15.70:0/1796136044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80ab600 con 0x7fc70813e290 2023-11-26T07:21:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc7067fc640 1 -- 172.21.15.70:0/1796136044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f80a7050 con 0x7fc70813e290 2023-11-26T07:21:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc7067fc640 1 -- 172.21.15.70:0/1796136044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80ab980 con 0x7fc70813e290 2023-11-26T07:21:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 -- 172.21.15.70:0/1796136044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc70813e290 msgr2=0x7fc7080cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 --2- 172.21.15.70:0/1796136044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc70813e290 0x7fc7080cf280 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc708072660 tx=0x7fc6f801c210 comp rx=0 tx=0).stop 2023-11-26T07:21:32.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 -- 172.21.15.70:0/1796136044 shutdown_connections 2023-11-26T07:21:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 --2- 172.21.15.70:0/1796136044 >> v2:172.21.15.120:3300/0 conn(0x7fc70815f4e0 0x7fc7081408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 --2- 172.21.15.70:0/1796136044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc7080cf7c0 0x7fc70815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 --2- 172.21.15.70:0/1796136044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc70813e290 0x7fc7080cf280 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 -- 172.21.15.70:0/1796136044 >> 172.21.15.70:0/1796136044 conn(0x7fc70806a890 msgr2=0x7fc70806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 -- 172.21.15.70:0/1796136044 shutdown_connections 2023-11-26T07:21:32.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 -- 172.21.15.70:0/1796136044 wait complete. 2023-11-26T07:21:32.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 Processor -- start 2023-11-26T07:21:32.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.477+0000 7fc70de5a640 1 -- start start 2023-11-26T07:21:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7080cf7c0 0x7fc708154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc70813e290 0x7fc7080b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc70815f4e0 0x7fc7080b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815d8a0 con 0x7fc7080cf7c0 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815cc90 con 0x7fc70813e290 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815cf70 con 0x7fc70815f4e0 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7080cf7c0 0x7fc708154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7080cf7c0 0x7fc708154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36416/0 (socket says 172.21.15.70:36416) 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 -- 172.21.15.70:0/4221773359 learned_addr learned my addr 172.21.15.70:0/4221773359 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc707fff640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc70815f4e0 0x7fc7080b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc706ffd640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc70813e290 0x7fc7080b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 -- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc70815f4e0 msgr2=0x7fc7080b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc70815f4e0 0x7fc7080b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 -- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc70813e290 msgr2=0x7fc7080b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc70813e290 0x7fc7080b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 -- 172.21.15.70:0/4221773359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80094d0 con 0x7fc7080cf7c0 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc706ffd640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc70813e290 0x7fc7080b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc7077fe640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7080cf7c0 0x7fc708154770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80ae040 tx=0x7fc6f801aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc6effff640 1 -- 172.21.15.70:0/4221773359 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80b6620 con 0x7fc7080cf7c0 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc6effff640 1 -- 172.21.15.70:0/4221773359 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f80b67a0 con 0x7fc7080cf7c0 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70815d250 con 0x7fc7080cf7c0 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc6effff640 1 -- 172.21.15.70:0/4221773359 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80b6b50 con 0x7fc7080cf7c0 2023-11-26T07:21:32.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc708154cb0 con 0x7fc7080cf7c0 2023-11-26T07:21:32.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708067680 con 0x7fc7080cf7c0 2023-11-26T07:21:32.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.481+0000 7fc6effff640 1 -- 172.21.15.70:0/4221773359 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fc6f80b2040 con 0x7fc7080cf7c0 2023-11-26T07:21:32.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.485+0000 7fc6effff640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc6f4066a10 0x7fc6f4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.485+0000 7fc6effff640 1 -- 172.21.15.70:0/4221773359 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc6f811edc0 con 0x7fc7080cf7c0 2023-11-26T07:21:32.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.485+0000 7fc706ffd640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc6f4066a10 0x7fc6f4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.485+0000 7fc706ffd640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc6f4066a10 0x7fc6f4068ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc006fd0 tx=0x7fc6fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.489+0000 7fc6effff640 1 -- 172.21.15.70:0/4221773359 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6f80eb7d0 con 0x7fc7080cf7c0 2023-11-26T07:21:32.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.637+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc70815f2c0 con 0x7fc7080cf7c0 2023-11-26T07:21:32.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.637+0000 7fc6effff640 1 -- 172.21.15.70:0/4221773359 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6f80b0020 con 0x7fc7080cf7c0 2023-11-26T07:21:32.642 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:21:32.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc6f4066a10 msgr2=0x7fc6f4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc6f4066a10 0x7fc6f4068ed0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc006fd0 tx=0x7fc6fc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7080cf7c0 msgr2=0x7fc708154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7080cf7c0 0x7fc708154770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80ae040 tx=0x7fc6f801aa50 comp rx=0 tx=0).stop 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 shutdown_connections 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc70815f4e0 0x7fc7080b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc70813e290 0x7fc7080b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc6f4066a10 0x7fc6f4068ed0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 --2- 172.21.15.70:0/4221773359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7080cf7c0 0x7fc708154770 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 >> 172.21.15.70:0/4221773359 conn(0x7fc70806a890 msgr2=0x7fc70815a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 shutdown_connections 2023-11-26T07:21:32.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.641+0000 7fc70de5a640 1 -- 172.21.15.70:0/4221773359 wait complete. 2023-11-26T07:21:32.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:21:32.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 Processor -- start 2023-11-26T07:21:32.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 -- start start 2023-11-26T07:21:32.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f73b815d580 0x7f73b80d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b80d3e60 0x7f73b80d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f73b80d1d30 0x7f73b80cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b80d21e0 con 0x7f73b815d580 2023-11-26T07:21:32.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b80d0bc0 con 0x7f73b80d1d30 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73be254640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80d0320 con 0x7f73b80d3e60 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f73b815d580 0x7f73b80d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f73b815d580 0x7f73b80d3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36422/0 (socket says 172.21.15.70:36422) 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 -- 172.21.15.70:0/2263497570 learned_addr learned my addr 172.21.15.70:0/2263497570 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b6ffd640 1 --2- 172.21.15.70:0/2263497570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b80d3e60 0x7f73b80d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b7fff640 1 --2- 172.21.15.70:0/2263497570 >> v2:172.21.15.120:3300/0 conn(0x7f73b80d1d30 0x7f73b80cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 -- 172.21.15.70:0/2263497570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b80d3e60 msgr2=0x7f73b80d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 --2- 172.21.15.70:0/2263497570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b80d3e60 0x7f73b80d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 -- 172.21.15.70:0/2263497570 >> v2:172.21.15.120:3300/0 conn(0x7f73b80d1d30 msgr2=0x7f73b80cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 --2- 172.21.15.70:0/2263497570 >> v2:172.21.15.120:3300/0 conn(0x7f73b80d1d30 0x7f73b80cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.801+0000 7f73b77fe640 1 -- 172.21.15.70:0/2263497570 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b80d0600 con 0x7f73b815d580 2023-11-26T07:21:32.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73b77fe640 1 --2- 172.21.15.70:0/2263497570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b815d580 0x7f73b80d3920 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f73b80b20c0 tx=0x7f73a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33904d35bf71933 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73b67fc640 1 -- 172.21.15.70:0/2263497570 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a80aa5f0 con 0x7f73b815d580 2023-11-26T07:21:32.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73b67fc640 1 -- 172.21.15.70:0/2263497570 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a80aa750 con 0x7f73b815d580 2023-11-26T07:21:32.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73b67fc640 1 -- 172.21.15.70:0/2263497570 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a80aaae0 con 0x7f73b815d580 2023-11-26T07:21:32.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 -- 172.21.15.70:0/2263497570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b815d580 msgr2=0x7f73b80d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 --2- 172.21.15.70:0/2263497570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b815d580 0x7f73b80d3920 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f73b80b20c0 tx=0x7f73a801c4d0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 -- 172.21.15.70:0/2263497570 shutdown_connections 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 --2- 172.21.15.70:0/2263497570 >> v2:172.21.15.120:3300/0 conn(0x7f73b80d1d30 0x7f73b80cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 --2- 172.21.15.70:0/2263497570 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b80d3e60 0x7f73b80d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 --2- 172.21.15.70:0/2263497570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b815d580 0x7f73b80d3920 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 -- 172.21.15.70:0/2263497570 >> 172.21.15.70:0/2263497570 conn(0x7f73b809c550 msgr2=0x7f73b80d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 -- 172.21.15.70:0/2263497570 shutdown_connections 2023-11-26T07:21:32.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.805+0000 7f73be254640 1 -- 172.21.15.70:0/2263497570 wait complete. 2023-11-26T07:21:32.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 Processor -- start 2023-11-26T07:21:32.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 -- start start 2023-11-26T07:21:32.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b80d1d30 0x7f73b80b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b80d3e60 0x7f73b8154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b815d580 0x7f73b815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80b7460 con 0x7f73b80d1d30 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80b68e0 con 0x7f73b80d3e60 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80b6bc0 con 0x7f73b815d580 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b80d1d30 0x7f73b80b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b80d1d30 0x7f73b80b6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36428/0 (socket says 172.21.15.70:36428) 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 -- 172.21.15.70:0/191233994 learned_addr learned my addr 172.21.15.70:0/191233994 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b6ffd640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b80d3e60 0x7f73b8154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b7fff640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b815d580 0x7f73b815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 -- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b815d580 msgr2=0x7f73b815ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b815d580 0x7f73b815ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 -- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b80d3e60 msgr2=0x7f73b8154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b80d3e60 0x7f73b8154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 -- 172.21.15.70:0/191233994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80094d0 con 0x7f73b80d1d30 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b6ffd640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b80d3e60 0x7f73b8154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73b77fe640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b80d1d30 0x7f73b80b6060 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f73a801ab80 tx=0x7f73a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f739ffff640 1 -- 172.21.15.70:0/191233994 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a80b3800 con 0x7f73b80d1d30 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f739ffff640 1 -- 172.21.15.70:0/191233994 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a80b3980 con 0x7f73b80d1d30 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b80b6ea0 con 0x7f73b80d1d30 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f739ffff640 1 -- 172.21.15.70:0/191233994 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a80b3d30 con 0x7f73b80d1d30 2023-11-26T07:21:32.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.809+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b80b65a0 con 0x7f73b80d1d30 2023-11-26T07:21:32.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.813+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b8067680 con 0x7f73b80d1d30 2023-11-26T07:21:32.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.813+0000 7f739ffff640 1 -- 172.21.15.70:0/191233994 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f73a80b2380 con 0x7f73b80d1d30 2023-11-26T07:21:32.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.813+0000 7f739ffff640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f73a4066a40 0x7f73a4068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:32.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.813+0000 7f739ffff640 1 -- 172.21.15.70:0/191233994 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f73a80a7070 con 0x7f73b80d1d30 2023-11-26T07:21:32.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.813+0000 7f73b6ffd640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f73a4066a40 0x7f73a4068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:32.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.813+0000 7f73b6ffd640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f73a4066a40 0x7f73a4068f00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f73b80b51c0 tx=0x7f73ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:32.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.817+0000 7f739ffff640 1 -- 172.21.15.70:0/191233994 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73a80ebb90 con 0x7f73b80d1d30 2023-11-26T07:21:32.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.969+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73b80b6d00 con 0x7f73b80d1d30 2023-11-26T07:21:32.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.969+0000 7f739ffff640 1 -- 172.21.15.70:0/191233994 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73b80b6d00 con 0x7f73b80d1d30 2023-11-26T07:21:32.974 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f73a4066a40 msgr2=0x7f73a4068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f73a4066a40 0x7f73a4068f00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f73b80b51c0 tx=0x7f73ac008040 comp rx=0 tx=0).stop 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b80d1d30 msgr2=0x7f73b80b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b80d1d30 0x7f73b80b6060 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f73a801ab80 tx=0x7f73a801ad10 comp rx=0 tx=0).stop 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 shutdown_connections 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f73b815d580 0x7f73b815ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73b80d3e60 0x7f73b8154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f73a4066a40 0x7f73a4068f00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 --2- 172.21.15.70:0/191233994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73b80d1d30 0x7f73b80b6060 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:32.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 >> 172.21.15.70:0/191233994 conn(0x7f73b809c550 msgr2=0x7f73b815ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:32.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 shutdown_connections 2023-11-26T07:21:32.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:32.973+0000 7f73be254640 1 -- 172.21.15.70:0/191233994 wait complete. 2023-11-26T07:21:32.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:21:33.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11da92a640 1 Processor -- start 2023-11-26T07:21:33.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11da92a640 1 -- start start 2023-11-26T07:21:33.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11da92a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d415d6e0 0x7f11d40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11da92a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11d40d1bc0 0x7f11d40b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11da92a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d40cf0e0 con 0x7f11d40b2160 2023-11-26T07:21:33.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11da92a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d415dac0 con 0x7f11d40d1bc0 2023-11-26T07:21:33.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11da92a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d40ceb20 con 0x7f11d415d6e0 2023-11-26T07:21:33.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d8ec7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11d40d1bc0 0x7f11d40b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d8ec7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11d40d1bc0 0x7f11d40b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:34550/0 (socket says 172.21.15.70:34550) 2023-11-26T07:21:33.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d37fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f11d40b2160 0x7f11d40d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:51110/0 (socket says 172.21.15.70:51110) 2023-11-26T07:21:33.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d3fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d415d6e0 0x7f11d40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d8ec7640 1 -- 172.21.15.70:0/1977234607 learned_addr learned my addr 172.21.15.70:0/1977234607 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:33.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d3fff640 1 -- 172.21.15.70:0/1977234607 >> v2:172.21.15.120:3300/0 conn(0x7f11d40d1bc0 msgr2=0x7f11d40b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:33.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d3fff640 1 --2- 172.21.15.70:0/1977234607 >> v2:172.21.15.120:3300/0 conn(0x7f11d40d1bc0 0x7f11d40b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d3fff640 1 -- 172.21.15.70:0/1977234607 >> v1:172.21.15.120:6789/0 conn(0x7f11d40b2160 legacy=0x7f11d40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d3fff640 1 -- 172.21.15.70:0/1977234607 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40cee00 con 0x7f11d415d6e0 2023-11-26T07:21:33.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.133+0000 7f11d8ec7640 1 --2- 172.21.15.70:0/1977234607 >> v2:172.21.15.120:3300/0 conn(0x7f11d40d1bc0 0x7f11d40b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:33.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11d3fff640 1 --2- 172.21.15.70:0/1977234607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d415d6e0 0x7f11d40d0df0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097c0 tx=0x7f11c401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced761f48165d2d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11d2ffd640 1 -- 172.21.15.70:0/1977234607 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40ab600 con 0x7f11d415d6e0 2023-11-26T07:21:33.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11d2ffd640 1 -- 172.21.15.70:0/1977234607 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c40a7050 con 0x7f11d415d6e0 2023-11-26T07:21:33.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11d2ffd640 1 -- 172.21.15.70:0/1977234607 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40ab980 con 0x7f11d415d6e0 2023-11-26T07:21:33.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 -- 172.21.15.70:0/1977234607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d415d6e0 msgr2=0x7f11d40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 --2- 172.21.15.70:0/1977234607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d415d6e0 0x7f11d40d0df0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11c40097c0 tx=0x7f11c401c480 comp rx=0 tx=0).stop 2023-11-26T07:21:33.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 -- 172.21.15.70:0/1977234607 shutdown_connections 2023-11-26T07:21:33.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 --2- 172.21.15.70:0/1977234607 >> v2:172.21.15.120:3300/0 conn(0x7f11d40d1bc0 0x7f11d40b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 --2- 172.21.15.70:0/1977234607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d415d6e0 0x7f11d40d0df0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 -- 172.21.15.70:0/1977234607 >> 172.21.15.70:0/1977234607 conn(0x7f11d409c550 msgr2=0x7f11d40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 -- 172.21.15.70:0/1977234607 shutdown_connections 2023-11-26T07:21:33.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.137+0000 7f11da92a640 1 -- 172.21.15.70:0/1977234607 wait complete. 2023-11-26T07:21:33.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 Processor -- start 2023-11-26T07:21:33.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 -- start start 2023-11-26T07:21:33.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d40b2160 0x7f11d4152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d40d1bc0 0x7f11d40cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11d415d6e0 0x7f11d40cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d41530c0 con 0x7f11d415d6e0 2023-11-26T07:21:33.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4159370 con 0x7f11d40d1bc0 2023-11-26T07:21:33.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4159650 con 0x7f11d40b2160 2023-11-26T07:21:33.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11d415d6e0 0x7f11d40cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11d415d6e0 0x7f11d40cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36446/0 (socket says 172.21.15.70:36446) 2023-11-26T07:21:33.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 -- 172.21.15.70:0/194395983 learned_addr learned my addr 172.21.15.70:0/194395983 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:33.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d3fff640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d40b2160 0x7f11d4152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d37fe640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d40d1bc0 0x7f11d40cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 -- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d40b2160 msgr2=0x7f11d4152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d40b2160 0x7f11d4152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 -- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d40d1bc0 msgr2=0x7f11d40cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d40d1bc0 0x7f11d40cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 -- 172.21.15.70:0/194395983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc009b30 con 0x7f11d415d6e0 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d8ec7640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11d415d6e0 0x7f11d40cf490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00efc0 tx=0x7f11cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d0ff9640 1 -- 172.21.15.70:0/194395983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc018070 con 0x7f11d415d6e0 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d0ff9640 1 -- 172.21.15.70:0/194395983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc00f040 con 0x7f11d415d6e0 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c4009420 con 0x7f11d415d6e0 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11d0ff9640 1 -- 172.21.15.70:0/194395983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc00ce00 con 0x7f11d415d6e0 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.141+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d4159c10 con 0x7f11d415d6e0 2023-11-26T07:21:33.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.145+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d4067680 con 0x7f11d415d6e0 2023-11-26T07:21:33.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.145+0000 7f11d0ff9640 1 -- 172.21.15.70:0/194395983 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f11cc014480 con 0x7f11d415d6e0 2023-11-26T07:21:33.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.145+0000 7f11d0ff9640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11c0066a10 0x7f11c0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.145+0000 7f11d0ff9640 1 -- 172.21.15.70:0/194395983 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f11cc084d20 con 0x7f11d415d6e0 2023-11-26T07:21:33.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.145+0000 7f11d3fff640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11c0066a10 0x7f11c0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.145+0000 7f11d3fff640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11c0066a10 0x7f11c0068ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f11c40ad000 tx=0x7f11c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.149+0000 7f11d0ff9640 1 -- 172.21.15.70:0/194395983 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11cc051850 con 0x7f11d415d6e0 2023-11-26T07:21:33.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.297+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11d415fc20 con 0x7f11d415d6e0 2023-11-26T07:21:33.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.297+0000 7f11d0ff9640 1 -- 172.21.15.70:0/194395983 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11cc054e70 con 0x7f11d415d6e0 2023-11-26T07:21:33.302 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:21:33.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11c0066a10 msgr2=0x7f11c0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11c0066a10 0x7f11c0068ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f11c40ad000 tx=0x7f11c4008040 comp rx=0 tx=0).stop 2023-11-26T07:21:33.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11d415d6e0 msgr2=0x7f11d40cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11d415d6e0 0x7f11d40cf490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00efc0 tx=0x7f11cc00c490 comp rx=0 tx=0).stop 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 shutdown_connections 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f11c0066a10 0x7f11c0068ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11d415d6e0 0x7f11d40cf490 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11d40d1bc0 0x7f11d40cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 --2- 172.21.15.70:0/194395983 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f11d40b2160 0x7f11d4152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 >> 172.21.15.70:0/194395983 conn(0x7f11d409c550 msgr2=0x7f11d4160520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 shutdown_connections 2023-11-26T07:21:33.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.301+0000 7f11da92a640 1 -- 172.21.15.70:0/194395983 wait complete. 2023-11-26T07:21:33.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:33.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08d10e640 1 Processor -- start 2023-11-26T07:21:33.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08d10e640 1 -- start start 2023-11-26T07:21:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08d10e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb08806b190 0x7fb088146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08d10e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb08806a490 0x7fb08806a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08d10e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb088146380 con 0x7fb088145fa0 2023-11-26T07:21:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08d10e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb088071480 con 0x7fb08806a490 2023-11-26T07:21:33.462 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08d10e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb088072000 con 0x7fb08806b190 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08759e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb08806a490 0x7fb08806a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08759e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb08806a490 0x7fb08806a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36450/0 (socket says 172.21.15.70:36450) 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08759e640 1 -- 172.21.15.70:0/3585557187 learned_addr learned my addr 172.21.15.70:0/3585557187 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb07e59c640 1 --2- 172.21.15.70:0/3585557187 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb08806b190 0x7fb088146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08759e640 1 -- 172.21.15.70:0/3585557187 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb08806b190 msgr2=0x7fb088146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08759e640 1 --2- 172.21.15.70:0/3585557187 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb08806b190 0x7fb088146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08759e640 1 -- 172.21.15.70:0/3585557187 >> v1:172.21.15.120:6789/0 conn(0x7fb088145fa0 legacy=0x7fb088072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb08759e640 1 -- 172.21.15.70:0/3585557187 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088071660 con 0x7fb08806a490 2023-11-26T07:21:33.463 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.457+0000 7fb07e59c640 1 --2- 172.21.15.70:0/3585557187 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb08806b190 0x7fb088146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08759e640 1 --2- 172.21.15.70:0/3585557187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806a490 0x7fb08806a920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e50 tx=0x7fb08001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d069f0b2f4ce9303 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08659c640 1 -- 172.21.15.70:0/3585557187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0800a57d0 con 0x7fb08806a490 2023-11-26T07:21:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08659c640 1 -- 172.21.15.70:0/3585557187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0800a5930 con 0x7fb08806a490 2023-11-26T07:21:33.465 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08659c640 1 -- 172.21.15.70:0/3585557187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0800a5cc0 con 0x7fb08806a490 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 -- 172.21.15.70:0/3585557187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806a490 msgr2=0x7fb08806a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 --2- 172.21.15.70:0/3585557187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806a490 0x7fb08806a920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e50 tx=0x7fb08001ca10 comp rx=0 tx=0).stop 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 -- 172.21.15.70:0/3585557187 shutdown_connections 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 --2- 172.21.15.70:0/3585557187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806a490 0x7fb08806a920 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 --2- 172.21.15.70:0/3585557187 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb08806b190 0x7fb088146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 -- 172.21.15.70:0/3585557187 >> 172.21.15.70:0/3585557187 conn(0x7fb0880cff00 msgr2=0x7fb0880d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 -- 172.21.15.70:0/3585557187 shutdown_connections 2023-11-26T07:21:33.466 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.461+0000 7fb08d10e640 1 -- 172.21.15.70:0/3585557187 wait complete. 2023-11-26T07:21:33.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 Processor -- start 2023-11-26T07:21:33.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 -- start start 2023-11-26T07:21:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08806a490 0x7fb08815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806b190 0x7fb08813d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb088145fa0 0x7fb08815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cd4e0 con 0x7fb08806b190 2023-11-26T07:21:33.470 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cd820 con 0x7fb08806a490 2023-11-26T07:21:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cdb00 con 0x7fb088145fa0 2023-11-26T07:21:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806b190 0x7fb08813d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806b190 0x7fb08813d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36466/0 (socket says 172.21.15.70:36466) 2023-11-26T07:21:33.471 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 -- 172.21.15.70:0/2383341926 learned_addr learned my addr 172.21.15.70:0/2383341926 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb086d9d640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08806a490 0x7fb08815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08759e640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb088145fa0 0x7fb08815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 -- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb088145fa0 msgr2=0x7fb08815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb088145fa0 0x7fb08815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 -- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08806a490 msgr2=0x7fb08815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.472 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08806a490 0x7fb08815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 -- 172.21.15.70:0/2383341926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009b30 con 0x7fb08806b190 2023-11-26T07:21:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07e59c640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806b190 0x7fb08813d590 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb07800d800 tx=0x7fb07800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07ffff640 1 -- 172.21.15.70:0/2383341926 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0780096a0 con 0x7fb08806b190 2023-11-26T07:21:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07ffff640 1 -- 172.21.15.70:0/2383341926 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb078009800 con 0x7fb08806b190 2023-11-26T07:21:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb07ffff640 1 -- 172.21.15.70:0/2383341926 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078009bb0 con 0x7fb08806b190 2023-11-26T07:21:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0880cdde0 con 0x7fb08806b190 2023-11-26T07:21:33.473 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.465+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08815dee0 con 0x7fb08806b190 2023-11-26T07:21:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.469+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb088067680 con 0x7fb08806b190 2023-11-26T07:21:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.469+0000 7fb07ffff640 1 -- 172.21.15.70:0/2383341926 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb078009d10 con 0x7fb08806b190 2023-11-26T07:21:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.469+0000 7fb07ffff640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb068066a10 0x7fb068068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.469+0000 7fb07ffff640 1 -- 172.21.15.70:0/2383341926 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb078084e20 con 0x7fb08806b190 2023-11-26T07:21:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.469+0000 7fb086d9d640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb068066a10 0x7fb068068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.469+0000 7fb086d9d640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb068066a10 0x7fb068068ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb0880681d0 tx=0x7fb070009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.473+0000 7fb07ffff640 1 -- 172.21.15.70:0/2383341926 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb078051a20 con 0x7fb08806b190 2023-11-26T07:21:33.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.653+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0880aee70 con 0x7fb08806b190 2023-11-26T07:21:33.657 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.653+0000 7fb07ffff640 1 -- 172.21.15.70:0/2383341926 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fb078055040 con 0x7fb08806b190 2023-11-26T07:21:33.658 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:33.658 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3372803527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3372803527},{"type":"v1","addr":"172.21.15.120:6833","nonce":3372803527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5671,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2241396376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2241396376},{"type":"v1","addr":"172.21.15.120:6835","nonce":2241396376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1311811000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1311811000},{"type":"v1","addr":"172.21.15.70:6835","nonce":1311811000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:31.700041+0000","modified":"2023-11-26T07:20:34.716588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/1491316829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":1491316829},{"type":"v1","addr":"172.21.15.70:6837","nonce":1491316829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:33.658 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb068066a10 msgr2=0x7fb068068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb068066a10 0x7fb068068ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb0880681d0 tx=0x7fb070009040 comp rx=0 tx=0).stop 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806b190 msgr2=0x7fb08813d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806b190 0x7fb08813d590 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb07800d800 tx=0x7fb07800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 shutdown_connections 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb068066a10 0x7fb068068ed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb08806b190 0x7fb08813d590 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb088145fa0 0x7fb08815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 --2- 172.21.15.70:0/2383341926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08806a490 0x7fb08815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 >> 172.21.15.70:0/2383341926 conn(0x7fb0880cff00 msgr2=0x7fb0880ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 shutdown_connections 2023-11-26T07:21:33.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.657+0000 7fb08d10e640 1 -- 172.21.15.70:0/2383341926 wait complete. 2023-11-26T07:21:33.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:33.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccd5a32640 1 Processor -- start 2023-11-26T07:21:33.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccd5a32640 1 -- start start 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccd5a32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccd5a32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fccd00b2160 0x7fccd00d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccd5a32640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00cf0e0 con 0x7fccd00d19f0 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccd5a32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd015dac0 con 0x7fccd00b2160 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccd5a32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00d1e80 con 0x7fccd015d6e0 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccce7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fccd00b2160 0x7fccd00d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccce7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fccd00b2160 0x7fccd00d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53974/0 (socket says 172.21.15.70:53974) 2023-11-26T07:21:33.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccce7fc640 1 -- 172.21.15.70:0/3182322636 learned_addr learned my addr 172.21.15.70:0/3182322636 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fcccf7fe640 1 --1- 172.21.15.70:0/3182322636 >> v1:172.21.15.70:6789/0 conn(0x7fccd00d19f0 0x7fccd00cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34828/0 (socket says 172.21.15.70:34828) 2023-11-26T07:21:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccceffd640 1 --2- 172.21.15.70:0/3182322636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccce7fc640 1 -- 172.21.15.70:0/3182322636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 msgr2=0x7fccd00d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccce7fc640 1 --2- 172.21.15.70:0/3182322636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccce7fc640 1 -- 172.21.15.70:0/3182322636 >> v1:172.21.15.70:6789/0 conn(0x7fccd00d19f0 legacy=0x7fccd00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.813+0000 7fccce7fc640 1 -- 172.21.15.70:0/3182322636 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00ceb20 con 0x7fccd00b2160 2023-11-26T07:21:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccce7fc640 1 --2- 172.21.15.70:0/3182322636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00b2160 0x7fccd00d14b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009870 tx=0x7fccc401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862cbc2e2d3c4478 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fcccdffb640 1 -- 172.21.15.70:0/3182322636 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc40a7070 con 0x7fccd00b2160 2023-11-26T07:21:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fcccdffb640 1 -- 172.21.15.70:0/3182322636 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc40ab430 con 0x7fccd00b2160 2023-11-26T07:21:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fcccdffb640 1 -- 172.21.15.70:0/3182322636 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc40ab7c0 con 0x7fccd00b2160 2023-11-26T07:21:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 -- 172.21.15.70:0/3182322636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00b2160 msgr2=0x7fccd00d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 --2- 172.21.15.70:0/3182322636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00b2160 0x7fccd00d14b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009870 tx=0x7fccc401c540 comp rx=0 tx=0).stop 2023-11-26T07:21:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 -- 172.21.15.70:0/3182322636 shutdown_connections 2023-11-26T07:21:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 --2- 172.21.15.70:0/3182322636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00b2160 0x7fccd00d14b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 --2- 172.21.15.70:0/3182322636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 -- 172.21.15.70:0/3182322636 >> 172.21.15.70:0/3182322636 conn(0x7fccd009c550 msgr2=0x7fccd00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 -- 172.21.15.70:0/3182322636 shutdown_connections 2023-11-26T07:21:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.817+0000 7fccd5a32640 1 -- 172.21.15.70:0/3182322636 wait complete. 2023-11-26T07:21:33.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 Processor -- start 2023-11-26T07:21:33.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 -- start start 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccd00b2160 0x7fccd015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00d19f0 0x7fccd00b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd015c2c0 con 0x7fccd00d19f0 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00c8140 con 0x7fccd00b2160 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00b3330 con 0x7fccd015d6e0 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00d19f0 0x7fccd00b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00d19f0 0x7fccd00b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53990/0 (socket says 172.21.15.70:53990) 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 -- 172.21.15.70:0/1584049361 learned_addr learned my addr 172.21.15.70:0/1584049361 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:33.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccceffd640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccd00b2160 0x7fccd015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fcccf7fe640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 -- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 msgr2=0x7fccd00b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 -- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccd00b2160 msgr2=0x7fccd015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccd00b2160 0x7fccd015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 -- 172.21.15.70:0/1584049361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40094d0 con 0x7fccd00d19f0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccceffd640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccd00b2160 0x7fccd015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccce7fc640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00d19f0 0x7fccd00b29c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fccc401a170 tx=0x7fccc40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccb7fff640 1 -- 172.21.15.70:0/1584049361 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc40ba070 con 0x7fccd00d19f0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccb7fff640 1 -- 172.21.15.70:0/1584049361 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc40b4420 con 0x7fccd00d19f0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd00b3610 con 0x7fccd00d19f0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccb7fff640 1 -- 172.21.15.70:0/1584049361 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc40b47d0 con 0x7fccd00d19f0 2023-11-26T07:21:33.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.821+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd00c7dd0 con 0x7fccd00d19f0 2023-11-26T07:21:33.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.825+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd00b3ac0 con 0x7fccd00d19f0 2023-11-26T07:21:33.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.825+0000 7fccb7fff640 1 -- 172.21.15.70:0/1584049361 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fccc40b4930 con 0x7fccd00d19f0 2023-11-26T07:21:33.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.825+0000 7fccb7fff640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccbc066a10 0x7fccbc068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:33.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.825+0000 7fccb7fff640 1 -- 172.21.15.70:0/1584049361 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fccc411e470 con 0x7fccd00d19f0 2023-11-26T07:21:33.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.825+0000 7fccceffd640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccbc066a10 0x7fccbc068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:33.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.825+0000 7fccceffd640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccbc066a10 0x7fccbc068ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fccd00b5cf0 tx=0x7fccc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:33.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.829+0000 7fccb7fff640 1 -- 172.21.15.70:0/1584049361 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccc40eaf10 con 0x7fccd00d19f0 2023-11-26T07:21:33.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd0067680 con 0x7fccd00d19f0 2023-11-26T07:21:33.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccb7fff640 1 -- 172.21.15.70:0/1584049361 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16730 (secure 0 0 0) 0x7fccc40ee530 con 0x7fccd00d19f0 2023-11-26T07:21:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:33.985 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":52,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:28.813599+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccbc066a10 msgr2=0x7fccbc068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccbc066a10 0x7fccbc068ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fccd00b5cf0 tx=0x7fccc0008040 comp rx=0 tx=0).stop 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00d19f0 msgr2=0x7fccd00b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00d19f0 0x7fccd00b29c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fccc401a170 tx=0x7fccc40192e0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 shutdown_connections 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fccbc066a10 0x7fccbc068ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccd00d19f0 0x7fccd00b29c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fccd015d6e0 0x7fccd00b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 --2- 172.21.15.70:0/1584049361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fccd00b2160 0x7fccd015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:33.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 >> 172.21.15.70:0/1584049361 conn(0x7fccd009c550 msgr2=0x7fccd00cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:33.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 shutdown_connections 2023-11-26T07:21:33.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:33.981+0000 7fccd5a32640 1 -- 172.21.15.70:0/1584049361 wait complete. 2023-11-26T07:21:34.007 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:21:34.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:34.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.141+0000 7f48cf12a640 1 Processor -- start 2023-11-26T07:21:34.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.141+0000 7f48cf12a640 1 -- start start 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48cf12a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f48c815d6e0 0x7f48c80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48cf12a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48cf12a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c80cf0e0 con 0x7f48c80b2160 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48cf12a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c815dac0 con 0x7f48c815d6e0 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48cf12a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c80ceb20 con 0x7f48c80d1bc0 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48ccec6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f48c815d6e0 0x7f48c80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48ccec6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f48c815d6e0 0x7f48c80d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54004/0 (socket says 172.21.15.70:54004) 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48ccec6640 1 -- 172.21.15.70:0/4216630042 learned_addr learned my addr 172.21.15.70:0/4216630042 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:34.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48cd6c7640 1 --2- 172.21.15.70:0/4216630042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48ccec6640 1 -- 172.21.15.70:0/4216630042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 msgr2=0x7f48c80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48ccec6640 1 --2- 172.21.15.70:0/4216630042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48ccec6640 1 -- 172.21.15.70:0/4216630042 >> v1:172.21.15.70:6789/0 conn(0x7f48c80b2160 legacy=0x7f48c80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.145+0000 7f48ccec6640 1 -- 172.21.15.70:0/4216630042 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c80cee00 con 0x7f48c815d6e0 2023-11-26T07:21:34.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48ccec6640 1 --2- 172.21.15.70:0/4216630042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c815d6e0 0x7f48c80d0df0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009870 tx=0x7f48c401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd96deda41d60ba server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48bf7fe640 1 -- 172.21.15.70:0/4216630042 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40a7070 con 0x7f48c815d6e0 2023-11-26T07:21:34.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48bf7fe640 1 -- 172.21.15.70:0/4216630042 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c40ab430 con 0x7f48c815d6e0 2023-11-26T07:21:34.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48bf7fe640 1 -- 172.21.15.70:0/4216630042 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40ab7c0 con 0x7f48c815d6e0 2023-11-26T07:21:34.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 -- 172.21.15.70:0/4216630042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c815d6e0 msgr2=0x7f48c80d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 --2- 172.21.15.70:0/4216630042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c815d6e0 0x7f48c80d0df0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009870 tx=0x7f48c401c540 comp rx=0 tx=0).stop 2023-11-26T07:21:34.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 -- 172.21.15.70:0/4216630042 shutdown_connections 2023-11-26T07:21:34.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 --2- 172.21.15.70:0/4216630042 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 --2- 172.21.15.70:0/4216630042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c815d6e0 0x7f48c80d0df0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 -- 172.21.15.70:0/4216630042 >> 172.21.15.70:0/4216630042 conn(0x7f48c809c550 msgr2=0x7f48c80d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 -- 172.21.15.70:0/4216630042 shutdown_connections 2023-11-26T07:21:34.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 -- 172.21.15.70:0/4216630042 wait complete. 2023-11-26T07:21:34.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 Processor -- start 2023-11-26T07:21:34.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.149+0000 7f48cf12a640 1 -- start start 2023-11-26T07:21:34.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c80b2160 0x7f48c815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48c815d6e0 0x7f48c815f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8154b90 con 0x7f48c80b2160 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8154e00 con 0x7f48c815d6e0 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c81550e0 con 0x7f48c80d1bc0 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c80b2160 0x7f48c815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c80b2160 0x7f48c815dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54010/0 (socket says 172.21.15.70:54010) 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 -- 172.21.15.70:0/828365811 learned_addr learned my addr 172.21.15.70:0/828365811 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48bffff640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cd6c7640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48c815d6e0 0x7f48c815f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 -- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 msgr2=0x7f48c80c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 -- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48c815d6e0 msgr2=0x7f48c815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48c815d6e0 0x7f48c815f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 -- 172.21.15.70:0/828365811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40094d0 con 0x7f48c80b2160 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48bffff640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cd6c7640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48c815d6e0 0x7f48c815f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48ccec6640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c80b2160 0x7f48c815dc00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ad040 tx=0x7f48c40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48bd7fa640 1 -- 172.21.15.70:0/828365811 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40bc070 con 0x7f48c80b2160 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48bd7fa640 1 -- 172.21.15.70:0/828365811 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c40b4420 con 0x7f48c80b2160 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48bd7fa640 1 -- 172.21.15.70:0/828365811 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40b47d0 con 0x7f48c80b2160 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c81553c0 con 0x7f48c80b2160 2023-11-26T07:21:34.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c815e230 con 0x7f48c80b2160 2023-11-26T07:21:34.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c8067dc0 con 0x7f48c80b2160 2023-11-26T07:21:34.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.153+0000 7f48bd7fa640 1 -- 172.21.15.70:0/828365811 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f48c40b4930 con 0x7f48c80b2160 2023-11-26T07:21:34.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.157+0000 7f48bd7fa640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b4066a10 0x7f48b4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.157+0000 7f48bd7fa640 1 -- 172.21.15.70:0/828365811 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f48c411e340 con 0x7f48c80b2160 2023-11-26T07:21:34.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.157+0000 7f48bffff640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b4066a10 0x7f48b4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.157+0000 7f48bffff640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b4066a10 0x7f48b4068ed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48c80d0cb0 tx=0x7f48b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.161+0000 7f48bd7fa640 1 -- 172.21.15.70:0/828365811 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48c40eae30 con 0x7f48c80b2160 2023-11-26T07:21:34.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.341+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48c8067680 con 0x7f48c80b2160 2023-11-26T07:21:34.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.341+0000 7f48bd7fa640 1 -- 172.21.15.70:0/828365811 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f48c40ee450 con 0x7f48c80b2160 2023-11-26T07:21:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:34.346 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3372803527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3372803527},{"type":"v1","addr":"172.21.15.120:6833","nonce":3372803527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5671,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2241396376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2241396376},{"type":"v1","addr":"172.21.15.120:6835","nonce":2241396376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1311811000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1311811000},{"type":"v1","addr":"172.21.15.70:6835","nonce":1311811000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:31.700041+0000","modified":"2023-11-26T07:20:34.716588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/1491316829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":1491316829},{"type":"v1","addr":"172.21.15.70:6837","nonce":1491316829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:34.346 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2023-11-26T07:21:34.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b4066a10 msgr2=0x7f48b4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b4066a10 0x7f48b4068ed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f48c80d0cb0 tx=0x7f48b8009040 comp rx=0 tx=0).stop 2023-11-26T07:21:34.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c80b2160 msgr2=0x7f48c815dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c80b2160 0x7f48c815dc00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ad040 tx=0x7f48c40192e0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 shutdown_connections 2023-11-26T07:21:34.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f48c815d6e0 0x7f48c815f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f48c80d1bc0 0x7f48c80c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f48b4066a10 0x7f48b4068ed0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 --2- 172.21.15.70:0/828365811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48c80b2160 0x7f48c815dc00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 >> 172.21.15.70:0/828365811 conn(0x7f48c809c550 msgr2=0x7f48c80734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 shutdown_connections 2023-11-26T07:21:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.345+0000 7f48cf12a640 1 -- 172.21.15.70:0/828365811 wait complete. 2023-11-26T07:21:34.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:34.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f50265aa640 1 Processor -- start 2023-11-26T07:21:34.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f50265aa640 1 -- start start 2023-11-26T07:21:34.506 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f50265aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f50200cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f50265aa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50200cd1b0 0x7f50200cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f50265aa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50200cfc20 con 0x7f5020143ac0 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f50265aa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5020143ea0 con 0x7f50200cd1b0 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f50265aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50200cc730 con 0x7f50200cf280 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f5024b47640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50200cd1b0 0x7f50200cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f5024b47640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50200cd1b0 0x7f50200cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54014/0 (socket says 172.21.15.70:54014) 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f5024b47640 1 -- 172.21.15.70:0/1800123911 learned_addr learned my addr 172.21.15.70:0/1800123911 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f501f7fe640 1 --2- 172.21.15.70:0/1800123911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f50200cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f5024b47640 1 -- 172.21.15.70:0/1800123911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 msgr2=0x7f50200cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f5024b47640 1 --2- 172.21.15.70:0/1800123911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f50200cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f5024b47640 1 -- 172.21.15.70:0/1800123911 >> v1:172.21.15.120:6789/0 conn(0x7f5020143ac0 legacy=0x7f5020070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.501+0000 7f5024b47640 1 -- 172.21.15.70:0/1800123911 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020070ee0 con 0x7f50200cd1b0 2023-11-26T07:21:34.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f5024b47640 1 --2- 172.21.15.70:0/1800123911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50200cd1b0 0x7f50200cd5e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5018009e50 tx=0x7f501801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cfd6c470fb507d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f501effd640 1 -- 172.21.15.70:0/1800123911 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180a58e0 con 0x7f50200cd1b0 2023-11-26T07:21:34.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f501effd640 1 -- 172.21.15.70:0/1800123911 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180a5a40 con 0x7f50200cd1b0 2023-11-26T07:21:34.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f501effd640 1 -- 172.21.15.70:0/1800123911 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180a5dd0 con 0x7f50200cd1b0 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 -- 172.21.15.70:0/1800123911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50200cd1b0 msgr2=0x7f50200cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 --2- 172.21.15.70:0/1800123911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50200cd1b0 0x7f50200cd5e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5018009e50 tx=0x7f501801ca10 comp rx=0 tx=0).stop 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 -- 172.21.15.70:0/1800123911 shutdown_connections 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 --2- 172.21.15.70:0/1800123911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50200cd1b0 0x7f50200cd5e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 --2- 172.21.15.70:0/1800123911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f50200cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 -- 172.21.15.70:0/1800123911 >> 172.21.15.70:0/1800123911 conn(0x7f502006a890 msgr2=0x7f502006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 -- 172.21.15.70:0/1800123911 shutdown_connections 2023-11-26T07:21:34.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.505+0000 7f50265aa640 1 -- 172.21.15.70:0/1800123911 wait complete. 2023-11-26T07:21:34.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 Processor -- start 2023-11-26T07:21:34.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 -- start start 2023-11-26T07:21:34.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50200cd1b0 0x7f502013d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f502013b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020143ac0 0x7f5020140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502013d940 con 0x7f5020143ac0 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502013b700 con 0x7f50200cd1b0 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502013e3f0 con 0x7f50200cf280 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020143ac0 0x7f5020140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020143ac0 0x7f5020140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54022/0 (socket says 172.21.15.70:54022) 2023-11-26T07:21:34.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 -- 172.21.15.70:0/2638197383 learned_addr learned my addr 172.21.15.70:0/2638197383 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f501ffff640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50200cd1b0 0x7f502013d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f501f7fe640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f502013b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 -- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 msgr2=0x7f502013b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f502013b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 -- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50200cd1b0 msgr2=0x7f502013d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50200cd1b0 0x7f502013d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 -- 172.21.15.70:0/2638197383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018009b30 con 0x7f5020143ac0 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f501ffff640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50200cd1b0 0x7f502013d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f501f7fe640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f502013b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f5024b47640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020143ac0 0x7f5020140d60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f50180af040 tx=0x7f50180197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f501cff9640 1 -- 172.21.15.70:0/2638197383 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180b8640 con 0x7f5020143ac0 2023-11-26T07:21:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f501cff9640 1 -- 172.21.15.70:0/2638197383 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180b87c0 con 0x7f5020143ac0 2023-11-26T07:21:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f501cff9640 1 -- 172.21.15.70:0/2638197383 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180b8b70 con 0x7f5020143ac0 2023-11-26T07:21:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50200ad270 con 0x7f5020143ac0 2023-11-26T07:21:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.509+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50200ad550 con 0x7f5020143ac0 2023-11-26T07:21:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.513+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50200ad6e0 con 0x7f5020143ac0 2023-11-26T07:21:34.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.513+0000 7f501cff9640 1 -- 172.21.15.70:0/2638197383 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f50180b8cd0 con 0x7f5020143ac0 2023-11-26T07:21:34.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.513+0000 7f501cff9640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f500c066a10 0x7f500c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.513+0000 7f501cff9640 1 -- 172.21.15.70:0/2638197383 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f501811fb50 con 0x7f5020143ac0 2023-11-26T07:21:34.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.513+0000 7f501ffff640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f500c066a10 0x7f500c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.513+0000 7f501ffff640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f500c066a10 0x7f500c068ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50100016f0 tx=0x7f5010009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.517+0000 7f501cff9640 1 -- 172.21.15.70:0/2638197383 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50180ec6c0 con 0x7f5020143ac0 2023-11-26T07:21:34.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5020067680 con 0x7f5020143ac0 2023-11-26T07:21:34.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f501cff9640 1 -- 172.21.15.70:0/2638197383 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f50180efce0 con 0x7f5020143ac0 2023-11-26T07:21:34.704 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:34.704 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3372803527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3372803527},{"type":"v1","addr":"172.21.15.120:6833","nonce":3372803527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5671,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2241396376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2241396376},{"type":"v1","addr":"172.21.15.120:6835","nonce":2241396376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1311811000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1311811000},{"type":"v1","addr":"172.21.15.70:6835","nonce":1311811000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:20:31.700041+0000","modified":"2023-11-26T07:20:34.716588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5784},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5784":{"gid":5784,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/1491316829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":1491316829},{"type":"v1","addr":"172.21.15.70:6837","nonce":1491316829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-26T07:21:34.705 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2023-11-26T07:21:34.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f500c066a10 msgr2=0x7f500c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f500c066a10 0x7f500c068ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50100016f0 tx=0x7f5010009040 comp rx=0 tx=0).stop 2023-11-26T07:21:34.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020143ac0 msgr2=0x7f5020140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020143ac0 0x7f5020140d60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f50180af040 tx=0x7f50180197b0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 shutdown_connections 2023-11-26T07:21:34.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f500c066a10 0x7f500c068ed0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5020143ac0 0x7f5020140d60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50200cf280 0x7f502013b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 --2- 172.21.15.70:0/2638197383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50200cd1b0 0x7f502013d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 >> 172.21.15.70:0/2638197383 conn(0x7f502006a890 msgr2=0x7f50200cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 shutdown_connections 2023-11-26T07:21:34.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.701+0000 7f50265aa640 1 -- 172.21.15.70:0/2638197383 wait complete. 2023-11-26T07:21:34.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:34.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.857+0000 7f334fd1d640 1 Processor -- start 2023-11-26T07:21:34.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.857+0000 7f334fd1d640 1 -- start start 2023-11-26T07:21:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334fd1d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33480cf990 0x7f334815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334fd1d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f334815f4e0 0x7f33480cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334fd1d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334806c520 con 0x7f334813e290 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334fd1d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334806c800 con 0x7f334815f4e0 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334fd1d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334806cae0 con 0x7f33480cf990 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334dab9640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f334813e290 0x7f33480cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34844/0 (socket says 172.21.15.70:34844) 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334dab9640 1 -- 172.21.15.70:0/4292274413 learned_addr learned my addr 172.21.15.70:0/4292274413 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334e2ba640 1 --2- 172.21.15.70:0/4292274413 >> v2:172.21.15.70:3300/0 conn(0x7f334815f4e0 0x7f33480cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334d2b8640 1 --2- 172.21.15.70:0/4292274413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33480cf990 0x7f334815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334e2ba640 1 -- 172.21.15.70:0/4292274413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33480cf990 msgr2=0x7f334815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334e2ba640 1 --2- 172.21.15.70:0/4292274413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33480cf990 0x7f334815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334e2ba640 1 -- 172.21.15.70:0/4292274413 >> v1:172.21.15.70:6789/0 conn(0x7f334813e290 legacy=0x7f33480cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.861+0000 7f334e2ba640 1 -- 172.21.15.70:0/4292274413 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334806cdc0 con 0x7f334815f4e0 2023-11-26T07:21:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334e2ba640 1 --2- 172.21.15.70:0/4292274413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f334815f4e0 0x7f33480cd7b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3340009d90 tx=0x7f334001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8960e5a84bc365f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334cab7640 1 -- 172.21.15.70:0/4292274413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400a5a00 con 0x7f334815f4e0 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334cab7640 1 -- 172.21.15.70:0/4292274413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33400a5b60 con 0x7f334815f4e0 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334cab7640 1 -- 172.21.15.70:0/4292274413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400ad440 con 0x7f334815f4e0 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 -- 172.21.15.70:0/4292274413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f334815f4e0 msgr2=0x7f33480cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 --2- 172.21.15.70:0/4292274413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f334815f4e0 0x7f33480cd7b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3340009d90 tx=0x7f334001c920 comp rx=0 tx=0).stop 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 -- 172.21.15.70:0/4292274413 shutdown_connections 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 --2- 172.21.15.70:0/4292274413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f334815f4e0 0x7f33480cd7b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 --2- 172.21.15.70:0/4292274413 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f33480cf990 0x7f334815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 -- 172.21.15.70:0/4292274413 >> 172.21.15.70:0/4292274413 conn(0x7f334806a890 msgr2=0x7f334806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 -- 172.21.15.70:0/4292274413 shutdown_connections 2023-11-26T07:21:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 -- 172.21.15.70:0/4292274413 wait complete. 2023-11-26T07:21:34.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 Processor -- start 2023-11-26T07:21:34.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.865+0000 7f334fd1d640 1 -- start start 2023-11-26T07:21:34.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33480cf990 0x7f33480af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f334813e290 0x7f3348137550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f334815f4e0 0x7f334814d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480b3340 con 0x7f33480cf990 2023-11-26T07:21:34.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480b3620 con 0x7f334815f4e0 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480b3900 con 0x7f334813e290 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33480cf990 0x7f33480af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33480cf990 0x7f33480af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54040/0 (socket says 172.21.15.70:54040) 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 -- 172.21.15.70:0/3258905543 learned_addr learned my addr 172.21.15.70:0/3258905543 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334d2b8640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f334813e290 0x7f3348137550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334e2ba640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f334815f4e0 0x7f334814d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 -- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f334813e290 msgr2=0x7f3348137550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f334813e290 0x7f3348137550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 -- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f334815f4e0 msgr2=0x7f334814d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f334815f4e0 0x7f334814d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 -- 172.21.15.70:0/3258905543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340009a70 con 0x7f33480cf990 2023-11-26T07:21:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334dab9640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33480cf990 0x7f33480af510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f334400c500 tx=0x7f334400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f333e7fc640 1 -- 172.21.15.70:0/3258905543 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344005cf0 con 0x7f33480cf990 2023-11-26T07:21:34.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f333e7fc640 1 -- 172.21.15.70:0/3258905543 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344005e50 con 0x7f33480cf990 2023-11-26T07:21:34.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f333e7fc640 1 -- 172.21.15.70:0/3258905543 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33440072f0 con 0x7f33480cf990 2023-11-26T07:21:34.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33480b3be0 con 0x7f33480cf990 2023-11-26T07:21:34.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3348137220 con 0x7f33480cf990 2023-11-26T07:21:34.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3348067680 con 0x7f33480cf990 2023-11-26T07:21:34.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.869+0000 7f333e7fc640 1 -- 172.21.15.70:0/3258905543 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f3344007450 con 0x7f33480cf990 2023-11-26T07:21:34.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.873+0000 7f333e7fc640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f332c066a40 0x7f332c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:34.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.873+0000 7f333e7fc640 1 -- 172.21.15.70:0/3258905543 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3344083da0 con 0x7f33480cf990 2023-11-26T07:21:34.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.873+0000 7f334d2b8640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f332c066a40 0x7f332c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:34.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.873+0000 7f334d2b8640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f332c066a40 0x7f332c068f00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3348155b30 tx=0x7f3338008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:34.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:34.877+0000 7f333e7fc640 1 -- 172.21.15.70:0/3258905543 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3344050a50 con 0x7f33480cf990 2023-11-26T07:21:35.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.025+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33480b4090 con 0x7f33480cf990 2023-11-26T07:21:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f333e7fc640 1 -- 172.21.15.70:0/3258905543 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16730 (secure 0 0 0) 0x7f3344017020 con 0x7f33480cf990 2023-11-26T07:21:35.031 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:35.032 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":52,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:28.813599+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:20:30.063697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-26T07:20:30.697996+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.38","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:35.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f332c066a40 msgr2=0x7f332c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f332c066a40 0x7f332c068f00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3348155b30 tx=0x7f3338008040 comp rx=0 tx=0).stop 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33480cf990 msgr2=0x7f33480af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33480cf990 0x7f33480af510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f334400c500 tx=0x7f334400c9c0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 shutdown_connections 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f334815f4e0 0x7f334814d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f334813e290 0x7f3348137550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f332c066a40 0x7f332c068f00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 --2- 172.21.15.70:0/3258905543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33480cf990 0x7f33480af510 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 >> 172.21.15.70:0/3258905543 conn(0x7f334806a890 msgr2=0x7f3348152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 shutdown_connections 2023-11-26T07:21:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.029+0000 7f334fd1d640 1 -- 172.21.15.70:0/3258905543 wait complete. 2023-11-26T07:21:35.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:21:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3057c9c640 1 Processor -- start 2023-11-26T07:21:35.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3057c9c640 1 -- start start 2023-11-26T07:21:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3057c9c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f305014b1e0 0x7f30500cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3057c9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3050070fd0 0x7f3050162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3057c9c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500cfc20 con 0x7f30500cf7c0 2023-11-26T07:21:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3057c9c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3050162080 con 0x7f305014b1e0 2023-11-26T07:21:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3057c9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3050161d70 con 0x7f3050070fd0 2023-11-26T07:21:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3055a38640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f305014b1e0 0x7f30500cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3055a38640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f305014b1e0 0x7f30500cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54042/0 (socket says 172.21.15.70:54042) 2023-11-26T07:21:35.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3055a38640 1 -- 172.21.15.70:0/2949919947 learned_addr learned my addr 172.21.15.70:0/2949919947 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:35.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3056239640 1 --2- 172.21.15.70:0/2949919947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3050070fd0 0x7f3050162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3055a38640 1 -- 172.21.15.70:0/2949919947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3050070fd0 msgr2=0x7f3050162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:35.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3055a38640 1 --2- 172.21.15.70:0/2949919947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3050070fd0 0x7f3050162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3055a38640 1 -- 172.21.15.70:0/2949919947 >> v1:172.21.15.70:6789/0 conn(0x7f30500cf7c0 legacy=0x7f30500708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3055a38640 1 -- 172.21.15.70:0/2949919947 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305014b5c0 con 0x7f305014b1e0 2023-11-26T07:21:35.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.189+0000 7f3056239640 1 --2- 172.21.15.70:0/2949919947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3050070fd0 0x7f3050162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:35.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3055a38640 1 --2- 172.21.15.70:0/2949919947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f305014b1e0 0x7f30500cf280 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f304c009870 tx=0x7f304c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdf8ff87550400 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3054a36640 1 -- 172.21.15.70:0/2949919947 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0aa670 con 0x7f305014b1e0 2023-11-26T07:21:35.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3054a36640 1 -- 172.21.15.70:0/2949919947 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0aa7d0 con 0x7f305014b1e0 2023-11-26T07:21:35.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3054a36640 1 -- 172.21.15.70:0/2949919947 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0aab60 con 0x7f305014b1e0 2023-11-26T07:21:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 -- 172.21.15.70:0/2949919947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f305014b1e0 msgr2=0x7f30500cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 --2- 172.21.15.70:0/2949919947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f305014b1e0 0x7f30500cf280 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f304c009870 tx=0x7f304c01c510 comp rx=0 tx=0).stop 2023-11-26T07:21:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 -- 172.21.15.70:0/2949919947 shutdown_connections 2023-11-26T07:21:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 --2- 172.21.15.70:0/2949919947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3050070fd0 0x7f3050162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 --2- 172.21.15.70:0/2949919947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f305014b1e0 0x7f30500cf280 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 -- 172.21.15.70:0/2949919947 >> 172.21.15.70:0/2949919947 conn(0x7f305006a890 msgr2=0x7f305006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:35.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 -- 172.21.15.70:0/2949919947 shutdown_connections 2023-11-26T07:21:35.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.193+0000 7f3057c9c640 1 -- 172.21.15.70:0/2949919947 wait complete. 2023-11-26T07:21:35.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 Processor -- start 2023-11-26T07:21:35.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 -- start start 2023-11-26T07:21:35.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3050070fd0 0x7f30500ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30500cf7c0 0x7f30500b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f305014b1e0 0x7f30500b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050161690 con 0x7f30500cf7c0 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30500ace60 con 0x7f3050070fd0 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500aa5a0 con 0x7f305014b1e0 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30500cf7c0 0x7f30500b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30500cf7c0 0x7f30500b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54050/0 (socket says 172.21.15.70:54050) 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 -- 172.21.15.70:0/1047552316 learned_addr learned my addr 172.21.15.70:0/1047552316 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055a38640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3050070fd0 0x7f30500ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3056239640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f305014b1e0 0x7f30500b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 -- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f305014b1e0 msgr2=0x7f30500b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f305014b1e0 0x7f30500b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 -- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3050070fd0 msgr2=0x7f30500ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3050070fd0 0x7f30500ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 -- 172.21.15.70:0/1047552316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0094d0 con 0x7f30500cf7c0 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055a38640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3050070fd0 0x7f30500ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3055237640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30500cf7c0 0x7f30500b00e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f304000c500 tx=0x7f304000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f30467fc640 1 -- 172.21.15.70:0/1047552316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040005220 con 0x7f30500cf7c0 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f30467fc640 1 -- 172.21.15.70:0/1047552316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040005380 con 0x7f30500cf7c0 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500aa880 con 0x7f30500cf7c0 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f30467fc640 1 -- 172.21.15.70:0/1047552316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040007270 con 0x7f30500cf7c0 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3050160c70 con 0x7f30500cf7c0 2023-11-26T07:21:35.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.197+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30500aaa10 con 0x7f30500cf7c0 2023-11-26T07:21:35.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.201+0000 7f30467fc640 1 -- 172.21.15.70:0/1047552316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f30400073d0 con 0x7f30500cf7c0 2023-11-26T07:21:35.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.201+0000 7f30467fc640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3034066a10 0x7f3034068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.201+0000 7f30467fc640 1 -- 172.21.15.70:0/1047552316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3040084270 con 0x7f30500cf7c0 2023-11-26T07:21:35.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.201+0000 7f3055a38640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3034066a10 0x7f3034068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.201+0000 7f3055a38640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3034066a10 0x7f3034068ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f304c0ae000 tx=0x7f304c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.205+0000 7f30467fc640 1 -- 172.21.15.70:0/1047552316 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3040050df0 con 0x7f30500cf7c0 2023-11-26T07:21:35.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.389+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3050067680 con 0x7f30500cf7c0 2023-11-26T07:21:35.395 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-11-26T07:21:35.393+0000 7fe8c07be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:21:35.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.393+0000 7f30467fc640 1 -- 172.21.15.70:0/1047552316 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3040054410 con 0x7f30500cf7c0 2023-11-26T07:21:35.398 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:21:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3034066a10 msgr2=0x7f3034068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3034066a10 0x7f3034068ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f304c0ae000 tx=0x7f304c0a7000 comp rx=0 tx=0).stop 2023-11-26T07:21:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30500cf7c0 msgr2=0x7f30500b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30500cf7c0 0x7f30500b00e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f304000c500 tx=0x7f304000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 shutdown_connections 2023-11-26T07:21:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3034066a10 0x7f3034068ed0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30500cf7c0 0x7f30500b00e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f305014b1e0 0x7f30500b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 --2- 172.21.15.70:0/1047552316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3050070fd0 0x7f30500ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 >> 172.21.15.70:0/1047552316 conn(0x7f305006a890 msgr2=0x7f305016bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 shutdown_connections 2023-11-26T07:21:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.397+0000 7f3057c9c640 1 -- 172.21.15.70:0/1047552316 wait complete. 2023-11-26T07:21:35.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:21:35.477 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2023-11-26T07:21:35.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8eeabf8640 1 Processor -- start 2023-11-26T07:21:35.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8eeabf8640 1 -- start start 2023-11-26T07:21:35.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8eeabf8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8eeabf8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8ee40b2160 0x7f8ee40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8eeabf8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee40cf0e0 con 0x7f8ee40d19f0 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8eeabf8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee415dac0 con 0x7f8ee40b2160 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8eeabf8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40d1e80 con 0x7f8ee415d6e0 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8edbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8ee40b2160 0x7f8ee40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8ee9195640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8ee40d19f0 0x7f8ee40cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34862/0 (socket says 172.21.15.70:34862) 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8ee9195640 1 -- 172.21.15.70:0/2948884347 learned_addr learned my addr 172.21.15.70:0/2948884347 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8ee8994640 1 --2- 172.21.15.70:0/2948884347 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8edbfff640 1 -- 172.21.15.70:0/2948884347 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 msgr2=0x7f8ee40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8edbfff640 1 --2- 172.21.15.70:0/2948884347 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee40d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8edbfff640 1 -- 172.21.15.70:0/2948884347 >> v1:172.21.15.70:6789/0 conn(0x7f8ee40d19f0 legacy=0x7f8ee40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8edbfff640 1 -- 172.21.15.70:0/2948884347 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40ceb20 con 0x7f8ee40b2160 2023-11-26T07:21:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.569+0000 7f8edb7fe640 1 -- 172.21.15.70:0/2948884347 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308934810 0 0) 0x7f8ee40cf0e0 con 0x7f8ee40d19f0 2023-11-26T07:21:35.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8edbfff640 1 --2- 172.21.15.70:0/2948884347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40b2160 0x7f8ee40d14b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097c0 tx=0x7f8ed401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59f788abacb12bc server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8edb7fe640 1 -- 172.21.15.70:0/2948884347 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40ab600 con 0x7f8ee40b2160 2023-11-26T07:21:35.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8edb7fe640 1 -- 172.21.15.70:0/2948884347 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed40a7050 con 0x7f8ee40b2160 2023-11-26T07:21:35.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8edb7fe640 1 -- 172.21.15.70:0/2948884347 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40ab980 con 0x7f8ee40b2160 2023-11-26T07:21:35.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 -- 172.21.15.70:0/2948884347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40b2160 msgr2=0x7f8ee40d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/2948884347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40b2160 0x7f8ee40d14b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40097c0 tx=0x7f8ed401c480 comp rx=0 tx=0).stop 2023-11-26T07:21:35.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 -- 172.21.15.70:0/2948884347 shutdown_connections 2023-11-26T07:21:35.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/2948884347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40b2160 0x7f8ee40d14b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/2948884347 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee40d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 -- 172.21.15.70:0/2948884347 >> 172.21.15.70:0/2948884347 conn(0x7f8ee409c550 msgr2=0x7f8ee40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:35.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 -- 172.21.15.70:0/2948884347 shutdown_connections 2023-11-26T07:21:35.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.573+0000 7f8eeabf8640 1 -- 172.21.15.70:0/2948884347 wait complete. 2023-11-26T07:21:35.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 Processor -- start 2023-11-26T07:21:35.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 -- start start 2023-11-26T07:21:35.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ee40b2160 0x7f8ee415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40d19f0 0x7f8ee41563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee4156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4157770 con 0x7f8ee40d19f0 2023-11-26T07:21:35.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee4155600 con 0x7f8ee40b2160 2023-11-26T07:21:35.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41558e0 con 0x7f8ee415d6e0 2023-11-26T07:21:35.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40d19f0 0x7f8ee41563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40d19f0 0x7f8ee41563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54094/0 (socket says 172.21.15.70:54094) 2023-11-26T07:21:35.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 -- 172.21.15.70:0/1330612064 learned_addr learned my addr 172.21.15.70:0/1330612064 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:35.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8ee9195640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee4156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8ee8994640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ee40b2160 0x7f8ee415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 -- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 msgr2=0x7f8ee4156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee4156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 -- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ee40b2160 msgr2=0x7f8ee415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ee40b2160 0x7f8ee415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 -- 172.21.15.70:0/1330612064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4009420 con 0x7f8ee40d19f0 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8ee9195640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee4156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8ee8994640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ee40b2160 0x7f8ee415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8edbfff640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40d19f0 0x7f8ee41563c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40ae040 tx=0x7f8ed4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8ed97fa640 1 -- 172.21.15.70:0/1330612064 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40b4840 con 0x7f8ee40d19f0 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8ed97fa640 1 -- 172.21.15.70:0/1330612064 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed40b49c0 con 0x7f8ee40d19f0 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8ed97fa640 1 -- 172.21.15.70:0/1330612064 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40b4d70 con 0x7f8ee40d19f0 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee4155bc0 con 0x7f8ee40d19f0 2023-11-26T07:21:35.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.577+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee415c770 con 0x7f8ee40d19f0 2023-11-26T07:21:35.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.581+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee4067680 con 0x7f8ee40d19f0 2023-11-26T07:21:35.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.581+0000 7f8ed97fa640 1 -- 172.21.15.70:0/1330612064 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f8ed40b2040 con 0x7f8ee40d19f0 2023-11-26T07:21:35.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.581+0000 7f8ed97fa640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ed0066a10 0x7f8ed0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:35.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.581+0000 7f8ed97fa640 1 -- 172.21.15.70:0/1330612064 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8ed411ee30 con 0x7f8ee40d19f0 2023-11-26T07:21:35.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.581+0000 7f8ee8994640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ed0066a10 0x7f8ed0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:35.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.581+0000 7f8ee8994640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ed0066a10 0x7f8ed0068ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40667a0 tx=0x7f8ee0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:35.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.585+0000 7f8ed97fa640 1 -- 172.21.15.70:0/1330612064 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ed40eb8f0 con 0x7f8ee40d19f0 2023-11-26T07:21:35.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:35.769+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ee4156070 con 0x7f8ee40d19f0 2023-11-26T07:21:36.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8ed97fa640 1 -- 172.21.15.70:0/1330612064 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ed40b80a0 con 0x7f8ee40d19f0 2023-11-26T07:21:36.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ed0066a10 msgr2=0x7f8ed0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ed0066a10 0x7f8ed0068ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40667a0 tx=0x7f8ee0008040 comp rx=0 tx=0).stop 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40d19f0 msgr2=0x7f8ee41563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40d19f0 0x7f8ee41563c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40ae040 tx=0x7f8ed4019220 comp rx=0 tx=0).stop 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 shutdown_connections 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ed0066a10 0x7f8ed0068ed0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee40d19f0 0x7f8ee41563c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8ee415d6e0 0x7f8ee4156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 --2- 172.21.15.70:0/1330612064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ee40b2160 0x7f8ee415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 >> 172.21.15.70:0/1330612064 conn(0x7f8ee409c550 msgr2=0x7f8ee40cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 shutdown_connections 2023-11-26T07:21:36.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.401+0000 7f8eeabf8640 1 -- 172.21.15.70:0/1330612064 wait complete. 2023-11-26T07:21:36.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:21:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.613+0000 7f3f3e357640 1 Processor -- start 2023-11-26T07:21:36.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.613+0000 7f3f3e357640 1 -- start start 2023-11-26T07:21:36.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.613+0000 7f3f3e357640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f380cf990 0x7f3f3815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.613+0000 7f3f3e357640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3806c520 con 0x7f3f3815f4e0 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.613+0000 7f3f3e357640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3806c800 con 0x7f3f3813e290 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.613+0000 7f3f3e357640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3806cae0 con 0x7f3f380cf990 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.613+0000 7f3f3c8f4640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3f3815f4e0 0x7f3f380cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34876/0 (socket says 172.21.15.70:34876) 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f3c8f4640 1 -- 172.21.15.70:0/1709840716 learned_addr learned my addr 172.21.15.70:0/1709840716 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f377fe640 1 --2- 172.21.15.70:0/1709840716 >> v2:172.21.15.120:3300/0 conn(0x7f3f380cf990 0x7f3f3815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f36ffd640 1 -- 172.21.15.70:0/1709840716 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557000826 0 0) 0x7f3f3806c520 con 0x7f3f3815f4e0 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f36ffd640 1 -- 172.21.15.70:0/1709840716 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f20003530 con 0x7f3f3815f4e0 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f377fe640 1 -- 172.21.15.70:0/1709840716 >> v1:172.21.15.120:6789/0 conn(0x7f3f3813e290 legacy=0x7f3f380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f377fe640 1 -- 172.21.15.70:0/1709840716 >> v1:172.21.15.70:6789/0 conn(0x7f3f3815f4e0 legacy=0x7f3f380cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f377fe640 1 -- 172.21.15.70:0/1709840716 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3806cdc0 con 0x7f3f380cf990 2023-11-26T07:21:36.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f377fe640 1 --2- 172.21.15.70:0/1709840716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815efa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0097c0 tx=0x7f3f2c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1ce7ed9309d0d03 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:36.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f36ffd640 1 -- 172.21.15.70:0/1709840716 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0ab670 con 0x7f3f380cf990 2023-11-26T07:21:36.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f36ffd640 1 -- 172.21.15.70:0/1709840716 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c0ab7d0 con 0x7f3f380cf990 2023-11-26T07:21:36.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.617+0000 7f3f36ffd640 1 -- 172.21.15.70:0/1709840716 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0abb60 con 0x7f3f380cf990 2023-11-26T07:21:36.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- 172.21.15.70:0/1709840716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 msgr2=0x7f3f3815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 --2- 172.21.15.70:0/1709840716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815efa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0097c0 tx=0x7f3f2c01c450 comp rx=0 tx=0).stop 2023-11-26T07:21:36.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- 172.21.15.70:0/1709840716 shutdown_connections 2023-11-26T07:21:36.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 --2- 172.21.15.70:0/1709840716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815efa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- 172.21.15.70:0/1709840716 >> 172.21.15.70:0/1709840716 conn(0x7f3f3806a890 msgr2=0x7f3f3806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:36.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- 172.21.15.70:0/1709840716 shutdown_connections 2023-11-26T07:21:36.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- 172.21.15.70:0/1709840716 wait complete. 2023-11-26T07:21:36.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 Processor -- start 2023-11-26T07:21:36.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- start start 2023-11-26T07:21:36.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3813e290 0x7f3f3813cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3f3815f4e0 0x7f3f3813d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3813d6d0 con 0x7f3f3813e290 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3813b890 con 0x7f3f380cf990 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3e357640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3813c6f0 con 0x7f3f3815f4e0 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3813e290 0x7f3f3813cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f37fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3813e290 0x7f3f3813cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54100/0 (socket says 172.21.15.70:54100) 2023-11-26T07:21:36.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f377fe640 1 -- 172.21.15.70:0/3969731630 learned_addr learned my addr 172.21.15.70:0/3969731630 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.621+0000 7f3f3c8f4640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3f3815f4e0 0x7f3f3813d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f377fe640 1 -- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3f3815f4e0 msgr2=0x7f3f3813d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f377fe640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3f3815f4e0 0x7f3f3813d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f377fe640 1 -- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 msgr2=0x7f3f3815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f377fe640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f377fe640 1 -- 172.21.15.70:0/3969731630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009420 con 0x7f3f3813e290 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f37fff640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f377fe640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3813e290 0x7f3f3813cc50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0ad040 tx=0x7f3f2c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f34ff9640 1 -- 172.21.15.70:0/3969731630 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0b5810 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f34ff9640 1 -- 172.21.15.70:0/3969731630 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c0b5970 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f34ff9640 1 -- 172.21.15.70:0/3969731630 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0b5d20 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3813bae0 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3813c0a0 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f380b3830 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f34ff9640 1 -- 172.21.15.70:0/3969731630 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f3f2c0bf410 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f34ff9640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3f24066a10 0x7f3f24068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f34ff9640 1 -- 172.21.15.70:0/3969731630 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3f3815fb00 con 0x7f3f3813e290 2023-11-26T07:21:36.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.625+0000 7f3f37fff640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3f24066a10 0x7f3f24068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:36.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.629+0000 7f3f37fff640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3f24066a10 0x7f3f24068ed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3f28007fd0 tx=0x7f3f28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:36.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.629+0000 7f3f34ff9640 1 -- 172.21.15.70:0/3969731630 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f2c0ebf20 con 0x7f3f3813e290 2023-11-26T07:21:36.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:36.785+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f3813c860 con 0x7f3f3813e290 2023-11-26T07:21:37.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.401+0000 7f3f34ff9640 1 -- 172.21.15.70:0/3969731630 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3f2c0ef540 con 0x7f3f3813e290 2023-11-26T07:21:37.406 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:21:37.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3f24066a10 msgr2=0x7f3f24068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3f24066a10 0x7f3f24068ed0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3f28007fd0 tx=0x7f3f28009040 comp rx=0 tx=0).stop 2023-11-26T07:21:37.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3813e290 msgr2=0x7f3f3813cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3813e290 0x7f3f3813cc50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0ad040 tx=0x7f3f2c01ac90 comp rx=0 tx=0).stop 2023-11-26T07:21:37.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 shutdown_connections 2023-11-26T07:21:37.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3f24066a10 0x7f3f24068ed0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3813e290 0x7f3f3813cc50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3f3815f4e0 0x7f3f3813d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 --2- 172.21.15.70:0/3969731630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f380cf990 0x7f3f3815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 >> 172.21.15.70:0/3969731630 conn(0x7f3f3806a890 msgr2=0x7f3f38138e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:37.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.405+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 shutdown_connections 2023-11-26T07:21:37.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.409+0000 7f3f3e357640 1 -- 172.21.15.70:0/3969731630 wait complete. 2023-11-26T07:21:37.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:21:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.573+0000 7fb3005aa640 1 Processor -- start 2023-11-26T07:21:37.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.573+0000 7fb3005aa640 1 -- start start 2023-11-26T07:21:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.573+0000 7fb3005aa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb2f80ce7c0 0x7fb2f815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.573+0000 7fb3005aa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f806c520 con 0x7fb2f813e290 2023-11-26T07:21:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.573+0000 7fb3005aa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f806c800 con 0x7fb2f80cf990 2023-11-26T07:21:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.573+0000 7fb3005aa640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f806cae0 con 0x7fb2f80ce7c0 2023-11-26T07:21:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fe346640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb2f813e290 0x7fb2f80cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34890/0 (socket says 172.21.15.70:34890) 2023-11-26T07:21:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fe346640 1 -- 172.21.15.70:0/3276083088 learned_addr learned my addr 172.21.15.70:0/3276083088 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2feb47640 1 --2- 172.21.15.70:0/3276083088 >> v2:172.21.15.120:3300/0 conn(0x7fb2f80ce7c0 0x7fb2f815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707995214 0 0) 0x7fb2f806c520 con 0x7fb2f813e290 2023-11-26T07:21:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e4003530 con 0x7fb2f813e290 2023-11-26T07:21:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196397628 0 0) 0x7fb2e4003530 con 0x7fb2f813e290 2023-11-26T07:21:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 >> v2:172.21.15.120:3300/0 conn(0x7fb2f80ce7c0 msgr2=0x7fb2f815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 --2- 172.21.15.70:0/3276083088 >> v2:172.21.15.120:3300/0 conn(0x7fb2f80ce7c0 0x7fb2f815f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 >> v1:172.21.15.120:6789/0 conn(0x7fb2f80cf990 legacy=0x7fb2f815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f806cdc0 con 0x7fb2f813e290 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fb2f4001680 con 0x7fb2f813e290 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 >> v1:172.21.15.70:6789/0 conn(0x7fb2f813e290 legacy=0x7fb2f80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e4003980 0x7fb2e4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e4004380 0x7fb2e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f806cae0 con 0x7fb2e40050f0 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e400c030 con 0x7fb2e4004380 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e400c1f0 con 0x7fb2e4003980 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2feb47640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fdb45640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e4004380 0x7fb2e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fe346640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e4003980 0x7fb2e4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2feb47640 1 -- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e4003980 msgr2=0x7fb2e4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:37.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2feb47640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e4003980 0x7fb2e4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2feb47640 1 -- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e4004380 msgr2=0x7fb2e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:37.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2feb47640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e4004380 0x7fb2e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2feb47640 1 -- 172.21.15.70:0/3276083088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4003530 con 0x7fb2e40050f0 2023-11-26T07:21:37.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.577+0000 7fb2fdb45640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e4004380 0x7fb2e4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:37.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb2feb47640 1 -- 172.21.15.70:0/3276083088 reap_dead start 2023-11-26T07:21:37.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb2feb47640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2e400b990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009fc0 tx=0x7fb2f001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f2acaf64841479 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:37.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00a5c80 con 0x7fb2e40050f0 2023-11-26T07:21:37.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000f040 con 0x7fb2e40050f0 2023-11-26T07:21:37.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb2fd344640 1 -- 172.21.15.70:0/3276083088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0003be0 con 0x7fb2e40050f0 2023-11-26T07:21:37.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 -- 172.21.15.70:0/3276083088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 msgr2=0x7fb2e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2e400b990 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009fc0 tx=0x7fb2f001cc70 comp rx=0 tx=0).stop 2023-11-26T07:21:37.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 -- 172.21.15.70:0/3276083088 shutdown_connections 2023-11-26T07:21:37.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 --2- 172.21.15.70:0/3276083088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2e400b990 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 -- 172.21.15.70:0/3276083088 >> 172.21.15.70:0/3276083088 conn(0x7fb2f806a890 msgr2=0x7fb2f806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:37.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 -- 172.21.15.70:0/3276083088 shutdown_connections 2023-11-26T07:21:37.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 -- 172.21.15.70:0/3276083088 wait complete. 2023-11-26T07:21:37.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 Processor -- start 2023-11-26T07:21:37.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.581+0000 7fb3005aa640 1 -- start start 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2f80b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2f80b33e0 0x7fb2f80b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2f8135000 0x7fb2f81354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80b19f0 con 0x7fb2e40050f0 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80b2340 con 0x7fb2f80b33e0 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80b2620 con 0x7fb2f8135000 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2f80b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2f80b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54120/0 (socket says 172.21.15.70:54120) 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 -- 172.21.15.70:0/4288939708 learned_addr learned my addr 172.21.15.70:0/4288939708 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fdb45640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2f80b33e0 0x7fb2f80b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 -- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2f8135000 msgr2=0x7fb2f81354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2feb47640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2f8135000 0x7fb2f81354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2f8135000 0x7fb2f81354b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 -- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2f80b33e0 msgr2=0x7fb2f80b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2f80b33e0 0x7fb2f80b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 -- 172.21.15.70:0/4288939708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80b2900 con 0x7fb2e40050f0 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fdb45640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2f80b33e0 0x7fb2f80b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2feb47640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2f8135000 0x7fb2f81354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2fe346640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2f80b14b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4004f00 tx=0x7fb2f4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2eeffd640 1 -- 172.21.15.70:0/4288939708 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400f750 con 0x7fb2e40050f0 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2eeffd640 1 -- 172.21.15.70:0/4288939708 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f400f8d0 con 0x7fb2e40050f0 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f80b2be0 con 0x7fb2e40050f0 2023-11-26T07:21:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2eeffd640 1 -- 172.21.15.70:0/4288939708 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400fc80 con 0x7fb2e40050f0 2023-11-26T07:21:37.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f8134440 con 0x7fb2e40050f0 2023-11-26T07:21:37.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f8067680 con 0x7fb2e40050f0 2023-11-26T07:21:37.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.585+0000 7fb2eeffd640 1 -- 172.21.15.70:0/4288939708 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb2f401d460 con 0x7fb2e40050f0 2023-11-26T07:21:37.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.589+0000 7fb2eeffd640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2dc066a40 0x7fb2dc068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:37.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.589+0000 7fb2eeffd640 1 -- 172.21.15.70:0/4288939708 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fb2f40847b0 con 0x7fb2e40050f0 2023-11-26T07:21:37.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.589+0000 7fb2fdb45640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2dc066a40 0x7fb2dc068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:37.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.589+0000 7fb2fdb45640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2dc066a40 0x7fb2dc068f00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2f806d700 tx=0x7fb2e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:37.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.593+0000 7fb2eeffd640 1 -- 172.21.15.70:0/4288939708 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2f4051550 con 0x7fb2e40050f0 2023-11-26T07:21:37.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:37.749+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb2f806df50 con 0x7fb2e40050f0 2023-11-26T07:21:38.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.409+0000 7fb2eeffd640 1 -- 172.21.15.70:0/4288939708 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb2f4054b70 con 0x7fb2e40050f0 2023-11-26T07:21:38.414 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2023-11-26T07:21:38.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.413+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2dc066a40 msgr2=0x7fb2dc068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.413+0000 7fb3005aa640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2dc066a40 0x7fb2dc068f00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2f806d700 tx=0x7fb2e8009040 comp rx=0 tx=0).stop 2023-11-26T07:21:38.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.413+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 msgr2=0x7fb2f80b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.413+0000 7fb3005aa640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2f80b14b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4004f00 tx=0x7fb2f4007430 comp rx=0 tx=0).stop 2023-11-26T07:21:38.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 shutdown_connections 2023-11-26T07:21:38.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2f8135000 0x7fb2f81354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2f80b33e0 0x7fb2f80b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2dc066a40 0x7fb2dc068f00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 --2- 172.21.15.70:0/4288939708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40050f0 0x7fb2f80b14b0 secure :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4004f00 tx=0x7fb2f4007430 comp rx=0 tx=0).stop 2023-11-26T07:21:38.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 >> 172.21.15.70:0/4288939708 conn(0x7fb2f806a890 msgr2=0x7fb2f806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 shutdown_connections 2023-11-26T07:21:38.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.417+0000 7fb3005aa640 1 -- 172.21.15.70:0/4288939708 wait complete. 2023-11-26T07:21:38.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:21:38.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.597+0000 7f4959b2a640 1 Processor -- start 2023-11-26T07:21:38.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.597+0000 7f4959b2a640 1 -- start start 2023-11-26T07:21:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f4959b2a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4954143ac0 0x7f4954070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f4959b2a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f49540708b0 0x7f49540cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f4959b2a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49540cc730 con 0x7f49540cf7c0 2023-11-26T07:21:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f4959b2a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4954143ea0 con 0x7f49540708b0 2023-11-26T07:21:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f4959b2a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49540cfbd0 con 0x7f4954143ac0 2023-11-26T07:21:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f494bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f49540708b0 0x7f49540cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f494bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f49540708b0 0x7f49540cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54124/0 (socket says 172.21.15.70:54124) 2023-11-26T07:21:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f494bfff640 1 -- 172.21.15.70:0/1564427368 learned_addr learned my addr 172.21.15.70:0/1564427368 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f49537fe640 1 --2- 172.21.15.70:0/1564427368 >> v2:172.21.15.120:3300/0 conn(0x7f4954143ac0 0x7f4954070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f494bfff640 1 -- 172.21.15.70:0/1564427368 >> v2:172.21.15.120:3300/0 conn(0x7f4954143ac0 msgr2=0x7f4954070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f494bfff640 1 --2- 172.21.15.70:0/1564427368 >> v2:172.21.15.120:3300/0 conn(0x7f4954143ac0 0x7f4954070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f494bfff640 1 -- 172.21.15.70:0/1564427368 >> v1:172.21.15.120:6789/0 conn(0x7f49540cf7c0 legacy=0x7f49540b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:38.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.601+0000 7f494bfff640 1 -- 172.21.15.70:0/1564427368 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4954070ee0 con 0x7f49540708b0 2023-11-26T07:21:38.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f494bfff640 1 --2- 172.21.15.70:0/1564427368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540708b0 0x7f49540cf280 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f495406dca0 tx=0x7f493c01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10b840111e36e15 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4952ffd640 1 -- 172.21.15.70:0/1564427368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0a7c60 con 0x7f49540708b0 2023-11-26T07:21:38.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4952ffd640 1 -- 172.21.15.70:0/1564427368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c0a7dc0 con 0x7f49540708b0 2023-11-26T07:21:38.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4952ffd640 1 -- 172.21.15.70:0/1564427368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0af660 con 0x7f49540708b0 2023-11-26T07:21:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 -- 172.21.15.70:0/1564427368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540708b0 msgr2=0x7f49540cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 --2- 172.21.15.70:0/1564427368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540708b0 0x7f49540cf280 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f495406dca0 tx=0x7f493c01eb90 comp rx=0 tx=0).stop 2023-11-26T07:21:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 -- 172.21.15.70:0/1564427368 shutdown_connections 2023-11-26T07:21:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 --2- 172.21.15.70:0/1564427368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540708b0 0x7f49540cf280 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 --2- 172.21.15.70:0/1564427368 >> v2:172.21.15.120:3300/0 conn(0x7f4954143ac0 0x7f4954070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 -- 172.21.15.70:0/1564427368 >> 172.21.15.70:0/1564427368 conn(0x7f495406a890 msgr2=0x7f495406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 -- 172.21.15.70:0/1564427368 shutdown_connections 2023-11-26T07:21:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 -- 172.21.15.70:0/1564427368 wait complete. 2023-11-26T07:21:38.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 Processor -- start 2023-11-26T07:21:38.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.605+0000 7f4959b2a640 1 -- start start 2023-11-26T07:21:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f49540708b0 0x7f4954154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540cf7c0 0x7f495415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4954143ac0 0x7f495415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4954155080 con 0x7f49540cf7c0 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49540adc90 con 0x7f4954143ac0 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49540ad800 con 0x7f49540708b0 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540cf7c0 0x7f495415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540cf7c0 0x7f495415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54140/0 (socket says 172.21.15.70:54140) 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 -- 172.21.15.70:0/2392915225 learned_addr learned my addr 172.21.15.70:0/2392915225 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f49537fe640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f49540708b0 0x7f4954154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4953fff640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4954143ac0 0x7f495415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 -- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f49540708b0 msgr2=0x7f4954154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f49540708b0 0x7f4954154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 -- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4954143ac0 msgr2=0x7f495415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4954143ac0 0x7f495415bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 -- 172.21.15.70:0/2392915225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c00b770 con 0x7f49540cf7c0 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4953fff640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4954143ac0 0x7f495415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f494bfff640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540cf7c0 0x7f495415a7c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f493c01c7c0 tx=0x7f493c01b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4950ff9640 1 -- 172.21.15.70:0/2392915225 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0ba660 con 0x7f49540cf7c0 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4950ff9640 1 -- 172.21.15.70:0/2392915225 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c0ba7c0 con 0x7f49540cf7c0 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4950ff9640 1 -- 172.21.15.70:0/2392915225 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0bab70 con 0x7f49540cf7c0 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49540acbf0 con 0x7f49540cf7c0 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49540ad1b0 con 0x7f49540cf7c0 2023-11-26T07:21:38.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.609+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49540cf280 con 0x7f49540cf7c0 2023-11-26T07:21:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.613+0000 7f4950ff9640 1 -- 172.21.15.70:0/2392915225 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f493c0c2360 con 0x7f49540cf7c0 2023-11-26T07:21:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.613+0000 7f4950ff9640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4934066a10 0x7f4934068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.613+0000 7f4950ff9640 1 -- 172.21.15.70:0/2392915225 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f493c11f2b0 con 0x7f49540cf7c0 2023-11-26T07:21:38.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.613+0000 7f49537fe640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4934066a10 0x7f4934068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.617 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.613+0000 7f49537fe640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4934066a10 0x7f4934068ed0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f49540cdbf0 tx=0x7f4944008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.617+0000 7f4950ff9640 1 -- 172.21.15.70:0/2392915225 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f493c0ec420 con 0x7f49540cf7c0 2023-11-26T07:21:38.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.765+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f4954067680 con 0x7f49540cf7c0 2023-11-26T07:21:38.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4950ff9640 1 -- 172.21.15.70:0/2392915225 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v16) v1 ==== 115+0+0 (secure 0 0 0) 0x7f493c0efa40 con 0x7f49540cf7c0 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4934066a10 msgr2=0x7f4934068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4934066a10 0x7f4934068ed0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f49540cdbf0 tx=0x7f4944008040 comp rx=0 tx=0).stop 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540cf7c0 msgr2=0x7f495415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540cf7c0 0x7f495415a7c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f493c01c7c0 tx=0x7f493c01b930 comp rx=0 tx=0).stop 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 shutdown_connections 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4934066a10 0x7f4934068ed0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49540cf7c0 0x7f495415a7c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4954143ac0 0x7f495415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 --2- 172.21.15.70:0/2392915225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f49540708b0 0x7f4954154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.769+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 >> 172.21.15.70:0/2392915225 conn(0x7f495406a890 msgr2=0x7f4954142a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.773+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 shutdown_connections 2023-11-26T07:21:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.773+0000 7f4959b2a640 1 -- 172.21.15.70:0/2392915225 wait complete. 2023-11-26T07:21:38.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:21:38.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afbd65640 1 Processor -- start 2023-11-26T07:21:38.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afbd65640 1 -- start start 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afbd65640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af40cf280 0x7f9af40cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afbd65640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40cfc20 con 0x7f9af40cd1b0 2023-11-26T07:21:38.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afbd65640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40cc730 con 0x7f9af4143ac0 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afbd65640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4143ea0 con 0x7f9af40cf280 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afa302640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9af40cd1b0 0x7f9af40cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34906/0 (socket says 172.21.15.70:34906) 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9afa302640 1 -- 172.21.15.70:0/3836083424 learned_addr learned my addr 172.21.15.70:0/3836083424 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:38.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9af9300640 1 --2- 172.21.15.70:0/3836083424 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af40cf280 0x7f9af40cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9af8aff640 1 -- 172.21.15.70:0/3836083424 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335750402 0 0) 0x7f9af40cfc20 con 0x7f9af40cd1b0 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9af8aff640 1 -- 172.21.15.70:0/3836083424 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae0003530 con 0x7f9af40cd1b0 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9af8aff640 1 -- 172.21.15.70:0/3836083424 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497055248 0 0) 0x7f9af40cc730 con 0x7f9af4143ac0 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9af9300640 1 -- 172.21.15.70:0/3836083424 >> v1:172.21.15.120:6789/0 conn(0x7f9af4143ac0 legacy=0x7f9af4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9af9300640 1 -- 172.21.15.70:0/3836083424 >> v1:172.21.15.70:6789/0 conn(0x7f9af40cd1b0 legacy=0x7f9af40cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.933+0000 7f9af9300640 1 -- 172.21.15.70:0/3836083424 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4070ee0 con 0x7f9af40cf280 2023-11-26T07:21:38.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9af9300640 1 --2- 172.21.15.70:0/3836083424 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af40cf280 0x7f9af40cf6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40097f0 tx=0x7f9ae401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e04f75db842874 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9af8aff640 1 -- 172.21.15.70:0/3836083424 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40aa620 con 0x7f9af40cf280 2023-11-26T07:21:38.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9af8aff640 1 -- 172.21.15.70:0/3836083424 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae40aa780 con 0x7f9af40cf280 2023-11-26T07:21:38.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9af8aff640 1 -- 172.21.15.70:0/3836083424 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40aab10 con 0x7f9af40cf280 2023-11-26T07:21:38.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9afbd65640 1 -- 172.21.15.70:0/3836083424 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af40cf280 msgr2=0x7f9af40cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9afbd65640 1 --2- 172.21.15.70:0/3836083424 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af40cf280 0x7f9af40cf6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40097f0 tx=0x7f9ae401c4c0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9afbd65640 1 -- 172.21.15.70:0/3836083424 shutdown_connections 2023-11-26T07:21:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9afbd65640 1 --2- 172.21.15.70:0/3836083424 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af40cf280 0x7f9af40cf6e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9afbd65640 1 -- 172.21.15.70:0/3836083424 >> 172.21.15.70:0/3836083424 conn(0x7f9af406a890 msgr2=0x7f9af406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9afbd65640 1 -- 172.21.15.70:0/3836083424 shutdown_connections 2023-11-26T07:21:38.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.937+0000 7f9afbd65640 1 -- 172.21.15.70:0/3836083424 wait complete. 2023-11-26T07:21:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 Processor -- start 2023-11-26T07:21:38.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 -- start start 2023-11-26T07:21:38.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9af40cd1b0 0x7f9af4148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9af40cf280 0x7f9af4148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af4143ac0 0x7f9af41473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40b14f0 con 0x7f9af40cd1b0 2023-11-26T07:21:38.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41465f0 con 0x7f9af40cf280 2023-11-26T07:21:38.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41468d0 con 0x7f9af4143ac0 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9af40cd1b0 0x7f9af4148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9af40cd1b0 0x7f9af4148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54150/0 (socket says 172.21.15.70:54150) 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 -- 172.21.15.70:0/2725820340 learned_addr learned my addr 172.21.15.70:0/2725820340 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afa302640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af4143ac0 0x7f9af41473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 -- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af4143ac0 msgr2=0x7f9af41473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9300640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9af40cf280 0x7f9af4148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af4143ac0 0x7f9af41473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 -- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9af40cf280 msgr2=0x7f9af4148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9af40cf280 0x7f9af4148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 -- 172.21.15.70:0/2725820340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae4009420 con 0x7f9af40cd1b0 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afa302640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af4143ac0 0x7f9af41473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:38.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9300640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9af40cf280 0x7f9af4148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:38.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9af9b01640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9af40cd1b0 0x7f9af4148680 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c4d0 tx=0x7f9af000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9aea7fc640 1 -- 172.21.15.70:0/2725820340 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0005480 con 0x7f9af40cd1b0 2023-11-26T07:21:38.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9aea7fc640 1 -- 172.21.15.70:0/2725820340 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0003600 con 0x7f9af40cd1b0 2023-11-26T07:21:38.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9aea7fc640 1 -- 172.21.15.70:0/2725820340 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00039b0 con 0x7f9af40cd1b0 2023-11-26T07:21:38.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af4146bb0 con 0x7f9af40cd1b0 2023-11-26T07:21:38.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.941+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af4143ff0 con 0x7f9af40cd1b0 2023-11-26T07:21:38.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.945+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af41470d0 con 0x7f9af40cd1b0 2023-11-26T07:21:38.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.945+0000 7f9aea7fc640 1 -- 172.21.15.70:0/2725820340 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f9af0003b10 con 0x7f9af40cd1b0 2023-11-26T07:21:38.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.945+0000 7f9aea7fc640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9ad8066a10 0x7f9ad8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:38.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.945+0000 7f9aea7fc640 1 -- 172.21.15.70:0/2725820340 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9af0083c30 con 0x7f9af40cd1b0 2023-11-26T07:21:38.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.945+0000 7f9af9300640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9ad8066a10 0x7f9ad8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:38.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.945+0000 7f9af9300640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9ad8066a10 0x7f9ad8068ed0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40ae000 tx=0x7f9ae4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:38.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:38.949+0000 7f9aea7fc640 1 -- 172.21.15.70:0/2725820340 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9af41470d0 con 0x7f9af40cd1b0 2023-11-26T07:21:39.104 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.101+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9af41470d0 con 0x7f9af40cd1b0 2023-11-26T07:21:39.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9aea7fc640 1 -- 172.21.15.70:0/2725820340 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9af41470d0 con 0x7f9af40cd1b0 2023-11-26T07:21:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9ad8066a10 msgr2=0x7f9ad8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9ad8066a10 0x7f9ad8068ed0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40ae000 tx=0x7f9ae4008040 comp rx=0 tx=0).stop 2023-11-26T07:21:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9af40cd1b0 msgr2=0x7f9af4148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9af40cd1b0 0x7f9af4148680 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c4d0 tx=0x7f9af000c990 comp rx=0 tx=0).stop 2023-11-26T07:21:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 shutdown_connections 2023-11-26T07:21:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9af4143ac0 0x7f9af41473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9af40cf280 0x7f9af4148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9ad8066a10 0x7f9ad8068ed0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 --2- 172.21.15.70:0/2725820340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9af40cd1b0 0x7f9af4148680 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 >> 172.21.15.70:0/2725820340 conn(0x7f9af406a890 msgr2=0x7f9af40ac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 shutdown_connections 2023-11-26T07:21:39.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.105+0000 7f9afbd65640 1 -- 172.21.15.70:0/2725820340 wait complete. 2023-11-26T07:21:39.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2023-11-26T07:21:39.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafd57aa640 1 Processor -- start 2023-11-26T07:21:39.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafd57aa640 1 -- start start 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafd57aa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fafd00d17f0 0x7fafd00d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafd57aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00b0490 0x7fafd00b0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafd57aa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd00d0bc0 con 0x7fafd015d580 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafd57aa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd00d0320 con 0x7fafd00d17f0 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafd57aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00d0600 con 0x7fafd00b0490 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafce7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fafd00d17f0 0x7fafd00d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafce7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fafd00d17f0 0x7fafd00d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54160/0 (socket says 172.21.15.70:54160) 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafce7fc640 1 -- 172.21.15.70:0/3320204454 learned_addr learned my addr 172.21.15.70:0/3320204454 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafcf7fe640 1 --2- 172.21.15.70:0/3320204454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00b0490 0x7fafd00b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafce7fc640 1 -- 172.21.15.70:0/3320204454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00b0490 msgr2=0x7fafd00b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafce7fc640 1 --2- 172.21.15.70:0/3320204454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00b0490 0x7fafd00b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafce7fc640 1 -- 172.21.15.70:0/3320204454 >> v1:172.21.15.120:6789/0 conn(0x7fafd015d580 legacy=0x7fafd00d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.264+0000 7fafce7fc640 1 -- 172.21.15.70:0/3320204454 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00d08e0 con 0x7fafd00d17f0 2023-11-26T07:21:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafce7fc640 1 --2- 172.21.15.70:0/3320204454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00d17f0 0x7fafd00d1c30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009870 tx=0x7fafc401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4966f284e60f3b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafcdffb640 1 -- 172.21.15.70:0/3320204454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40aa650 con 0x7fafd00d17f0 2023-11-26T07:21:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafcdffb640 1 -- 172.21.15.70:0/3320204454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc40aa7b0 con 0x7fafd00d17f0 2023-11-26T07:21:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafcdffb640 1 -- 172.21.15.70:0/3320204454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40aab40 con 0x7fafd00d17f0 2023-11-26T07:21:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 -- 172.21.15.70:0/3320204454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00d17f0 msgr2=0x7fafd00d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 --2- 172.21.15.70:0/3320204454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00d17f0 0x7fafd00d1c30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009870 tx=0x7fafc401c510 comp rx=0 tx=0).stop 2023-11-26T07:21:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 -- 172.21.15.70:0/3320204454 shutdown_connections 2023-11-26T07:21:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 --2- 172.21.15.70:0/3320204454 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00b0490 0x7fafd00b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 --2- 172.21.15.70:0/3320204454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00d17f0 0x7fafd00d1c30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 -- 172.21.15.70:0/3320204454 >> 172.21.15.70:0/3320204454 conn(0x7fafd009c550 msgr2=0x7fafd00d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 -- 172.21.15.70:0/3320204454 shutdown_connections 2023-11-26T07:21:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.268+0000 7fafd57aa640 1 -- 172.21.15.70:0/3320204454 wait complete. 2023-11-26T07:21:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 Processor -- start 2023-11-26T07:21:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 -- start start 2023-11-26T07:21:39.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00b0490 0x7fafd00b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00d17f0 0x7fafd00b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd015d580 0x7fafd0154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd0154ea0 con 0x7fafd00b0490 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00b2420 con 0x7fafd015d580 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00b2700 con 0x7fafd00d17f0 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00b0490 0x7fafd00b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00b0490 0x7fafd00b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54164/0 (socket says 172.21.15.70:54164) 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 -- 172.21.15.70:0/1994619583 learned_addr learned my addr 172.21.15.70:0/1994619583 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafcf7fe640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd015d580 0x7fafd0154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafce7fc640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00d17f0 0x7fafd00b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 -- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00d17f0 msgr2=0x7fafd00b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00d17f0 0x7fafd00b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.278 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 -- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd015d580 msgr2=0x7fafd0154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:39.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd015d580 0x7fafd0154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:39.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 -- 172.21.15.70:0/1994619583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40094d0 con 0x7fafd00b0490 2023-11-26T07:21:39.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafceffd640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00b0490 0x7fafd00b41f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c3c0 tx=0x7fafc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafb77fe640 1 -- 172.21.15.70:0/1994619583 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00052d0 con 0x7fafd00b0490 2023-11-26T07:21:39.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafb77fe640 1 -- 172.21.15.70:0/1994619583 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0005430 con 0x7fafd00b0490 2023-11-26T07:21:39.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafb77fe640 1 -- 172.21.15.70:0/1994619583 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0003840 con 0x7fafd00b0490 2023-11-26T07:21:39.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd00b29e0 con 0x7fafd00b0490 2023-11-26T07:21:39.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.272+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd00b6dc0 con 0x7fafd00b0490 2023-11-26T07:21:39.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.276+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd0067680 con 0x7fafd00b0490 2023-11-26T07:21:39.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.276+0000 7fafb77fe640 1 -- 172.21.15.70:0/1994619583 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fafc00039a0 con 0x7fafd00b0490 2023-11-26T07:21:39.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.276+0000 7fafb77fe640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fafbc066a40 0x7fafbc068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:39.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.276+0000 7fafb77fe640 1 -- 172.21.15.70:0/1994619583 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fafc00839d0 con 0x7fafd00b0490 2023-11-26T07:21:39.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.276+0000 7fafce7fc640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fafbc066a40 0x7fafbc068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.276+0000 7fafce7fc640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fafbc066a40 0x7fafbc068f00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fafc40ae000 tx=0x7fafc40b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:39.285 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.280+0000 7fafb77fe640 1 -- 172.21.15.70:0/1994619583 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafc00509e0 con 0x7fafd00b0490 2023-11-26T07:21:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:39.488+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) v1 -- 0x7fafd0067cb0 con 0x7fafd00b0490 2023-11-26T07:21:40.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.416+0000 7fafb77fe640 1 -- 172.21.15.70:0/1994619583 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v207) v1 ==== 180+0+0 (secure 0 0 0) 0x7fafc0054000 con 0x7fafd00b0490 2023-11-26T07:21:40.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fafbc066a40 msgr2=0x7fafbc068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fafbc066a40 0x7fafbc068f00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fafc40ae000 tx=0x7fafc40b5040 comp rx=0 tx=0).stop 2023-11-26T07:21:40.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00b0490 msgr2=0x7fafd00b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00b0490 0x7fafd00b41f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c3c0 tx=0x7fafc000c880 comp rx=0 tx=0).stop 2023-11-26T07:21:40.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 shutdown_connections 2023-11-26T07:21:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafd015d580 0x7fafd0154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fafd00d17f0 0x7fafd00b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fafbc066a40 0x7fafbc068f00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 --2- 172.21.15.70:0/1994619583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd00b0490 0x7fafd00b41f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 >> 172.21.15.70:0/1994619583 conn(0x7fafd009c550 msgr2=0x7fafd00b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 shutdown_connections 2023-11-26T07:21:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.420+0000 7fafd57aa640 1 -- 172.21.15.70:0/1994619583 wait complete. 2023-11-26T07:21:40.449 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during in-progress state and validate the reason ... ok 2023-11-26T07:21:40.449 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during pending state and validate the reason 2023-11-26T07:21:40.449 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:21:40.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f885e0c9640 1 Processor -- start 2023-11-26T07:21:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f885e0c9640 1 -- start start 2023-11-26T07:21:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f885e0c9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88580d17f0 0x7f88580d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f885e0c9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580d0bc0 con 0x7f885815d580 2023-11-26T07:21:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f885e0c9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580d0320 con 0x7f88580b0490 2023-11-26T07:21:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f885e0c9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580d0600 con 0x7f88580d17f0 2023-11-26T07:21:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f885815d580 0x7f88580d3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34918/0 (socket says 172.21.15.70:34918) 2023-11-26T07:21:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 -- 172.21.15.70:0/3988939154 learned_addr learned my addr 172.21.15.70:0/3988939154 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f8856ffd640 1 --2- 172.21.15.70:0/3988939154 >> v2:172.21.15.120:3300/0 conn(0x7f88580d17f0 0x7f88580d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793994246 0 0) 0x7f88580d0bc0 con 0x7f885815d580 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8840003530 con 0x7f885815d580 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678661648 0 0) 0x7f8840003530 con 0x7f885815d580 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 >> v2:172.21.15.120:3300/0 conn(0x7f88580d17f0 msgr2=0x7f88580d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 --2- 172.21.15.70:0/3988939154 >> v2:172.21.15.120:3300/0 conn(0x7f88580d17f0 0x7f88580d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 >> v1:172.21.15.120:6789/0 conn(0x7f88580b0490 legacy=0x7f88580b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580d08e0 con 0x7f885815d580 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f8848001680 con 0x7f885815d580 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 >> v1:172.21.15.70:6789/0 conn(0x7f885815d580 legacy=0x7f88580d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8840003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8840004380 0x7f8840004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8840005050 0x7f884000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580d0600 con 0x7f8840003980 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884000bfb0 con 0x7f8840004380 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884000c170 con 0x7f8840005050 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8840003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f8856ffd640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8840004380 0x7f8840004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f8857fff640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8840005050 0x7f884000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 -- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8840005050 msgr2=0x7f884000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8840005050 0x7f884000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 -- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8840004380 msgr2=0x7f8840004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8840004380 0x7f8840004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f88577fe640 1 -- 172.21.15.70:0/3988939154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840003530 con 0x7f8840003980 2023-11-26T07:21:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.588+0000 7f8857fff640 1 -- 172.21.15.70:0/3988939154 reap_dead start 2023-11-26T07:21:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f88577fe640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8840003d60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f884800c210 tx=0x7f884801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4c56f352912436 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848005ae0 con 0x7f8840003980 2023-11-26T07:21:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848005c60 con 0x7f8840003980 2023-11-26T07:21:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f88567fc640 1 -- 172.21.15.70:0/3988939154 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480a5a40 con 0x7f8840003980 2023-11-26T07:21:40.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f885e0c9640 1 -- 172.21.15.70:0/3988939154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 msgr2=0x7f8840003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f885e0c9640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8840003d60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f884800c210 tx=0x7f884801cbf0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f885e0c9640 1 -- 172.21.15.70:0/3988939154 shutdown_connections 2023-11-26T07:21:40.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f885e0c9640 1 --2- 172.21.15.70:0/3988939154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8840003d60 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f885e0c9640 1 -- 172.21.15.70:0/3988939154 >> 172.21.15.70:0/3988939154 conn(0x7f885809c550 msgr2=0x7f88580d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:40.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f885e0c9640 1 -- 172.21.15.70:0/3988939154 shutdown_connections 2023-11-26T07:21:40.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.592+0000 7f885e0c9640 1 -- 172.21.15.70:0/3988939154 wait complete. 2023-11-26T07:21:40.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 Processor -- start 2023-11-26T07:21:40.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 -- start start 2023-11-26T07:21:40.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8858155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f885815efe0 0x7f885815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88581522e0 0x7f8858152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858152cd0 con 0x7f8840003980 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858155ed0 con 0x7f88581522e0 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885815dd90 con 0x7f885815efe0 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8858155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8858155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54174/0 (socket says 172.21.15.70:54174) 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 -- 172.21.15.70:0/875609185 learned_addr learned my addr 172.21.15.70:0/875609185 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f8856ffd640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f885815efe0 0x7f885815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f8857fff640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88581522e0 0x7f8858152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 -- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f885815efe0 msgr2=0x7f885815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f885815efe0 0x7f885815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 -- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88581522e0 msgr2=0x7f8858152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88581522e0 0x7f8858152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 -- 172.21.15.70:0/875609185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885815e070 con 0x7f8840003980 2023-11-26T07:21:40.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f88577fe640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8858155580 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f884801ca20 tx=0x7f8840005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:40.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f883ffff640 1 -- 172.21.15.70:0/875609185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480b4070 con 0x7f8840003980 2023-11-26T07:21:40.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f883ffff640 1 -- 172.21.15.70:0/875609185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848001500 con 0x7f8840003980 2023-11-26T07:21:40.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f883ffff640 1 -- 172.21.15.70:0/875609185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480a5800 con 0x7f8840003980 2023-11-26T07:21:40.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885815e350 con 0x7f8840003980 2023-11-26T07:21:40.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.596+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885815eb50 con 0x7f8840003980 2023-11-26T07:21:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.600+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858067680 con 0x7f8840003980 2023-11-26T07:21:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.600+0000 7f883ffff640 1 -- 172.21.15.70:0/875609185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f88480a5960 con 0x7f8840003980 2023-11-26T07:21:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.600+0000 7f883ffff640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8844066a10 0x7f8844068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.600+0000 7f883ffff640 1 -- 172.21.15.70:0/875609185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f884811dff0 con 0x7f8840003980 2023-11-26T07:21:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.600+0000 7f8856ffd640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8844066a10 0x7f8844068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.600+0000 7f8856ffd640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8844066a10 0x7f8844068ed0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88580b6110 tx=0x7f884c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:40.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.604+0000 7f883ffff640 1 -- 172.21.15.70:0/875609185 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88480eaf90 con 0x7f8840003980 2023-11-26T07:21:40.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.756+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8858067680 con 0x7f8840003980 2023-11-26T07:21:40.761 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.756+0000 7f883ffff640 1 -- 172.21.15.70:0/875609185 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+12986 (secure 0 0 0) 0x7f88480ee5b0 con 0x7f8840003980 2023-11-26T07:21:40.761 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:40.761 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":55,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:38.407170+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6837/1491316829":"2023-11-27T07:21:35.395761+0000","172.21.15.70:6836/1491316829":"2023-11-27T07:21:35.395761+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:40.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.756+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8844066a10 msgr2=0x7f8844068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.756+0000 7f885e0c9640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8844066a10 0x7f8844068ed0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f88580b6110 tx=0x7f884c009190 comp rx=0 tx=0).stop 2023-11-26T07:21:40.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.756+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 msgr2=0x7f8858155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.763 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.756+0000 7f885e0c9640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8858155580 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f884801ca20 tx=0x7f8840005800 comp rx=0 tx=0).stop 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 shutdown_connections 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88581522e0 0x7f8858152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f885815efe0 0x7f885815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8844066a10 0x7f8844068ed0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 --2- 172.21.15.70:0/875609185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8840003980 0x7f8858155580 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 >> 172.21.15.70:0/875609185 conn(0x7f885809c550 msgr2=0x7f88580d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 shutdown_connections 2023-11-26T07:21:40.764 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.760+0000 7f885e0c9640 1 -- 172.21.15.70:0/875609185 wait complete. 2023-11-26T07:21:40.783 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:40.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:40.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1d079640 1 Processor -- start 2023-11-26T07:21:40.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1d079640 1 -- start start 2023-11-26T07:21:40.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1d079640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6d180b2f80 0x7f6d18071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1d079640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d180ce680 0x7f6d1806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1d079640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1806c750 con 0x7f6d181596d0 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1d079640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d180cbe00 con 0x7f6d180ce680 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1d079640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d180b3550 con 0x7f6d180b2f80 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1759e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6d180ce680 0x7f6d1806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d16d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6d181596d0 0x7f6d180b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34928/0 (socket says 172.21.15.70:34928) 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d16d9d640 1 -- 172.21.15.70:0/4069612367 learned_addr learned my addr 172.21.15.70:0/4069612367 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d0ffff640 1 --2- 172.21.15.70:0/4069612367 >> v2:172.21.15.120:3300/0 conn(0x7f6d180b2f80 0x7f6d18071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1759e640 1 -- 172.21.15.70:0/4069612367 >> v2:172.21.15.120:3300/0 conn(0x7f6d180b2f80 msgr2=0x7f6d18071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:40.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1759e640 1 --2- 172.21.15.70:0/4069612367 >> v2:172.21.15.120:3300/0 conn(0x7f6d180b2f80 0x7f6d18071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1759e640 1 -- 172.21.15.70:0/4069612367 >> v1:172.21.15.70:6789/0 conn(0x7f6d181596d0 legacy=0x7f6d180b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1759e640 1 -- 172.21.15.70:0/4069612367 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d18071e80 con 0x7f6d180ce680 2023-11-26T07:21:40.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d1659c640 1 -- 172.21.15.70:0/4069612367 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678629003 0 0) 0x7f6d1806c750 con 0x7f6d181596d0 2023-11-26T07:21:40.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.920+0000 7f6d0ffff640 1 --2- 172.21.15.70:0/4069612367 >> v2:172.21.15.120:3300/0 conn(0x7f6d180b2f80 0x7f6d18071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:40.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1759e640 1 --2- 172.21.15.70:0/4069612367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180ce680 0x7f6d1806cbe0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6d180ce440 tx=0x7f6d1001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff992f0145911aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:40.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1659c640 1 -- 172.21.15.70:0/4069612367 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a57b0 con 0x7f6d180ce680 2023-11-26T07:21:40.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1659c640 1 -- 172.21.15.70:0/4069612367 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d100a5910 con 0x7f6d180ce680 2023-11-26T07:21:40.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1659c640 1 -- 172.21.15.70:0/4069612367 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a5ca0 con 0x7f6d180ce680 2023-11-26T07:21:40.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 -- 172.21.15.70:0/4069612367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180ce680 msgr2=0x7f6d1806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 --2- 172.21.15.70:0/4069612367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180ce680 0x7f6d1806cbe0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6d180ce440 tx=0x7f6d1001c880 comp rx=0 tx=0).stop 2023-11-26T07:21:40.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 -- 172.21.15.70:0/4069612367 shutdown_connections 2023-11-26T07:21:40.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 --2- 172.21.15.70:0/4069612367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180ce680 0x7f6d1806cbe0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 --2- 172.21.15.70:0/4069612367 >> v2:172.21.15.120:3300/0 conn(0x7f6d180b2f80 0x7f6d18071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 -- 172.21.15.70:0/4069612367 >> 172.21.15.70:0/4069612367 conn(0x7f6d1806a890 msgr2=0x7f6d1806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:40.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 -- 172.21.15.70:0/4069612367 shutdown_connections 2023-11-26T07:21:40.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.924+0000 7f6d1d079640 1 -- 172.21.15.70:0/4069612367 wait complete. 2023-11-26T07:21:40.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 Processor -- start 2023-11-26T07:21:40.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 -- start start 2023-11-26T07:21:40.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180b2f80 0x7f6d18152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d180ce680 0x7f6d18158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d181596d0 0x7f6d18154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d181530b0 con 0x7f6d180b2f80 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18153390 con 0x7f6d181596d0 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18153670 con 0x7f6d180ce680 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180b2f80 0x7f6d18152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180b2f80 0x7f6d18152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54190/0 (socket says 172.21.15.70:54190) 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 -- 172.21.15.70:0/3240790859 learned_addr learned my addr 172.21.15.70:0/3240790859 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d0ffff640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d180ce680 0x7f6d18158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1759e640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d181596d0 0x7f6d18154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 -- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d180ce680 msgr2=0x7f6d18158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d180ce680 0x7f6d18158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 -- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d181596d0 msgr2=0x7f6d18154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d181596d0 0x7f6d18154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 -- 172.21.15.70:0/3240790859 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10009a70 con 0x7f6d180b2f80 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d16d9d640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180b2f80 0x7f6d18152740 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800c480 tx=0x7f6d0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d0f7fe640 1 -- 172.21.15.70:0/3240790859 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080074e0 con 0x7f6d180b2f80 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d0f7fe640 1 -- 172.21.15.70:0/3240790859 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d08007660 con 0x7f6d180b2f80 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d0f7fe640 1 -- 172.21.15.70:0/3240790859 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08004a30 con 0x7f6d180b2f80 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d18153950 con 0x7f6d180b2f80 2023-11-26T07:21:40.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d18152c80 con 0x7f6d180b2f80 2023-11-26T07:21:40.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.928+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d18067680 con 0x7f6d180b2f80 2023-11-26T07:21:40.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.932+0000 7f6d0f7fe640 1 -- 172.21.15.70:0/3240790859 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f6d08004b90 con 0x7f6d180b2f80 2023-11-26T07:21:40.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.932+0000 7f6d0f7fe640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6cf8066a10 0x7f6cf8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:40.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.932+0000 7f6d0f7fe640 1 -- 172.21.15.70:0/3240790859 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d08083730 con 0x7f6d180b2f80 2023-11-26T07:21:40.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.932+0000 7f6d0ffff640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6cf8066a10 0x7f6cf8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:40.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.932+0000 7f6d0ffff640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6cf8066a10 0x7f6cf8068ed0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6d181f91c0 tx=0x7f6d00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:40.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:40.936+0000 7f6d0f7fe640 1 -- 172.21.15.70:0/3240790859 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d08050690 con 0x7f6d180b2f80 2023-11-26T07:21:41.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d18153e00 con 0x7f6d180b2f80 2023-11-26T07:21:41.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d0f7fe640 1 -- 172.21.15.70:0/3240790859 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d08053cb0 con 0x7f6d180b2f80 2023-11-26T07:21:41.093 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:21:41.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6cf8066a10 msgr2=0x7f6cf8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6cf8066a10 0x7f6cf8068ed0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6d181f91c0 tx=0x7f6d00008040 comp rx=0 tx=0).stop 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180b2f80 msgr2=0x7f6d18152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180b2f80 0x7f6d18152740 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800c480 tx=0x7f6d0800c940 comp rx=0 tx=0).stop 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 shutdown_connections 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d181596d0 0x7f6d18154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6d180ce680 0x7f6d18158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6cf8066a10 0x7f6cf8068ed0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 --2- 172.21.15.70:0/3240790859 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d180b2f80 0x7f6d18152740 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.088+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 >> 172.21.15.70:0/3240790859 conn(0x7f6d1806a890 msgr2=0x7f6d1815bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.092+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 shutdown_connections 2023-11-26T07:21:41.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.092+0000 7f6d1d079640 1 -- 172.21.15.70:0/3240790859 wait complete. 2023-11-26T07:21:41.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-11-26T07:21:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e45c4640 1 Processor -- start 2023-11-26T07:21:41.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e45c4640 1 -- start start 2023-11-26T07:21:41.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e45c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc06f000 0x7f86dc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e45c4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f86dc099a70 0x7f86dc06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e45c4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc0cf260 con 0x7f86dc06f3e0 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e45c4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc06d570 con 0x7f86dc099a70 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e45c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc09a010 con 0x7f86dc06f000 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e2b61640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f86dc099a70 0x7f86dc06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e1b5f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f86dc06f3e0 0x7f86dc06b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34942/0 (socket says 172.21.15.70:34942) 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e1b5f640 1 -- 172.21.15.70:0/2336797078 learned_addr learned my addr 172.21.15.70:0/2336797078 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e2360640 1 --2- 172.21.15.70:0/2336797078 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc06f000 0x7f86dc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e2b61640 1 -- 172.21.15.70:0/2336797078 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc06f000 msgr2=0x7f86dc06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e2b61640 1 --2- 172.21.15.70:0/2336797078 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc06f000 0x7f86dc06d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e2b61640 1 -- 172.21.15.70:0/2336797078 >> v1:172.21.15.70:6789/0 conn(0x7f86dc06f3e0 legacy=0x7f86dc06b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.248+0000 7f86e2b61640 1 -- 172.21.15.70:0/2336797078 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc09a2f0 con 0x7f86dc099a70 2023-11-26T07:21:41.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e2b61640 1 --2- 172.21.15.70:0/2336797078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc099a70 0x7f86dc06bcb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009d90 tx=0x7f86d401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151d1cfe8040f460 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:41.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e135e640 1 -- 172.21.15.70:0/2336797078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40a5900 con 0x7f86dc099a70 2023-11-26T07:21:41.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e135e640 1 -- 172.21.15.70:0/2336797078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d40a5a60 con 0x7f86dc099a70 2023-11-26T07:21:41.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e135e640 1 -- 172.21.15.70:0/2336797078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d40a5df0 con 0x7f86dc099a70 2023-11-26T07:21:41.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 -- 172.21.15.70:0/2336797078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc099a70 msgr2=0x7f86dc06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 --2- 172.21.15.70:0/2336797078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc099a70 0x7f86dc06bcb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009d90 tx=0x7f86d401c950 comp rx=0 tx=0).stop 2023-11-26T07:21:41.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 -- 172.21.15.70:0/2336797078 shutdown_connections 2023-11-26T07:21:41.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 --2- 172.21.15.70:0/2336797078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc099a70 0x7f86dc06bcb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 --2- 172.21.15.70:0/2336797078 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc06f000 0x7f86dc06d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 -- 172.21.15.70:0/2336797078 >> 172.21.15.70:0/2336797078 conn(0x7f86dc0b2d10 msgr2=0x7f86dc0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:41.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 -- 172.21.15.70:0/2336797078 shutdown_connections 2023-11-26T07:21:41.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.252+0000 7f86e45c4640 1 -- 172.21.15.70:0/2336797078 wait complete. 2023-11-26T07:21:41.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 Processor -- start 2023-11-26T07:21:41.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 -- start start 2023-11-26T07:21:41.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86dc06f000 0x7f86dc153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc06f3e0 0x7f86dc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc099a70 0x7f86dc0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc153da0 con 0x7f86dc06f3e0 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc153f70 con 0x7f86dc06f000 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0c8e60 con 0x7f86dc099a70 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc06f3e0 0x7f86dc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc06f3e0 0x7f86dc0c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54214/0 (socket says 172.21.15.70:54214) 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 -- 172.21.15.70:0/3779112146 learned_addr learned my addr 172.21.15.70:0/3779112146 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e2b61640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc099a70 0x7f86dc0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e2360640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86dc06f000 0x7f86dc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 -- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc099a70 msgr2=0x7f86dc0c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc099a70 0x7f86dc0c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 -- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86dc06f000 msgr2=0x7f86dc153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86dc06f000 0x7f86dc153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 -- 172.21.15.70:0/3779112146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4009a70 con 0x7f86dc06f3e0 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e1b5f640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc06f3e0 0x7f86dc0c82f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c500 tx=0x7f86cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86d2ffd640 1 -- 172.21.15.70:0/3779112146 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc005cf0 con 0x7f86dc06f3e0 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86d2ffd640 1 -- 172.21.15.70:0/3779112146 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc005e50 con 0x7f86dc06f3e0 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86d2ffd640 1 -- 172.21.15.70:0/3779112146 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0072f0 con 0x7f86dc06f3e0 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc0c9140 con 0x7f86dc06f3e0 2023-11-26T07:21:41.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.256+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc0b44f0 con 0x7f86dc06f3e0 2023-11-26T07:21:41.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.260+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc0b4070 con 0x7f86dc06f3e0 2023-11-26T07:21:41.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.260+0000 7f86d2ffd640 1 -- 172.21.15.70:0/3779112146 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f86cc007450 con 0x7f86dc06f3e0 2023-11-26T07:21:41.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.260+0000 7f86d2ffd640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f86c0066a10 0x7f86c0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:41.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.260+0000 7f86d2ffd640 1 -- 172.21.15.70:0/3779112146 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86cc083a30 con 0x7f86dc06f3e0 2023-11-26T07:21:41.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.260+0000 7f86e2360640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f86c0066a10 0x7f86c0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:41.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.260+0000 7f86e2360640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f86c0066a10 0x7f86c0068ed0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009b60 tx=0x7f86d8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:41.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.264+0000 7f86d2ffd640 1 -- 172.21.15.70:0/3779112146 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86dc0b4070 con 0x7f86dc06f3e0 2023-11-26T07:21:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:41.468+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7f86dc0b4070 con 0x7f86dc06f3e0 2023-11-26T07:21:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86d2ffd640 1 -- 172.21.15.70:0/3779112146 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v209) v1 ==== 179+0+0 (secure 0 0 0) 0x7f86dc0b4070 con 0x7f86dc06f3e0 2023-11-26T07:21:42.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f86c0066a10 msgr2=0x7f86c0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f86c0066a10 0x7f86c0068ed0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009b60 tx=0x7f86d8009190 comp rx=0 tx=0).stop 2023-11-26T07:21:42.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc06f3e0 msgr2=0x7f86dc0c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc06f3e0 0x7f86dc0c82f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c500 tx=0x7f86cc00c9c0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 shutdown_connections 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f86c0066a10 0x7f86c0068ed0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86dc06f3e0 0x7f86dc0c82f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f86dc099a70 0x7f86dc0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 --2- 172.21.15.70:0/3779112146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86dc06f000 0x7f86dc153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 >> 172.21.15.70:0/3779112146 conn(0x7f86dc0b2d10 msgr2=0x7f86dc0c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 shutdown_connections 2023-11-26T07:21:42.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.428+0000 7f86e45c4640 1 -- 172.21.15.70:0/3779112146 wait complete. 2023-11-26T07:21:42.457 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:21:42.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.596+0000 7fdc0652a640 1 Processor -- start 2023-11-26T07:21:42.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.596+0000 7fdc0652a640 1 -- start start 2023-11-26T07:21:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc0652a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdc000cf280 0x7fdc000cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc0652a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdc000cd1b0 0x7fdc000cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc0652a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000cc730 con 0x7fdc00143ac0 2023-11-26T07:21:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc0652a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc00143ea0 con 0x7fdc000cd1b0 2023-11-26T07:21:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc0652a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc000cfc50 con 0x7fdc000cf280 2023-11-26T07:21:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdbfffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fdc00143ac0 0x7fdc00070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34946/0 (socket says 172.21.15.70:34946) 2023-11-26T07:21:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdbfffff640 1 -- 172.21.15.70:0/2191884888 learned_addr learned my addr 172.21.15.70:0/2191884888 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc04ac7640 1 --2- 172.21.15.70:0/2191884888 >> v2:172.21.15.70:3300/0 conn(0x7fdc000cd1b0 0x7fdc000cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdbff7fe640 1 --2- 172.21.15.70:0/2191884888 >> v2:172.21.15.120:3300/0 conn(0x7fdc000cf280 0x7fdc000cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdbfeffd640 1 -- 172.21.15.70:0/2191884888 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319588270 0 0) 0x7fdc000cc730 con 0x7fdc00143ac0 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdbfeffd640 1 -- 172.21.15.70:0/2191884888 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe8003530 con 0x7fdc00143ac0 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc04ac7640 1 -- 172.21.15.70:0/2191884888 >> v2:172.21.15.120:3300/0 conn(0x7fdc000cf280 msgr2=0x7fdc000cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc04ac7640 1 --2- 172.21.15.70:0/2191884888 >> v2:172.21.15.120:3300/0 conn(0x7fdc000cf280 0x7fdc000cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc04ac7640 1 -- 172.21.15.70:0/2191884888 >> v1:172.21.15.70:6789/0 conn(0x7fdc00143ac0 legacy=0x7fdc00070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc04ac7640 1 -- 172.21.15.70:0/2191884888 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00070ee0 con 0x7fdc000cd1b0 2023-11-26T07:21:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.600+0000 7fdc04ac7640 1 --2- 172.21.15.70:0/2191884888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cd1b0 0x7fdc000cd5c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdc000aeb10 tx=0x7fdbf801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81220bb5bfd792f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdbfeffd640 1 -- 172.21.15.70:0/2191884888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80a59d0 con 0x7fdc000cd1b0 2023-11-26T07:21:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdbfeffd640 1 -- 172.21.15.70:0/2191884888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf80a5b30 con 0x7fdc000cd1b0 2023-11-26T07:21:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdbfeffd640 1 -- 172.21.15.70:0/2191884888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80a5ea0 con 0x7fdc000cd1b0 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- 172.21.15.70:0/2191884888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cd1b0 msgr2=0x7fdc000cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 --2- 172.21.15.70:0/2191884888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cd1b0 0x7fdc000cd5c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdc000aeb10 tx=0x7fdbf801c910 comp rx=0 tx=0).stop 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- 172.21.15.70:0/2191884888 shutdown_connections 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 --2- 172.21.15.70:0/2191884888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cd1b0 0x7fdc000cd5c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 --2- 172.21.15.70:0/2191884888 >> v2:172.21.15.120:3300/0 conn(0x7fdc000cf280 0x7fdc000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- 172.21.15.70:0/2191884888 >> 172.21.15.70:0/2191884888 conn(0x7fdc0006a890 msgr2=0x7fdc0006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- 172.21.15.70:0/2191884888 shutdown_connections 2023-11-26T07:21:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- 172.21.15.70:0/2191884888 wait complete. 2023-11-26T07:21:42.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 Processor -- start 2023-11-26T07:21:42.609 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- start start 2023-11-26T07:21:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdc000cd1b0 0x7fdc00157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cf280 0x7fdc000ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc00143ac0 0x7fdc000ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000ae390 con 0x7fdc000cf280 2023-11-26T07:21:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00138580 con 0x7fdc00143ac0 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdc0652a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00138860 con 0x7fdc000cd1b0 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdbff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cf280 0x7fdc000ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdbff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cf280 0x7fdc000ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54234/0 (socket says 172.21.15.70:54234) 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.604+0000 7fdbff7fe640 1 -- 172.21.15.70:0/3698883968 learned_addr learned my addr 172.21.15.70:0/3698883968 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdc04ac7640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc00143ac0 0x7fdc000ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbff7fe640 1 -- 172.21.15.70:0/3698883968 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdc000cd1b0 msgr2=0x7fdc00157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbff7fe640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdc000cd1b0 0x7fdc00157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbff7fe640 1 -- 172.21.15.70:0/3698883968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc00143ac0 msgr2=0x7fdc000ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbff7fe640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc00143ac0 0x7fdc000ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbff7fe640 1 -- 172.21.15.70:0/3698883968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8009a70 con 0x7fdc000cf280 2023-11-26T07:21:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbff7fe640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cf280 0x7fdc000ade50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400ea40 tx=0x7fdbf400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbfcff9640 1 -- 172.21.15.70:0/3698883968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400de60 con 0x7fdc000cf280 2023-11-26T07:21:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbfcff9640 1 -- 172.21.15.70:0/3698883968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf4010440 con 0x7fdc000cf280 2023-11-26T07:21:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbfcff9640 1 -- 172.21.15.70:0/3698883968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40107d0 con 0x7fdc000cf280 2023-11-26T07:21:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc000ad6b0 con 0x7fdc000cf280 2023-11-26T07:21:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc00138230 con 0x7fdc000cf280 2023-11-26T07:21:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc00138a20 con 0x7fdc000cf280 2023-11-26T07:21:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbfcff9640 1 -- 172.21.15.70:0/3698883968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fdbf4010930 con 0x7fdc000cf280 2023-11-26T07:21:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.608+0000 7fdbfcff9640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdbec066a10 0x7fdbec068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.612+0000 7fdbfcff9640 1 -- 172.21.15.70:0/3698883968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdbf4014030 con 0x7fdc000cf280 2023-11-26T07:21:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.612+0000 7fdbfffff640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdbec066a10 0x7fdbec068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.612+0000 7fdbfffff640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdbec066a10 0x7fdbec068ed0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0007fd0 tx=0x7fdbf0007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:42.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.612+0000 7fdbfcff9640 1 -- 172.21.15.70:0/3698883968 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbf40518a0 con 0x7fdc000cf280 2023-11-26T07:21:42.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.764+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdc00067680 con 0x7fdc000cf280 2023-11-26T07:21:42.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdbfcff9640 1 -- 172.21.15.70:0/3698883968 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdbf4054ec0 con 0x7fdc000cf280 2023-11-26T07:21:42.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdbec066a10 msgr2=0x7fdbec068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdbec066a10 0x7fdbec068ed0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0007fd0 tx=0x7fdbf0007900 comp rx=0 tx=0).stop 2023-11-26T07:21:42.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cf280 msgr2=0x7fdc000ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:42.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cf280 0x7fdc000ade50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400ea40 tx=0x7fdbf400ef00 comp rx=0 tx=0).stop 2023-11-26T07:21:42.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 shutdown_connections 2023-11-26T07:21:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdbec066a10 0x7fdbec068ed0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc000cf280 0x7fdc000ade50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc00143ac0 0x7fdc000ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.768+0000 7fdc0652a640 1 --2- 172.21.15.70:0/3698883968 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdc000cd1b0 0x7fdc00157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.772+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 >> 172.21.15.70:0/3698883968 conn(0x7fdc0006a890 msgr2=0x7fdc0015a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.772+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 shutdown_connections 2023-11-26T07:21:42.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:42.772+0000 7fdc0652a640 1 -- 172.21.15.70:0/3698883968 wait complete. 2023-11-26T07:21:42.794 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:21:42.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:42.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:21:42.949 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:21:42.949 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:42.949 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:42.958 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:21:42.958 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:21:42.958 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:42.967 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:21:42.968 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:21:42.968 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:43.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:21:43.007 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:21:43.007 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:21:43.024 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:21:43.024 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:21:43.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:43.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.180+0000 7f1ba00e3640 1 Processor -- start 2023-11-26T07:21:43.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.180+0000 7f1ba00e3640 1 -- start start 2023-11-26T07:21:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1ba00e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b980cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1ba00e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1b98070fd0 0x7f1b98162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1ba00e3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b980cfc20 con 0x7f1b980cf7c0 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1ba00e3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b98162080 con 0x7f1b98070fd0 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1ba00e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98161d70 con 0x7f1b9814b1e0 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9e680640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1b98070fd0 0x7f1b98162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9e680640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1b98070fd0 0x7f1b98162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54236/0 (socket says 172.21.15.70:54236) 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9e680640 1 -- 172.21.15.70:0/184316531 learned_addr learned my addr 172.21.15.70:0/184316531 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9de7f640 1 --2- 172.21.15.70:0/184316531 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b980cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9e680640 1 -- 172.21.15.70:0/184316531 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 msgr2=0x7f1b980cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9e680640 1 --2- 172.21.15.70:0/184316531 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b980cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9e680640 1 -- 172.21.15.70:0/184316531 >> v1:172.21.15.120:6789/0 conn(0x7f1b980cf7c0 legacy=0x7f1b980708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.184+0000 7f1b9e680640 1 -- 172.21.15.70:0/184316531 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9814b5c0 con 0x7f1b98070fd0 2023-11-26T07:21:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1b9e680640 1 --2- 172.21.15.70:0/184316531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b98070fd0 0x7f1b98162510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009e50 tx=0x7f1b9001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9fd14b3a4eef0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1b9ce7d640 1 -- 172.21.15.70:0/184316531 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900a58a0 con 0x7f1b98070fd0 2023-11-26T07:21:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1b9ce7d640 1 -- 172.21.15.70:0/184316531 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900a5a00 con 0x7f1b98070fd0 2023-11-26T07:21:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1b9ce7d640 1 -- 172.21.15.70:0/184316531 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900a5d90 con 0x7f1b98070fd0 2023-11-26T07:21:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 -- 172.21.15.70:0/184316531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b98070fd0 msgr2=0x7f1b98162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/184316531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b98070fd0 0x7f1b98162510 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009e50 tx=0x7f1b9001c9e0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 -- 172.21.15.70:0/184316531 shutdown_connections 2023-11-26T07:21:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/184316531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b98070fd0 0x7f1b98162510 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/184316531 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b980cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 -- 172.21.15.70:0/184316531 >> 172.21.15.70:0/184316531 conn(0x7f1b9806a890 msgr2=0x7f1b9806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 -- 172.21.15.70:0/184316531 shutdown_connections 2023-11-26T07:21:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 -- 172.21.15.70:0/184316531 wait complete. 2023-11-26T07:21:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 Processor -- start 2023-11-26T07:21:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 -- start start 2023-11-26T07:21:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b98070fd0 0x7f1b98145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.188+0000 7f1ba00e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b980cf7c0 0x7f1b98160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1ba00e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b981612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1ba00e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b98161830 con 0x7f1b980cf7c0 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1ba00e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980aa780 con 0x7f1b98070fd0 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1ba00e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980aaa60 con 0x7f1b9814b1e0 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b980cf7c0 0x7f1b98160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b980cf7c0 0x7f1b98160db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54246/0 (socket says 172.21.15.70:54246) 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 -- 172.21.15.70:0/2702595070 learned_addr learned my addr 172.21.15.70:0/2702595070 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9de7f640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b98070fd0 0x7f1b98145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9e680640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b981612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 -- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 msgr2=0x7f1b981612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b981612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 -- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b98070fd0 msgr2=0x7f1b98145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b98070fd0 0x7f1b98145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 -- 172.21.15.70:0/2702595070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b90009b30 con 0x7f1b980cf7c0 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9de7f640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b98070fd0 0x7f1b98145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9e680640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b981612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b9d67e640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b980cf7c0 0x7f1b98160db0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c500 tx=0x7f1b8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b8e7fc640 1 -- 172.21.15.70:0/2702595070 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88005220 con 0x7f1b980cf7c0 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b8e7fc640 1 -- 172.21.15.70:0/2702595070 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b88005380 con 0x7f1b980cf7c0 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b8e7fc640 1 -- 172.21.15.70:0/2702595070 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88007270 con 0x7f1b980cf7c0 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b980aad40 con 0x7f1b980cf7c0 2023-11-26T07:21:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b980ab300 con 0x7f1b980cf7c0 2023-11-26T07:21:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b980ab520 con 0x7f1b980cf7c0 2023-11-26T07:21:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b8e7fc640 1 -- 172.21.15.70:0/2702595070 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f1b880073d0 con 0x7f1b980cf7c0 2023-11-26T07:21:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b8e7fc640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b7c066a10 0x7f1b7c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.192+0000 7f1b8e7fc640 1 -- 172.21.15.70:0/2702595070 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b88083f90 con 0x7f1b980cf7c0 2023-11-26T07:21:43.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.196+0000 7f1b9de7f640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b7c066a10 0x7f1b7c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.196+0000 7f1b9de7f640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b7c066a10 0x7f1b7c068ed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097a0 tx=0x7f1b94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:43.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.196+0000 7f1b8e7fc640 1 -- 172.21.15.70:0/2702595070 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b88050e70 con 0x7f1b980cf7c0 2023-11-26T07:21:43.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b98067680 con 0x7f1b980cf7c0 2023-11-26T07:21:43.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1b8e7fc640 1 -- 172.21.15.70:0/2702595070 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f1b88054490 con 0x7f1b980cf7c0 2023-11-26T07:21:43.384 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:43.384 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3372803527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3372803527},{"type":"v1","addr":"172.21.15.120:6833","nonce":3372803527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5671,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2241396376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2241396376},{"type":"v1","addr":"172.21.15.120:6835","nonce":2241396376}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1311811000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1311811000},{"type":"v1","addr":"172.21.15.70:6835","nonce":1311811000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2121790109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2121790109},{"type":"v1","addr":"172.21.15.70:6837","nonce":2121790109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[]} 2023-11-26T07:21:43.385 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 31 2023-11-26T07:21:43.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b7c066a10 msgr2=0x7f1b7c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b7c066a10 0x7f1b7c068ed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1b940097a0 tx=0x7f1b94008040 comp rx=0 tx=0).stop 2023-11-26T07:21:43.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b980cf7c0 msgr2=0x7f1b98160db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:43.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b980cf7c0 0x7f1b98160db0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c500 tx=0x7f1b8800c9c0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 shutdown_connections 2023-11-26T07:21:43.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1b7c066a10 0x7f1b7c068ed0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b980cf7c0 0x7f1b98160db0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1b9814b1e0 0x7f1b981612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 --2- 172.21.15.70:0/2702595070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b98070fd0 0x7f1b98145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:43.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 >> 172.21.15.70:0/2702595070 conn(0x7f1b9806a890 msgr2=0x7f1b980b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:43.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 shutdown_connections 2023-11-26T07:21:43.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:43.380+0000 7f1ba00e3640 1 -- 172.21.15.70:0/2702595070 wait complete. 2023-11-26T07:21:43.405 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:21:43.406 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:21:43.406 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:21:43.406 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:43.406 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:21:43.406 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:21:43.406 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:21:43.406 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:43.407 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:21:43.407 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:21:43.407 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:21:43.407 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:43.407 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:21:43.407 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:21:43.407 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:21:43.407 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:21:43.424 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:21:43.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:21:43.426 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:21:43.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:21:43.427 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:21:43.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:21:43.470 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:21:43.470 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:43.477 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:21:43.478 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:43.479 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:21:43.480 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:43.556 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2023-11-26T07:21:43.568 INFO:tasks.ceph.mds.b.smithi120.stdout:starting mds.b at 2023-11-26T07:21:43.569 INFO:tasks.ceph.mds.d.smithi120.stdout:starting mds.d at 2023-11-26T07:21:44.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-26T07:21:49.424 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:21:49.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:21:49.428 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:21:49.428 DEBUG:teuthology.parallel:result is None 2023-11-26T07:21:49.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:21:49.522 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-11-26T07:21:49.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.572+0000 7ff50591d640 1 Processor -- start 2023-11-26T07:21:49.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.572+0000 7ff50591d640 1 -- start start 2023-11-26T07:21:49.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff50591d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5000cf280 0x7ff5000cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff50591d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000cc730 con 0x7ff5000cd1b0 2023-11-26T07:21:49.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff50591d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff500070ee0 con 0x7ff500143ac0 2023-11-26T07:21:49.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff50591d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff500143ea0 con 0x7ff5000cf280 2023-11-26T07:21:49.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff4f67fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff5000cf280 0x7ff5000cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff4ff7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff5000cd1b0 0x7ff5000cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41980/0 (socket says 172.21.15.70:41980) 2023-11-26T07:21:49.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff4ff7fe640 1 -- 172.21.15.70:0/2551441684 learned_addr learned my addr 172.21.15.70:0/2551441684 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:49.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff4f67fc640 1 -- 172.21.15.70:0/2551441684 >> v1:172.21.15.120:6789/0 conn(0x7ff500143ac0 legacy=0x7ff500070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff4f67fc640 1 -- 172.21.15.70:0/2551441684 >> v1:172.21.15.70:6789/0 conn(0x7ff5000cd1b0 legacy=0x7ff5000cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff4f67fc640 1 -- 172.21.15.70:0/2551441684 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000711c0 con 0x7ff5000cf280 2023-11-26T07:21:49.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.576+0000 7ff4f67fc640 1 --2- 172.21.15.70:0/2551441684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cf280 0x7ff5000cf710 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80097c0 tx=0x7ff4e801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57f5a5f8212bba6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff4fe7fc640 1 -- 172.21.15.70:0/2551441684 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80a8050 con 0x7ff5000cf280 2023-11-26T07:21:49.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff4fe7fc640 1 -- 172.21.15.70:0/2551441684 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e80ac5f0 con 0x7ff5000cf280 2023-11-26T07:21:49.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff4fe7fc640 1 -- 172.21.15.70:0/2551441684 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80ac980 con 0x7ff5000cf280 2023-11-26T07:21:49.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- 172.21.15.70:0/2551441684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cf280 msgr2=0x7ff5000cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 --2- 172.21.15.70:0/2551441684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cf280 0x7ff5000cf710 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80097c0 tx=0x7ff4e801c480 comp rx=0 tx=0).stop 2023-11-26T07:21:49.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- 172.21.15.70:0/2551441684 shutdown_connections 2023-11-26T07:21:49.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 --2- 172.21.15.70:0/2551441684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cf280 0x7ff5000cf710 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- 172.21.15.70:0/2551441684 >> 172.21.15.70:0/2551441684 conn(0x7ff50006a890 msgr2=0x7ff50006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:49.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- 172.21.15.70:0/2551441684 shutdown_connections 2023-11-26T07:21:49.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- 172.21.15.70:0/2551441684 wait complete. 2023-11-26T07:21:49.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 Processor -- start 2023-11-26T07:21:49.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- start start 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cd1b0 0x7ff5001f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000cf280 0x7ff5001f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff500143ac0 0x7ff500158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000b19a0 con 0x7ff5000cd1b0 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000b0d20 con 0x7ff5000cf280 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff50591d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000b1000 con 0x7ff500143ac0 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.580+0000 7ff4feffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cd1b0 0x7ff5001f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cd1b0 0x7ff5001f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42266/0 (socket says 172.21.15.70:42266) 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 -- 172.21.15.70:0/835370307 learned_addr learned my addr 172.21.15.70:0/835370307 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4f67fc640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000cf280 0x7ff5001f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4ff7fe640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff500143ac0 0x7ff500158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 -- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff500143ac0 msgr2=0x7ff500158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff500143ac0 0x7ff500158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 -- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000cf280 msgr2=0x7ff5001f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000cf280 0x7ff5001f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 -- 172.21.15.70:0/835370307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8009420 con 0x7ff5000cd1b0 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4ff7fe640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff500143ac0 0x7ff500158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4feffd640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cd1b0 0x7ff5001f6e10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c3c0 tx=0x7ff4f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4fcff9640 1 -- 172.21.15.70:0/835370307 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00052d0 con 0x7ff5000cd1b0 2023-11-26T07:21:49.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4fcff9640 1 -- 172.21.15.70:0/835370307 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0005430 con 0x7ff5000cd1b0 2023-11-26T07:21:49.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4fcff9640 1 -- 172.21.15.70:0/835370307 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0003840 con 0x7ff5000cd1b0 2023-11-26T07:21:49.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5000b12e0 con 0x7ff5000cd1b0 2023-11-26T07:21:49.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5001f4f40 con 0x7ff5000cd1b0 2023-11-26T07:21:49.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500067680 con 0x7ff5000cd1b0 2023-11-26T07:21:49.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.584+0000 7ff4fcff9640 1 -- 172.21.15.70:0/835370307 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7ff4f00039a0 con 0x7ff5000cd1b0 2023-11-26T07:21:49.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.588+0000 7ff4fcff9640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4e0066a10 0x7ff4e0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:49.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.588+0000 7ff4fcff9640 1 -- 172.21.15.70:0/835370307 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff4f0083ad0 con 0x7ff5000cd1b0 2023-11-26T07:21:49.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.588+0000 7ff4f67fc640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4e0066a10 0x7ff4e0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:49.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.588+0000 7ff4f67fc640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4e0066a10 0x7ff4e0068ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ae000 tx=0x7ff4e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:49.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.592+0000 7ff4fcff9640 1 -- 172.21.15.70:0/835370307 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4f0050a50 con 0x7ff5000cd1b0 2023-11-26T07:21:49.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:49.752+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff5000cb670 con 0x7ff5000cd1b0 2023-11-26T07:21:50.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.820+0000 7ff4fcff9640 1 -- 172.21.15.70:0/835370307 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff4f0017080 con 0x7ff5000cd1b0 2023-11-26T07:21:50.825 INFO:teuthology.orchestra.run.smithi070.stderr: removed all blocklist entries 2023-11-26T07:21:50.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4e0066a10 msgr2=0x7ff4e0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4e0066a10 0x7ff4e0068ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ae000 tx=0x7ff4e8008040 comp rx=0 tx=0).stop 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cd1b0 msgr2=0x7ff5001f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cd1b0 0x7ff5001f6e10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c3c0 tx=0x7ff4f000c880 comp rx=0 tx=0).stop 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 shutdown_connections 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff500143ac0 0x7ff500158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff5000cf280 0x7ff5001f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4e0066a10 0x7ff4e0068ed0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 --2- 172.21.15.70:0/835370307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5000cd1b0 0x7ff5001f6e10 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 >> 172.21.15.70:0/835370307 conn(0x7ff50006a890 msgr2=0x7ff50006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 shutdown_connections 2023-11-26T07:21:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.824+0000 7ff50591d640 1 -- 172.21.15.70:0/835370307 wait complete. 2023-11-26T07:21:50.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:21:50.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f095669c640 1 Processor -- start 2023-11-26T07:21:50.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f095669c640 1 -- start start 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f095669c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f095015d6e0 0x7f09500d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f095669c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f09500b2160 0x7f09500d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f095669c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500cf0e0 con 0x7f09500d19f0 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f095669c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095015dac0 con 0x7f095015d6e0 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f095669c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09500d1e80 con 0x7f09500b2160 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f095015d6e0 0x7f09500d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f095015d6e0 0x7f09500d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42276/0 (socket says 172.21.15.70:42276) 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094ffff640 1 -- 172.21.15.70:0/3125748410 learned_addr learned my addr 172.21.15.70:0/3125748410 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094f7fe640 1 --2- 172.21.15.70:0/3125748410 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f09500b2160 0x7f09500d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094ffff640 1 -- 172.21.15.70:0/3125748410 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f09500b2160 msgr2=0x7f09500d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094ffff640 1 --2- 172.21.15.70:0/3125748410 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f09500b2160 0x7f09500d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094ffff640 1 -- 172.21.15.70:0/3125748410 >> v1:172.21.15.120:6789/0 conn(0x7f09500d19f0 legacy=0x7f09500cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:50.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.992+0000 7f094ffff640 1 -- 172.21.15.70:0/3125748410 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500ceb20 con 0x7f095015d6e0 2023-11-26T07:21:51.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f094ffff640 1 --2- 172.21.15.70:0/3125748410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f095015d6e0 0x7f09500d0df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0940009870 tx=0x7f094001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7643954ec526e96 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f094effd640 1 -- 172.21.15.70:0/3125748410 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400ac410 con 0x7f095015d6e0 2023-11-26T07:21:51.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f094effd640 1 -- 172.21.15.70:0/3125748410 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09400ac570 con 0x7f095015d6e0 2023-11-26T07:21:51.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f094effd640 1 -- 172.21.15.70:0/3125748410 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400ac900 con 0x7f095015d6e0 2023-11-26T07:21:51.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 -- 172.21.15.70:0/3125748410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f095015d6e0 msgr2=0x7f09500d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 --2- 172.21.15.70:0/3125748410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f095015d6e0 0x7f09500d0df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0940009870 tx=0x7f094001c500 comp rx=0 tx=0).stop 2023-11-26T07:21:51.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 -- 172.21.15.70:0/3125748410 shutdown_connections 2023-11-26T07:21:51.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 --2- 172.21.15.70:0/3125748410 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f09500b2160 0x7f09500d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 --2- 172.21.15.70:0/3125748410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f095015d6e0 0x7f09500d0df0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 -- 172.21.15.70:0/3125748410 >> 172.21.15.70:0/3125748410 conn(0x7f095009c550 msgr2=0x7f09500d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 -- 172.21.15.70:0/3125748410 shutdown_connections 2023-11-26T07:21:51.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:50.996+0000 7f095669c640 1 -- 172.21.15.70:0/3125748410 wait complete. 2023-11-26T07:21:51.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 Processor -- start 2023-11-26T07:21:51.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 -- start start 2023-11-26T07:21:51.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09500b2160 0x7f095014b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09500d19f0 0x7f09500b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f095015d6e0 0x7f0950158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095014bb00 con 0x7f09500b2160 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500b6380 con 0x7f09500d19f0 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095015bbf0 con 0x7f095015d6e0 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09500b2160 0x7f095014b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09500b2160 0x7f095014b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42290/0 (socket says 172.21.15.70:42290) 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 -- 172.21.15.70:0/3246586813 learned_addr learned my addr 172.21.15.70:0/3246586813 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f0954c39640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f095015d6e0 0x7f0950158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094f7fe640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09500d19f0 0x7f09500b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 -- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f095015d6e0 msgr2=0x7f0950158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f095015d6e0 0x7f0950158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 -- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09500d19f0 msgr2=0x7f09500b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09500d19f0 0x7f09500b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 -- 172.21.15.70:0/3246586813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400094d0 con 0x7f09500b2160 2023-11-26T07:21:51.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094ffff640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09500b2160 0x7f095014b5c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f09400af040 tx=0x7f09400192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094cff9640 1 -- 172.21.15.70:0/3246586813 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400ac410 con 0x7f09500b2160 2023-11-26T07:21:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094cff9640 1 -- 172.21.15.70:0/3246586813 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09400b65f0 con 0x7f09500b2160 2023-11-26T07:21:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f094cff9640 1 -- 172.21.15.70:0/3246586813 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400b69a0 con 0x7f09500b2160 2023-11-26T07:21:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095015bed0 con 0x7f09500b2160 2023-11-26T07:21:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.000+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095015c490 con 0x7f09500b2160 2023-11-26T07:21:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.004+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0950067680 con 0x7f09500b2160 2023-11-26T07:21:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.004+0000 7f094cff9640 1 -- 172.21.15.70:0/3246586813 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f09400b6b00 con 0x7f09500b2160 2023-11-26T07:21:51.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.004+0000 7f094cff9640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f093c066a10 0x7f093c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.004+0000 7f094cff9640 1 -- 172.21.15.70:0/3246586813 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f094011f070 con 0x7f09500b2160 2023-11-26T07:21:51.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.004+0000 7f094f7fe640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f093c066a10 0x7f093c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.004+0000 7f094f7fe640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f093c066a10 0x7f093c068ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f095014bdc0 tx=0x7f0944008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.008+0000 7f094cff9640 1 -- 172.21.15.70:0/3246586813 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09400ec0b0 con 0x7f09500b2160 2023-11-26T07:21:51.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.208+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f095009c930 con 0x7f09500b2160 2023-11-26T07:21:51.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.208+0000 7f094cff9640 1 -- 172.21.15.70:0/3246586813 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f09400b1090 con 0x7f09500b2160 2023-11-26T07:21:51.214 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:51.214 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:21:51.214 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_dump": [ 2023-11-26T07:21:51.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.215 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.a", 2023-11-26T07:21:51.215 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlK818ExAA3Pl7hruKT9tvdseH1RoDNw==", 2023-11-26T07:21:51.215 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.215 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.215 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:21:51.216 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:21:51.216 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.217 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.b", 2023-11-26T07:21:51.217 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl+74KIBAAAU2yWLE9nGWyh2Eew8a2cQ==", 2023-11-26T07:21:51.217 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.218 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.218 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:21:51.218 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:21:51.218 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.c", 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl2a4KGxAAGVTHr4IYGCxqIbJI4GAlHw==", 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.d", 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlkKVrJxAA/tao4nxlwlxXqNbpcOQO0w==", 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.0", 2023-11-26T07:21:51.220 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDv8GJlMTzJDRAAtRLnzO4hzBrRsOTxU0sn1g==", 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.1", 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDy8GJlYwIPFBAA08sYURmRGI+e5KAfsYCowQ==", 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.221 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.2", 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD18GJl2yAVGxAAbmsr89meMeh8tOtuLwO2nQ==", 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.3", 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD48GJlgsovIRAAR7B4+PHY5+5A/pLTUYSv/Q==", 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.4", 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD+8GJllmjnJRAAfX4zIcgsX+H5/jgeJd4fJQ==", 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.223 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.5", 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAB8WJlebhlLBAAXicxjU2Nww1KEts/9c6YWQ==", 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.6", 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAE8WJlrYwEMxAAt996EyIggEIdDG5Jo8pxLg==", 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.7", 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAH8WJlUqeLOhAAMXAlFPwvIZkjtwDqTqj9Dg==", 2023-11-26T07:21:51.225 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.0", 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA==", 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow r", 2023-11-26T07:21:51.226 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.1", 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl19ntNBAAm+Na43D/jVnw3XfgG4syqg==", 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.2", 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlbfhnMRAAUU4/Sqog5uGnzt4xD/6M6g==", 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.3", 2023-11-26T07:21:51.228 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlUVjqOhAAg1iYDvnKqcoojshB4YtI7Q==", 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.admin", 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDs8GJlRiV4MhAABZ2mWkM6iWcfvniCtWCj4w==", 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.229 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.x", 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl5WcCDxAAAQ7rZ5sJaZ6CGeJ2izEpNA==", 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:21:51.230 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.y", 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlc3stCxAAjCksCvC5/30P/2m2kedt6w==", 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:51.231 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-11-26T07:21:51.232 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:21:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f093c066a10 msgr2=0x7f093c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f093c066a10 0x7f093c068ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f095014bdc0 tx=0x7f0944008040 comp rx=0 tx=0).stop 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09500b2160 msgr2=0x7f095014b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09500b2160 0x7f095014b5c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f09400af040 tx=0x7f09400192a0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 shutdown_connections 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f095015d6e0 0x7f0950158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f09500d19f0 0x7f09500b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f093c066a10 0x7f093c068ed0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 --2- 172.21.15.70:0/3246586813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09500b2160 0x7f095014b5c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 >> 172.21.15.70:0/3246586813 conn(0x7f095009c550 msgr2=0x7f09500b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 shutdown_connections 2023-11-26T07:21:51.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.212+0000 7f095669c640 1 -- 172.21.15.70:0/3246586813 wait complete. 2023-11-26T07:21:51.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:51.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.368+0000 7fdd018bb640 1 Processor -- start 2023-11-26T07:21:51.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.368+0000 7fdd018bb640 1 -- start start 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdd018bb640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdd018bb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdcfc099a70 0x7fdcfc06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdd018bb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcfc0cf260 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdd018bb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcfc06d570 con 0x7fdcfc099a70 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdd018bb640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc09a010 con 0x7fdcfc06f000 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfb7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdcfc099a70 0x7fdcfc06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcf27fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fdcfc06f3e0 0x7fdcfc06b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41988/0 (socket says 172.21.15.70:41988) 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfb7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdcfc099a70 0x7fdcfc06bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42292/0 (socket says 172.21.15.70:42292) 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcf27fc640 1 -- 172.21.15.70:0/417887848 learned_addr learned my addr 172.21.15.70:0/417887848 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:51.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfaffd640 1 --2- 172.21.15.70:0/417887848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfb7fe640 1 -- 172.21.15.70:0/417887848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 msgr2=0x7fdcfc06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:51.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfb7fe640 1 --2- 172.21.15.70:0/417887848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc06d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfb7fe640 1 -- 172.21.15.70:0/417887848 >> v1:172.21.15.70:6789/0 conn(0x7fdcfc06f3e0 legacy=0x7fdcfc06b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfb7fe640 1 -- 172.21.15.70:0/417887848 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc09a2f0 con 0x7fdcfc099a70 2023-11-26T07:21:51.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfa7fc640 1 -- 172.21.15.70:0/417887848 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233295539 0 0) 0x7fdcfc0cf260 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.372+0000 7fdcfb7fe640 1 --2- 172.21.15.70:0/417887848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc099a70 0x7fdcfc06bcb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40097c0 tx=0x7fdcf401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937795a1522547fe server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdcfa7fc640 1 -- 172.21.15.70:0/417887848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40ab600 con 0x7fdcfc099a70 2023-11-26T07:21:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdcfa7fc640 1 -- 172.21.15.70:0/417887848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40a7050 con 0x7fdcfc099a70 2023-11-26T07:21:51.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdcfa7fc640 1 -- 172.21.15.70:0/417887848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40ab980 con 0x7fdcfc099a70 2023-11-26T07:21:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- 172.21.15.70:0/417887848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc099a70 msgr2=0x7fdcfc06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 --2- 172.21.15.70:0/417887848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc099a70 0x7fdcfc06bcb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40097c0 tx=0x7fdcf401c480 comp rx=0 tx=0).stop 2023-11-26T07:21:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- 172.21.15.70:0/417887848 shutdown_connections 2023-11-26T07:21:51.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 --2- 172.21.15.70:0/417887848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc099a70 0x7fdcfc06bcb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 --2- 172.21.15.70:0/417887848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc06d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- 172.21.15.70:0/417887848 >> 172.21.15.70:0/417887848 conn(0x7fdcfc0b2d10 msgr2=0x7fdcfc0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- 172.21.15.70:0/417887848 shutdown_connections 2023-11-26T07:21:51.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- 172.21.15.70:0/417887848 wait complete. 2023-11-26T07:21:51.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 Processor -- start 2023-11-26T07:21:51.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- start start 2023-11-26T07:21:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc14a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc06f3e0 0x7fdcfc0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcfc099a70 0x7fdcfc154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc150d60 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b52f0 con 0x7fdcfc099a70 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.376+0000 7fdd018bb640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcfc0b5520 con 0x7fdcfc06f000 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc06f3e0 0x7fdcfc0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc06f3e0 0x7fdcfc0b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42300/0 (socket says 172.21.15.70:42300) 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 -- 172.21.15.70:0/3290312925 learned_addr learned my addr 172.21.15.70:0/3290312925 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcfaffd640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc14a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcfb7fe640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcfc099a70 0x7fdcfc154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 -- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 msgr2=0x7fdcfc14a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc14a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 -- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcfc099a70 msgr2=0x7fdcfc154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcfc099a70 0x7fdcfc154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 -- 172.21.15.70:0/3290312925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4009420 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf27fc640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc06f3e0 0x7fdcfc0b65c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdce4001570 tx=0x7fdce400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf8ff9640 1 -- 172.21.15.70:0/3290312925 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400a640 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf8ff9640 1 -- 172.21.15.70:0/3290312925 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400a7c0 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcfc0b5800 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf8ff9640 1 -- 172.21.15.70:0/3290312925 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400ab70 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcfc0b5dc0 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcfc067680 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.380+0000 7fdcf8ff9640 1 -- 172.21.15.70:0/3290312925 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fdce400acd0 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.384+0000 7fdcf8ff9640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdcdc066a10 0x7fdcdc068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.384+0000 7fdcf8ff9640 1 -- 172.21.15.70:0/3290312925 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdce4083e40 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.384+0000 7fdcfaffd640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdcdc066a10 0x7fdcdc068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.384+0000 7fdcfaffd640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdcdc066a10 0x7fdcdc068ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc150f10 tx=0x7fdcec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.388+0000 7fdcf8ff9640 1 -- 172.21.15.70:0/3290312925 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdce4050e10 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-26T07:21:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.536+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcfc0cd870 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.536+0000 7fdcf8ff9640 1 -- 172.21.15.70:0/3290312925 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+12857 (secure 0 0 0) 0x7fdce4018020 con 0x7fdcfc06f3e0 2023-11-26T07:21:51.542 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:51.542 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":60,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:50.823089+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdcdc066a10 msgr2=0x7fdcdc068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdcdc066a10 0x7fdcdc068ed0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc150f10 tx=0x7fdcec009190 comp rx=0 tx=0).stop 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc06f3e0 msgr2=0x7fdcfc0b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc06f3e0 0x7fdcfc0b65c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdce4001570 tx=0x7fdce400cd20 comp rx=0 tx=0).stop 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 shutdown_connections 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdcdc066a10 0x7fdcdc068ed0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcfc06f3e0 0x7fdcfc0b65c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcfc099a70 0x7fdcfc154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 --2- 172.21.15.70:0/3290312925 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdcfc06f000 0x7fdcfc14a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 >> 172.21.15.70:0/3290312925 conn(0x7fdcfc0b2d10 msgr2=0x7fdcfc156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 shutdown_connections 2023-11-26T07:21:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.540+0000 7fdd018bb640 1 -- 172.21.15.70:0/3290312925 wait complete. 2023-11-26T07:21:51.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:21:51.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:21:51.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.696+0000 7f6876f94640 1 Processor -- start 2023-11-26T07:21:51.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.696+0000 7f6876f94640 1 -- start start 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6876f94640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6870070ba0 0x7f687006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6876f94640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6870161cf0 0x7f6870070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6876f94640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700714c0 con 0x7f68700cdd10 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6876f94640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700cd610 con 0x7f6870070ba0 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6876f94640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700cd8f0 con 0x7f6870161cf0 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6874d30640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6870070ba0 0x7f687006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6874d30640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6870070ba0 0x7f687006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42312/0 (socket says 172.21.15.70:42312) 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6874d30640 1 -- 172.21.15.70:0/2983727900 learned_addr learned my addr 172.21.15.70:0/2983727900 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6875531640 1 --1- 172.21.15.70:0/2983727900 >> v1:172.21.15.70:6789/0 conn(0x7f68700cdd10 0x7f687006a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41992/0 (socket says 172.21.15.70:41992) 2023-11-26T07:21:51.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6867fff640 1 --2- 172.21.15.70:0/2983727900 >> v2:172.21.15.120:3300/0 conn(0x7f6870161cf0 0x7f6870070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6874d30640 1 -- 172.21.15.70:0/2983727900 >> v2:172.21.15.120:3300/0 conn(0x7f6870161cf0 msgr2=0x7f6870070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:51.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6874d30640 1 --2- 172.21.15.70:0/2983727900 >> v2:172.21.15.120:3300/0 conn(0x7f6870161cf0 0x7f6870070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6874d30640 1 -- 172.21.15.70:0/2983727900 >> v1:172.21.15.70:6789/0 conn(0x7f68700cdd10 legacy=0x7f687006a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f6874d30640 1 -- 172.21.15.70:0/2983727900 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870161210 con 0x7f6870070ba0 2023-11-26T07:21:51.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.700+0000 7f68677fe640 1 -- 172.21.15.70:0/2983727900 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784304235 0 0) 0x7f68700714c0 con 0x7f68700cdd10 2023-11-26T07:21:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6874d30640 1 --2- 172.21.15.70:0/2983727900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6870070ba0 0x7f687006bae0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f68700cbd40 tx=0x7f686c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9447f860b0e9d2af server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f68677fe640 1 -- 172.21.15.70:0/2983727900 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0ab600 con 0x7f6870070ba0 2023-11-26T07:21:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f68677fe640 1 -- 172.21.15.70:0/2983727900 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c0a7050 con 0x7f6870070ba0 2023-11-26T07:21:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f68677fe640 1 -- 172.21.15.70:0/2983727900 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0ab980 con 0x7f6870070ba0 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 -- 172.21.15.70:0/2983727900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6870070ba0 msgr2=0x7f687006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 --2- 172.21.15.70:0/2983727900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6870070ba0 0x7f687006bae0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f68700cbd40 tx=0x7f686c01c500 comp rx=0 tx=0).stop 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 -- 172.21.15.70:0/2983727900 shutdown_connections 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 --2- 172.21.15.70:0/2983727900 >> v2:172.21.15.120:3300/0 conn(0x7f6870161cf0 0x7f6870070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 --2- 172.21.15.70:0/2983727900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6870070ba0 0x7f687006bae0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 -- 172.21.15.70:0/2983727900 >> 172.21.15.70:0/2983727900 conn(0x7f68700cf710 msgr2=0x7f68700cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 -- 172.21.15.70:0/2983727900 shutdown_connections 2023-11-26T07:21:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 -- 172.21.15.70:0/2983727900 wait complete. 2023-11-26T07:21:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 Processor -- start 2023-11-26T07:21:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.704+0000 7f6876f94640 1 -- start start 2023-11-26T07:21:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6870070ba0 0x7f68700b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68700cdd10 0x7f6870152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6870161cf0 0x7f6870153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700af6c0 con 0x7f68700cdd10 2023-11-26T07:21:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700af9a0 con 0x7f6870070ba0 2023-11-26T07:21:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700afc80 con 0x7f6870161cf0 2023-11-26T07:21:51.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68700cdd10 0x7f6870152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68700cdd10 0x7f6870152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42320/0 (socket says 172.21.15.70:42320) 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 -- 172.21.15.70:0/1906385772 learned_addr learned my addr 172.21.15.70:0/1906385772 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6874d30640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6870070ba0 0x7f68700b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6875531640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6870161cf0 0x7f6870153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 -- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6870161cf0 msgr2=0x7f6870153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6870161cf0 0x7f6870153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 -- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6870070ba0 msgr2=0x7f68700b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6870070ba0 0x7f68700b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 -- 172.21.15.70:0/1906385772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c0094d0 con 0x7f68700cdd10 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6874d30640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6870070ba0 0x7f68700b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6867fff640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68700cdd10 0x7f6870152e30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f686000d5f0 tx=0x7f686000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f68657fa640 1 -- 172.21.15.70:0/1906385772 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68600125f0 con 0x7f68700cdd10 2023-11-26T07:21:51.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f68657fa640 1 -- 172.21.15.70:0/1906385772 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6860012750 con 0x7f68700cdd10 2023-11-26T07:21:51.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f68657fa640 1 -- 172.21.15.70:0/1906385772 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860012ae0 con 0x7f68700cdd10 2023-11-26T07:21:51.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68700aff60 con 0x7f68700cdd10 2023-11-26T07:21:51.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68700af390 con 0x7f68700cdd10 2023-11-26T07:21:51.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870067680 con 0x7f68700cdd10 2023-11-26T07:21:51.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.708+0000 7f68657fa640 1 -- 172.21.15.70:0/1906385772 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f6860012c40 con 0x7f68700cdd10 2023-11-26T07:21:51.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.712+0000 7f68657fa640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f685c066a10 0x7f685c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:51.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.712+0000 7f68657fa640 1 -- 172.21.15.70:0/1906385772 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68600848e0 con 0x7f68700cdd10 2023-11-26T07:21:51.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.712+0000 7f6874d30640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f685c066a10 0x7f685c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:51.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.712+0000 7f6874d30640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f685c066a10 0x7f685c068ed0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f686c0ad000 tx=0x7f686c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:51.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.716+0000 7f68657fa640 1 -- 172.21.15.70:0/1906385772 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6860051940 con 0x7f68700cdd10 2023-11-26T07:21:51.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68700ad140 con 0x7f68700cdd10 2023-11-26T07:21:51.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f68657fa640 1 -- 172.21.15.70:0/1906385772 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6860007380 con 0x7f68700cdd10 2023-11-26T07:21:51.872 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f685c066a10 msgr2=0x7f685c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f685c066a10 0x7f685c068ed0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f686c0ad000 tx=0x7f686c0a6000 comp rx=0 tx=0).stop 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68700cdd10 msgr2=0x7f6870152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68700cdd10 0x7f6870152e30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f686000d5f0 tx=0x7f686000dab0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 shutdown_connections 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f685c066a10 0x7f685c068ed0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68700cdd10 0x7f6870152e30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6870161cf0 0x7f6870153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 --2- 172.21.15.70:0/1906385772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6870070ba0 0x7f68700b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:51.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 >> 172.21.15.70:0/1906385772 conn(0x7f68700cf710 msgr2=0x7f6870155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:51.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 shutdown_connections 2023-11-26T07:21:51.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:51.868+0000 7f6876f94640 1 -- 172.21.15.70:0/1906385772 wait complete. 2023-11-26T07:21:51.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:21:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f271afaa640 1 Processor -- start 2023-11-26T07:21:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f271afaa640 1 -- start start 2023-11-26T07:21:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f271afaa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f27140d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f271afaa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140cf0e0 con 0x7f27140b2160 2023-11-26T07:21:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f271afaa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140ceb20 con 0x7f27140d1bc0 2023-11-26T07:21:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f271afaa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271415dac0 con 0x7f271415d6e0 2023-11-26T07:21:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f2713fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f27140b2160 0x7f27140d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:41996/0 (socket says 172.21.15.70:41996) 2023-11-26T07:21:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f2713fff640 1 -- 172.21.15.70:0/2803226038 learned_addr learned my addr 172.21.15.70:0/2803226038 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f2718d46640 1 --2- 172.21.15.70:0/2803226038 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f27140d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f27137fe640 1 -- 172.21.15.70:0/2803226038 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511942260 0 0) 0x7f27140cf0e0 con 0x7f27140b2160 2023-11-26T07:21:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f27137fe640 1 -- 172.21.15.70:0/2803226038 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2704003530 con 0x7f27140b2160 2023-11-26T07:21:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f27137fe640 1 -- 172.21.15.70:0/2803226038 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296546384 0 0) 0x7f27140ceb20 con 0x7f27140d1bc0 2023-11-26T07:21:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f27137fe640 1 -- 172.21.15.70:0/2803226038 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27140cf0e0 con 0x7f27140d1bc0 2023-11-26T07:21:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f2718d46640 1 -- 172.21.15.70:0/2803226038 >> v1:172.21.15.120:6789/0 conn(0x7f27140d1bc0 legacy=0x7f27140b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f2718d46640 1 -- 172.21.15.70:0/2803226038 >> v1:172.21.15.70:6789/0 conn(0x7f27140b2160 legacy=0x7f27140d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.028+0000 7f2718d46640 1 -- 172.21.15.70:0/2803226038 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140cee00 con 0x7f271415d6e0 2023-11-26T07:21:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f2718d46640 1 --2- 172.21.15.70:0/2803226038 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f27140d0df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27080097f0 tx=0x7f270801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1887298042117d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f27137fe640 1 -- 172.21.15.70:0/2803226038 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080ac410 con 0x7f271415d6e0 2023-11-26T07:21:52.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f27137fe640 1 -- 172.21.15.70:0/2803226038 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080ac570 con 0x7f271415d6e0 2023-11-26T07:21:52.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f27137fe640 1 -- 172.21.15.70:0/2803226038 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080ac900 con 0x7f271415d6e0 2023-11-26T07:21:52.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f271afaa640 1 -- 172.21.15.70:0/2803226038 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 msgr2=0x7f27140d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f271afaa640 1 --2- 172.21.15.70:0/2803226038 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f27140d0df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f27080097f0 tx=0x7f270801c4c0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f271afaa640 1 -- 172.21.15.70:0/2803226038 shutdown_connections 2023-11-26T07:21:52.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f271afaa640 1 --2- 172.21.15.70:0/2803226038 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f27140d0df0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f271afaa640 1 -- 172.21.15.70:0/2803226038 >> 172.21.15.70:0/2803226038 conn(0x7f271409c550 msgr2=0x7f27140d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:52.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f271afaa640 1 -- 172.21.15.70:0/2803226038 shutdown_connections 2023-11-26T07:21:52.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.032+0000 7f271afaa640 1 -- 172.21.15.70:0/2803226038 wait complete. 2023-11-26T07:21:52.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 Processor -- start 2023-11-26T07:21:52.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 -- start start 2023-11-26T07:21:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27140b2160 0x7f27140c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27140d1bc0 0x7f27140c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f2714154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271415b480 con 0x7f27140b2160 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271415b760 con 0x7f27140d1bc0 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271415ba40 con 0x7f271415d6e0 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27140b2160 0x7f27140c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27140b2160 0x7f27140c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42322/0 (socket says 172.21.15.70:42322) 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 -- 172.21.15.70:0/632254895 learned_addr learned my addr 172.21.15.70:0/632254895 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2713fff640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27140d1bc0 0x7f27140c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2719547640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f2714154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 -- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 msgr2=0x7f2714154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f2714154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 -- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27140d1bc0 msgr2=0x7f27140c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27140d1bc0 0x7f27140c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 -- 172.21.15.70:0/632254895 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009420 con 0x7f27140b2160 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2719547640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f2714154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f2718d46640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27140b2160 0x7f27140c6d50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f27080190d0 tx=0x7f2708019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f27117fa640 1 -- 172.21.15.70:0/632254895 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708006e20 con 0x7f27140b2160 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f27117fa640 1 -- 172.21.15.70:0/632254895 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080ace20 con 0x7f27140b2160 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f27117fa640 1 -- 172.21.15.70:0/632254895 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080b5880 con 0x7f27140b2160 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271415bd20 con 0x7f27140b2160 2023-11-26T07:21:52.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.036+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271415c2e0 con 0x7f27140b2160 2023-11-26T07:21:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.040+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714067680 con 0x7f27140b2160 2023-11-26T07:21:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.040+0000 7f27117fa640 1 -- 172.21.15.70:0/632254895 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f27080b3040 con 0x7f27140b2160 2023-11-26T07:21:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.040+0000 7f27117fa640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26f8066a10 0x7f26f8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.040+0000 7f27117fa640 1 -- 172.21.15.70:0/632254895 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f270811e2d0 con 0x7f27140b2160 2023-11-26T07:21:52.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.040+0000 7f2713fff640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26f8066a10 0x7f26f8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.040+0000 7f2713fff640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26f8066a10 0x7f26f8068ed0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2700000f70 tx=0x7f2700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.044+0000 7f27117fa640 1 -- 172.21.15.70:0/632254895 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27080eb2b0 con 0x7f27140b2160 2023-11-26T07:21:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f27140b09a0 con 0x7f27140b2160 2023-11-26T07:21:52.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f27117fa640 1 -- 172.21.15.70:0/632254895 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+65 (secure 0 0 0) 0x7f27080ee8d0 con 0x7f27140b2160 2023-11-26T07:21:52.205 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:52.205 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:21:52.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:21:52.205 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2023-11-26T07:21:52.205 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2023-11-26T07:21:52.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:21:52.205 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:21:52.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26f8066a10 msgr2=0x7f26f8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26f8066a10 0x7f26f8068ed0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2700000f70 tx=0x7f2700009040 comp rx=0 tx=0).stop 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27140b2160 msgr2=0x7f27140c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27140b2160 0x7f27140c6d50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f27080190d0 tx=0x7f2708019260 comp rx=0 tx=0).stop 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 shutdown_connections 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f271415d6e0 0x7f2714154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27140d1bc0 0x7f27140c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f26f8066a10 0x7f26f8068ed0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 --2- 172.21.15.70:0/632254895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27140b2160 0x7f27140c6d50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 >> 172.21.15.70:0/632254895 conn(0x7f271409c550 msgr2=0x7f27140b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 shutdown_connections 2023-11-26T07:21:52.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.200+0000 7f271afaa640 1 -- 172.21.15.70:0/632254895 wait complete. 2023-11-26T07:21:52.225 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:21:52.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:21:52.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.360+0000 7f2a92194640 1 Processor -- start 2023-11-26T07:21:52.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.360+0000 7f2a92194640 1 -- start start 2023-11-26T07:21:52.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a92194640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2a8c0cf990 0x7f2a8c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a92194640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a92194640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c06c520 con 0x7f2a8c13e290 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a92194640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c06c800 con 0x7f2a8c0cf990 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a92194640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c06cae0 con 0x7f2a8c15f4e0 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2a8c0cf990 0x7f2a8c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2a8c0cf990 0x7f2a8c15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42330/0 (socket says 172.21.15.70:42330) 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8affd640 1 -- 172.21.15.70:0/4073594838 learned_addr learned my addr 172.21.15.70:0/4073594838 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8bfff640 1 --2- 172.21.15.70:0/4073594838 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8affd640 1 -- 172.21.15.70:0/4073594838 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 msgr2=0x7f2a8c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8affd640 1 --2- 172.21.15.70:0/4073594838 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c0cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8affd640 1 -- 172.21.15.70:0/4073594838 >> v1:172.21.15.120:6789/0 conn(0x7f2a8c13e290 legacy=0x7f2a8c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8affd640 1 -- 172.21.15.70:0/4073594838 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c06cdc0 con 0x7f2a8c0cf990 2023-11-26T07:21:52.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.364+0000 7f2a8bfff640 1 --2- 172.21.15.70:0/4073594838 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:52.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a8affd640 1 --2- 172.21.15.70:0/4073594838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c15efa0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a8001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761d1bfd09be4f88 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a8a7fc640 1 -- 172.21.15.70:0/4073594838 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800a95f0 con 0x7f2a8c0cf990 2023-11-26T07:21:52.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a8a7fc640 1 -- 172.21.15.70:0/4073594838 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a800a9750 con 0x7f2a8c0cf990 2023-11-26T07:21:52.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a8a7fc640 1 -- 172.21.15.70:0/4073594838 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a800a9ae0 con 0x7f2a8c0cf990 2023-11-26T07:21:52.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- 172.21.15.70:0/4073594838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 msgr2=0x7f2a8c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 --2- 172.21.15.70:0/4073594838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c15efa0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a8001c510 comp rx=0 tx=0).stop 2023-11-26T07:21:52.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- 172.21.15.70:0/4073594838 shutdown_connections 2023-11-26T07:21:52.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 --2- 172.21.15.70:0/4073594838 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 --2- 172.21.15.70:0/4073594838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c15efa0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- 172.21.15.70:0/4073594838 >> 172.21.15.70:0/4073594838 conn(0x7f2a8c06a890 msgr2=0x7f2a8c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- 172.21.15.70:0/4073594838 shutdown_connections 2023-11-26T07:21:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- 172.21.15.70:0/4073594838 wait complete. 2023-11-26T07:21:52.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 Processor -- start 2023-11-26T07:21:52.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- start start 2023-11-26T07:21:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c0af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a8c13e290 0x7f2a8c137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c15ac10 con 0x7f2a8c0cf990 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0aff10 con 0x7f2a8c13e290 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.368+0000 7f2a92194640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0b01f0 con 0x7f2a8c15f4e0 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c0af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42334/0 (socket says 172.21.15.70:42334) 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 -- 172.21.15.70:0/3179434743 learned_addr learned my addr 172.21.15.70:0/3179434743 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8affd640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a8c13e290 0x7f2a8c137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8bfff640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 -- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 msgr2=0x7f2a8c15a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c15a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 -- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a8c13e290 msgr2=0x7f2a8c137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a8c13e290 0x7f2a8c137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 -- 172.21.15.70:0/3179434743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800094d0 con 0x7f2a8c0cf990 2023-11-26T07:21:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8bfff640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a8b7fe640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c0af930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00c500 tx=0x7f2a7c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a73fff640 1 -- 172.21.15.70:0/3179434743 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c005220 con 0x7f2a8c0cf990 2023-11-26T07:21:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a73fff640 1 -- 172.21.15.70:0/3179434743 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c005380 con 0x7f2a8c0cf990 2023-11-26T07:21:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a73fff640 1 -- 172.21.15.70:0/3179434743 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c007270 con 0x7f2a8c0cf990 2023-11-26T07:21:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c0aec70 con 0x7f2a8c0cf990 2023-11-26T07:21:52.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c0b04d0 con 0x7f2a8c0cf990 2023-11-26T07:21:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c067680 con 0x7f2a8c0cf990 2023-11-26T07:21:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a73fff640 1 -- 172.21.15.70:0/3179434743 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f2a7c0073d0 con 0x7f2a8c0cf990 2023-11-26T07:21:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.372+0000 7f2a73fff640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2a78066a10 0x7f2a78068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.376+0000 7f2a73fff640 1 -- 172.21.15.70:0/3179434743 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a7c083e40 con 0x7f2a8c0cf990 2023-11-26T07:21:52.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.376+0000 7f2a8affd640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2a78066a10 0x7f2a78068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:52.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.376+0000 7f2a8affd640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2a78066a10 0x7f2a78068ed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2a800ae000 tx=0x7f2a800b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:52.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.376+0000 7f2a73fff640 1 -- 172.21.15.70:0/3179434743 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a7c088070 con 0x7f2a8c0cf990 2023-11-26T07:21:52.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.528+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2a8c144c30 con 0x7f2a8c0cf990 2023-11-26T07:21:52.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a73fff640 1 -- 172.21.15.70:0/3179434743 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2a7c050db0 con 0x7f2a8c0cf990 2023-11-26T07:21:52.840 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2023-11-26T07:21:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2a78066a10 msgr2=0x7f2a78068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2a78066a10 0x7f2a78068ed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2a800ae000 tx=0x7f2a800b3040 comp rx=0 tx=0).stop 2023-11-26T07:21:52.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 msgr2=0x7f2a8c0af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:52.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c0af930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00c500 tx=0x7f2a7c00c9c0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 shutdown_connections 2023-11-26T07:21:52.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2a8c15f4e0 0x7f2a8c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2a8c13e290 0x7f2a8c137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2a78066a10 0x7f2a78068ed0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 --2- 172.21.15.70:0/3179434743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a8c0cf990 0x7f2a8c0af930 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:52.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 >> 172.21.15.70:0/3179434743 conn(0x7f2a8c06a890 msgr2=0x7f2a8c138b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:52.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.836+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 shutdown_connections 2023-11-26T07:21:52.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:52.840+0000 7f2a92194640 1 -- 172.21.15.70:0/3179434743 wait complete. 2023-11-26T07:21:52.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:21:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9eb101640 1 Processor -- start 2023-11-26T07:21:53.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9eb101640 1 -- start start 2023-11-26T07:21:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9eb101640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4143c00 0x7fe9e40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9eb101640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9e4071550 0x7fe9e40719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9eb101640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e40b25f0 con 0x7fe9e4070390 2023-11-26T07:21:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9eb101640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e4071f20 con 0x7fe9e4071550 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9eb101640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40b28d0 con 0x7fe9e4143c00 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e8e9d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4143c00 0x7fe9e40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e8e9d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4143c00 0x7fe9e40b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:59904/0 (socket says 172.21.15.70:59904) 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e8e9d640 1 -- 172.21.15.70:0/3857946621 learned_addr learned my addr 172.21.15.70:0/3857946621 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e969e640 1 --2- 172.21.15.70:0/3857946621 >> v2:172.21.15.120:3300/0 conn(0x7fe9e4071550 0x7fe9e40719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e8e9d640 1 -- 172.21.15.70:0/3857946621 >> v2:172.21.15.120:3300/0 conn(0x7fe9e4071550 msgr2=0x7fe9e40719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e8e9d640 1 --2- 172.21.15.70:0/3857946621 >> v2:172.21.15.120:3300/0 conn(0x7fe9e4071550 0x7fe9e40719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e8e9d640 1 -- 172.21.15.70:0/3857946621 >> v1:172.21.15.120:6789/0 conn(0x7fe9e4070390 legacy=0x7fe9e40cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.016+0000 7fe9e8e9d640 1 -- 172.21.15.70:0/3857946621 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40b2bb0 con 0x7fe9e4143c00 2023-11-26T07:21:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9e8e9d640 1 --2- 172.21.15.70:0/3857946621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4143c00 0x7fe9e40b1ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009870 tx=0x7fe9d801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9138d78410efd7d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9e37fe640 1 -- 172.21.15.70:0/3857946621 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80ac620 con 0x7fe9e4143c00 2023-11-26T07:21:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9e37fe640 1 -- 172.21.15.70:0/3857946621 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d80ac780 con 0x7fe9e4143c00 2023-11-26T07:21:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9e37fe640 1 -- 172.21.15.70:0/3857946621 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80acb10 con 0x7fe9e4143c00 2023-11-26T07:21:53.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 -- 172.21.15.70:0/3857946621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4143c00 msgr2=0x7fe9e40b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 --2- 172.21.15.70:0/3857946621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4143c00 0x7fe9e40b1ef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009870 tx=0x7fe9d801c4b0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 -- 172.21.15.70:0/3857946621 shutdown_connections 2023-11-26T07:21:53.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 --2- 172.21.15.70:0/3857946621 >> v2:172.21.15.120:3300/0 conn(0x7fe9e4071550 0x7fe9e40719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 --2- 172.21.15.70:0/3857946621 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4143c00 0x7fe9e40b1ef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 -- 172.21.15.70:0/3857946621 >> 172.21.15.70:0/3857946621 conn(0x7fe9e40b0bf0 msgr2=0x7fe9e40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:53.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 -- 172.21.15.70:0/3857946621 shutdown_connections 2023-11-26T07:21:53.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.020+0000 7fe9eb101640 1 -- 172.21.15.70:0/3857946621 wait complete. 2023-11-26T07:21:53.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 Processor -- start 2023-11-26T07:21:53.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 -- start start 2023-11-26T07:21:53.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4070390 0x7fe9e41402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9e4071550 0x7fe9e4156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4143c00 0x7fe9e413e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4157110 con 0x7fe9e4071550 2023-11-26T07:21:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41415f0 con 0x7fe9e4143c00 2023-11-26T07:21:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e41409e0 con 0x7fe9e4070390 2023-11-26T07:21:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9e4071550 0x7fe9e4156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e8e9d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4070390 0x7fe9e41402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9e4071550 0x7fe9e4156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42336/0 (socket says 172.21.15.70:42336) 2023-11-26T07:21:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e3fff640 1 -- 172.21.15.70:0/1035644582 learned_addr learned my addr 172.21.15.70:0/1035644582 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e969e640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4143c00 0x7fe9e413e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e8e9d640 1 -- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4143c00 msgr2=0x7fe9e413e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e8e9d640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4143c00 0x7fe9e413e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e8e9d640 1 -- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9e4071550 msgr2=0x7fe9e4156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e8e9d640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9e4071550 0x7fe9e4156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e8e9d640 1 -- 172.21.15.70:0/1035644582 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80094d0 con 0x7fe9e4070390 2023-11-26T07:21:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e3fff640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9e4071550 0x7fe9e4156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e8e9d640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4070390 0x7fe9e41402d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80ac000 tx=0x7fe9d8019250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e17fa640 1 -- 172.21.15.70:0/1035644582 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80bb070 con 0x7fe9e4070390 2023-11-26T07:21:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e17fa640 1 -- 172.21.15.70:0/1035644582 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d80ac9b0 con 0x7fe9e4070390 2023-11-26T07:21:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9e17fa640 1 -- 172.21.15.70:0/1035644582 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80acd40 con 0x7fe9e4070390 2023-11-26T07:21:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e4140cc0 con 0x7fe9e4070390 2023-11-26T07:21:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.024+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e4141280 con 0x7fe9e4070390 2023-11-26T07:21:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.028+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e4164f50 con 0x7fe9e4070390 2023-11-26T07:21:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.028+0000 7fe9e17fa640 1 -- 172.21.15.70:0/1035644582 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fe9d80b3070 con 0x7fe9e4070390 2023-11-26T07:21:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.028+0000 7fe9e17fa640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe9c8066a10 0x7fe9c8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:53.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.028+0000 7fe9e17fa640 1 -- 172.21.15.70:0/1035644582 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe9d811dfd0 con 0x7fe9e4070390 2023-11-26T07:21:53.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.028+0000 7fe9e3fff640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe9c8066a10 0x7fe9c8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:53.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.028+0000 7fe9e3fff640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe9c8066a10 0x7fe9c8068ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4071270 tx=0x7fe9d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:53.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.032+0000 7fe9e17fa640 1 -- 172.21.15.70:0/1035644582 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9d80eaf50 con 0x7fe9e4070390 2023-11-26T07:21:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.184+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe9e4164f50 con 0x7fe9e4070390 2023-11-26T07:21:53.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.844+0000 7fe9e17fa640 1 -- 172.21.15.70:0/1035644582 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe9e4164f50 con 0x7fe9e4070390 2023-11-26T07:21:53.848 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2023-11-26T07:21:53.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe9c8066a10 msgr2=0x7fe9c8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe9c8066a10 0x7fe9c8068ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4071270 tx=0x7fe9d0009040 comp rx=0 tx=0).stop 2023-11-26T07:21:53.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4070390 msgr2=0x7fe9e41402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:53.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4070390 0x7fe9e41402d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80ac000 tx=0x7fe9d8019250 comp rx=0 tx=0).stop 2023-11-26T07:21:53.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 shutdown_connections 2023-11-26T07:21:53.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe9c8066a10 0x7fe9c8068ed0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9e4071550 0x7fe9e4156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e4143c00 0x7fe9e413e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:53.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 --2- 172.21.15.70:0/1035644582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe9e4070390 0x7fe9e41402d0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80ac000 tx=0x7fe9d8019250 comp rx=0 tx=0).stop 2023-11-26T07:21:53.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 >> 172.21.15.70:0/1035644582 conn(0x7fe9e40b0bf0 msgr2=0x7fe9e40cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:53.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 shutdown_connections 2023-11-26T07:21:53.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:53.856+0000 7fe9eb101640 1 -- 172.21.15.70:0/1035644582 wait complete. 2023-11-26T07:21:53.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:21:54.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 Processor -- start 2023-11-26T07:21:54.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 -- start start 2023-11-26T07:21:54.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6e5814b1e0 0x7f6e580cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6e580cf7c0 0x7f6e580708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e58070e00 0x7f6e580b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580cfc20 con 0x7f6e580cf7c0 2023-11-26T07:21:54.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e58162080 con 0x7f6e5814b1e0 2023-11-26T07:21:54.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5ffdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58161d70 con 0x7f6e58070e00 2023-11-26T07:21:54.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6e580cf7c0 0x7f6e580708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6e580cf7c0 0x7f6e580708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46198/0 (socket says 172.21.15.70:46198) 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 -- 172.21.15.70:0/2376229492 learned_addr learned my addr 172.21.15.70:0/2376229492 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5e57c640 1 --2- 172.21.15.70:0/2376229492 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e58070e00 0x7f6e580b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5dd7b640 1 --2- 172.21.15.70:0/2376229492 >> v2:172.21.15.120:3300/0 conn(0x7f6e5814b1e0 0x7f6e580cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 -- 172.21.15.70:0/2376229492 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e58070e00 msgr2=0x7f6e580b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 --2- 172.21.15.70:0/2376229492 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e58070e00 0x7f6e580b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 -- 172.21.15.70:0/2376229492 >> v2:172.21.15.120:3300/0 conn(0x7f6e5814b1e0 msgr2=0x7f6e580cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 --2- 172.21.15.70:0/2376229492 >> v2:172.21.15.120:3300/0 conn(0x7f6e5814b1e0 0x7f6e580cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.032+0000 7f6e5d57a640 1 -- 172.21.15.70:0/2376229492 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5814b5c0 con 0x7f6e580cf7c0 2023-11-26T07:21:54.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5d57a640 1 --2- 172.21.15.70:0/2376229492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e580cf7c0 0x7f6e580708c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6e5806e480 tx=0x7f6e4801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e6bcbe3349152b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5cd79640 1 -- 172.21.15.70:0/2376229492 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480ab600 con 0x7f6e580cf7c0 2023-11-26T07:21:54.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5cd79640 1 -- 172.21.15.70:0/2376229492 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e480a7050 con 0x7f6e580cf7c0 2023-11-26T07:21:54.042 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5cd79640 1 -- 172.21.15.70:0/2376229492 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480ab980 con 0x7f6e580cf7c0 2023-11-26T07:21:54.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/2376229492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e580cf7c0 msgr2=0x7f6e580708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/2376229492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e580cf7c0 0x7f6e580708c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6e5806e480 tx=0x7f6e4801c210 comp rx=0 tx=0).stop 2023-11-26T07:21:54.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/2376229492 shutdown_connections 2023-11-26T07:21:54.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/2376229492 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e58070e00 0x7f6e580b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/2376229492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e580cf7c0 0x7f6e580708c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/2376229492 >> v2:172.21.15.120:3300/0 conn(0x7f6e5814b1e0 0x7f6e580cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.036+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/2376229492 >> 172.21.15.70:0/2376229492 conn(0x7f6e5806a890 msgr2=0x7f6e5806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:54.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/2376229492 shutdown_connections 2023-11-26T07:21:54.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/2376229492 wait complete. 2023-11-26T07:21:54.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 Processor -- start 2023-11-26T07:21:54.045 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 -- start start 2023-11-26T07:21:54.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e58070e00 0x7f6e580b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e580cf7c0 0x7f6e5815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e5814b1e0 0x7f6e58160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58160d50 con 0x7f6e58070e00 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580b06c0 con 0x7f6e580cf7c0 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5ffdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580afd90 con 0x7f6e5814b1e0 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e58070e00 0x7f6e580b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e58070e00 0x7f6e580b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46200/0 (socket says 172.21.15.70:46200) 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 -- 172.21.15.70:0/3388558046 learned_addr learned my addr 172.21.15.70:0/3388558046 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5e57c640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e5814b1e0 0x7f6e58160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5d57a640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e580cf7c0 0x7f6e5815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 -- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e5814b1e0 msgr2=0x7f6e58160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e5814b1e0 0x7f6e58160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 -- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e580cf7c0 msgr2=0x7f6e5815f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e580cf7c0 0x7f6e5815f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 -- 172.21.15.70:0/3388558046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480094d0 con 0x7f6e58070e00 2023-11-26T07:21:54.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.040+0000 7f6e5dd7b640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e58070e00 0x7f6e580b0b50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400e870 tx=0x7f6e5400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e4e7fc640 1 -- 172.21.15.70:0/3388558046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e54009510 con 0x7f6e58070e00 2023-11-26T07:21:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e4e7fc640 1 -- 172.21.15.70:0/3388558046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5400eec0 con 0x7f6e58070e00 2023-11-26T07:21:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e4e7fc640 1 -- 172.21.15.70:0/3388558046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5400cb40 con 0x7f6e58070e00 2023-11-26T07:21:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580b0070 con 0x7f6e58070e00 2023-11-26T07:21:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5815f700 con 0x7f6e58070e00 2023-11-26T07:21:54.049 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e58067680 con 0x7f6e58070e00 2023-11-26T07:21:54.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e4e7fc640 1 -- 172.21.15.70:0/3388558046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f6e5400cca0 con 0x7f6e58070e00 2023-11-26T07:21:54.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e4e7fc640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6e3c066a60 0x7f6e3c068f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:54.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.044+0000 7f6e4e7fc640 1 -- 172.21.15.70:0/3388558046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6e540850b0 con 0x7f6e58070e00 2023-11-26T07:21:54.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.048+0000 7f6e5d57a640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6e3c066a60 0x7f6e3c068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:54.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.048+0000 7f6e5d57a640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6e3c066a60 0x7f6e3c068f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e480ad000 tx=0x7f6e48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:54.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.048+0000 7f6e4e7fc640 1 -- 172.21.15.70:0/3388558046 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e54051e10 con 0x7f6e58070e00 2023-11-26T07:21:54.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.232+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6e58147f30 con 0x7f6e58070e00 2023-11-26T07:21:54.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.856+0000 7f6e4e7fc640 1 -- 172.21.15.70:0/3388558046 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v34) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6e54017020 con 0x7f6e58070e00 2023-11-26T07:21:54.862 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 8 and data pool 9 2023-11-26T07:21:54.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6e3c066a60 msgr2=0x7f6e3c068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6e3c066a60 0x7f6e3c068f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e480ad000 tx=0x7f6e48008040 comp rx=0 tx=0).stop 2023-11-26T07:21:54.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e58070e00 msgr2=0x7f6e580b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:54.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e58070e00 0x7f6e580b0b50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400e870 tx=0x7f6e5400ec70 comp rx=0 tx=0).stop 2023-11-26T07:21:54.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 shutdown_connections 2023-11-26T07:21:54.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6e5814b1e0 0x7f6e58160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e580cf7c0 0x7f6e5815f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6e3c066a60 0x7f6e3c068f20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 --2- 172.21.15.70:0/3388558046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e58070e00 0x7f6e580b0b50 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:54.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.868+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 >> 172.21.15.70:0/3388558046 conn(0x7f6e5806a890 msgr2=0x7f6e58146bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:54.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.872+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 shutdown_connections 2023-11-26T07:21:54.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:54.872+0000 7f6e5ffdf640 1 -- 172.21.15.70:0/3388558046 wait complete. 2023-11-26T07:21:54.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:55.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee9501640 1 Processor -- start 2023-11-26T07:21:55.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee9501640 1 -- start start 2023-11-26T07:21:55.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee9501640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee415d6e0 0x7fcee40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee9501640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcee40b2160 0x7fcee40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee9501640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40cf0e0 con 0x7fcee40d19f0 2023-11-26T07:21:55.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee9501640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee415dac0 con 0x7fcee40b2160 2023-11-26T07:21:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee9501640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40d1e80 con 0x7fcee415d6e0 2023-11-26T07:21:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee2ffd640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee415d6e0 0x7fcee40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee37fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcee40d19f0 0x7fcee40cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:48002/0 (socket says 172.21.15.70:48002) 2023-11-26T07:21:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee37fe640 1 -- 172.21.15.70:0/376501373 learned_addr learned my addr 172.21.15.70:0/376501373 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcedbfff640 1 --2- 172.21.15.70:0/376501373 >> v2:172.21.15.120:3300/0 conn(0x7fcee40b2160 0x7fcee40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee27fc640 1 -- 172.21.15.70:0/376501373 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690739401 0 0) 0x7fcee40cf0e0 con 0x7fcee40d19f0 2023-11-26T07:21:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee27fc640 1 -- 172.21.15.70:0/376501373 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced0003530 con 0x7fcee40d19f0 2023-11-26T07:21:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcedbfff640 1 -- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee415d6e0 msgr2=0x7fcee40d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcedbfff640 1 --2- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee415d6e0 0x7fcee40d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcedbfff640 1 -- 172.21.15.70:0/376501373 >> v1:172.21.15.120:6789/0 conn(0x7fcee40d19f0 legacy=0x7fcee40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcedbfff640 1 -- 172.21.15.70:0/376501373 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40ceb20 con 0x7fcee40b2160 2023-11-26T07:21:55.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.052+0000 7fcee2ffd640 1 --2- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee415d6e0 0x7fcee40d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:55.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcedbfff640 1 --2- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee40b2160 0x7fcee40d14b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097c0 tx=0x7fcecc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acfd7c17b7c8a3ed server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee27fc640 1 -- 172.21.15.70:0/376501373 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0ab600 con 0x7fcee40b2160 2023-11-26T07:21:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee27fc640 1 -- 172.21.15.70:0/376501373 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc0a7050 con 0x7fcee40b2160 2023-11-26T07:21:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee27fc640 1 -- 172.21.15.70:0/376501373 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0ab980 con 0x7fcee40b2160 2023-11-26T07:21:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 -- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee40b2160 msgr2=0x7fcee40d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 --2- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee40b2160 0x7fcee40d14b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097c0 tx=0x7fcecc01c480 comp rx=0 tx=0).stop 2023-11-26T07:21:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 -- 172.21.15.70:0/376501373 shutdown_connections 2023-11-26T07:21:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 --2- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee40b2160 0x7fcee40d14b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 --2- 172.21.15.70:0/376501373 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee415d6e0 0x7fcee40d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 -- 172.21.15.70:0/376501373 >> 172.21.15.70:0/376501373 conn(0x7fcee409c550 msgr2=0x7fcee40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 -- 172.21.15.70:0/376501373 shutdown_connections 2023-11-26T07:21:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.056+0000 7fcee9501640 1 -- 172.21.15.70:0/376501373 wait complete. 2023-11-26T07:21:55.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 Processor -- start 2023-11-26T07:21:55.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 -- start start 2023-11-26T07:21:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee40b2160 0x7fcee4157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee40d19f0 0x7fcee414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee415d6e0 0x7fcee415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee414fdd0 con 0x7fcee40b2160 2023-11-26T07:21:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40c94e0 con 0x7fcee415d6e0 2023-11-26T07:21:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40c8440 con 0x7fcee40d19f0 2023-11-26T07:21:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee40b2160 0x7fcee4157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee40b2160 0x7fcee4157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46214/0 (socket says 172.21.15.70:46214) 2023-11-26T07:21:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 -- 172.21.15.70:0/3739470708 learned_addr learned my addr 172.21.15.70:0/3739470708 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee37fe640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee415d6e0 0x7fcee415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcedbfff640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee40d19f0 0x7fcee414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 -- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee40d19f0 msgr2=0x7fcee414f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee40d19f0 0x7fcee414f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 -- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee415d6e0 msgr2=0x7fcee415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee415d6e0 0x7fcee415bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 -- 172.21.15.70:0/3739470708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4009420 con 0x7fcee40b2160 2023-11-26T07:21:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee2ffd640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee40b2160 0x7fcee4157320 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fced400e980 tx=0x7fced400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcedb7fe640 1 -- 172.21.15.70:0/3739470708 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400ca00 con 0x7fcee40b2160 2023-11-26T07:21:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcedb7fe640 1 -- 172.21.15.70:0/3739470708 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400cb60 con 0x7fcee40b2160 2023-11-26T07:21:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcedb7fe640 1 -- 172.21.15.70:0/3739470708 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4013470 con 0x7fcee40b2160 2023-11-26T07:21:55.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc009420 con 0x7fcee40b2160 2023-11-26T07:21:55.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.060+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee40c8a00 con 0x7fcee40b2160 2023-11-26T07:21:55.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.064+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee4067680 con 0x7fcee40b2160 2023-11-26T07:21:55.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.064+0000 7fcedb7fe640 1 -- 172.21.15.70:0/3739470708 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fced40135d0 con 0x7fcee40b2160 2023-11-26T07:21:55.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.064+0000 7fcedb7fe640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcec4066a10 0x7fcec4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.064+0000 7fcedb7fe640 1 -- 172.21.15.70:0/3739470708 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fced4084af0 con 0x7fcee40b2160 2023-11-26T07:21:55.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.064+0000 7fcedbfff640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcec4066a10 0x7fcec4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.064+0000 7fcedbfff640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcec4066a10 0x7fcec4068ed0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0ad000 tx=0x7fcecc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.068+0000 7fcedb7fe640 1 -- 172.21.15.70:0/3739470708 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fced40517b0 con 0x7fcee40b2160 2023-11-26T07:21:55.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.220+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcee415de90 con 0x7fcee40b2160 2023-11-26T07:21:55.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcedb7fe640 1 -- 172.21.15.70:0/3739470708 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16578 (secure 0 0 0) 0x7fced4054dd0 con 0x7fcee40b2160 2023-11-26T07:21:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:55.228 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":63,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:54.236279+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:55.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcec4066a10 msgr2=0x7fcec4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcec4066a10 0x7fcec4068ed0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0ad000 tx=0x7fcecc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:55.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee40b2160 msgr2=0x7fcee4157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee40b2160 0x7fcee4157320 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fced400e980 tx=0x7fced400ee40 comp rx=0 tx=0).stop 2023-11-26T07:21:55.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 shutdown_connections 2023-11-26T07:21:55.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcee415d6e0 0x7fcee415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcee40d19f0 0x7fcee414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcec4066a10 0x7fcec4068ed0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 --2- 172.21.15.70:0/3739470708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee40b2160 0x7fcee4157320 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 >> 172.21.15.70:0/3739470708 conn(0x7fcee409c550 msgr2=0x7fcee40cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:55.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 shutdown_connections 2023-11-26T07:21:55.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.224+0000 7fcee9501640 1 -- 172.21.15.70:0/3739470708 wait complete. 2023-11-26T07:21:55.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:55.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb121910640 1 Processor -- start 2023-11-26T07:21:55.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb121910640 1 -- start start 2023-11-26T07:21:55.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb121910640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb11c15d680 0x7fb11c0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb121910640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11c0cdc40 con 0x7fb11c0d1d90 2023-11-26T07:21:55.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb121910640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11c0ce7a0 con 0x7fb11c15d2a0 2023-11-26T07:21:55.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb121910640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11c0d1440 con 0x7fb11c15d680 2023-11-26T07:21:55.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb12110f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb11c0d1d90 0x7fb11c0b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45552/0 (socket says 172.21.15.70:45552) 2023-11-26T07:21:55.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb12110f640 1 -- 172.21.15.70:0/1403817232 learned_addr learned my addr 172.21.15.70:0/1403817232 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:55.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11bfff640 1 --2- 172.21.15.70:0/1403817232 >> v2:172.21.15.120:3300/0 conn(0x7fb11c15d680 0x7fb11c0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671828690 0 0) 0x7fb11c0cdc40 con 0x7fb11c0d1d90 2023-11-26T07:21:55.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb10c003530 con 0x7fb11c0d1d90 2023-11-26T07:21:55.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279546204 0 0) 0x7fb10c003530 con 0x7fb11c0d1d90 2023-11-26T07:21:55.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 >> v2:172.21.15.120:3300/0 conn(0x7fb11c15d680 msgr2=0x7fb11c0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 --2- 172.21.15.70:0/1403817232 >> v2:172.21.15.120:3300/0 conn(0x7fb11c15d680 0x7fb11c0d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 >> v1:172.21.15.120:6789/0 conn(0x7fb11c15d2a0 legacy=0x7fb11c0d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0cde70 con 0x7fb11c0d1d90 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fb114001a00 con 0x7fb11c0d1d90 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 >> v1:172.21.15.70:6789/0 conn(0x7fb11c0d1d90 legacy=0x7fb11c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb10c003980 0x7fb10c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb10c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb10c005190 0x7fb10c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c0d1440 con 0x7fb10c0047d0 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c00bfe0 con 0x7fb10c005190 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c00c1a0 con 0x7fb10c003980 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11bfff640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb10c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb12090e640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb10c003980 0x7fb10c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb12110f640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb10c005190 0x7fb10c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11bfff640 1 -- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb10c003980 msgr2=0x7fb10c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:55.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11bfff640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb10c003980 0x7fb10c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11bfff640 1 -- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb10c005190 msgr2=0x7fb10c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:55.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11bfff640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb10c005190 0x7fb10c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb11bfff640 1 -- 172.21.15.70:0/1403817232 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c003530 con 0x7fb10c0047d0 2023-11-26T07:21:55.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.384+0000 7fb12110f640 1 -- 172.21.15.70:0/1403817232 reap_dead start 2023-11-26T07:21:55.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb11bfff640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb10c004c50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb108009ae0 tx=0x7fb10801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83659e57fb691fc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080a5640 con 0x7fb10c0047d0 2023-11-26T07:21:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1080a57a0 con 0x7fb10c0047d0 2023-11-26T07:21:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb11b7fe640 1 -- 172.21.15.70:0/1403817232 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080a5b50 con 0x7fb10c0047d0 2023-11-26T07:21:55.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb121910640 1 -- 172.21.15.70:0/1403817232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 msgr2=0x7fb10c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb121910640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb10c004c50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb108009ae0 tx=0x7fb10801ca50 comp rx=0 tx=0).stop 2023-11-26T07:21:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb121910640 1 -- 172.21.15.70:0/1403817232 shutdown_connections 2023-11-26T07:21:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb121910640 1 --2- 172.21.15.70:0/1403817232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb10c004c50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb121910640 1 -- 172.21.15.70:0/1403817232 >> 172.21.15.70:0/1403817232 conn(0x7fb11c0d30a0 msgr2=0x7fb11c0d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb121910640 1 -- 172.21.15.70:0/1403817232 shutdown_connections 2023-11-26T07:21:55.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.388+0000 7fb121910640 1 -- 172.21.15.70:0/1403817232 wait complete. 2023-11-26T07:21:55.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 Processor -- start 2023-11-26T07:21:55.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 -- start start 2023-11-26T07:21:55.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb11c1f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb11c0ca170 0x7fb11c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb11c0b73a0 0x7fb11c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c0cab30 con 0x7fb10c0047d0 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c14ad60 con 0x7fb11c0ca170 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c0b8120 con 0x7fb11c0b73a0 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb11c1f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb11c1f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46220/0 (socket says 172.21.15.70:46220) 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 -- 172.21.15.70:0/422121992 learned_addr learned my addr 172.21.15.70:0/422121992 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12110f640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb11c0b73a0 0x7fb11c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb11bfff640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb11c0ca170 0x7fb11c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 -- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb11c0b73a0 msgr2=0x7fb11c0b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.399 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb11c0b73a0 0x7fb11c0b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 -- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb11c0ca170 msgr2=0x7fb11c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb11c0ca170 0x7fb11c0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 -- 172.21.15.70:0/422121992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c0b8400 con 0x7fb10c0047d0 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb12090e640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb11c1f25f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb110011470 tx=0x7fb110011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb1197fa640 1 -- 172.21.15.70:0/422121992 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110015820 con 0x7fb10c0047d0 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb1197fa640 1 -- 172.21.15.70:0/422121992 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb110015980 con 0x7fb10c0047d0 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb1197fa640 1 -- 172.21.15.70:0/422121992 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110015d30 con 0x7fb10c0047d0 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11c0b86e0 con 0x7fb10c0047d0 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.392+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11c0b7d60 con 0x7fb10c0047d0 2023-11-26T07:21:55.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.396+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11c0b8b90 con 0x7fb10c0047d0 2023-11-26T07:21:55.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.396+0000 7fb1197fa640 1 -- 172.21.15.70:0/422121992 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb11001e400 con 0x7fb10c0047d0 2023-11-26T07:21:55.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.396+0000 7fb1197fa640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb100066a10 0x7fb100068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.396+0000 7fb1197fa640 1 -- 172.21.15.70:0/422121992 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb110087660 con 0x7fb10c0047d0 2023-11-26T07:21:55.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.396+0000 7fb11bfff640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb100066a10 0x7fb100068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.396+0000 7fb11bfff640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb100066a10 0x7fb100068ed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1080af000 tx=0x7fb1080046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.400+0000 7fb1197fa640 1 -- 172.21.15.70:0/422121992 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb110054430 con 0x7fb10c0047d0 2023-11-26T07:21:55.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.552+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb11c067500 con 0x7fb10c0047d0 2023-11-26T07:21:55.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.552+0000 7fb1197fa640 1 -- 172.21.15.70:0/422121992 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16578 (secure 0 0 0) 0x7fb110019090 con 0x7fb10c0047d0 2023-11-26T07:21:55.558 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:55.558 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":63,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:54.236279+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb100066a10 msgr2=0x7fb100068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb100066a10 0x7fb100068ed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1080af000 tx=0x7fb1080046d0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 msgr2=0x7fb11c1f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb11c1f25f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb110011470 tx=0x7fb110011930 comp rx=0 tx=0).stop 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 shutdown_connections 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb11c0b73a0 0x7fb11c0b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb11c0ca170 0x7fb11c0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb100066a10 0x7fb100068ed0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 --2- 172.21.15.70:0/422121992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10c0047d0 0x7fb11c1f25f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 >> 172.21.15.70:0/422121992 conn(0x7fb11c0d30a0 msgr2=0x7fb11c0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:55.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 shutdown_connections 2023-11-26T07:21:55.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.556+0000 7fb121910640 1 -- 172.21.15.70:0/422121992 wait complete. 2023-11-26T07:21:55.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:21:55.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb950091640 1 Processor -- start 2023-11-26T07:21:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb950091640 1 -- start start 2023-11-26T07:21:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb950091640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f000 0x7fb94806d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb950091640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb94806f3e0 0x7fb94806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb950091640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480cf260 con 0x7fb948099a70 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb950091640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94806d570 con 0x7fb94806f3e0 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb950091640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94809a010 con 0x7fb94806f000 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94e62e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb948099a70 0x7fb94806bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45562/0 (socket says 172.21.15.70:45562) 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94e62e640 1 -- 172.21.15.70:0/359758224 learned_addr learned my addr 172.21.15.70:0/359758224 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94de2d640 1 --2- 172.21.15.70:0/359758224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f000 0x7fb94806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94d62c640 1 --2- 172.21.15.70:0/359758224 >> v2:172.21.15.120:3300/0 conn(0x7fb94806f3e0 0x7fb94806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94ce2b640 1 -- 172.21.15.70:0/359758224 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500616087 0 0) 0x7fb9480cf260 con 0x7fb948099a70 2023-11-26T07:21:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94ce2b640 1 -- 172.21.15.70:0/359758224 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb934003530 con 0x7fb948099a70 2023-11-26T07:21:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94de2d640 1 -- 172.21.15.70:0/359758224 >> v2:172.21.15.120:3300/0 conn(0x7fb94806f3e0 msgr2=0x7fb94806b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94de2d640 1 --2- 172.21.15.70:0/359758224 >> v2:172.21.15.120:3300/0 conn(0x7fb94806f3e0 0x7fb94806b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94de2d640 1 -- 172.21.15.70:0/359758224 >> v1:172.21.15.70:6789/0 conn(0x7fb948099a70 legacy=0x7fb94806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.716+0000 7fb94de2d640 1 -- 172.21.15.70:0/359758224 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94809a2f0 con 0x7fb94806f000 2023-11-26T07:21:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb94de2d640 1 --2- 172.21.15.70:0/359758224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f000 0x7fb94806d030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097c0 tx=0x7fb94401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4976e96395ceb337 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb94ce2b640 1 -- 172.21.15.70:0/359758224 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440ab600 con 0x7fb94806f000 2023-11-26T07:21:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb94ce2b640 1 -- 172.21.15.70:0/359758224 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9440a7050 con 0x7fb94806f000 2023-11-26T07:21:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb94ce2b640 1 -- 172.21.15.70:0/359758224 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440ab980 con 0x7fb94806f000 2023-11-26T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 -- 172.21.15.70:0/359758224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f000 msgr2=0x7fb94806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 --2- 172.21.15.70:0/359758224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f000 0x7fb94806d030 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097c0 tx=0x7fb94401c480 comp rx=0 tx=0).stop 2023-11-26T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 -- 172.21.15.70:0/359758224 shutdown_connections 2023-11-26T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 --2- 172.21.15.70:0/359758224 >> v2:172.21.15.120:3300/0 conn(0x7fb94806f3e0 0x7fb94806b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 --2- 172.21.15.70:0/359758224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f000 0x7fb94806d030 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 -- 172.21.15.70:0/359758224 >> 172.21.15.70:0/359758224 conn(0x7fb9480b2d10 msgr2=0x7fb9480b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 -- 172.21.15.70:0/359758224 shutdown_connections 2023-11-26T07:21:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.720+0000 7fb950091640 1 -- 172.21.15.70:0/359758224 wait complete. 2023-11-26T07:21:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 Processor -- start 2023-11-26T07:21:55.728 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 -- start start 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb94806f000 0x7fb9480cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f3e0 0x7fb9480c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb948099a70 0x7fb9480c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94814eff0 con 0x7fb948099a70 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480cb210 con 0x7fb94806f000 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94814e3e0 con 0x7fb94806f3e0 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb948099a70 0x7fb9480c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb948099a70 0x7fb9480c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46224/0 (socket says 172.21.15.70:46224) 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 -- 172.21.15.70:0/2104118069 learned_addr learned my addr 172.21.15.70:0/2104118069 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94d62c640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f3e0 0x7fb9480c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94de2d640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb94806f000 0x7fb9480cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 -- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f3e0 msgr2=0x7fb9480c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f3e0 0x7fb9480c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 -- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb94806f000 msgr2=0x7fb9480cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb94806f000 0x7fb9480cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 -- 172.21.15.70:0/2104118069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944009420 con 0x7fb948099a70 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb94e62e640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb948099a70 0x7fb9480c5270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb94000caa0 tx=0x7fb94000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb93e7fc640 1 -- 172.21.15.70:0/2104118069 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000ac00 con 0x7fb948099a70 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb93e7fc640 1 -- 172.21.15.70:0/2104118069 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000ad60 con 0x7fb948099a70 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94814e6c0 con 0x7fb948099a70 2023-11-26T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb93e7fc640 1 -- 172.21.15.70:0/2104118069 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940012620 con 0x7fb948099a70 2023-11-26T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94814ec80 con 0x7fb948099a70 2023-11-26T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.724+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94814f160 con 0x7fb948099a70 2023-11-26T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.728+0000 7fb93e7fc640 1 -- 172.21.15.70:0/2104118069 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb940007070 con 0x7fb948099a70 2023-11-26T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.728+0000 7fb93e7fc640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb92c066a40 0x7fb92c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:55.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.728+0000 7fb93e7fc640 1 -- 172.21.15.70:0/2104118069 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb940084800 con 0x7fb948099a70 2023-11-26T07:21:55.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.728+0000 7fb94de2d640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb92c066a40 0x7fb92c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:55.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.728+0000 7fb94de2d640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb92c066a40 0x7fb92c068f00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb9440ad000 tx=0x7fb9440a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:55.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.732+0000 7fb93e7fc640 1 -- 172.21.15.70:0/2104118069 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb940051480 con 0x7fb948099a70 2023-11-26T07:21:55.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:55.920+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb948067680 con 0x7fb948099a70 2023-11-26T07:21:56.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.872+0000 7fb93e7fc640 1 -- 172.21.15.70:0/2104118069 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb940054aa0 con 0x7fb948099a70 2023-11-26T07:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.872+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb92c066a40 msgr2=0x7fb92c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.872+0000 7fb950091640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb92c066a40 0x7fb92c068f00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb9440ad000 tx=0x7fb9440a6000 comp rx=0 tx=0).stop 2023-11-26T07:21:56.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.872+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb948099a70 msgr2=0x7fb9480c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.872+0000 7fb950091640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb948099a70 0x7fb9480c5270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb94000caa0 tx=0x7fb94000cf60 comp rx=0 tx=0).stop 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 shutdown_connections 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb92c066a40 0x7fb92c068f00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb948099a70 0x7fb9480c5270 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb94806f3e0 0x7fb9480c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 --2- 172.21.15.70:0/2104118069 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb94806f000 0x7fb9480cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 >> 172.21.15.70:0/2104118069 conn(0x7fb9480b2d10 msgr2=0x7fb9480b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 shutdown_connections 2023-11-26T07:21:56.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:56.876+0000 7fb950091640 1 -- 172.21.15.70:0/2104118069 wait complete. 2023-11-26T07:21:56.902 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:21:56.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.040+0000 7fcbeb4f5640 1 Processor -- start 2023-11-26T07:21:57.046 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.040+0000 7fcbeb4f5640 1 -- start start 2023-11-26T07:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbeb4f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcbe4071970 0x7fcbe415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbeb4f5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe406e3f0 con 0x7fcbe40714e0 2023-11-26T07:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbeb4f5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe40722f0 con 0x7fcbe4144720 2023-11-26T07:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbeb4f5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe406de30 con 0x7fcbe4071970 2023-11-26T07:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe9cf2640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcbe40714e0 0x7fcbe415bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45566/0 (socket says 172.21.15.70:45566) 2023-11-26T07:21:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe9cf2640 1 -- 172.21.15.70:0/1532081806 learned_addr learned my addr 172.21.15.70:0/1532081806 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbeacf4640 1 --2- 172.21.15.70:0/1532081806 >> v2:172.21.15.120:3300/0 conn(0x7fcbe4071970 0x7fcbe415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671987376 0 0) 0x7fcbe406e3f0 con 0x7fcbe40714e0 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd0003530 con 0x7fcbe40714e0 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361636984 0 0) 0x7fcbe40722f0 con 0x7fcbe4144720 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe406e3f0 con 0x7fcbe4144720 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2758543631 0 0) 0x7fcbd0003530 con 0x7fcbe40714e0 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 >> v2:172.21.15.120:3300/0 conn(0x7fcbe4071970 msgr2=0x7fcbe415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 --2- 172.21.15.70:0/1532081806 >> v2:172.21.15.120:3300/0 conn(0x7fcbe4071970 0x7fcbe415c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 >> v1:172.21.15.120:6789/0 conn(0x7fcbe4144720 legacy=0x7fcbe406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe406e110 con 0x7fcbe40714e0 2023-11-26T07:21:57.050 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fcbd4001680 con 0x7fcbe40714e0 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 >> v1:172.21.15.70:6789/0 conn(0x7fcbe40714e0 legacy=0x7fcbe415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbd0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbd00047d0 0x7fcbd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbd0005190 0x7fcbd000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe406de30 con 0x7fcbd0003b60 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd000c060 con 0x7fcbd00047d0 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd000c220 con 0x7fcbd0005190 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbea4f3640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbd0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbeacf4640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbd0005190 0x7fcbd000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbe9cf2640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbd00047d0 0x7fcbd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbea4f3640 1 -- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbd0005190 msgr2=0x7fcbd000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:57.051 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbea4f3640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbd0005190 0x7fcbd000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbea4f3640 1 -- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbd00047d0 msgr2=0x7fcbd0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:57.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbea4f3640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbd00047d0 0x7fcbd0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbea4f3640 1 -- 172.21.15.70:0/1532081806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd0003530 con 0x7fcbd0003b60 2023-11-26T07:21:57.052 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.044+0000 7fcbeacf4640 1 -- 172.21.15.70:0/1532081806 reap_dead start 2023-11-26T07:21:57.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbea4f3640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbd0003f60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00018d0 tx=0x7fcbe001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3332c2d0c65dfb3b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:57.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00052d0 con 0x7fcbd0003b60 2023-11-26T07:21:57.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00a7050 con 0x7fcbd0003b60 2023-11-26T07:21:57.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbe94f1640 1 -- 172.21.15.70:0/1532081806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0003600 con 0x7fcbd0003b60 2023-11-26T07:21:57.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/1532081806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 msgr2=0x7fcbd0003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbd0003f60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00018d0 tx=0x7fcbe001c4d0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/1532081806 shutdown_connections 2023-11-26T07:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/1532081806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbd0003f60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/1532081806 >> 172.21.15.70:0/1532081806 conn(0x7fcbe406a890 msgr2=0x7fcbe406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/1532081806 shutdown_connections 2023-11-26T07:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/1532081806 wait complete. 2023-11-26T07:21:57.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 Processor -- start 2023-11-26T07:21:57.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.048+0000 7fcbeb4f5640 1 -- start start 2023-11-26T07:21:57.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbe4159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe415a390 0x7fcbe415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe4141320 0x7fcbe41417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4141ce0 con 0x7fcbd0003b60 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40b3f60 con 0x7fcbe415a390 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40b2440 con 0x7fcbe4141320 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbe4159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbe4159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46246/0 (socket says 172.21.15.70:46246) 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 -- 172.21.15.70:0/157418890 learned_addr learned my addr 172.21.15.70:0/157418890 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeacf4640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe4141320 0x7fcbe41417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbe9cf2640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe415a390 0x7fcbe415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 -- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe4141320 msgr2=0x7fcbe41417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:57.057 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe4141320 0x7fcbe41417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 -- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe415a390 msgr2=0x7fcbe415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe415a390 0x7fcbe415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 -- 172.21.15.70:0/157418890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40adba0 con 0x7fcbd0003b60 2023-11-26T07:21:57.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbea4f3640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbe4159b50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00018d0 tx=0x7fcbd0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbdaffd640 1 -- 172.21.15.70:0/157418890 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00069e0 con 0x7fcbd0003b60 2023-11-26T07:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbdaffd640 1 -- 172.21.15.70:0/157418890 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0006b40 con 0x7fcbd0003b60 2023-11-26T07:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe40ade80 con 0x7fcbd0003b60 2023-11-26T07:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbdaffd640 1 -- 172.21.15.70:0/157418890 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0007030 con 0x7fcbd0003b60 2023-11-26T07:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe415a090 con 0x7fcbd0003b60 2023-11-26T07:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.052+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe40b1f10 con 0x7fcbd0003b60 2023-11-26T07:21:57.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.056+0000 7fcbdaffd640 1 -- 172.21.15.70:0/157418890 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fcbe0007190 con 0x7fcbd0003b60 2023-11-26T07:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.056+0000 7fcbdaffd640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc8066a10 0x7fcbc8068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.056+0000 7fcbdaffd640 1 -- 172.21.15.70:0/157418890 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbe011db90 con 0x7fcbd0003b60 2023-11-26T07:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.056+0000 7fcbe9cf2640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc8066a10 0x7fcbc8068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:57.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.056+0000 7fcbe9cf2640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc8066a10 0x7fcbc8068ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4001b70 tx=0x7fcbd4001a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:57.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.060+0000 7fcbdaffd640 1 -- 172.21.15.70:0/157418890 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbe00ea700 con 0x7fcbd0003b60 2023-11-26T07:21:57.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.236+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcbe4067500 con 0x7fcbd0003b60 2023-11-26T07:21:57.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.880+0000 7fcbdaffd640 1 -- 172.21.15.70:0/157418890 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcbe00bc070 con 0x7fcbd0003b60 2023-11-26T07:21:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc8066a10 msgr2=0x7fcbc8068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc8066a10 0x7fcbc8068ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4001b70 tx=0x7fcbd4001a40 comp rx=0 tx=0).stop 2023-11-26T07:21:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 msgr2=0x7fcbe4159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbe4159b50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00018d0 tx=0x7fcbd0005800 comp rx=0 tx=0).stop 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 shutdown_connections 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcbe4141320 0x7fcbe41417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe415a390 0x7fcbe415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcbc8066a10 0x7fcbc8068ed0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 --2- 172.21.15.70:0/157418890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbd0003b60 0x7fcbe4159b50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 >> 172.21.15.70:0/157418890 conn(0x7fcbe406a890 msgr2=0x7fcbe4143720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 shutdown_connections 2023-11-26T07:21:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:57.884+0000 7fcbeb4f5640 1 -- 172.21.15.70:0/157418890 wait complete. 2023-11-26T07:21:57.911 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:21:57.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:58.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f36056c9640 1 Processor -- start 2023-11-26T07:21:58.053 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f36056c9640 1 -- start start 2023-11-26T07:21:58.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f36056c9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f360006b190 0x7f3600146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f36056c9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f360006a490 0x7f360006a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.054 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f36056c9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3600146380 con 0x7f3600145fa0 2023-11-26T07:21:58.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f36056c9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3600071480 con 0x7f360006a490 2023-11-26T07:21:58.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f36056c9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3600072000 con 0x7f360006b190 2023-11-26T07:21:58.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f360006b190 0x7f3600146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f360006b190 0x7f3600146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:38114/0 (socket says 172.21.15.70:38114) 2023-11-26T07:21:58.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f35feffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3600145fa0 0x7f3600072420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:48022/0 (socket says 172.21.15.70:48022) 2023-11-26T07:21:58.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f35ff7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f360006a490 0x7f360006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.048+0000 7f35f7fff640 1 -- 172.21.15.70:0/1417996656 learned_addr learned my addr 172.21.15.70:0/1417996656 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:58.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35fe7fc640 1 -- 172.21.15.70:0/1417996656 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141170680 0 0) 0x7f3600146380 con 0x7f3600145fa0 2023-11-26T07:21:58.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35f7fff640 1 -- 172.21.15.70:0/1417996656 >> v2:172.21.15.120:3300/0 conn(0x7f360006a490 msgr2=0x7f360006a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:58.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35f7fff640 1 --2- 172.21.15.70:0/1417996656 >> v2:172.21.15.120:3300/0 conn(0x7f360006a490 0x7f360006a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35f7fff640 1 -- 172.21.15.70:0/1417996656 >> v1:172.21.15.120:6789/0 conn(0x7f3600145fa0 legacy=0x7f3600072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35f7fff640 1 -- 172.21.15.70:0/1417996656 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600071660 con 0x7f360006b190 2023-11-26T07:21:58.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35f7fff640 1 --2- 172.21.15.70:0/1417996656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f360006b190 0x7f3600146530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009870 tx=0x7f35e801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f38598cbc1e1ff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35fe7fc640 1 -- 172.21.15.70:0/1417996656 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80a7070 con 0x7f360006b190 2023-11-26T07:21:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35fe7fc640 1 -- 172.21.15.70:0/1417996656 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80ab430 con 0x7f360006b190 2023-11-26T07:21:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.052+0000 7f35fe7fc640 1 -- 172.21.15.70:0/1417996656 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80ab7c0 con 0x7f360006b190 2023-11-26T07:21:58.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- 172.21.15.70:0/1417996656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f360006b190 msgr2=0x7f3600146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 --2- 172.21.15.70:0/1417996656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f360006b190 0x7f3600146530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009870 tx=0x7f35e801c540 comp rx=0 tx=0).stop 2023-11-26T07:21:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- 172.21.15.70:0/1417996656 shutdown_connections 2023-11-26T07:21:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 --2- 172.21.15.70:0/1417996656 >> v2:172.21.15.120:3300/0 conn(0x7f360006a490 0x7f360006a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 --2- 172.21.15.70:0/1417996656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f360006b190 0x7f3600146530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- 172.21.15.70:0/1417996656 >> 172.21.15.70:0/1417996656 conn(0x7f36000cff00 msgr2=0x7f36000d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- 172.21.15.70:0/1417996656 shutdown_connections 2023-11-26T07:21:58.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- 172.21.15.70:0/1417996656 wait complete. 2023-11-26T07:21:58.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 Processor -- start 2023-11-26T07:21:58.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- start start 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f360006a490 0x7f360015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f360006b190 0x7f36000ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3600145fa0 0x7f36000adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36001f5cd0 con 0x7f360006b190 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360015eba0 con 0x7f360006a490 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f36056c9640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360015ee80 con 0x7f3600145fa0 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f360006b190 0x7f36000ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f360006b190 0x7f36000ad5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46262/0 (socket says 172.21.15.70:46262) 2023-11-26T07:21:58.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 -- 172.21.15.70:0/656035883 learned_addr learned my addr 172.21.15.70:0/656035883 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35feffd640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f360006a490 0x7f360015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 -- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3600145fa0 msgr2=0x7f36000adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35ff7fe640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3600145fa0 0x7f36000adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3600145fa0 0x7f36000adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 -- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f360006a490 msgr2=0x7f360015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f360006a490 0x7f360015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 -- 172.21.15.70:0/656035883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80094d0 con 0x7f360006b190 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35feffd640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f360006a490 0x7f360015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35ff7fe640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3600145fa0 0x7f36000adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:58.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.056+0000 7f35f7fff640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f360006b190 0x7f36000ad5d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f35e80ad040 tx=0x7f35e80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35f77fe640 1 -- 172.21.15.70:0/656035883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b4620 con 0x7f360006b190 2023-11-26T07:21:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35f77fe640 1 -- 172.21.15.70:0/656035883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80b4780 con 0x7f360006b190 2023-11-26T07:21:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3600143400 con 0x7f360006b190 2023-11-26T07:21:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35f77fe640 1 -- 172.21.15.70:0/656035883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b4b30 con 0x7f360006b190 2023-11-26T07:21:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36001439c0 con 0x7f360006b190 2023-11-26T07:21:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3600067680 con 0x7f360006b190 2023-11-26T07:21:58.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35f77fe640 1 -- 172.21.15.70:0/656035883 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f35e80b4c90 con 0x7f360006b190 2023-11-26T07:21:58.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35f77fe640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e0066a10 0x7f35e0068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35f77fe640 1 -- 172.21.15.70:0/656035883 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35e811edd0 con 0x7f360006b190 2023-11-26T07:21:58.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35feffd640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e0066a10 0x7f35e0068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.060+0000 7f35feffd640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e0066a10 0x7f35e0068ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f35f0000f70 tx=0x7f35f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.064+0000 7f35f77fe640 1 -- 172.21.15.70:0/656035883 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35e80eb920 con 0x7f360006b190 2023-11-26T07:21:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.244+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f360015eff0 con 0x7f360006b190 2023-11-26T07:21:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.244+0000 7f35f77fe640 1 -- 172.21.15.70:0/656035883 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f35e80c4090 con 0x7f360006b190 2023-11-26T07:21:58.251 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:58.251 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/3935694912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3935694912},{"type":"v1","addr":"172.21.15.120:6834","nonce":3935694912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/886224003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":886224003},{"type":"v1","addr":"172.21.15.120:6835","nonce":886224003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1027556569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1027556569},{"type":"v1","addr":"172.21.15.70:6835","nonce":1027556569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:54.236576+0000","modified":"2023-11-26T07:21:57.243631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3834969891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3834969891},{"type":"v1","addr":"172.21.15.70:6837","nonce":3834969891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:21:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2023-11-26T07:21:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e0066a10 msgr2=0x7f35e0068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e0066a10 0x7f35e0068ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f35f0000f70 tx=0x7f35f0009040 comp rx=0 tx=0).stop 2023-11-26T07:21:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f360006b190 msgr2=0x7f36000ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f360006b190 0x7f36000ad5d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f35e80ad040 tx=0x7f35e80192e0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 shutdown_connections 2023-11-26T07:21:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35e0066a10 0x7f35e0068ed0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f360006b190 0x7f36000ad5d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3600145fa0 0x7f36000adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 --2- 172.21.15.70:0/656035883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f360006a490 0x7f360015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 >> 172.21.15.70:0/656035883 conn(0x7f36000cff00 msgr2=0x7f36000af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 shutdown_connections 2023-11-26T07:21:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.248+0000 7f36056c9640 1 -- 172.21.15.70:0/656035883 wait complete. 2023-11-26T07:21:58.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:21:58.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.404+0000 7f37b0068640 1 Processor -- start 2023-11-26T07:21:58.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.404+0000 7f37b0068640 1 -- start start 2023-11-26T07:21:58.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.404+0000 7f37b0068640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f37a814b1e0 0x7f37a80cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.404+0000 7f37b0068640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a8070fd0 0x7f37a8162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.404+0000 7f37b0068640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a80cfc20 con 0x7f37a80cf7c0 2023-11-26T07:21:58.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.404+0000 7f37b0068640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a8162080 con 0x7f37a814b1e0 2023-11-26T07:21:58.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.404+0000 7f37b0068640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a8161d70 con 0x7f37a8070fd0 2023-11-26T07:21:58.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ad603640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f37a80cf7c0 0x7f37a80708c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45570/0 (socket says 172.21.15.70:45570) 2023-11-26T07:21:58.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ad603640 1 -- 172.21.15.70:0/3222523284 learned_addr learned my addr 172.21.15.70:0/3222523284 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:58.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ade04640 1 --2- 172.21.15.70:0/3222523284 >> v2:172.21.15.120:3300/0 conn(0x7f37a814b1e0 0x7f37a80cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ae605640 1 --2- 172.21.15.70:0/3222523284 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a8070fd0 0x7f37a8162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ace02640 1 -- 172.21.15.70:0/3222523284 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435283823 0 0) 0x7f37a80cfc20 con 0x7f37a80cf7c0 2023-11-26T07:21:58.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ace02640 1 -- 172.21.15.70:0/3222523284 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3794003530 con 0x7f37a80cf7c0 2023-11-26T07:21:58.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ae605640 1 -- 172.21.15.70:0/3222523284 >> v2:172.21.15.120:3300/0 conn(0x7f37a814b1e0 msgr2=0x7f37a80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:58.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ae605640 1 --2- 172.21.15.70:0/3222523284 >> v2:172.21.15.120:3300/0 conn(0x7f37a814b1e0 0x7f37a80cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ae605640 1 -- 172.21.15.70:0/3222523284 >> v1:172.21.15.70:6789/0 conn(0x7f37a80cf7c0 legacy=0x7f37a80708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ae605640 1 -- 172.21.15.70:0/3222523284 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a814b5c0 con 0x7f37a8070fd0 2023-11-26T07:21:58.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.408+0000 7f37ae605640 1 --2- 172.21.15.70:0/3222523284 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a8070fd0 0x7f37a8162510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009d90 tx=0x7f37a001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd5890fdadd9053 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37ace02640 1 -- 172.21.15.70:0/3222523284 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a00a59e0 con 0x7f37a8070fd0 2023-11-26T07:21:58.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37ace02640 1 -- 172.21.15.70:0/3222523284 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a00a5b40 con 0x7f37a8070fd0 2023-11-26T07:21:58.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37ace02640 1 -- 172.21.15.70:0/3222523284 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a00ad440 con 0x7f37a8070fd0 2023-11-26T07:21:58.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- 172.21.15.70:0/3222523284 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a8070fd0 msgr2=0x7f37a8162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 --2- 172.21.15.70:0/3222523284 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a8070fd0 0x7f37a8162510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009d90 tx=0x7f37a001c920 comp rx=0 tx=0).stop 2023-11-26T07:21:58.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- 172.21.15.70:0/3222523284 shutdown_connections 2023-11-26T07:21:58.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 --2- 172.21.15.70:0/3222523284 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a8070fd0 0x7f37a8162510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 --2- 172.21.15.70:0/3222523284 >> v2:172.21.15.120:3300/0 conn(0x7f37a814b1e0 0x7f37a80cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- 172.21.15.70:0/3222523284 >> 172.21.15.70:0/3222523284 conn(0x7f37a806a890 msgr2=0x7f37a806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:58.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- 172.21.15.70:0/3222523284 shutdown_connections 2023-11-26T07:21:58.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- 172.21.15.70:0/3222523284 wait complete. 2023-11-26T07:21:58.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 Processor -- start 2023-11-26T07:21:58.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- start start 2023-11-26T07:21:58.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37a8070fd0 0x7f37a8146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37a80cf7c0 0x7f37a814e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a814b1e0 0x7f37a8160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a814c0e0 con 0x7f37a8070fd0 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a8161700 con 0x7f37a80cf7c0 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37b0068640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a814b7b0 con 0x7f37a814b1e0 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.412+0000 7f37ade04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37a8070fd0 0x7f37a8146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37a8070fd0 0x7f37a8146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46276/0 (socket says 172.21.15.70:46276) 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 -- 172.21.15.70:0/2545624644 learned_addr learned my addr 172.21.15.70:0/2545624644 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ad603640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37a80cf7c0 0x7f37a814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ae605640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a814b1e0 0x7f37a8160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 -- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a814b1e0 msgr2=0x7f37a8160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a814b1e0 0x7f37a8160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 -- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37a80cf7c0 msgr2=0x7f37a814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37a80cf7c0 0x7f37a814e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 -- 172.21.15.70:0/2545624644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0009a70 con 0x7f37a8070fd0 2023-11-26T07:21:58.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37ade04640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37a8070fd0 0x7f37a8146d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e870 tx=0x7f37a400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f379e7fc640 1 -- 172.21.15.70:0/2545624644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4009510 con 0x7f37a8070fd0 2023-11-26T07:21:58.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f379e7fc640 1 -- 172.21.15.70:0/2545624644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400eec0 con 0x7f37a8070fd0 2023-11-26T07:21:58.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f379e7fc640 1 -- 172.21.15.70:0/2545624644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400cb40 con 0x7f37a8070fd0 2023-11-26T07:21:58.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a814ba90 con 0x7f37a8070fd0 2023-11-26T07:21:58.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a814e5a0 con 0x7f37a8070fd0 2023-11-26T07:21:58.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a8067680 con 0x7f37a8070fd0 2023-11-26T07:21:58.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f379e7fc640 1 -- 172.21.15.70:0/2545624644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f37a400ccc0 con 0x7f37a8070fd0 2023-11-26T07:21:58.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f379e7fc640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f378c066a10 0x7f378c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.416+0000 7f379e7fc640 1 -- 172.21.15.70:0/2545624644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37a4084930 con 0x7f37a8070fd0 2023-11-26T07:21:58.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.420+0000 7f37ad603640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f378c066a10 0x7f378c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.420+0000 7f37ad603640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f378c066a10 0x7f378c068ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37a80ce1d0 tx=0x7f3798007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.420+0000 7f379e7fc640 1 -- 172.21.15.70:0/2545624644 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37a4051640 con 0x7f37a8070fd0 2023-11-26T07:21:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.572+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37a806b4a0 con 0x7f37a8070fd0 2023-11-26T07:21:58.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.572+0000 7f379e7fc640 1 -- 172.21.15.70:0/2545624644 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f37a4054c60 con 0x7f37a8070fd0 2023-11-26T07:21:58.578 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:58.578 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":64,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:21:55.861930+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f378c066a10 msgr2=0x7f378c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f378c066a10 0x7f378c068ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37a80ce1d0 tx=0x7f3798007d40 comp rx=0 tx=0).stop 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37a8070fd0 msgr2=0x7f37a8146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37a8070fd0 0x7f37a8146d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f37a400e870 tx=0x7f37a400ec70 comp rx=0 tx=0).stop 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 shutdown_connections 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f37a814b1e0 0x7f37a8160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37a80cf7c0 0x7f37a814e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f378c066a10 0x7f378c068ed0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 --2- 172.21.15.70:0/2545624644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37a8070fd0 0x7f37a8146d90 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 >> 172.21.15.70:0/2545624644 conn(0x7f37a806a890 msgr2=0x7f37a80b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 shutdown_connections 2023-11-26T07:21:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.576+0000 7f37b0068640 1 -- 172.21.15.70:0/2545624644 wait complete. 2023-11-26T07:21:58.599 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:21:58.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:21:58.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a315df640 1 Processor -- start 2023-11-26T07:21:58.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a315df640 1 -- start start 2023-11-26T07:21:58.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a315df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a2c0d17f0 0x7f8a2c0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a315df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8a2c0b0490 0x7f8a2c0b0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a315df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c0d0bc0 con 0x7f8a2c15d580 2023-11-26T07:21:58.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a315df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0d0320 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a315df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0d0600 con 0x7f8a2c0b0490 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a227fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a2c0d17f0 0x7f8a2c0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a227fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a2c0d17f0 0x7f8a2c0d1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46282/0 (socket says 172.21.15.70:46282) 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a227fc640 1 -- 172.21.15.70:0/220179309 learned_addr learned my addr 172.21.15.70:0/220179309 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.732+0000 7f8a2affd640 1 --1- 172.21.15.70:0/220179309 >> v1:172.21.15.70:6789/0 conn(0x7f8a2c15d580 0x7f8a2c0d3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45582/0 (socket says 172.21.15.70:45582) 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a2b7fe640 1 --2- 172.21.15.70:0/220179309 >> v2:172.21.15.120:3300/0 conn(0x7f8a2c0b0490 0x7f8a2c0b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a227fc640 1 -- 172.21.15.70:0/220179309 >> v2:172.21.15.120:3300/0 conn(0x7f8a2c0b0490 msgr2=0x7f8a2c0b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a227fc640 1 --2- 172.21.15.70:0/220179309 >> v2:172.21.15.120:3300/0 conn(0x7f8a2c0b0490 0x7f8a2c0b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a227fc640 1 -- 172.21.15.70:0/220179309 >> v1:172.21.15.70:6789/0 conn(0x7f8a2c15d580 legacy=0x7f8a2c0d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a227fc640 1 -- 172.21.15.70:0/220179309 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0d08e0 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a227fc640 1 --2- 172.21.15.70:0/220179309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c0d1c30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c08d400 tx=0x7f8a1401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8849ae7b1c592f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a2a7fc640 1 -- 172.21.15.70:0/220179309 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140a5840 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a2a7fc640 1 -- 172.21.15.70:0/220179309 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140a59a0 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a2a7fc640 1 -- 172.21.15.70:0/220179309 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140a5d30 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a315df640 1 -- 172.21.15.70:0/220179309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 msgr2=0x7f8a2c0d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a315df640 1 --2- 172.21.15.70:0/220179309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c0d1c30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c08d400 tx=0x7f8a1401c9a0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.736+0000 7f8a315df640 1 -- 172.21.15.70:0/220179309 shutdown_connections 2023-11-26T07:21:58.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 --2- 172.21.15.70:0/220179309 >> v2:172.21.15.120:3300/0 conn(0x7f8a2c0b0490 0x7f8a2c0b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 --2- 172.21.15.70:0/220179309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c0d1c30 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 -- 172.21.15.70:0/220179309 >> 172.21.15.70:0/220179309 conn(0x7f8a2c09c550 msgr2=0x7f8a2c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:58.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 -- 172.21.15.70:0/220179309 shutdown_connections 2023-11-26T07:21:58.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 -- 172.21.15.70:0/220179309 wait complete. 2023-11-26T07:21:58.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 Processor -- start 2023-11-26T07:21:58.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 -- start start 2023-11-26T07:21:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a2c0b0490 0x7f8a2c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a2c15d580 0x7f8a2c0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0b4bd0 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cb630 con 0x7f8a2c0b0490 2023-11-26T07:21:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a315df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0b48f0 con 0x7f8a2c15d580 2023-11-26T07:21:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46294/0 (socket says 172.21.15.70:46294) 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 -- 172.21.15.70:0/2590754638 learned_addr learned my addr 172.21.15.70:0/2590754638 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a2b7fe640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a2c15d580 0x7f8a2c0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a2affd640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a2c0b0490 0x7f8a2c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 -- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a2c15d580 msgr2=0x7f8a2c0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a2c15d580 0x7f8a2c0b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 -- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a2c0b0490 msgr2=0x7f8a2c0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a2c0b0490 0x7f8a2c0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a227fc640 1 -- 172.21.15.70:0/2590754638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009b30 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.740+0000 7f8a2affd640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a2c0b0490 0x7f8a2c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:58.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a227fc640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c155030 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8a140195b0 tx=0x7f8a14019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a23fff640 1 -- 172.21.15.70:0/2590754638 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140b8670 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a23fff640 1 -- 172.21.15.70:0/2590754638 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140b87f0 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a23fff640 1 -- 172.21.15.70:0/2590754638 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140b8ba0 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c0cc3b0 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0cc970 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c0ccb60 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a23fff640 1 -- 172.21.15.70:0/2590754638 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f8a140b8d00 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a23fff640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a0c066a10 0x7f8a0c068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a23fff640 1 -- 172.21.15.70:0/2590754638 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a1411ff50 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.744+0000 7f8a2affd640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a0c066a10 0x7f8a0c068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:58.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.748+0000 7f8a2affd640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a0c066a10 0x7f8a0c068ed0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c000f70 tx=0x7f8a1c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:58.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.748+0000 7f8a23fff640 1 -- 172.21.15.70:0/2590754638 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a140ecb70 con 0x7f8a2c0d17f0 2023-11-26T07:21:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.900+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a2c0d13b0 con 0x7f8a0c066a10 2023-11-26T07:21:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.908+0000 7f8a23fff640 1 -- 172.21.15.70:0/2590754638 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289280 (secure 0 0 0) 0x7f8a1c0074e0 con 0x7f8a0c066a10 2023-11-26T07:21:58.916 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:21:58.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a0c066a10 msgr2=0x7f8a0c068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a0c066a10 0x7f8a0c068ed0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c000f70 tx=0x7f8a1c007d50 comp rx=0 tx=0).stop 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 msgr2=0x7f8a2c155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c155030 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8a140195b0 tx=0x7f8a14019740 comp rx=0 tx=0).stop 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 shutdown_connections 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a0c066a10 0x7f8a0c068ed0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a2c0d17f0 0x7f8a2c155030 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a2c15d580 0x7f8a2c0b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 --2- 172.21.15.70:0/2590754638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a2c0b0490 0x7f8a2c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 >> 172.21.15.70:0/2590754638 conn(0x7f8a2c09c550 msgr2=0x7f8a2c15f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 shutdown_connections 2023-11-26T07:21:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:58.912+0000 7f8a315df640 1 -- 172.21.15.70:0/2590754638 wait complete. 2023-11-26T07:21:58.936 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-11-26T07:21:58.041545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256604,"kb_used_data":7132,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718116,"statfs":{"total":773094113280,"available":772831350784,"internally_reserved":0,"allocated":7303168,"data_stored":3730309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.200901"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877648+0000","last_change":"2023-11-26T07:21:54.876608+0000","last_active":"2023-11-26T07:21:54.877648+0000","last_peered":"2023-11-26T07:21:54.877648+0000","last_clean":"2023-11-26T07:21:54.877648+0000","last_became_active":"2023-11-26T07:21:54.876319+0000","last_became_peered":"2023-11-26T07:21:54.876319+0000","last_unstale":"2023-11-26T07:21:54.877648+0000","last_undegraded":"2023-11-26T07:21:54.877648+0000","last_fullsized":"2023-11-26T07:21:54.877648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:36:16.180517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887799+0000","last_change":"2023-11-26T07:21:54.880597+0000","last_active":"2023-11-26T07:21:54.887799+0000","last_peered":"2023-11-26T07:21:54.887799+0000","last_clean":"2023-11-26T07:21:54.887799+0000","last_became_active":"2023-11-26T07:21:54.880337+0000","last_became_peered":"2023-11-26T07:21:54.880337+0000","last_unstale":"2023-11-26T07:21:54.887799+0000","last_undegraded":"2023-11-26T07:21:54.887799+0000","last_fullsized":"2023-11-26T07:21:54.887799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:23:08.018777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877927+0000","last_change":"2023-11-26T07:21:54.873333+0000","last_active":"2023-11-26T07:21:54.877927+0000","last_peered":"2023-11-26T07:21:54.877927+0000","last_clean":"2023-11-26T07:21:54.877927+0000","last_became_active":"2023-11-26T07:21:54.872340+0000","last_became_peered":"2023-11-26T07:21:54.872340+0000","last_unstale":"2023-11-26T07:21:54.877927+0000","last_undegraded":"2023-11-26T07:21:54.877927+0000","last_fullsized":"2023-11-26T07:21:54.877927+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:17.292413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.880163+0000","last_change":"2023-11-26T07:21:54.871507+0000","last_active":"2023-11-26T07:21:54.880163+0000","last_peered":"2023-11-26T07:21:54.880163+0000","last_clean":"2023-11-26T07:21:54.880163+0000","last_became_active":"2023-11-26T07:21:54.871259+0000","last_became_peered":"2023-11-26T07:21:54.871259+0000","last_unstale":"2023-11-26T07:21:54.880163+0000","last_undegraded":"2023-11-26T07:21:54.880163+0000","last_fullsized":"2023-11-26T07:21:54.880163+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:34.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894486+0000","last_change":"2023-11-26T07:21:54.886247+0000","last_active":"2023-11-26T07:21:54.894486+0000","last_peered":"2023-11-26T07:21:54.894486+0000","last_clean":"2023-11-26T07:21:54.894486+0000","last_became_active":"2023-11-26T07:21:54.885938+0000","last_became_peered":"2023-11-26T07:21:54.885938+0000","last_unstale":"2023-11-26T07:21:54.894486+0000","last_undegraded":"2023-11-26T07:21:54.894486+0000","last_fullsized":"2023-11-26T07:21:54.894486+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:44:38.829109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.893857+0000","last_change":"2023-11-26T07:21:54.884002+0000","last_active":"2023-11-26T07:21:54.893857+0000","last_peered":"2023-11-26T07:21:54.893857+0000","last_clean":"2023-11-26T07:21:54.893857+0000","last_became_active":"2023-11-26T07:21:54.883611+0000","last_became_peered":"2023-11-26T07:21:54.883611+0000","last_unstale":"2023-11-26T07:21:54.893857+0000","last_undegraded":"2023-11-26T07:21:54.893857+0000","last_fullsized":"2023-11-26T07:21:54.893857+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:08.674163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.878848+0000","last_change":"2023-11-26T07:21:54.872968+0000","last_active":"2023-11-26T07:21:54.878848+0000","last_peered":"2023-11-26T07:21:54.878848+0000","last_clean":"2023-11-26T07:21:54.878848+0000","last_became_active":"2023-11-26T07:21:54.872622+0000","last_became_peered":"2023-11-26T07:21:54.872622+0000","last_unstale":"2023-11-26T07:21:54.878848+0000","last_undegraded":"2023-11-26T07:21:54.878848+0000","last_fullsized":"2023-11-26T07:21:54.878848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:15.272183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885323+0000","last_change":"2023-11-26T07:21:54.873241+0000","last_active":"2023-11-26T07:21:54.885323+0000","last_peered":"2023-11-26T07:21:54.885323+0000","last_clean":"2023-11-26T07:21:54.885323+0000","last_became_active":"2023-11-26T07:21:54.872924+0000","last_became_peered":"2023-11-26T07:21:54.872924+0000","last_unstale":"2023-11-26T07:21:54.885323+0000","last_undegraded":"2023-11-26T07:21:54.885323+0000","last_fullsized":"2023-11-26T07:21:54.885323+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:07:17.781964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.881181+0000","last_change":"2023-11-26T07:21:54.875327+0000","last_active":"2023-11-26T07:21:54.881181+0000","last_peered":"2023-11-26T07:21:54.881181+0000","last_clean":"2023-11-26T07:21:54.881181+0000","last_became_active":"2023-11-26T07:21:54.875037+0000","last_became_peered":"2023-11-26T07:21:54.875037+0000","last_unstale":"2023-11-26T07:21:54.881181+0000","last_undegraded":"2023-11-26T07:21:54.881181+0000","last_fullsized":"2023-11-26T07:21:54.881181+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899581+0000","last_change":"2023-11-26T07:21:54.893449+0000","last_active":"2023-11-26T07:21:54.899581+0000","last_peered":"2023-11-26T07:21:54.899581+0000","last_clean":"2023-11-26T07:21:54.899581+0000","last_became_active":"2023-11-26T07:21:54.891902+0000","last_became_peered":"2023-11-26T07:21:54.891902+0000","last_unstale":"2023-11-26T07:21:54.899581+0000","last_undegraded":"2023-11-26T07:21:54.899581+0000","last_fullsized":"2023-11-26T07:21:54.899581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:27:26.916362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899677+0000","last_change":"2023-11-26T07:21:54.894161+0000","last_active":"2023-11-26T07:21:54.899677+0000","last_peered":"2023-11-26T07:21:54.899677+0000","last_clean":"2023-11-26T07:21:54.899677+0000","last_became_active":"2023-11-26T07:21:54.890471+0000","last_became_peered":"2023-11-26T07:21:54.890471+0000","last_unstale":"2023-11-26T07:21:54.899677+0000","last_undegraded":"2023-11-26T07:21:54.899677+0000","last_fullsized":"2023-11-26T07:21:54.899677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:44.060959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.880143+0000","last_change":"2023-11-26T07:21:54.870874+0000","last_active":"2023-11-26T07:21:54.880143+0000","last_peered":"2023-11-26T07:21:54.880143+0000","last_clean":"2023-11-26T07:21:54.880143+0000","last_became_active":"2023-11-26T07:21:54.870501+0000","last_became_peered":"2023-11-26T07:21:54.870501+0000","last_unstale":"2023-11-26T07:21:54.880143+0000","last_undegraded":"2023-11-26T07:21:54.880143+0000","last_fullsized":"2023-11-26T07:21:54.880143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.883518+0000","last_change":"2023-11-26T07:21:54.879910+0000","last_active":"2023-11-26T07:21:54.883518+0000","last_peered":"2023-11-26T07:21:54.883518+0000","last_clean":"2023-11-26T07:21:54.883518+0000","last_became_active":"2023-11-26T07:21:54.879552+0000","last_became_peered":"2023-11-26T07:21:54.879552+0000","last_unstale":"2023-11-26T07:21:54.883518+0000","last_undegraded":"2023-11-26T07:21:54.883518+0000","last_fullsized":"2023-11-26T07:21:54.883518+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:08:56.934855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.868339+0000","last_change":"2023-11-26T07:21:54.866202+0000","last_active":"2023-11-26T07:21:54.868339+0000","last_peered":"2023-11-26T07:21:54.868339+0000","last_clean":"2023-11-26T07:21:54.868339+0000","last_became_active":"2023-11-26T07:21:54.865883+0000","last_became_peered":"2023-11-26T07:21:54.865883+0000","last_unstale":"2023-11-26T07:21:54.868339+0000","last_undegraded":"2023-11-26T07:21:54.868339+0000","last_fullsized":"2023-11-26T07:21:54.868339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:23:54.645308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.884678+0000","last_change":"2023-11-26T07:21:54.878091+0000","last_active":"2023-11-26T07:21:54.884678+0000","last_peered":"2023-11-26T07:21:54.884678+0000","last_clean":"2023-11-26T07:21:54.884678+0000","last_became_active":"2023-11-26T07:21:54.877770+0000","last_became_peered":"2023-11-26T07:21:54.877770+0000","last_unstale":"2023-11-26T07:21:54.884678+0000","last_undegraded":"2023-11-26T07:21:54.884678+0000","last_fullsized":"2023-11-26T07:21:54.884678+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:03.197555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.889270+0000","last_change":"2023-11-26T07:21:54.882074+0000","last_active":"2023-11-26T07:21:54.889270+0000","last_peered":"2023-11-26T07:21:54.889270+0000","last_clean":"2023-11-26T07:21:54.889270+0000","last_became_active":"2023-11-26T07:21:54.881746+0000","last_became_peered":"2023-11-26T07:21:54.881746+0000","last_unstale":"2023-11-26T07:21:54.889270+0000","last_undegraded":"2023-11-26T07:21:54.889270+0000","last_fullsized":"2023-11-26T07:21:54.889270+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:17.292413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.876519+0000","last_change":"2023-11-26T07:21:54.871081+0000","last_active":"2023-11-26T07:21:54.876519+0000","last_peered":"2023-11-26T07:21:54.876519+0000","last_clean":"2023-11-26T07:21:54.876519+0000","last_became_active":"2023-11-26T07:21:54.870768+0000","last_became_peered":"2023-11-26T07:21:54.870768+0000","last_unstale":"2023-11-26T07:21:54.876519+0000","last_undegraded":"2023-11-26T07:21:54.876519+0000","last_fullsized":"2023-11-26T07:21:54.876519+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:37.275256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887372+0000","last_change":"2023-11-26T07:21:54.880558+0000","last_active":"2023-11-26T07:21:54.887372+0000","last_peered":"2023-11-26T07:21:54.887372+0000","last_clean":"2023-11-26T07:21:54.887372+0000","last_became_active":"2023-11-26T07:21:54.878846+0000","last_became_peered":"2023-11-26T07:21:54.878846+0000","last_unstale":"2023-11-26T07:21:54.887372+0000","last_undegraded":"2023-11-26T07:21:54.887372+0000","last_fullsized":"2023-11-26T07:21:54.887372+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:08.674163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886826+0000","last_change":"2023-11-26T07:21:54.877421+0000","last_active":"2023-11-26T07:21:54.886826+0000","last_peered":"2023-11-26T07:21:54.886826+0000","last_clean":"2023-11-26T07:21:54.886826+0000","last_became_active":"2023-11-26T07:21:54.877130+0000","last_became_peered":"2023-11-26T07:21:54.877130+0000","last_unstale":"2023-11-26T07:21:54.886826+0000","last_undegraded":"2023-11-26T07:21:54.886826+0000","last_fullsized":"2023-11-26T07:21:54.886826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:48:20.825006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885952+0000","last_change":"2023-11-26T07:21:54.875580+0000","last_active":"2023-11-26T07:21:54.885952+0000","last_peered":"2023-11-26T07:21:54.885952+0000","last_clean":"2023-11-26T07:21:54.885952+0000","last_became_active":"2023-11-26T07:21:54.875335+0000","last_became_peered":"2023-11-26T07:21:54.875335+0000","last_unstale":"2023-11-26T07:21:54.885952+0000","last_undegraded":"2023-11-26T07:21:54.885952+0000","last_fullsized":"2023-11-26T07:21:54.885952+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:47:46.632920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887447+0000","last_change":"2023-11-26T07:21:54.878207+0000","last_active":"2023-11-26T07:21:54.887447+0000","last_peered":"2023-11-26T07:21:54.887447+0000","last_clean":"2023-11-26T07:21:54.887447+0000","last_became_active":"2023-11-26T07:21:54.877842+0000","last_became_peered":"2023-11-26T07:21:54.877842+0000","last_unstale":"2023-11-26T07:21:54.887447+0000","last_undegraded":"2023-11-26T07:21:54.887447+0000","last_fullsized":"2023-11-26T07:21:54.887447+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:59.700379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888040+0000","last_change":"2023-11-26T07:21:54.881185+0000","last_active":"2023-11-26T07:21:54.888040+0000","last_peered":"2023-11-26T07:21:54.888040+0000","last_clean":"2023-11-26T07:21:54.888040+0000","last_became_active":"2023-11-26T07:21:54.880888+0000","last_became_peered":"2023-11-26T07:21:54.880888+0000","last_unstale":"2023-11-26T07:21:54.888040+0000","last_undegraded":"2023-11-26T07:21:54.888040+0000","last_fullsized":"2023-11-26T07:21:54.888040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:49.327587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.892093+0000","last_change":"2023-11-26T07:21:54.886559+0000","last_active":"2023-11-26T07:21:54.892093+0000","last_peered":"2023-11-26T07:21:54.892093+0000","last_clean":"2023-11-26T07:21:54.892093+0000","last_became_active":"2023-11-26T07:21:54.886282+0000","last_became_peered":"2023-11-26T07:21:54.886282+0000","last_unstale":"2023-11-26T07:21:54.892093+0000","last_undegraded":"2023-11-26T07:21:54.892093+0000","last_fullsized":"2023-11-26T07:21:54.892093+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:30:00.261440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879851+0000","last_change":"2023-11-26T07:21:54.876062+0000","last_active":"2023-11-26T07:21:54.879851+0000","last_peered":"2023-11-26T07:21:54.879851+0000","last_clean":"2023-11-26T07:21:54.879851+0000","last_became_active":"2023-11-26T07:21:54.875424+0000","last_became_peered":"2023-11-26T07:21:54.875424+0000","last_unstale":"2023-11-26T07:21:54.879851+0000","last_undegraded":"2023-11-26T07:21:54.879851+0000","last_fullsized":"2023-11-26T07:21:54.879851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:46:42.799510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894658+0000","last_change":"2023-11-26T07:21:54.891015+0000","last_active":"2023-11-26T07:21:54.894658+0000","last_peered":"2023-11-26T07:21:54.894658+0000","last_clean":"2023-11-26T07:21:54.894658+0000","last_became_active":"2023-11-26T07:21:54.890724+0000","last_became_peered":"2023-11-26T07:21:54.890724+0000","last_unstale":"2023-11-26T07:21:54.894658+0000","last_undegraded":"2023-11-26T07:21:54.894658+0000","last_fullsized":"2023-11-26T07:21:54.894658+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:35:48.334390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877191+0000","last_change":"2023-11-26T07:21:54.868454+0000","last_active":"2023-11-26T07:21:54.877191+0000","last_peered":"2023-11-26T07:21:54.877191+0000","last_clean":"2023-11-26T07:21:54.877191+0000","last_became_active":"2023-11-26T07:21:54.867394+0000","last_became_peered":"2023-11-26T07:21:54.867394+0000","last_unstale":"2023-11-26T07:21:54.877191+0000","last_undegraded":"2023-11-26T07:21:54.877191+0000","last_fullsized":"2023-11-26T07:21:54.877191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:12.682807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.889035+0000","last_change":"2023-11-26T07:21:54.882539+0000","last_active":"2023-11-26T07:21:54.889035+0000","last_peered":"2023-11-26T07:21:54.889035+0000","last_clean":"2023-11-26T07:21:54.889035+0000","last_became_active":"2023-11-26T07:21:54.882296+0000","last_became_peered":"2023-11-26T07:21:54.882296+0000","last_unstale":"2023-11-26T07:21:54.889035+0000","last_undegraded":"2023-11-26T07:21:54.889035+0000","last_fullsized":"2023-11-26T07:21:54.889035+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:05:20.665670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887988+0000","last_change":"2023-11-26T07:21:54.882602+0000","last_active":"2023-11-26T07:21:54.887988+0000","last_peered":"2023-11-26T07:21:54.887988+0000","last_clean":"2023-11-26T07:21:54.887988+0000","last_became_active":"2023-11-26T07:21:54.882053+0000","last_became_peered":"2023-11-26T07:21:54.882053+0000","last_unstale":"2023-11-26T07:21:54.887988+0000","last_undegraded":"2023-11-26T07:21:54.887988+0000","last_fullsized":"2023-11-26T07:21:54.887988+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:16:13.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887542+0000","last_change":"2023-11-26T07:21:54.883306+0000","last_active":"2023-11-26T07:21:54.887542+0000","last_peered":"2023-11-26T07:21:54.887542+0000","last_clean":"2023-11-26T07:21:54.887542+0000","last_became_active":"2023-11-26T07:21:54.883025+0000","last_became_peered":"2023-11-26T07:21:54.883025+0000","last_unstale":"2023-11-26T07:21:54.887542+0000","last_undegraded":"2023-11-26T07:21:54.887542+0000","last_fullsized":"2023-11-26T07:21:54.887542+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:48.522150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877991+0000","last_change":"2023-11-26T07:21:54.873898+0000","last_active":"2023-11-26T07:21:54.877991+0000","last_peered":"2023-11-26T07:21:54.877991+0000","last_clean":"2023-11-26T07:21:54.877991+0000","last_became_active":"2023-11-26T07:21:54.873617+0000","last_became_peered":"2023-11-26T07:21:54.873617+0000","last_unstale":"2023-11-26T07:21:54.877991+0000","last_undegraded":"2023-11-26T07:21:54.877991+0000","last_fullsized":"2023-11-26T07:21:54.877991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:25:09.308148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894597+0000","last_change":"2023-11-26T07:21:54.888852+0000","last_active":"2023-11-26T07:21:54.894597+0000","last_peered":"2023-11-26T07:21:54.894597+0000","last_clean":"2023-11-26T07:21:54.894597+0000","last_became_active":"2023-11-26T07:21:54.886492+0000","last_became_peered":"2023-11-26T07:21:54.886492+0000","last_unstale":"2023-11-26T07:21:54.894597+0000","last_undegraded":"2023-11-26T07:21:54.894597+0000","last_fullsized":"2023-11-26T07:21:54.894597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:05:38.957864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886576+0000","last_change":"2023-11-26T07:21:54.875398+0000","last_active":"2023-11-26T07:21:54.886576+0000","last_peered":"2023-11-26T07:21:54.886576+0000","last_clean":"2023-11-26T07:21:54.886576+0000","last_became_active":"2023-11-26T07:21:54.874452+0000","last_became_peered":"2023-11-26T07:21:54.874452+0000","last_unstale":"2023-11-26T07:21:54.886576+0000","last_undegraded":"2023-11-26T07:21:54.886576+0000","last_fullsized":"2023-11-26T07:21:54.886576+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:51.440918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885407+0000","last_change":"2023-11-26T07:21:54.875163+0000","last_active":"2023-11-26T07:21:54.885407+0000","last_peered":"2023-11-26T07:21:54.885407+0000","last_clean":"2023-11-26T07:21:54.885407+0000","last_became_active":"2023-11-26T07:21:54.874871+0000","last_became_peered":"2023-11-26T07:21:54.874871+0000","last_unstale":"2023-11-26T07:21:54.885407+0000","last_undegraded":"2023-11-26T07:21:54.885407+0000","last_fullsized":"2023-11-26T07:21:54.885407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:36:29.351495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'4","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.902187+0000","last_change":"2023-11-26T07:21:53.869892+0000","last_active":"2023-11-26T07:21:54.902187+0000","last_peered":"2023-11-26T07:21:54.902187+0000","last_clean":"2023-11-26T07:21:54.902187+0000","last_became_active":"2023-11-26T07:21:53.868920+0000","last_became_peered":"2023-11-26T07:21:53.868920+0000","last_unstale":"2023-11-26T07:21:54.902187+0000","last_undegraded":"2023-11-26T07:21:54.902187+0000","last_fullsized":"2023-11-26T07:21:54.902187+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:05:29.841526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.898640+0000","last_change":"2023-11-26T07:21:54.885028+0000","last_active":"2023-11-26T07:21:54.898640+0000","last_peered":"2023-11-26T07:21:54.898640+0000","last_clean":"2023-11-26T07:21:54.898640+0000","last_became_active":"2023-11-26T07:21:54.884552+0000","last_became_peered":"2023-11-26T07:21:54.884552+0000","last_unstale":"2023-11-26T07:21:54.898640+0000","last_undegraded":"2023-11-26T07:21:54.898640+0000","last_fullsized":"2023-11-26T07:21:54.898640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:54:23.736030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899180+0000","last_change":"2023-11-26T07:21:53.870312+0000","last_active":"2023-11-26T07:21:54.899180+0000","last_peered":"2023-11-26T07:21:54.899180+0000","last_clean":"2023-11-26T07:21:54.899180+0000","last_became_active":"2023-11-26T07:21:53.869730+0000","last_became_peered":"2023-11-26T07:21:53.869730+0000","last_unstale":"2023-11-26T07:21:54.899180+0000","last_undegraded":"2023-11-26T07:21:54.899180+0000","last_fullsized":"2023-11-26T07:21:54.899180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:43.621553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888572+0000","last_change":"2023-11-26T07:21:54.879976+0000","last_active":"2023-11-26T07:21:54.888572+0000","last_peered":"2023-11-26T07:21:54.888572+0000","last_clean":"2023-11-26T07:21:54.888572+0000","last_became_active":"2023-11-26T07:21:54.877713+0000","last_became_peered":"2023-11-26T07:21:54.877713+0000","last_unstale":"2023-11-26T07:21:54.888572+0000","last_undegraded":"2023-11-26T07:21:54.888572+0000","last_fullsized":"2023-11-26T07:21:54.888572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:25:09.308148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899953+0000","last_change":"2023-11-26T07:21:53.871865+0000","last_active":"2023-11-26T07:21:54.899953+0000","last_peered":"2023-11-26T07:21:54.899953+0000","last_clean":"2023-11-26T07:21:54.899953+0000","last_became_active":"2023-11-26T07:21:53.871488+0000","last_became_peered":"2023-11-26T07:21:53.871488+0000","last_unstale":"2023-11-26T07:21:54.899953+0000","last_undegraded":"2023-11-26T07:21:54.899953+0000","last_fullsized":"2023-11-26T07:21:54.899953+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:52.736152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888679+0000","last_change":"2023-11-26T07:21:54.880016+0000","last_active":"2023-11-26T07:21:54.888679+0000","last_peered":"2023-11-26T07:21:54.888679+0000","last_clean":"2023-11-26T07:21:54.888679+0000","last_became_active":"2023-11-26T07:21:54.878781+0000","last_became_peered":"2023-11-26T07:21:54.878781+0000","last_unstale":"2023-11-26T07:21:54.888679+0000","last_undegraded":"2023-11-26T07:21:54.888679+0000","last_fullsized":"2023-11-26T07:21:54.888679+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:31.897985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894333+0000","last_change":"2023-11-26T07:21:53.864875+0000","last_active":"2023-11-26T07:21:54.894333+0000","last_peered":"2023-11-26T07:21:54.894333+0000","last_clean":"2023-11-26T07:21:54.894333+0000","last_became_active":"2023-11-26T07:21:53.864393+0000","last_became_peered":"2023-11-26T07:21:53.864393+0000","last_unstale":"2023-11-26T07:21:54.894333+0000","last_undegraded":"2023-11-26T07:21:54.894333+0000","last_fullsized":"2023-11-26T07:21:54.894333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:36:28.345506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.871569+0000","last_change":"2023-11-26T07:21:54.868860+0000","last_active":"2023-11-26T07:21:54.871569+0000","last_peered":"2023-11-26T07:21:54.871569+0000","last_clean":"2023-11-26T07:21:54.871569+0000","last_became_active":"2023-11-26T07:21:54.868547+0000","last_became_peered":"2023-11-26T07:21:54.868547+0000","last_unstale":"2023-11-26T07:21:54.871569+0000","last_undegraded":"2023-11-26T07:21:54.871569+0000","last_fullsized":"2023-11-26T07:21:54.871569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:56:10.057379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.896857+0000","last_change":"2023-11-26T07:21:53.863626+0000","last_active":"2023-11-26T07:21:54.896857+0000","last_peered":"2023-11-26T07:21:54.896857+0000","last_clean":"2023-11-26T07:21:54.896857+0000","last_became_active":"2023-11-26T07:21:53.863314+0000","last_became_peered":"2023-11-26T07:21:53.863314+0000","last_unstale":"2023-11-26T07:21:54.896857+0000","last_undegraded":"2023-11-26T07:21:54.896857+0000","last_fullsized":"2023-11-26T07:21:54.896857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:29:59.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886158+0000","last_change":"2023-11-26T07:21:54.875735+0000","last_active":"2023-11-26T07:21:54.886158+0000","last_peered":"2023-11-26T07:21:54.886158+0000","last_clean":"2023-11-26T07:21:54.886158+0000","last_became_active":"2023-11-26T07:21:54.875426+0000","last_became_peered":"2023-11-26T07:21:54.875426+0000","last_unstale":"2023-11-26T07:21:54.886158+0000","last_undegraded":"2023-11-26T07:21:54.886158+0000","last_fullsized":"2023-11-26T07:21:54.886158+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:54.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899114+0000","last_change":"2023-11-26T07:21:53.865412+0000","last_active":"2023-11-26T07:21:54.899114+0000","last_peered":"2023-11-26T07:21:54.899114+0000","last_clean":"2023-11-26T07:21:54.899114+0000","last_became_active":"2023-11-26T07:21:53.864892+0000","last_became_peered":"2023-11-26T07:21:53.864892+0000","last_unstale":"2023-11-26T07:21:54.899114+0000","last_undegraded":"2023-11-26T07:21:54.899114+0000","last_fullsized":"2023-11-26T07:21:54.899114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:38.890091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879834+0000","last_change":"2023-11-26T07:21:54.873265+0000","last_active":"2023-11-26T07:21:54.879834+0000","last_peered":"2023-11-26T07:21:54.879834+0000","last_clean":"2023-11-26T07:21:54.879834+0000","last_became_active":"2023-11-26T07:21:54.872992+0000","last_became_peered":"2023-11-26T07:21:54.872992+0000","last_unstale":"2023-11-26T07:21:54.879834+0000","last_undegraded":"2023-11-26T07:21:54.879834+0000","last_fullsized":"2023-11-26T07:21:54.879834+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:55.117046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.856670+0000","last_change":"2023-11-26T07:21:53.858360+0000","last_active":"2023-11-26T07:21:54.856670+0000","last_peered":"2023-11-26T07:21:54.856670+0000","last_clean":"2023-11-26T07:21:54.856670+0000","last_became_active":"2023-11-26T07:21:53.858073+0000","last_became_peered":"2023-11-26T07:21:53.858073+0000","last_unstale":"2023-11-26T07:21:54.856670+0000","last_undegraded":"2023-11-26T07:21:54.856670+0000","last_fullsized":"2023-11-26T07:21:54.856670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:29:59.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885499+0000","last_change":"2023-11-26T07:21:54.874881+0000","last_active":"2023-11-26T07:21:54.885499+0000","last_peered":"2023-11-26T07:21:54.885499+0000","last_clean":"2023-11-26T07:21:54.885499+0000","last_became_active":"2023-11-26T07:21:54.868914+0000","last_became_peered":"2023-11-26T07:21:54.868914+0000","last_unstale":"2023-11-26T07:21:54.885499+0000","last_undegraded":"2023-11-26T07:21:54.885499+0000","last_fullsized":"2023-11-26T07:21:54.885499+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:57.648151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.858086+0000","last_change":"2023-11-26T07:21:53.869697+0000","last_active":"2023-11-26T07:21:54.858086+0000","last_peered":"2023-11-26T07:21:54.858086+0000","last_clean":"2023-11-26T07:21:54.858086+0000","last_became_active":"2023-11-26T07:21:53.869412+0000","last_became_peered":"2023-11-26T07:21:53.869412+0000","last_unstale":"2023-11-26T07:21:54.858086+0000","last_undegraded":"2023-11-26T07:21:54.858086+0000","last_fullsized":"2023-11-26T07:21:54.858086+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:50.434929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.884703+0000","last_change":"2023-11-26T07:21:54.878133+0000","last_active":"2023-11-26T07:21:54.884703+0000","last_peered":"2023-11-26T07:21:54.884703+0000","last_clean":"2023-11-26T07:21:54.884703+0000","last_became_active":"2023-11-26T07:21:54.877832+0000","last_became_peered":"2023-11-26T07:21:54.877832+0000","last_unstale":"2023-11-26T07:21:54.884703+0000","last_undegraded":"2023-11-26T07:21:54.884703+0000","last_fullsized":"2023-11-26T07:21:54.884703+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:37:49.139827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.866892+0000","last_change":"2023-11-26T07:21:53.875432+0000","last_active":"2023-11-26T07:21:54.866892+0000","last_peered":"2023-11-26T07:21:54.866892+0000","last_clean":"2023-11-26T07:21:54.866892+0000","last_became_active":"2023-11-26T07:21:53.875167+0000","last_became_peered":"2023-11-26T07:21:53.875167+0000","last_unstale":"2023-11-26T07:21:54.866892+0000","last_undegraded":"2023-11-26T07:21:54.866892+0000","last_fullsized":"2023-11-26T07:21:54.866892+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:12:08.993953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901108+0000","last_change":"2023-11-26T07:21:54.897140+0000","last_active":"2023-11-26T07:21:54.901108+0000","last_peered":"2023-11-26T07:21:54.901108+0000","last_clean":"2023-11-26T07:21:54.901108+0000","last_became_active":"2023-11-26T07:21:54.896890+0000","last_became_peered":"2023-11-26T07:21:54.896890+0000","last_unstale":"2023-11-26T07:21:54.901108+0000","last_undegraded":"2023-11-26T07:21:54.901108+0000","last_fullsized":"2023-11-26T07:21:54.901108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:05:20.665670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.865457+0000","last_change":"2023-11-26T07:21:53.874877+0000","last_active":"2023-11-26T07:21:54.865457+0000","last_peered":"2023-11-26T07:21:54.865457+0000","last_clean":"2023-11-26T07:21:54.865457+0000","last_became_active":"2023-11-26T07:21:53.874597+0000","last_became_peered":"2023-11-26T07:21:53.874597+0000","last_unstale":"2023-11-26T07:21:54.865457+0000","last_undegraded":"2023-11-26T07:21:54.865457+0000","last_fullsized":"2023-11-26T07:21:54.865457+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:31.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899430+0000","last_change":"2023-11-26T07:21:54.890232+0000","last_active":"2023-11-26T07:21:54.899430+0000","last_peered":"2023-11-26T07:21:54.899430+0000","last_clean":"2023-11-26T07:21:54.899430+0000","last_became_active":"2023-11-26T07:21:54.889889+0000","last_became_peered":"2023-11-26T07:21:54.889889+0000","last_unstale":"2023-11-26T07:21:54.899430+0000","last_undegraded":"2023-11-26T07:21:54.899430+0000","last_fullsized":"2023-11-26T07:21:54.899430+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:42.607556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"63'3","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901439+0000","last_change":"2023-11-26T07:21:53.878323+0000","last_active":"2023-11-26T07:21:54.901439+0000","last_peered":"2023-11-26T07:21:54.901439+0000","last_clean":"2023-11-26T07:21:54.901439+0000","last_became_active":"2023-11-26T07:21:53.878058+0000","last_became_peered":"2023-11-26T07:21:53.878058+0000","last_unstale":"2023-11-26T07:21:54.901439+0000","last_undegraded":"2023-11-26T07:21:54.901439+0000","last_fullsized":"2023-11-26T07:21:54.901439+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:05:29.841526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901896+0000","last_change":"2023-11-26T07:21:54.899226+0000","last_active":"2023-11-26T07:21:54.901896+0000","last_peered":"2023-11-26T07:21:54.901896+0000","last_clean":"2023-11-26T07:21:54.901896+0000","last_became_active":"2023-11-26T07:21:54.899013+0000","last_became_peered":"2023-11-26T07:21:54.899013+0000","last_unstale":"2023-11-26T07:21:54.901896+0000","last_undegraded":"2023-11-26T07:21:54.901896+0000","last_fullsized":"2023-11-26T07:21:54.901896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:12.682807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901762+0000","last_change":"2023-11-26T07:21:53.863759+0000","last_active":"2023-11-26T07:21:54.901762+0000","last_peered":"2023-11-26T07:21:54.901762+0000","last_clean":"2023-11-26T07:21:54.901762+0000","last_became_active":"2023-11-26T07:21:53.863488+0000","last_became_peered":"2023-11-26T07:21:53.863488+0000","last_unstale":"2023-11-26T07:21:54.901762+0000","last_undegraded":"2023-11-26T07:21:54.901762+0000","last_fullsized":"2023-11-26T07:21:54.901762+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:07.668174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900894+0000","last_change":"2023-11-26T07:21:54.891959+0000","last_active":"2023-11-26T07:21:54.900894+0000","last_peered":"2023-11-26T07:21:54.900894+0000","last_clean":"2023-11-26T07:21:54.900894+0000","last_became_active":"2023-11-26T07:21:54.891667+0000","last_became_peered":"2023-11-26T07:21:54.891667+0000","last_unstale":"2023-11-26T07:21:54.900894+0000","last_undegraded":"2023-11-26T07:21:54.900894+0000","last_fullsized":"2023-11-26T07:21:54.900894+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:25:09.308148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.896961+0000","last_change":"2023-11-26T07:21:53.876376+0000","last_active":"2023-11-26T07:21:54.896961+0000","last_peered":"2023-11-26T07:21:54.896961+0000","last_clean":"2023-11-26T07:21:54.896961+0000","last_became_active":"2023-11-26T07:21:53.875946+0000","last_became_peered":"2023-11-26T07:21:53.875946+0000","last_unstale":"2023-11-26T07:21:54.896961+0000","last_undegraded":"2023-11-26T07:21:54.896961+0000","last_fullsized":"2023-11-26T07:21:54.896961+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:15:41.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.882172+0000","last_change":"2023-11-26T07:21:54.877747+0000","last_active":"2023-11-26T07:21:54.882172+0000","last_peered":"2023-11-26T07:21:54.882172+0000","last_clean":"2023-11-26T07:21:54.882172+0000","last_became_active":"2023-11-26T07:21:54.876707+0000","last_became_peered":"2023-11-26T07:21:54.876707+0000","last_unstale":"2023-11-26T07:21:54.882172+0000","last_undegraded":"2023-11-26T07:21:54.882172+0000","last_fullsized":"2023-11-26T07:21:54.882172+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:31.897985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.860909+0000","last_change":"2023-11-26T07:21:53.862858+0000","last_active":"2023-11-26T07:21:54.860909+0000","last_peered":"2023-11-26T07:21:54.860909+0000","last_clean":"2023-11-26T07:21:54.860909+0000","last_became_active":"2023-11-26T07:21:53.862003+0000","last_became_peered":"2023-11-26T07:21:53.862003+0000","last_unstale":"2023-11-26T07:21:54.860909+0000","last_undegraded":"2023-11-26T07:21:54.860909+0000","last_fullsized":"2023-11-26T07:21:54.860909+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:46:19.900198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.881140+0000","last_change":"2023-11-26T07:21:54.874625+0000","last_active":"2023-11-26T07:21:54.881140+0000","last_peered":"2023-11-26T07:21:54.881140+0000","last_clean":"2023-11-26T07:21:54.881140+0000","last_became_active":"2023-11-26T07:21:54.874165+0000","last_became_peered":"2023-11-26T07:21:54.874165+0000","last_unstale":"2023-11-26T07:21:54.881140+0000","last_undegraded":"2023-11-26T07:21:54.881140+0000","last_fullsized":"2023-11-26T07:21:54.881140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:57:36.212400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.859793+0000","last_change":"2023-11-26T07:21:53.868074+0000","last_active":"2023-11-26T07:21:54.859793+0000","last_peered":"2023-11-26T07:21:54.859793+0000","last_clean":"2023-11-26T07:21:54.859793+0000","last_became_active":"2023-11-26T07:21:53.866679+0000","last_became_peered":"2023-11-26T07:21:53.866679+0000","last_unstale":"2023-11-26T07:21:54.859793+0000","last_undegraded":"2023-11-26T07:21:54.859793+0000","last_fullsized":"2023-11-26T07:21:54.859793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:05:29.841526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.892112+0000","last_change":"2023-11-26T07:21:54.886592+0000","last_active":"2023-11-26T07:21:54.892112+0000","last_peered":"2023-11-26T07:21:54.892112+0000","last_clean":"2023-11-26T07:21:54.892112+0000","last_became_active":"2023-11-26T07:21:54.886335+0000","last_became_peered":"2023-11-26T07:21:54.886335+0000","last_unstale":"2023-11-26T07:21:54.892112+0000","last_undegraded":"2023-11-26T07:21:54.892112+0000","last_fullsized":"2023-11-26T07:21:54.892112+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"63'8","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901548+0000","last_change":"2023-11-26T07:21:53.870742+0000","last_active":"2023-11-26T07:21:54.901548+0000","last_peered":"2023-11-26T07:21:54.901548+0000","last_clean":"2023-11-26T07:21:54.901548+0000","last_became_active":"2023-11-26T07:21:53.870406+0000","last_became_peered":"2023-11-26T07:21:53.870406+0000","last_unstale":"2023-11-26T07:21:54.901548+0000","last_undegraded":"2023-11-26T07:21:54.901548+0000","last_fullsized":"2023-11-26T07:21:54.901548+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:37:48.133838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.876995+0000","last_change":"2023-11-26T07:21:54.871425+0000","last_active":"2023-11-26T07:21:54.876995+0000","last_peered":"2023-11-26T07:21:54.876995+0000","last_clean":"2023-11-26T07:21:54.876995+0000","last_became_active":"2023-11-26T07:21:54.871091+0000","last_became_peered":"2023-11-26T07:21:54.871091+0000","last_unstale":"2023-11-26T07:21:54.876995+0000","last_undegraded":"2023-11-26T07:21:54.876995+0000","last_fullsized":"2023-11-26T07:21:54.876995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:51.440918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.895849+0000","last_change":"2023-11-26T07:21:53.874309+0000","last_active":"2023-11-26T07:21:54.895849+0000","last_peered":"2023-11-26T07:21:54.895849+0000","last_clean":"2023-11-26T07:21:54.895849+0000","last_became_active":"2023-11-26T07:21:53.874014+0000","last_became_peered":"2023-11-26T07:21:53.874014+0000","last_unstale":"2023-11-26T07:21:54.895849+0000","last_undegraded":"2023-11-26T07:21:54.895849+0000","last_fullsized":"2023-11-26T07:21:54.895849+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:55:49.700960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900990+0000","last_change":"2023-11-26T07:21:54.892912+0000","last_active":"2023-11-26T07:21:54.900990+0000","last_peered":"2023-11-26T07:21:54.900990+0000","last_clean":"2023-11-26T07:21:54.900990+0000","last_became_active":"2023-11-26T07:21:54.892555+0000","last_became_peered":"2023-11-26T07:21:54.892555+0000","last_unstale":"2023-11-26T07:21:54.900990+0000","last_undegraded":"2023-11-26T07:21:54.900990+0000","last_fullsized":"2023-11-26T07:21:54.900990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:17.292413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.897324+0000","last_change":"2023-11-26T07:21:53.868920+0000","last_active":"2023-11-26T07:21:54.897324+0000","last_peered":"2023-11-26T07:21:54.897324+0000","last_clean":"2023-11-26T07:21:54.897324+0000","last_became_active":"2023-11-26T07:21:53.868620+0000","last_became_peered":"2023-11-26T07:21:53.868620+0000","last_unstale":"2023-11-26T07:21:54.897324+0000","last_undegraded":"2023-11-26T07:21:54.897324+0000","last_fullsized":"2023-11-26T07:21:54.897324+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:12:08.993953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885816+0000","last_change":"2023-11-26T07:21:54.873215+0000","last_active":"2023-11-26T07:21:54.885816+0000","last_peered":"2023-11-26T07:21:54.885816+0000","last_clean":"2023-11-26T07:21:54.885816+0000","last_became_active":"2023-11-26T07:21:54.872981+0000","last_became_peered":"2023-11-26T07:21:54.872981+0000","last_unstale":"2023-11-26T07:21:54.885816+0000","last_undegraded":"2023-11-26T07:21:54.885816+0000","last_fullsized":"2023-11-26T07:21:54.885816+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:29.451089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894158+0000","last_change":"2023-11-26T07:21:53.864617+0000","last_active":"2023-11-26T07:21:54.894158+0000","last_peered":"2023-11-26T07:21:54.894158+0000","last_clean":"2023-11-26T07:21:54.894158+0000","last_became_active":"2023-11-26T07:21:53.864294+0000","last_became_peered":"2023-11-26T07:21:53.864294+0000","last_unstale":"2023-11-26T07:21:54.894158+0000","last_undegraded":"2023-11-26T07:21:54.894158+0000","last_fullsized":"2023-11-26T07:21:54.894158+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:30.891996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901908+0000","last_change":"2023-11-26T07:21:54.899335+0000","last_active":"2023-11-26T07:21:54.901908+0000","last_peered":"2023-11-26T07:21:54.901908+0000","last_clean":"2023-11-26T07:21:54.901908+0000","last_became_active":"2023-11-26T07:21:54.899112+0000","last_became_peered":"2023-11-26T07:21:54.899112+0000","last_unstale":"2023-11-26T07:21:54.901908+0000","last_undegraded":"2023-11-26T07:21:54.901908+0000","last_fullsized":"2023-11-26T07:21:54.901908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:34.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.864536+0000","last_change":"2023-11-26T07:21:53.872700+0000","last_active":"2023-11-26T07:21:54.864536+0000","last_peered":"2023-11-26T07:21:54.864536+0000","last_clean":"2023-11-26T07:21:54.864536+0000","last_became_active":"2023-11-26T07:21:53.872418+0000","last_became_peered":"2023-11-26T07:21:53.872418+0000","last_unstale":"2023-11-26T07:21:54.864536+0000","last_undegraded":"2023-11-26T07:21:54.864536+0000","last_fullsized":"2023-11-26T07:21:54.864536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:11.676819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900989+0000","last_change":"2023-11-26T07:21:54.892916+0000","last_active":"2023-11-26T07:21:54.900989+0000","last_peered":"2023-11-26T07:21:54.900989+0000","last_clean":"2023-11-26T07:21:54.900989+0000","last_became_active":"2023-11-26T07:21:54.892623+0000","last_became_peered":"2023-11-26T07:21:54.892623+0000","last_unstale":"2023-11-26T07:21:54.900989+0000","last_undegraded":"2023-11-26T07:21:54.900989+0000","last_fullsized":"2023-11-26T07:21:54.900989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:59.700379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901472+0000","last_change":"2023-11-26T07:21:53.870940+0000","last_active":"2023-11-26T07:21:54.901472+0000","last_peered":"2023-11-26T07:21:54.901472+0000","last_clean":"2023-11-26T07:21:54.901472+0000","last_became_active":"2023-11-26T07:21:53.870603+0000","last_became_peered":"2023-11-26T07:21:53.870603+0000","last_unstale":"2023-11-26T07:21:54.901472+0000","last_undegraded":"2023-11-26T07:21:54.901472+0000","last_fullsized":"2023-11-26T07:21:54.901472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:38:54.789577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888690+0000","last_change":"2023-11-26T07:21:54.881077+0000","last_active":"2023-11-26T07:21:54.888690+0000","last_peered":"2023-11-26T07:21:54.888690+0000","last_clean":"2023-11-26T07:21:54.888690+0000","last_became_active":"2023-11-26T07:21:54.880722+0000","last_became_peered":"2023-11-26T07:21:54.880722+0000","last_unstale":"2023-11-26T07:21:54.888690+0000","last_undegraded":"2023-11-26T07:21:54.888690+0000","last_fullsized":"2023-11-26T07:21:54.888690+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:59.700379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.883335+0000","last_change":"2023-11-26T07:21:53.871620+0000","last_active":"2023-11-26T07:21:54.883335+0000","last_peered":"2023-11-26T07:21:54.883335+0000","last_clean":"2023-11-26T07:21:54.883335+0000","last_became_active":"2023-11-26T07:21:53.871187+0000","last_became_peered":"2023-11-26T07:21:53.871187+0000","last_unstale":"2023-11-26T07:21:54.883335+0000","last_undegraded":"2023-11-26T07:21:54.883335+0000","last_fullsized":"2023-11-26T07:21:54.883335+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:15:24.253743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879841+0000","last_change":"2023-11-26T07:21:54.872227+0000","last_active":"2023-11-26T07:21:54.879841+0000","last_peered":"2023-11-26T07:21:54.879841+0000","last_clean":"2023-11-26T07:21:54.879841+0000","last_became_active":"2023-11-26T07:21:54.871920+0000","last_became_peered":"2023-11-26T07:21:54.871920+0000","last_unstale":"2023-11-26T07:21:54.879841+0000","last_undegraded":"2023-11-26T07:21:54.879841+0000","last_fullsized":"2023-11-26T07:21:54.879841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.857484+0000","last_change":"2023-11-26T07:21:53.871154+0000","last_active":"2023-11-26T07:21:54.857484+0000","last_peered":"2023-11-26T07:21:54.857484+0000","last_clean":"2023-11-26T07:21:54.857484+0000","last_became_active":"2023-11-26T07:21:53.870762+0000","last_became_peered":"2023-11-26T07:21:53.870762+0000","last_unstale":"2023-11-26T07:21:54.857484+0000","last_undegraded":"2023-11-26T07:21:54.857484+0000","last_fullsized":"2023-11-26T07:21:54.857484+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:50.434929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.876932+0000","last_change":"2023-11-26T07:21:54.862430+0000","last_active":"2023-11-26T07:21:54.876932+0000","last_peered":"2023-11-26T07:21:54.876932+0000","last_clean":"2023-11-26T07:21:54.876932+0000","last_became_active":"2023-11-26T07:21:54.862086+0000","last_became_peered":"2023-11-26T07:21:54.862086+0000","last_unstale":"2023-11-26T07:21:54.876932+0000","last_undegraded":"2023-11-26T07:21:54.876932+0000","last_fullsized":"2023-11-26T07:21:54.876932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:08.674163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900189+0000","last_change":"2023-11-26T07:21:53.864682+0000","last_active":"2023-11-26T07:21:54.900189+0000","last_peered":"2023-11-26T07:21:54.900189+0000","last_clean":"2023-11-26T07:21:54.900189+0000","last_became_active":"2023-11-26T07:21:53.864390+0000","last_became_peered":"2023-11-26T07:21:53.864390+0000","last_unstale":"2023-11-26T07:21:54.900189+0000","last_undegraded":"2023-11-26T07:21:54.900189+0000","last_fullsized":"2023-11-26T07:21:54.900189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:08:55.928866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879591+0000","last_change":"2023-11-26T07:21:54.874758+0000","last_active":"2023-11-26T07:21:54.879591+0000","last_peered":"2023-11-26T07:21:54.879591+0000","last_clean":"2023-11-26T07:21:54.879591+0000","last_became_active":"2023-11-26T07:21:54.874437+0000","last_became_peered":"2023-11-26T07:21:54.874437+0000","last_unstale":"2023-11-26T07:21:54.879591+0000","last_undegraded":"2023-11-26T07:21:54.879591+0000","last_fullsized":"2023-11-26T07:21:54.879591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:37:49.139827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.867294+0000","last_change":"2023-11-26T07:21:53.865856+0000","last_active":"2023-11-26T07:21:54.867294+0000","last_peered":"2023-11-26T07:21:54.867294+0000","last_clean":"2023-11-26T07:21:54.867294+0000","last_became_active":"2023-11-26T07:21:53.865673+0000","last_became_peered":"2023-11-26T07:21:53.865673+0000","last_unstale":"2023-11-26T07:21:54.867294+0000","last_undegraded":"2023-11-26T07:21:54.867294+0000","last_fullsized":"2023-11-26T07:21:54.867294+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:18.566593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899012+0000","last_change":"2023-11-26T07:21:54.886118+0000","last_active":"2023-11-26T07:21:54.899012+0000","last_peered":"2023-11-26T07:21:54.899012+0000","last_clean":"2023-11-26T07:21:54.899012+0000","last_became_active":"2023-11-26T07:21:54.883548+0000","last_became_peered":"2023-11-26T07:21:54.883548+0000","last_unstale":"2023-11-26T07:21:54.899012+0000","last_undegraded":"2023-11-26T07:21:54.899012+0000","last_fullsized":"2023-11-26T07:21:54.899012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:43:48.445792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.861004+0000","last_change":"2023-11-26T07:21:53.862124+0000","last_active":"2023-11-26T07:21:54.861004+0000","last_peered":"2023-11-26T07:21:54.861004+0000","last_clean":"2023-11-26T07:21:54.861004+0000","last_became_active":"2023-11-26T07:21:53.860513+0000","last_became_peered":"2023-11-26T07:21:53.860513+0000","last_unstale":"2023-11-26T07:21:54.861004+0000","last_undegraded":"2023-11-26T07:21:54.861004+0000","last_fullsized":"2023-11-26T07:21:54.861004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:13:50.088439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888700+0000","last_change":"2023-11-26T07:21:54.882256+0000","last_active":"2023-11-26T07:21:54.888700+0000","last_peered":"2023-11-26T07:21:54.888700+0000","last_clean":"2023-11-26T07:21:54.888700+0000","last_became_active":"2023-11-26T07:21:54.879609+0000","last_became_peered":"2023-11-26T07:21:54.879609+0000","last_unstale":"2023-11-26T07:21:54.888700+0000","last_undegraded":"2023-11-26T07:21:54.888700+0000","last_fullsized":"2023-11-26T07:21:54.888700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:34.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.860197+0000","last_change":"2023-11-26T07:21:53.860629+0000","last_active":"2023-11-26T07:21:54.860197+0000","last_peered":"2023-11-26T07:21:54.860197+0000","last_clean":"2023-11-26T07:21:54.860197+0000","last_became_active":"2023-11-26T07:21:53.860303+0000","last_became_peered":"2023-11-26T07:21:53.860303+0000","last_unstale":"2023-11-26T07:21:54.860197+0000","last_undegraded":"2023-11-26T07:21:54.860197+0000","last_fullsized":"2023-11-26T07:21:54.860197+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:05:19.659681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888058+0000","last_change":"2023-11-26T07:21:54.885675+0000","last_active":"2023-11-26T07:21:54.888058+0000","last_peered":"2023-11-26T07:21:54.888058+0000","last_clean":"2023-11-26T07:21:54.888058+0000","last_became_active":"2023-11-26T07:21:54.885356+0000","last_became_peered":"2023-11-26T07:21:54.885356+0000","last_unstale":"2023-11-26T07:21:54.888058+0000","last_undegraded":"2023-11-26T07:21:54.888058+0000","last_fullsized":"2023-11-26T07:21:54.888058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:06.741623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886500+0000","last_change":"2023-11-26T07:21:53.862863+0000","last_active":"2023-11-26T07:21:54.886500+0000","last_peered":"2023-11-26T07:21:54.886500+0000","last_clean":"2023-11-26T07:21:54.886500+0000","last_became_active":"2023-11-26T07:21:53.862485+0000","last_became_peered":"2023-11-26T07:21:53.862485+0000","last_unstale":"2023-11-26T07:21:54.886500+0000","last_undegraded":"2023-11-26T07:21:54.886500+0000","last_fullsized":"2023-11-26T07:21:54.886500+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:29:59.489612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.892143+0000","last_change":"2023-11-26T07:21:54.886728+0000","last_active":"2023-11-26T07:21:54.892143+0000","last_peered":"2023-11-26T07:21:54.892143+0000","last_clean":"2023-11-26T07:21:54.892143+0000","last_became_active":"2023-11-26T07:21:54.886404+0000","last_became_peered":"2023-11-26T07:21:54.886404+0000","last_unstale":"2023-11-26T07:21:54.892143+0000","last_undegraded":"2023-11-26T07:21:54.892143+0000","last_fullsized":"2023-11-26T07:21:54.892143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:36:29.351495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.858310+0000","last_change":"2023-11-26T07:21:53.859481+0000","last_active":"2023-11-26T07:21:54.858310+0000","last_peered":"2023-11-26T07:21:54.858310+0000","last_clean":"2023-11-26T07:21:54.858310+0000","last_became_active":"2023-11-26T07:21:53.859199+0000","last_became_peered":"2023-11-26T07:21:53.859199+0000","last_unstale":"2023-11-26T07:21:54.858310+0000","last_undegraded":"2023-11-26T07:21:54.858310+0000","last_fullsized":"2023-11-26T07:21:54.858310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:16.286424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899474+0000","last_change":"2023-11-26T07:21:54.891701+0000","last_active":"2023-11-26T07:21:54.899474+0000","last_peered":"2023-11-26T07:21:54.899474+0000","last_clean":"2023-11-26T07:21:54.899474+0000","last_became_active":"2023-11-26T07:21:54.891442+0000","last_became_peered":"2023-11-26T07:21:54.891442+0000","last_unstale":"2023-11-26T07:21:54.899474+0000","last_undegraded":"2023-11-26T07:21:54.899474+0000","last_fullsized":"2023-11-26T07:21:54.899474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:32.992318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.883596+0000","last_change":"2023-11-26T07:21:53.862844+0000","last_active":"2023-11-26T07:21:54.883596+0000","last_peered":"2023-11-26T07:21:54.883596+0000","last_clean":"2023-11-26T07:21:54.883596+0000","last_became_active":"2023-11-26T07:21:53.862500+0000","last_became_peered":"2023-11-26T07:21:53.862500+0000","last_unstale":"2023-11-26T07:21:54.883596+0000","last_undegraded":"2023-11-26T07:21:54.883596+0000","last_fullsized":"2023-11-26T07:21:54.883596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:18:16.873706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887157+0000","last_change":"2023-11-26T07:21:54.879805+0000","last_active":"2023-11-26T07:21:54.887157+0000","last_peered":"2023-11-26T07:21:54.887157+0000","last_clean":"2023-11-26T07:21:54.887157+0000","last_became_active":"2023-11-26T07:21:54.878973+0000","last_became_peered":"2023-11-26T07:21:54.878973+0000","last_unstale":"2023-11-26T07:21:54.887157+0000","last_undegraded":"2023-11-26T07:21:54.887157+0000","last_fullsized":"2023-11-26T07:21:54.887157+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:09:50.992422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.864662+0000","last_change":"2023-11-26T07:21:53.868320+0000","last_active":"2023-11-26T07:21:54.864662+0000","last_peered":"2023-11-26T07:21:54.864662+0000","last_clean":"2023-11-26T07:21:54.864662+0000","last_became_active":"2023-11-26T07:21:53.867342+0000","last_became_peered":"2023-11-26T07:21:53.867342+0000","last_unstale":"2023-11-26T07:21:54.864662+0000","last_undegraded":"2023-11-26T07:21:54.864662+0000","last_fullsized":"2023-11-26T07:21:54.864662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:34.866649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.871536+0000","last_change":"2023-11-26T07:21:54.869316+0000","last_active":"2023-11-26T07:21:54.871536+0000","last_peered":"2023-11-26T07:21:54.871536+0000","last_clean":"2023-11-26T07:21:54.871536+0000","last_became_active":"2023-11-26T07:21:54.868991+0000","last_became_peered":"2023-11-26T07:21:54.868991+0000","last_unstale":"2023-11-26T07:21:54.871536+0000","last_undegraded":"2023-11-26T07:21:54.871536+0000","last_fullsized":"2023-11-26T07:21:54.871536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:31:42.991063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.860624+0000","last_change":"2023-11-26T07:21:53.863103+0000","last_active":"2023-11-26T07:21:54.860624+0000","last_peered":"2023-11-26T07:21:54.860624+0000","last_clean":"2023-11-26T07:21:54.860624+0000","last_became_active":"2023-11-26T07:21:53.862789+0000","last_became_peered":"2023-11-26T07:21:53.862789+0000","last_unstale":"2023-11-26T07:21:54.860624+0000","last_undegraded":"2023-11-26T07:21:54.860624+0000","last_fullsized":"2023-11-26T07:21:54.860624+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:29:59.489612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.863594+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:21:54.863594+0000","last_peered":"2023-11-26T07:21:54.863594+0000","last_clean":"2023-11-26T07:21:54.863594+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:21:54.863594+0000","last_undegraded":"2023-11-26T07:21:54.863594+0000","last_fullsized":"2023-11-26T07:21:54.863594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1359872,"data_stored":909469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84999999999999998,"5min":0.876,"15min":0.876},"last":0.77000000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90700000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.501,"5min":0.441,"15min":0.441},"max":{"1min":0.877,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.69499999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.91000000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.624,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81899999999999995,"5min":1.923,"15min":1.923},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64400000000000002},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65900000000000003,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91700000000000004,"5min":1,"15min":1},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99099999999999999,"5min":1.863,"15min":1.863},"last":0.877}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":745472,"data_stored":312166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.96999999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.876,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":1.0149999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68700000000000006,"15min":0.69599999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90800000000000003,"5min":1.089,"15min":1.089},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69299999999999995,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83399999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.046,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65800000000000003,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98899999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69299999999999995},"min":{"1min":0.41199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94199999999999995,"5min":1.018,"15min":1.018},"last":0.71999999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.70799999999999996,"15min":0.73599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.038,"5min":1.133,"15min":1.133},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.016,"5min":1.042,"15min":1.042},"last":0.95399999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0820000000000001,"5min":1.196,"15min":1.196},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77900000000000003,"15min":0.80800000000000005},"min":{"1min":0.51800000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0980000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.93799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":319593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.90000000000000002,"15min":1.018},"min":{"1min":0.43099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.87,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.93200000000000005,"15min":1.048},"min":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.77200000000000002,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.94199999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.995,"15min":1.119},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.85399999999999998,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.95699999999999996,"15min":0.98899999999999999},"min":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82299999999999995,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.746}]},{"osd":2,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86399999999999999,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.90600000000000003,"15min":1.018},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78700000000000003,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.02,"15min":1.159},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80600000000000005,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":1.1140000000000001,"15min":1.194},"min":{"1min":0.51700000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88900000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.86099999999999999,"15min":0.98699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83499999999999996,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.96999999999999997,"15min":1.1000000000000001},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.622}]},{"osd":6,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89200000000000002,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.667,"15min":2.0870000000000002},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92400000000000004,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":1.081,"15min":1.2290000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84399999999999997,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69699999999999995,"5min":1.139,"15min":1.2250000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.89300000000000002,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":320553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91200000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.87,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66900000000000004,"15min":0.64400000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98899999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.48199999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69299999999999995,"15min":0.68700000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94199999999999995,"5min":1.218,"15min":1.218},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.58699999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92800000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.36899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98199999999999998,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.238,"15min":1.238},"last":0.46300000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.72799999999999998,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.89600000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.497},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76100000000000001,"15min":0.81399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":1.095,"15min":1.095},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0149999999999999,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.78700000000000003,"15min":0.83099999999999996},"min":{"1min":0.49099999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":1.302,"15min":1.302},"last":0.70999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":318997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.41499999999999998,"15min":0.43099999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53300000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.42899999999999999,"15min":0.435},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52500000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53700000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.56299999999999994,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.56599999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.625,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67600000000000005,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.495}]},{"osd":4,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.80400000000000005,"15min":0.88600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0289999999999999,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.755},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.71499999999999997,"15min":0.747},"min":{"1min":0.48199999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91700000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.82199999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.82599999999999996,"15min":0.90800000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.113,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.871}]},{"osd":6,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72699999999999998,"15min":0.754},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.84499999999999997,"15min":0.92600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.99299999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86299999999999999,"15min":0.95199999999999996},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.0880000000000001,"5min":3.476,"15min":3.476},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.85199999999999998,"5min":1.03,"15min":1.03},"last":0.79400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":318997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.41099999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.433,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.62,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42899999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.746,"15min":0.746},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68200000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":1.258,"15min":1.258},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96599999999999997,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0629999999999999,"5min":1.169,"15min":1.169},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.98399999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0529999999999999,"5min":1.167,"15min":1.167},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.56999999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1140000000000001,"5min":1.24,"15min":1.24},"last":0.93799999999999994}]},{"osd":7,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.753},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.1240000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":319031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.46999999999999997,"15min":0.504},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.752,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68200000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.372}]},{"osd":2,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.497,"15min":0.52100000000000002},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61799999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.53900000000000003,"15min":0.57099999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71599999999999997,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.48899999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58999999999999997,"15min":0.63},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69999999999999996,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.54100000000000004,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70199999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.43099999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79900000000000004,"15min":0.83099999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.075,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0069999999999999,"5min":1.329,"15min":1.329},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.749,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96299999999999997,"5min":1.101,"15min":1.101},"last":0.83799999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.85399999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.99299999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.747},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.80400000000000005,"15min":0.83199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0549999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93899999999999995,"5min":1.173,"15min":1.173},"last":0.78300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1368064,"data_stored":911503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.56499999999999995,"15min":0.63600000000000001},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.68400000000000005,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52600000000000002,"15min":0.55600000000000005},"min":{"1min":0.34200000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58699999999999997,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.437}]},{"osd":2,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":2.415,"15min":2.415},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.65800000000000003,"15min":0.73999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.56699999999999995,"5min":5.234,"15min":5.234},"last":0.51600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56499999999999995,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68000000000000005,"5min":3.726,"15min":3.726},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.71599999999999997,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.85399999999999998,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.73299999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.875,"15min":0.96099999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96699999999999997,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.83299999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89600000000000002,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.79200000000000004,"15min":0.83699999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92800000000000005,"5min":2.835,"15min":2.835},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97699999999999998,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.88900000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.81200000000000006,"15min":0.85499999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84099999999999997,"15min":0.89300000000000002},"min":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.873,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.81599999999999995,"15min":0.86599999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0760000000000001,"5min":2.798,"15min":2.798},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:21:58.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:21:59.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 Processor -- start 2023-11-26T07:21:59.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 -- start start 2023-11-26T07:21:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fef001596d0 0x7fef00071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fef000ce680 0x7fef000b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef000b2db0 0x7fef0015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000b3240 con 0x7fef000ce680 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000cbe00 con 0x7fef001596d0 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef086d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0006c750 con 0x7fef000b2db0 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fef000ce680 0x7fef000b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fef000ce680 0x7fef000b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46302/0 (socket says 172.21.15.70:46302) 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 -- 172.21.15.70:0/1283841689 learned_addr learned my addr 172.21.15.70:0/1283841689 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:59.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef06472640 1 --2- 172.21.15.70:0/1283841689 >> v2:172.21.15.120:3300/0 conn(0x7fef001596d0 0x7fef00071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef06c73640 1 --2- 172.21.15.70:0/1283841689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef000b2db0 0x7fef0015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 -- 172.21.15.70:0/1283841689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef000b2db0 msgr2=0x7fef0015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 --2- 172.21.15.70:0/1283841689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef000b2db0 0x7fef0015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 -- 172.21.15.70:0/1283841689 >> v2:172.21.15.120:3300/0 conn(0x7fef001596d0 msgr2=0x7fef00071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 --2- 172.21.15.70:0/1283841689 >> v2:172.21.15.120:3300/0 conn(0x7fef001596d0 0x7fef00071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef05c71640 1 -- 172.21.15.70:0/1283841689 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000b3550 con 0x7fef000ce680 2023-11-26T07:21:59.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.112+0000 7fef06472640 1 --2- 172.21.15.70:0/1283841689 >> v2:172.21.15.120:3300/0 conn(0x7fef001596d0 0x7fef00071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:21:59.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef05c71640 1 --2- 172.21.15.70:0/1283841689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef000b2870 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fef0006e4d0 tx=0x7feef001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5529b362f7b9d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef05470640 1 -- 172.21.15.70:0/1283841689 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00ab600 con 0x7fef000ce680 2023-11-26T07:21:59.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef05470640 1 -- 172.21.15.70:0/1283841689 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00a7050 con 0x7fef000ce680 2023-11-26T07:21:59.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef05470640 1 -- 172.21.15.70:0/1283841689 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00ab980 con 0x7fef000ce680 2023-11-26T07:21:59.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 -- 172.21.15.70:0/1283841689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 msgr2=0x7fef000b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 --2- 172.21.15.70:0/1283841689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef000b2870 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fef0006e4d0 tx=0x7feef001c500 comp rx=0 tx=0).stop 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 -- 172.21.15.70:0/1283841689 shutdown_connections 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 --2- 172.21.15.70:0/1283841689 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef000b2db0 0x7fef0015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 --2- 172.21.15.70:0/1283841689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef000b2870 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 --2- 172.21.15.70:0/1283841689 >> v2:172.21.15.120:3300/0 conn(0x7fef001596d0 0x7fef00071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 -- 172.21.15.70:0/1283841689 >> 172.21.15.70:0/1283841689 conn(0x7fef0006a890 msgr2=0x7fef0006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 -- 172.21.15.70:0/1283841689 shutdown_connections 2023-11-26T07:21:59.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.116+0000 7fef086d6640 1 -- 172.21.15.70:0/1283841689 wait complete. 2023-11-26T07:21:59.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 Processor -- start 2023-11-26T07:21:59.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 -- start start 2023-11-26T07:21:59.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef000b2db0 0x7fef001502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef0014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef001596d0 0x7fef000cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000cdd10 con 0x7fef000ce680 2023-11-26T07:21:59.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0014f230 con 0x7fef000b2db0 2023-11-26T07:21:59.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0014f510 con 0x7fef001596d0 2023-11-26T07:21:59.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef0014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef0014eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46304/0 (socket says 172.21.15.70:46304) 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 -- 172.21.15.70:0/3811833707 learned_addr learned my addr 172.21.15.70:0/3811833707 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef06472640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef000b2db0 0x7fef001502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef06c73640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef001596d0 0x7fef000cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 -- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef001596d0 msgr2=0x7fef000cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef001596d0 0x7fef000cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 -- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef000b2db0 msgr2=0x7fef001502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef000b2db0 0x7fef001502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 -- 172.21.15.70:0/3811833707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094d0 con 0x7fef000ce680 2023-11-26T07:21:59.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef05c71640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef0014eba0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7feef001abb0 tx=0x7feef00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7feef6ffd640 1 -- 172.21.15.70:0/3811833707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00b4440 con 0x7fef000ce680 2023-11-26T07:21:59.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7feef6ffd640 1 -- 172.21.15.70:0/3811833707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00b45a0 con 0x7fef000ce680 2023-11-26T07:21:59.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7feef6ffd640 1 -- 172.21.15.70:0/3811833707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00b4930 con 0x7fef000ce680 2023-11-26T07:21:59.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0014f7f0 con 0x7fef000ce680 2023-11-26T07:21:59.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0014fdb0 con 0x7fef000ce680 2023-11-26T07:21:59.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.120+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0014ffa0 con 0x7fef000ce680 2023-11-26T07:21:59.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.124+0000 7feef6ffd640 1 -- 172.21.15.70:0/3811833707 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7feef00b2070 con 0x7fef000ce680 2023-11-26T07:21:59.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.124+0000 7feef6ffd640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feee4066a10 0x7feee4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.124+0000 7feef6ffd640 1 -- 172.21.15.70:0/3811833707 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feef011e800 con 0x7fef000ce680 2023-11-26T07:21:59.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.124+0000 7fef06472640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feee4066a10 0x7feee4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.124+0000 7fef06472640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feee4066a10 0x7feee4068ed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feefc006e90 tx=0x7feefc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.128+0000 7feef6ffd640 1 -- 172.21.15.70:0/3811833707 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feef00eb370 con 0x7fef000ce680 2023-11-26T07:21:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.276+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef00159ab0 con 0x7feee4066a10 2023-11-26T07:21:59.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.284+0000 7feef6ffd640 1 -- 172.21.15.70:0/3811833707 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289280 (secure 0 0 0) 0x7feefc0108d0 con 0x7feee4066a10 2023-11-26T07:21:59.291 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:21:59.293 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feee4066a10 msgr2=0x7feee4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feee4066a10 0x7feee4068ed0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feefc006e90 tx=0x7feefc008040 comp rx=0 tx=0).stop 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 msgr2=0x7fef0014eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef0014eba0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7feef001abb0 tx=0x7feef00192a0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 shutdown_connections 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feee4066a10 0x7feee4068ed0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef000ce680 0x7fef0014eba0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fef001596d0 0x7fef000cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 --2- 172.21.15.70:0/3811833707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef000b2db0 0x7fef001502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 >> 172.21.15.70:0/3811833707 conn(0x7fef0006a890 msgr2=0x7fef000ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:59.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 shutdown_connections 2023-11-26T07:21:59.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.288+0000 7fef086d6640 1 -- 172.21.15.70:0/3811833707 wait complete. 2023-11-26T07:21:59.311 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-11-26T07:21:58.041545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256604,"kb_used_data":7132,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718116,"statfs":{"total":773094113280,"available":772831350784,"internally_reserved":0,"allocated":7303168,"data_stored":3730309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.200901"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877648+0000","last_change":"2023-11-26T07:21:54.876608+0000","last_active":"2023-11-26T07:21:54.877648+0000","last_peered":"2023-11-26T07:21:54.877648+0000","last_clean":"2023-11-26T07:21:54.877648+0000","last_became_active":"2023-11-26T07:21:54.876319+0000","last_became_peered":"2023-11-26T07:21:54.876319+0000","last_unstale":"2023-11-26T07:21:54.877648+0000","last_undegraded":"2023-11-26T07:21:54.877648+0000","last_fullsized":"2023-11-26T07:21:54.877648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:36:16.180517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887799+0000","last_change":"2023-11-26T07:21:54.880597+0000","last_active":"2023-11-26T07:21:54.887799+0000","last_peered":"2023-11-26T07:21:54.887799+0000","last_clean":"2023-11-26T07:21:54.887799+0000","last_became_active":"2023-11-26T07:21:54.880337+0000","last_became_peered":"2023-11-26T07:21:54.880337+0000","last_unstale":"2023-11-26T07:21:54.887799+0000","last_undegraded":"2023-11-26T07:21:54.887799+0000","last_fullsized":"2023-11-26T07:21:54.887799+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:23:08.018777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877927+0000","last_change":"2023-11-26T07:21:54.873333+0000","last_active":"2023-11-26T07:21:54.877927+0000","last_peered":"2023-11-26T07:21:54.877927+0000","last_clean":"2023-11-26T07:21:54.877927+0000","last_became_active":"2023-11-26T07:21:54.872340+0000","last_became_peered":"2023-11-26T07:21:54.872340+0000","last_unstale":"2023-11-26T07:21:54.877927+0000","last_undegraded":"2023-11-26T07:21:54.877927+0000","last_fullsized":"2023-11-26T07:21:54.877927+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:17.292413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.880163+0000","last_change":"2023-11-26T07:21:54.871507+0000","last_active":"2023-11-26T07:21:54.880163+0000","last_peered":"2023-11-26T07:21:54.880163+0000","last_clean":"2023-11-26T07:21:54.880163+0000","last_became_active":"2023-11-26T07:21:54.871259+0000","last_became_peered":"2023-11-26T07:21:54.871259+0000","last_unstale":"2023-11-26T07:21:54.880163+0000","last_undegraded":"2023-11-26T07:21:54.880163+0000","last_fullsized":"2023-11-26T07:21:54.880163+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:34.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894486+0000","last_change":"2023-11-26T07:21:54.886247+0000","last_active":"2023-11-26T07:21:54.894486+0000","last_peered":"2023-11-26T07:21:54.894486+0000","last_clean":"2023-11-26T07:21:54.894486+0000","last_became_active":"2023-11-26T07:21:54.885938+0000","last_became_peered":"2023-11-26T07:21:54.885938+0000","last_unstale":"2023-11-26T07:21:54.894486+0000","last_undegraded":"2023-11-26T07:21:54.894486+0000","last_fullsized":"2023-11-26T07:21:54.894486+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:44:38.829109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.893857+0000","last_change":"2023-11-26T07:21:54.884002+0000","last_active":"2023-11-26T07:21:54.893857+0000","last_peered":"2023-11-26T07:21:54.893857+0000","last_clean":"2023-11-26T07:21:54.893857+0000","last_became_active":"2023-11-26T07:21:54.883611+0000","last_became_peered":"2023-11-26T07:21:54.883611+0000","last_unstale":"2023-11-26T07:21:54.893857+0000","last_undegraded":"2023-11-26T07:21:54.893857+0000","last_fullsized":"2023-11-26T07:21:54.893857+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:08.674163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.878848+0000","last_change":"2023-11-26T07:21:54.872968+0000","last_active":"2023-11-26T07:21:54.878848+0000","last_peered":"2023-11-26T07:21:54.878848+0000","last_clean":"2023-11-26T07:21:54.878848+0000","last_became_active":"2023-11-26T07:21:54.872622+0000","last_became_peered":"2023-11-26T07:21:54.872622+0000","last_unstale":"2023-11-26T07:21:54.878848+0000","last_undegraded":"2023-11-26T07:21:54.878848+0000","last_fullsized":"2023-11-26T07:21:54.878848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:07:15.272183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885323+0000","last_change":"2023-11-26T07:21:54.873241+0000","last_active":"2023-11-26T07:21:54.885323+0000","last_peered":"2023-11-26T07:21:54.885323+0000","last_clean":"2023-11-26T07:21:54.885323+0000","last_became_active":"2023-11-26T07:21:54.872924+0000","last_became_peered":"2023-11-26T07:21:54.872924+0000","last_unstale":"2023-11-26T07:21:54.885323+0000","last_undegraded":"2023-11-26T07:21:54.885323+0000","last_fullsized":"2023-11-26T07:21:54.885323+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:07:17.781964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.881181+0000","last_change":"2023-11-26T07:21:54.875327+0000","last_active":"2023-11-26T07:21:54.881181+0000","last_peered":"2023-11-26T07:21:54.881181+0000","last_clean":"2023-11-26T07:21:54.881181+0000","last_became_active":"2023-11-26T07:21:54.875037+0000","last_became_peered":"2023-11-26T07:21:54.875037+0000","last_unstale":"2023-11-26T07:21:54.881181+0000","last_undegraded":"2023-11-26T07:21:54.881181+0000","last_fullsized":"2023-11-26T07:21:54.881181+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899581+0000","last_change":"2023-11-26T07:21:54.893449+0000","last_active":"2023-11-26T07:21:54.899581+0000","last_peered":"2023-11-26T07:21:54.899581+0000","last_clean":"2023-11-26T07:21:54.899581+0000","last_became_active":"2023-11-26T07:21:54.891902+0000","last_became_peered":"2023-11-26T07:21:54.891902+0000","last_unstale":"2023-11-26T07:21:54.899581+0000","last_undegraded":"2023-11-26T07:21:54.899581+0000","last_fullsized":"2023-11-26T07:21:54.899581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:27:26.916362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899677+0000","last_change":"2023-11-26T07:21:54.894161+0000","last_active":"2023-11-26T07:21:54.899677+0000","last_peered":"2023-11-26T07:21:54.899677+0000","last_clean":"2023-11-26T07:21:54.899677+0000","last_became_active":"2023-11-26T07:21:54.890471+0000","last_became_peered":"2023-11-26T07:21:54.890471+0000","last_unstale":"2023-11-26T07:21:54.899677+0000","last_undegraded":"2023-11-26T07:21:54.899677+0000","last_fullsized":"2023-11-26T07:21:54.899677+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:44.060959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.880143+0000","last_change":"2023-11-26T07:21:54.870874+0000","last_active":"2023-11-26T07:21:54.880143+0000","last_peered":"2023-11-26T07:21:54.880143+0000","last_clean":"2023-11-26T07:21:54.880143+0000","last_became_active":"2023-11-26T07:21:54.870501+0000","last_became_peered":"2023-11-26T07:21:54.870501+0000","last_unstale":"2023-11-26T07:21:54.880143+0000","last_undegraded":"2023-11-26T07:21:54.880143+0000","last_fullsized":"2023-11-26T07:21:54.880143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.883518+0000","last_change":"2023-11-26T07:21:54.879910+0000","last_active":"2023-11-26T07:21:54.883518+0000","last_peered":"2023-11-26T07:21:54.883518+0000","last_clean":"2023-11-26T07:21:54.883518+0000","last_became_active":"2023-11-26T07:21:54.879552+0000","last_became_peered":"2023-11-26T07:21:54.879552+0000","last_unstale":"2023-11-26T07:21:54.883518+0000","last_undegraded":"2023-11-26T07:21:54.883518+0000","last_fullsized":"2023-11-26T07:21:54.883518+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:08:56.934855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.868339+0000","last_change":"2023-11-26T07:21:54.866202+0000","last_active":"2023-11-26T07:21:54.868339+0000","last_peered":"2023-11-26T07:21:54.868339+0000","last_clean":"2023-11-26T07:21:54.868339+0000","last_became_active":"2023-11-26T07:21:54.865883+0000","last_became_peered":"2023-11-26T07:21:54.865883+0000","last_unstale":"2023-11-26T07:21:54.868339+0000","last_undegraded":"2023-11-26T07:21:54.868339+0000","last_fullsized":"2023-11-26T07:21:54.868339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:23:54.645308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.884678+0000","last_change":"2023-11-26T07:21:54.878091+0000","last_active":"2023-11-26T07:21:54.884678+0000","last_peered":"2023-11-26T07:21:54.884678+0000","last_clean":"2023-11-26T07:21:54.884678+0000","last_became_active":"2023-11-26T07:21:54.877770+0000","last_became_peered":"2023-11-26T07:21:54.877770+0000","last_unstale":"2023-11-26T07:21:54.884678+0000","last_undegraded":"2023-11-26T07:21:54.884678+0000","last_fullsized":"2023-11-26T07:21:54.884678+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:24:03.197555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.889270+0000","last_change":"2023-11-26T07:21:54.882074+0000","last_active":"2023-11-26T07:21:54.889270+0000","last_peered":"2023-11-26T07:21:54.889270+0000","last_clean":"2023-11-26T07:21:54.889270+0000","last_became_active":"2023-11-26T07:21:54.881746+0000","last_became_peered":"2023-11-26T07:21:54.881746+0000","last_unstale":"2023-11-26T07:21:54.889270+0000","last_undegraded":"2023-11-26T07:21:54.889270+0000","last_fullsized":"2023-11-26T07:21:54.889270+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:17.292413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.876519+0000","last_change":"2023-11-26T07:21:54.871081+0000","last_active":"2023-11-26T07:21:54.876519+0000","last_peered":"2023-11-26T07:21:54.876519+0000","last_clean":"2023-11-26T07:21:54.876519+0000","last_became_active":"2023-11-26T07:21:54.870768+0000","last_became_peered":"2023-11-26T07:21:54.870768+0000","last_unstale":"2023-11-26T07:21:54.876519+0000","last_undegraded":"2023-11-26T07:21:54.876519+0000","last_fullsized":"2023-11-26T07:21:54.876519+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:45:37.275256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887372+0000","last_change":"2023-11-26T07:21:54.880558+0000","last_active":"2023-11-26T07:21:54.887372+0000","last_peered":"2023-11-26T07:21:54.887372+0000","last_clean":"2023-11-26T07:21:54.887372+0000","last_became_active":"2023-11-26T07:21:54.878846+0000","last_became_peered":"2023-11-26T07:21:54.878846+0000","last_unstale":"2023-11-26T07:21:54.887372+0000","last_undegraded":"2023-11-26T07:21:54.887372+0000","last_fullsized":"2023-11-26T07:21:54.887372+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:08.674163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886826+0000","last_change":"2023-11-26T07:21:54.877421+0000","last_active":"2023-11-26T07:21:54.886826+0000","last_peered":"2023-11-26T07:21:54.886826+0000","last_clean":"2023-11-26T07:21:54.886826+0000","last_became_active":"2023-11-26T07:21:54.877130+0000","last_became_peered":"2023-11-26T07:21:54.877130+0000","last_unstale":"2023-11-26T07:21:54.886826+0000","last_undegraded":"2023-11-26T07:21:54.886826+0000","last_fullsized":"2023-11-26T07:21:54.886826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:48:20.825006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885952+0000","last_change":"2023-11-26T07:21:54.875580+0000","last_active":"2023-11-26T07:21:54.885952+0000","last_peered":"2023-11-26T07:21:54.885952+0000","last_clean":"2023-11-26T07:21:54.885952+0000","last_became_active":"2023-11-26T07:21:54.875335+0000","last_became_peered":"2023-11-26T07:21:54.875335+0000","last_unstale":"2023-11-26T07:21:54.885952+0000","last_undegraded":"2023-11-26T07:21:54.885952+0000","last_fullsized":"2023-11-26T07:21:54.885952+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:47:46.632920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887447+0000","last_change":"2023-11-26T07:21:54.878207+0000","last_active":"2023-11-26T07:21:54.887447+0000","last_peered":"2023-11-26T07:21:54.887447+0000","last_clean":"2023-11-26T07:21:54.887447+0000","last_became_active":"2023-11-26T07:21:54.877842+0000","last_became_peered":"2023-11-26T07:21:54.877842+0000","last_unstale":"2023-11-26T07:21:54.887447+0000","last_undegraded":"2023-11-26T07:21:54.887447+0000","last_fullsized":"2023-11-26T07:21:54.887447+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:59.700379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888040+0000","last_change":"2023-11-26T07:21:54.881185+0000","last_active":"2023-11-26T07:21:54.888040+0000","last_peered":"2023-11-26T07:21:54.888040+0000","last_clean":"2023-11-26T07:21:54.888040+0000","last_became_active":"2023-11-26T07:21:54.880888+0000","last_became_peered":"2023-11-26T07:21:54.880888+0000","last_unstale":"2023-11-26T07:21:54.888040+0000","last_undegraded":"2023-11-26T07:21:54.888040+0000","last_fullsized":"2023-11-26T07:21:54.888040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:45:49.327587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.892093+0000","last_change":"2023-11-26T07:21:54.886559+0000","last_active":"2023-11-26T07:21:54.892093+0000","last_peered":"2023-11-26T07:21:54.892093+0000","last_clean":"2023-11-26T07:21:54.892093+0000","last_became_active":"2023-11-26T07:21:54.886282+0000","last_became_peered":"2023-11-26T07:21:54.886282+0000","last_unstale":"2023-11-26T07:21:54.892093+0000","last_undegraded":"2023-11-26T07:21:54.892093+0000","last_fullsized":"2023-11-26T07:21:54.892093+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:30:00.261440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879851+0000","last_change":"2023-11-26T07:21:54.876062+0000","last_active":"2023-11-26T07:21:54.879851+0000","last_peered":"2023-11-26T07:21:54.879851+0000","last_clean":"2023-11-26T07:21:54.879851+0000","last_became_active":"2023-11-26T07:21:54.875424+0000","last_became_peered":"2023-11-26T07:21:54.875424+0000","last_unstale":"2023-11-26T07:21:54.879851+0000","last_undegraded":"2023-11-26T07:21:54.879851+0000","last_fullsized":"2023-11-26T07:21:54.879851+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:46:42.799510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894658+0000","last_change":"2023-11-26T07:21:54.891015+0000","last_active":"2023-11-26T07:21:54.894658+0000","last_peered":"2023-11-26T07:21:54.894658+0000","last_clean":"2023-11-26T07:21:54.894658+0000","last_became_active":"2023-11-26T07:21:54.890724+0000","last_became_peered":"2023-11-26T07:21:54.890724+0000","last_unstale":"2023-11-26T07:21:54.894658+0000","last_undegraded":"2023-11-26T07:21:54.894658+0000","last_fullsized":"2023-11-26T07:21:54.894658+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:35:48.334390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877191+0000","last_change":"2023-11-26T07:21:54.868454+0000","last_active":"2023-11-26T07:21:54.877191+0000","last_peered":"2023-11-26T07:21:54.877191+0000","last_clean":"2023-11-26T07:21:54.877191+0000","last_became_active":"2023-11-26T07:21:54.867394+0000","last_became_peered":"2023-11-26T07:21:54.867394+0000","last_unstale":"2023-11-26T07:21:54.877191+0000","last_undegraded":"2023-11-26T07:21:54.877191+0000","last_fullsized":"2023-11-26T07:21:54.877191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:12.682807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.889035+0000","last_change":"2023-11-26T07:21:54.882539+0000","last_active":"2023-11-26T07:21:54.889035+0000","last_peered":"2023-11-26T07:21:54.889035+0000","last_clean":"2023-11-26T07:21:54.889035+0000","last_became_active":"2023-11-26T07:21:54.882296+0000","last_became_peered":"2023-11-26T07:21:54.882296+0000","last_unstale":"2023-11-26T07:21:54.889035+0000","last_undegraded":"2023-11-26T07:21:54.889035+0000","last_fullsized":"2023-11-26T07:21:54.889035+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:05:20.665670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887988+0000","last_change":"2023-11-26T07:21:54.882602+0000","last_active":"2023-11-26T07:21:54.887988+0000","last_peered":"2023-11-26T07:21:54.887988+0000","last_clean":"2023-11-26T07:21:54.887988+0000","last_became_active":"2023-11-26T07:21:54.882053+0000","last_became_peered":"2023-11-26T07:21:54.882053+0000","last_unstale":"2023-11-26T07:21:54.887988+0000","last_undegraded":"2023-11-26T07:21:54.887988+0000","last_fullsized":"2023-11-26T07:21:54.887988+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:16:13.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887542+0000","last_change":"2023-11-26T07:21:54.883306+0000","last_active":"2023-11-26T07:21:54.887542+0000","last_peered":"2023-11-26T07:21:54.887542+0000","last_clean":"2023-11-26T07:21:54.887542+0000","last_became_active":"2023-11-26T07:21:54.883025+0000","last_became_peered":"2023-11-26T07:21:54.883025+0000","last_unstale":"2023-11-26T07:21:54.887542+0000","last_undegraded":"2023-11-26T07:21:54.887542+0000","last_fullsized":"2023-11-26T07:21:54.887542+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:48.522150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.877991+0000","last_change":"2023-11-26T07:21:54.873898+0000","last_active":"2023-11-26T07:21:54.877991+0000","last_peered":"2023-11-26T07:21:54.877991+0000","last_clean":"2023-11-26T07:21:54.877991+0000","last_became_active":"2023-11-26T07:21:54.873617+0000","last_became_peered":"2023-11-26T07:21:54.873617+0000","last_unstale":"2023-11-26T07:21:54.877991+0000","last_undegraded":"2023-11-26T07:21:54.877991+0000","last_fullsized":"2023-11-26T07:21:54.877991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:25:09.308148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894597+0000","last_change":"2023-11-26T07:21:54.888852+0000","last_active":"2023-11-26T07:21:54.894597+0000","last_peered":"2023-11-26T07:21:54.894597+0000","last_clean":"2023-11-26T07:21:54.894597+0000","last_became_active":"2023-11-26T07:21:54.886492+0000","last_became_peered":"2023-11-26T07:21:54.886492+0000","last_unstale":"2023-11-26T07:21:54.894597+0000","last_undegraded":"2023-11-26T07:21:54.894597+0000","last_fullsized":"2023-11-26T07:21:54.894597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:05:38.957864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886576+0000","last_change":"2023-11-26T07:21:54.875398+0000","last_active":"2023-11-26T07:21:54.886576+0000","last_peered":"2023-11-26T07:21:54.886576+0000","last_clean":"2023-11-26T07:21:54.886576+0000","last_became_active":"2023-11-26T07:21:54.874452+0000","last_became_peered":"2023-11-26T07:21:54.874452+0000","last_unstale":"2023-11-26T07:21:54.886576+0000","last_undegraded":"2023-11-26T07:21:54.886576+0000","last_fullsized":"2023-11-26T07:21:54.886576+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:51.440918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885407+0000","last_change":"2023-11-26T07:21:54.875163+0000","last_active":"2023-11-26T07:21:54.885407+0000","last_peered":"2023-11-26T07:21:54.885407+0000","last_clean":"2023-11-26T07:21:54.885407+0000","last_became_active":"2023-11-26T07:21:54.874871+0000","last_became_peered":"2023-11-26T07:21:54.874871+0000","last_unstale":"2023-11-26T07:21:54.885407+0000","last_undegraded":"2023-11-26T07:21:54.885407+0000","last_fullsized":"2023-11-26T07:21:54.885407+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:36:29.351495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"63'4","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.902187+0000","last_change":"2023-11-26T07:21:53.869892+0000","last_active":"2023-11-26T07:21:54.902187+0000","last_peered":"2023-11-26T07:21:54.902187+0000","last_clean":"2023-11-26T07:21:54.902187+0000","last_became_active":"2023-11-26T07:21:53.868920+0000","last_became_peered":"2023-11-26T07:21:53.868920+0000","last_unstale":"2023-11-26T07:21:54.902187+0000","last_undegraded":"2023-11-26T07:21:54.902187+0000","last_fullsized":"2023-11-26T07:21:54.902187+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:05:29.841526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.898640+0000","last_change":"2023-11-26T07:21:54.885028+0000","last_active":"2023-11-26T07:21:54.898640+0000","last_peered":"2023-11-26T07:21:54.898640+0000","last_clean":"2023-11-26T07:21:54.898640+0000","last_became_active":"2023-11-26T07:21:54.884552+0000","last_became_peered":"2023-11-26T07:21:54.884552+0000","last_unstale":"2023-11-26T07:21:54.898640+0000","last_undegraded":"2023-11-26T07:21:54.898640+0000","last_fullsized":"2023-11-26T07:21:54.898640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:54:23.736030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899180+0000","last_change":"2023-11-26T07:21:53.870312+0000","last_active":"2023-11-26T07:21:54.899180+0000","last_peered":"2023-11-26T07:21:54.899180+0000","last_clean":"2023-11-26T07:21:54.899180+0000","last_became_active":"2023-11-26T07:21:53.869730+0000","last_became_peered":"2023-11-26T07:21:53.869730+0000","last_unstale":"2023-11-26T07:21:54.899180+0000","last_undegraded":"2023-11-26T07:21:54.899180+0000","last_fullsized":"2023-11-26T07:21:54.899180+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:43.621553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888572+0000","last_change":"2023-11-26T07:21:54.879976+0000","last_active":"2023-11-26T07:21:54.888572+0000","last_peered":"2023-11-26T07:21:54.888572+0000","last_clean":"2023-11-26T07:21:54.888572+0000","last_became_active":"2023-11-26T07:21:54.877713+0000","last_became_peered":"2023-11-26T07:21:54.877713+0000","last_unstale":"2023-11-26T07:21:54.888572+0000","last_undegraded":"2023-11-26T07:21:54.888572+0000","last_fullsized":"2023-11-26T07:21:54.888572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:25:09.308148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899953+0000","last_change":"2023-11-26T07:21:53.871865+0000","last_active":"2023-11-26T07:21:54.899953+0000","last_peered":"2023-11-26T07:21:54.899953+0000","last_clean":"2023-11-26T07:21:54.899953+0000","last_became_active":"2023-11-26T07:21:53.871488+0000","last_became_peered":"2023-11-26T07:21:53.871488+0000","last_unstale":"2023-11-26T07:21:54.899953+0000","last_undegraded":"2023-11-26T07:21:54.899953+0000","last_fullsized":"2023-11-26T07:21:54.899953+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:10:52.736152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888679+0000","last_change":"2023-11-26T07:21:54.880016+0000","last_active":"2023-11-26T07:21:54.888679+0000","last_peered":"2023-11-26T07:21:54.888679+0000","last_clean":"2023-11-26T07:21:54.888679+0000","last_became_active":"2023-11-26T07:21:54.878781+0000","last_became_peered":"2023-11-26T07:21:54.878781+0000","last_unstale":"2023-11-26T07:21:54.888679+0000","last_undegraded":"2023-11-26T07:21:54.888679+0000","last_fullsized":"2023-11-26T07:21:54.888679+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:31.897985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894333+0000","last_change":"2023-11-26T07:21:53.864875+0000","last_active":"2023-11-26T07:21:54.894333+0000","last_peered":"2023-11-26T07:21:54.894333+0000","last_clean":"2023-11-26T07:21:54.894333+0000","last_became_active":"2023-11-26T07:21:53.864393+0000","last_became_peered":"2023-11-26T07:21:53.864393+0000","last_unstale":"2023-11-26T07:21:54.894333+0000","last_undegraded":"2023-11-26T07:21:54.894333+0000","last_fullsized":"2023-11-26T07:21:54.894333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:36:28.345506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.871569+0000","last_change":"2023-11-26T07:21:54.868860+0000","last_active":"2023-11-26T07:21:54.871569+0000","last_peered":"2023-11-26T07:21:54.871569+0000","last_clean":"2023-11-26T07:21:54.871569+0000","last_became_active":"2023-11-26T07:21:54.868547+0000","last_became_peered":"2023-11-26T07:21:54.868547+0000","last_unstale":"2023-11-26T07:21:54.871569+0000","last_undegraded":"2023-11-26T07:21:54.871569+0000","last_fullsized":"2023-11-26T07:21:54.871569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:56:10.057379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.896857+0000","last_change":"2023-11-26T07:21:53.863626+0000","last_active":"2023-11-26T07:21:54.896857+0000","last_peered":"2023-11-26T07:21:54.896857+0000","last_clean":"2023-11-26T07:21:54.896857+0000","last_became_active":"2023-11-26T07:21:53.863314+0000","last_became_peered":"2023-11-26T07:21:53.863314+0000","last_unstale":"2023-11-26T07:21:54.896857+0000","last_undegraded":"2023-11-26T07:21:54.896857+0000","last_fullsized":"2023-11-26T07:21:54.896857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:29:59.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886158+0000","last_change":"2023-11-26T07:21:54.875735+0000","last_active":"2023-11-26T07:21:54.886158+0000","last_peered":"2023-11-26T07:21:54.886158+0000","last_clean":"2023-11-26T07:21:54.886158+0000","last_became_active":"2023-11-26T07:21:54.875426+0000","last_became_peered":"2023-11-26T07:21:54.875426+0000","last_unstale":"2023-11-26T07:21:54.886158+0000","last_undegraded":"2023-11-26T07:21:54.886158+0000","last_fullsized":"2023-11-26T07:21:54.886158+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:54.902707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899114+0000","last_change":"2023-11-26T07:21:53.865412+0000","last_active":"2023-11-26T07:21:54.899114+0000","last_peered":"2023-11-26T07:21:54.899114+0000","last_clean":"2023-11-26T07:21:54.899114+0000","last_became_active":"2023-11-26T07:21:53.864892+0000","last_became_peered":"2023-11-26T07:21:53.864892+0000","last_unstale":"2023-11-26T07:21:54.899114+0000","last_undegraded":"2023-11-26T07:21:54.899114+0000","last_fullsized":"2023-11-26T07:21:54.899114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:44:38.890091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879834+0000","last_change":"2023-11-26T07:21:54.873265+0000","last_active":"2023-11-26T07:21:54.879834+0000","last_peered":"2023-11-26T07:21:54.879834+0000","last_clean":"2023-11-26T07:21:54.879834+0000","last_became_active":"2023-11-26T07:21:54.872992+0000","last_became_peered":"2023-11-26T07:21:54.872992+0000","last_unstale":"2023-11-26T07:21:54.879834+0000","last_undegraded":"2023-11-26T07:21:54.879834+0000","last_fullsized":"2023-11-26T07:21:54.879834+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:12:55.117046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.856670+0000","last_change":"2023-11-26T07:21:53.858360+0000","last_active":"2023-11-26T07:21:54.856670+0000","last_peered":"2023-11-26T07:21:54.856670+0000","last_clean":"2023-11-26T07:21:54.856670+0000","last_became_active":"2023-11-26T07:21:53.858073+0000","last_became_peered":"2023-11-26T07:21:53.858073+0000","last_unstale":"2023-11-26T07:21:54.856670+0000","last_undegraded":"2023-11-26T07:21:54.856670+0000","last_fullsized":"2023-11-26T07:21:54.856670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:29:59.255452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885499+0000","last_change":"2023-11-26T07:21:54.874881+0000","last_active":"2023-11-26T07:21:54.885499+0000","last_peered":"2023-11-26T07:21:54.885499+0000","last_clean":"2023-11-26T07:21:54.885499+0000","last_became_active":"2023-11-26T07:21:54.868914+0000","last_became_peered":"2023-11-26T07:21:54.868914+0000","last_unstale":"2023-11-26T07:21:54.885499+0000","last_undegraded":"2023-11-26T07:21:54.885499+0000","last_fullsized":"2023-11-26T07:21:54.885499+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:17:57.648151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.858086+0000","last_change":"2023-11-26T07:21:53.869697+0000","last_active":"2023-11-26T07:21:54.858086+0000","last_peered":"2023-11-26T07:21:54.858086+0000","last_clean":"2023-11-26T07:21:54.858086+0000","last_became_active":"2023-11-26T07:21:53.869412+0000","last_became_peered":"2023-11-26T07:21:53.869412+0000","last_unstale":"2023-11-26T07:21:54.858086+0000","last_undegraded":"2023-11-26T07:21:54.858086+0000","last_fullsized":"2023-11-26T07:21:54.858086+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:50.434929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.884703+0000","last_change":"2023-11-26T07:21:54.878133+0000","last_active":"2023-11-26T07:21:54.884703+0000","last_peered":"2023-11-26T07:21:54.884703+0000","last_clean":"2023-11-26T07:21:54.884703+0000","last_became_active":"2023-11-26T07:21:54.877832+0000","last_became_peered":"2023-11-26T07:21:54.877832+0000","last_unstale":"2023-11-26T07:21:54.884703+0000","last_undegraded":"2023-11-26T07:21:54.884703+0000","last_fullsized":"2023-11-26T07:21:54.884703+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:37:49.139827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.866892+0000","last_change":"2023-11-26T07:21:53.875432+0000","last_active":"2023-11-26T07:21:54.866892+0000","last_peered":"2023-11-26T07:21:54.866892+0000","last_clean":"2023-11-26T07:21:54.866892+0000","last_became_active":"2023-11-26T07:21:53.875167+0000","last_became_peered":"2023-11-26T07:21:53.875167+0000","last_unstale":"2023-11-26T07:21:54.866892+0000","last_undegraded":"2023-11-26T07:21:54.866892+0000","last_fullsized":"2023-11-26T07:21:54.866892+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:12:08.993953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901108+0000","last_change":"2023-11-26T07:21:54.897140+0000","last_active":"2023-11-26T07:21:54.901108+0000","last_peered":"2023-11-26T07:21:54.901108+0000","last_clean":"2023-11-26T07:21:54.901108+0000","last_became_active":"2023-11-26T07:21:54.896890+0000","last_became_peered":"2023-11-26T07:21:54.896890+0000","last_unstale":"2023-11-26T07:21:54.901108+0000","last_undegraded":"2023-11-26T07:21:54.901108+0000","last_fullsized":"2023-11-26T07:21:54.901108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:05:20.665670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.865457+0000","last_change":"2023-11-26T07:21:53.874877+0000","last_active":"2023-11-26T07:21:54.865457+0000","last_peered":"2023-11-26T07:21:54.865457+0000","last_clean":"2023-11-26T07:21:54.865457+0000","last_became_active":"2023-11-26T07:21:53.874597+0000","last_became_peered":"2023-11-26T07:21:53.874597+0000","last_unstale":"2023-11-26T07:21:54.865457+0000","last_undegraded":"2023-11-26T07:21:54.865457+0000","last_fullsized":"2023-11-26T07:21:54.865457+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:21:31.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899430+0000","last_change":"2023-11-26T07:21:54.890232+0000","last_active":"2023-11-26T07:21:54.899430+0000","last_peered":"2023-11-26T07:21:54.899430+0000","last_clean":"2023-11-26T07:21:54.899430+0000","last_became_active":"2023-11-26T07:21:54.889889+0000","last_became_peered":"2023-11-26T07:21:54.889889+0000","last_unstale":"2023-11-26T07:21:54.899430+0000","last_undegraded":"2023-11-26T07:21:54.899430+0000","last_fullsized":"2023-11-26T07:21:54.899430+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:29:42.607556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"63'3","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901439+0000","last_change":"2023-11-26T07:21:53.878323+0000","last_active":"2023-11-26T07:21:54.901439+0000","last_peered":"2023-11-26T07:21:54.901439+0000","last_clean":"2023-11-26T07:21:54.901439+0000","last_became_active":"2023-11-26T07:21:53.878058+0000","last_became_peered":"2023-11-26T07:21:53.878058+0000","last_unstale":"2023-11-26T07:21:54.901439+0000","last_undegraded":"2023-11-26T07:21:54.901439+0000","last_fullsized":"2023-11-26T07:21:54.901439+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:05:29.841526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901896+0000","last_change":"2023-11-26T07:21:54.899226+0000","last_active":"2023-11-26T07:21:54.901896+0000","last_peered":"2023-11-26T07:21:54.901896+0000","last_clean":"2023-11-26T07:21:54.901896+0000","last_became_active":"2023-11-26T07:21:54.899013+0000","last_became_peered":"2023-11-26T07:21:54.899013+0000","last_unstale":"2023-11-26T07:21:54.901896+0000","last_undegraded":"2023-11-26T07:21:54.901896+0000","last_fullsized":"2023-11-26T07:21:54.901896+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:12.682807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"63'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901762+0000","last_change":"2023-11-26T07:21:53.863759+0000","last_active":"2023-11-26T07:21:54.901762+0000","last_peered":"2023-11-26T07:21:54.901762+0000","last_clean":"2023-11-26T07:21:54.901762+0000","last_became_active":"2023-11-26T07:21:53.863488+0000","last_became_peered":"2023-11-26T07:21:53.863488+0000","last_unstale":"2023-11-26T07:21:54.901762+0000","last_undegraded":"2023-11-26T07:21:54.901762+0000","last_fullsized":"2023-11-26T07:21:54.901762+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:07.668174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900894+0000","last_change":"2023-11-26T07:21:54.891959+0000","last_active":"2023-11-26T07:21:54.900894+0000","last_peered":"2023-11-26T07:21:54.900894+0000","last_clean":"2023-11-26T07:21:54.900894+0000","last_became_active":"2023-11-26T07:21:54.891667+0000","last_became_peered":"2023-11-26T07:21:54.891667+0000","last_unstale":"2023-11-26T07:21:54.900894+0000","last_undegraded":"2023-11-26T07:21:54.900894+0000","last_fullsized":"2023-11-26T07:21:54.900894+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:25:09.308148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.896961+0000","last_change":"2023-11-26T07:21:53.876376+0000","last_active":"2023-11-26T07:21:54.896961+0000","last_peered":"2023-11-26T07:21:54.896961+0000","last_clean":"2023-11-26T07:21:54.896961+0000","last_became_active":"2023-11-26T07:21:53.875946+0000","last_became_peered":"2023-11-26T07:21:53.875946+0000","last_unstale":"2023-11-26T07:21:54.896961+0000","last_undegraded":"2023-11-26T07:21:54.896961+0000","last_fullsized":"2023-11-26T07:21:54.896961+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:15:41.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.882172+0000","last_change":"2023-11-26T07:21:54.877747+0000","last_active":"2023-11-26T07:21:54.882172+0000","last_peered":"2023-11-26T07:21:54.882172+0000","last_clean":"2023-11-26T07:21:54.882172+0000","last_became_active":"2023-11-26T07:21:54.876707+0000","last_became_peered":"2023-11-26T07:21:54.876707+0000","last_unstale":"2023-11-26T07:21:54.882172+0000","last_undegraded":"2023-11-26T07:21:54.882172+0000","last_fullsized":"2023-11-26T07:21:54.882172+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:31.897985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.860909+0000","last_change":"2023-11-26T07:21:53.862858+0000","last_active":"2023-11-26T07:21:54.860909+0000","last_peered":"2023-11-26T07:21:54.860909+0000","last_clean":"2023-11-26T07:21:54.860909+0000","last_became_active":"2023-11-26T07:21:53.862003+0000","last_became_peered":"2023-11-26T07:21:53.862003+0000","last_unstale":"2023-11-26T07:21:54.860909+0000","last_undegraded":"2023-11-26T07:21:54.860909+0000","last_fullsized":"2023-11-26T07:21:54.860909+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:46:19.900198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.881140+0000","last_change":"2023-11-26T07:21:54.874625+0000","last_active":"2023-11-26T07:21:54.881140+0000","last_peered":"2023-11-26T07:21:54.881140+0000","last_clean":"2023-11-26T07:21:54.881140+0000","last_became_active":"2023-11-26T07:21:54.874165+0000","last_became_peered":"2023-11-26T07:21:54.874165+0000","last_unstale":"2023-11-26T07:21:54.881140+0000","last_undegraded":"2023-11-26T07:21:54.881140+0000","last_fullsized":"2023-11-26T07:21:54.881140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:57:36.212400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.859793+0000","last_change":"2023-11-26T07:21:53.868074+0000","last_active":"2023-11-26T07:21:54.859793+0000","last_peered":"2023-11-26T07:21:54.859793+0000","last_clean":"2023-11-26T07:21:54.859793+0000","last_became_active":"2023-11-26T07:21:53.866679+0000","last_became_peered":"2023-11-26T07:21:53.866679+0000","last_unstale":"2023-11-26T07:21:54.859793+0000","last_undegraded":"2023-11-26T07:21:54.859793+0000","last_fullsized":"2023-11-26T07:21:54.859793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:05:29.841526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.892112+0000","last_change":"2023-11-26T07:21:54.886592+0000","last_active":"2023-11-26T07:21:54.892112+0000","last_peered":"2023-11-26T07:21:54.892112+0000","last_clean":"2023-11-26T07:21:54.892112+0000","last_became_active":"2023-11-26T07:21:54.886335+0000","last_became_peered":"2023-11-26T07:21:54.886335+0000","last_unstale":"2023-11-26T07:21:54.892112+0000","last_undegraded":"2023-11-26T07:21:54.892112+0000","last_fullsized":"2023-11-26T07:21:54.892112+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"63'8","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901548+0000","last_change":"2023-11-26T07:21:53.870742+0000","last_active":"2023-11-26T07:21:54.901548+0000","last_peered":"2023-11-26T07:21:54.901548+0000","last_clean":"2023-11-26T07:21:54.901548+0000","last_became_active":"2023-11-26T07:21:53.870406+0000","last_became_peered":"2023-11-26T07:21:53.870406+0000","last_unstale":"2023-11-26T07:21:54.901548+0000","last_undegraded":"2023-11-26T07:21:54.901548+0000","last_fullsized":"2023-11-26T07:21:54.901548+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:37:48.133838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.876995+0000","last_change":"2023-11-26T07:21:54.871425+0000","last_active":"2023-11-26T07:21:54.876995+0000","last_peered":"2023-11-26T07:21:54.876995+0000","last_clean":"2023-11-26T07:21:54.876995+0000","last_became_active":"2023-11-26T07:21:54.871091+0000","last_became_peered":"2023-11-26T07:21:54.871091+0000","last_unstale":"2023-11-26T07:21:54.876995+0000","last_undegraded":"2023-11-26T07:21:54.876995+0000","last_fullsized":"2023-11-26T07:21:54.876995+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:51.440918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.895849+0000","last_change":"2023-11-26T07:21:53.874309+0000","last_active":"2023-11-26T07:21:54.895849+0000","last_peered":"2023-11-26T07:21:54.895849+0000","last_clean":"2023-11-26T07:21:54.895849+0000","last_became_active":"2023-11-26T07:21:53.874014+0000","last_became_peered":"2023-11-26T07:21:53.874014+0000","last_unstale":"2023-11-26T07:21:54.895849+0000","last_undegraded":"2023-11-26T07:21:54.895849+0000","last_fullsized":"2023-11-26T07:21:54.895849+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:55:49.700960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900990+0000","last_change":"2023-11-26T07:21:54.892912+0000","last_active":"2023-11-26T07:21:54.900990+0000","last_peered":"2023-11-26T07:21:54.900990+0000","last_clean":"2023-11-26T07:21:54.900990+0000","last_became_active":"2023-11-26T07:21:54.892555+0000","last_became_peered":"2023-11-26T07:21:54.892555+0000","last_unstale":"2023-11-26T07:21:54.900990+0000","last_undegraded":"2023-11-26T07:21:54.900990+0000","last_fullsized":"2023-11-26T07:21:54.900990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:17.292413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.897324+0000","last_change":"2023-11-26T07:21:53.868920+0000","last_active":"2023-11-26T07:21:54.897324+0000","last_peered":"2023-11-26T07:21:54.897324+0000","last_clean":"2023-11-26T07:21:54.897324+0000","last_became_active":"2023-11-26T07:21:53.868620+0000","last_became_peered":"2023-11-26T07:21:53.868620+0000","last_unstale":"2023-11-26T07:21:54.897324+0000","last_undegraded":"2023-11-26T07:21:54.897324+0000","last_fullsized":"2023-11-26T07:21:54.897324+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:12:08.993953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.885816+0000","last_change":"2023-11-26T07:21:54.873215+0000","last_active":"2023-11-26T07:21:54.885816+0000","last_peered":"2023-11-26T07:21:54.885816+0000","last_clean":"2023-11-26T07:21:54.885816+0000","last_became_active":"2023-11-26T07:21:54.872981+0000","last_became_peered":"2023-11-26T07:21:54.872981+0000","last_unstale":"2023-11-26T07:21:54.885816+0000","last_undegraded":"2023-11-26T07:21:54.885816+0000","last_fullsized":"2023-11-26T07:21:54.885816+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:08:29.451089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"63'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.894158+0000","last_change":"2023-11-26T07:21:53.864617+0000","last_active":"2023-11-26T07:21:54.894158+0000","last_peered":"2023-11-26T07:21:54.894158+0000","last_clean":"2023-11-26T07:21:54.894158+0000","last_became_active":"2023-11-26T07:21:53.864294+0000","last_became_peered":"2023-11-26T07:21:53.864294+0000","last_unstale":"2023-11-26T07:21:54.894158+0000","last_undegraded":"2023-11-26T07:21:54.894158+0000","last_fullsized":"2023-11-26T07:21:54.894158+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:57:30.891996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901908+0000","last_change":"2023-11-26T07:21:54.899335+0000","last_active":"2023-11-26T07:21:54.901908+0000","last_peered":"2023-11-26T07:21:54.901908+0000","last_clean":"2023-11-26T07:21:54.901908+0000","last_became_active":"2023-11-26T07:21:54.899112+0000","last_became_peered":"2023-11-26T07:21:54.899112+0000","last_unstale":"2023-11-26T07:21:54.901908+0000","last_undegraded":"2023-11-26T07:21:54.901908+0000","last_fullsized":"2023-11-26T07:21:54.901908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:34.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.864536+0000","last_change":"2023-11-26T07:21:53.872700+0000","last_active":"2023-11-26T07:21:54.864536+0000","last_peered":"2023-11-26T07:21:54.864536+0000","last_clean":"2023-11-26T07:21:54.864536+0000","last_became_active":"2023-11-26T07:21:53.872418+0000","last_became_peered":"2023-11-26T07:21:53.872418+0000","last_unstale":"2023-11-26T07:21:54.864536+0000","last_undegraded":"2023-11-26T07:21:54.864536+0000","last_fullsized":"2023-11-26T07:21:54.864536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:47:11.676819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900989+0000","last_change":"2023-11-26T07:21:54.892916+0000","last_active":"2023-11-26T07:21:54.900989+0000","last_peered":"2023-11-26T07:21:54.900989+0000","last_clean":"2023-11-26T07:21:54.900989+0000","last_became_active":"2023-11-26T07:21:54.892623+0000","last_became_peered":"2023-11-26T07:21:54.892623+0000","last_unstale":"2023-11-26T07:21:54.900989+0000","last_undegraded":"2023-11-26T07:21:54.900989+0000","last_fullsized":"2023-11-26T07:21:54.900989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:59.700379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.901472+0000","last_change":"2023-11-26T07:21:53.870940+0000","last_active":"2023-11-26T07:21:54.901472+0000","last_peered":"2023-11-26T07:21:54.901472+0000","last_clean":"2023-11-26T07:21:54.901472+0000","last_became_active":"2023-11-26T07:21:53.870603+0000","last_became_peered":"2023-11-26T07:21:53.870603+0000","last_unstale":"2023-11-26T07:21:54.901472+0000","last_undegraded":"2023-11-26T07:21:54.901472+0000","last_fullsized":"2023-11-26T07:21:54.901472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:38:54.789577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888690+0000","last_change":"2023-11-26T07:21:54.881077+0000","last_active":"2023-11-26T07:21:54.888690+0000","last_peered":"2023-11-26T07:21:54.888690+0000","last_clean":"2023-11-26T07:21:54.888690+0000","last_became_active":"2023-11-26T07:21:54.880722+0000","last_became_peered":"2023-11-26T07:21:54.880722+0000","last_unstale":"2023-11-26T07:21:54.888690+0000","last_undegraded":"2023-11-26T07:21:54.888690+0000","last_fullsized":"2023-11-26T07:21:54.888690+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:24:59.700379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.883335+0000","last_change":"2023-11-26T07:21:53.871620+0000","last_active":"2023-11-26T07:21:54.883335+0000","last_peered":"2023-11-26T07:21:54.883335+0000","last_clean":"2023-11-26T07:21:54.883335+0000","last_became_active":"2023-11-26T07:21:53.871187+0000","last_became_peered":"2023-11-26T07:21:53.871187+0000","last_unstale":"2023-11-26T07:21:54.883335+0000","last_undegraded":"2023-11-26T07:21:54.883335+0000","last_fullsized":"2023-11-26T07:21:54.883335+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:15:24.253743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879841+0000","last_change":"2023-11-26T07:21:54.872227+0000","last_active":"2023-11-26T07:21:54.879841+0000","last_peered":"2023-11-26T07:21:54.879841+0000","last_clean":"2023-11-26T07:21:54.879841+0000","last_became_active":"2023-11-26T07:21:54.871920+0000","last_became_peered":"2023-11-26T07:21:54.871920+0000","last_unstale":"2023-11-26T07:21:54.879841+0000","last_undegraded":"2023-11-26T07:21:54.879841+0000","last_fullsized":"2023-11-26T07:21:54.879841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:55:39.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.857484+0000","last_change":"2023-11-26T07:21:53.871154+0000","last_active":"2023-11-26T07:21:54.857484+0000","last_peered":"2023-11-26T07:21:54.857484+0000","last_clean":"2023-11-26T07:21:54.857484+0000","last_became_active":"2023-11-26T07:21:53.870762+0000","last_became_peered":"2023-11-26T07:21:53.870762+0000","last_unstale":"2023-11-26T07:21:54.857484+0000","last_undegraded":"2023-11-26T07:21:54.857484+0000","last_fullsized":"2023-11-26T07:21:54.857484+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:35:50.434929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.876932+0000","last_change":"2023-11-26T07:21:54.862430+0000","last_active":"2023-11-26T07:21:54.876932+0000","last_peered":"2023-11-26T07:21:54.876932+0000","last_clean":"2023-11-26T07:21:54.876932+0000","last_became_active":"2023-11-26T07:21:54.862086+0000","last_became_peered":"2023-11-26T07:21:54.862086+0000","last_unstale":"2023-11-26T07:21:54.876932+0000","last_undegraded":"2023-11-26T07:21:54.876932+0000","last_fullsized":"2023-11-26T07:21:54.876932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:01:08.674163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"63'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.900189+0000","last_change":"2023-11-26T07:21:53.864682+0000","last_active":"2023-11-26T07:21:54.900189+0000","last_peered":"2023-11-26T07:21:54.900189+0000","last_clean":"2023-11-26T07:21:54.900189+0000","last_became_active":"2023-11-26T07:21:53.864390+0000","last_became_peered":"2023-11-26T07:21:53.864390+0000","last_unstale":"2023-11-26T07:21:54.900189+0000","last_undegraded":"2023-11-26T07:21:54.900189+0000","last_fullsized":"2023-11-26T07:21:54.900189+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:08:55.928866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.879591+0000","last_change":"2023-11-26T07:21:54.874758+0000","last_active":"2023-11-26T07:21:54.879591+0000","last_peered":"2023-11-26T07:21:54.879591+0000","last_clean":"2023-11-26T07:21:54.879591+0000","last_became_active":"2023-11-26T07:21:54.874437+0000","last_became_peered":"2023-11-26T07:21:54.874437+0000","last_unstale":"2023-11-26T07:21:54.879591+0000","last_undegraded":"2023-11-26T07:21:54.879591+0000","last_fullsized":"2023-11-26T07:21:54.879591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:37:49.139827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.867294+0000","last_change":"2023-11-26T07:21:53.865856+0000","last_active":"2023-11-26T07:21:54.867294+0000","last_peered":"2023-11-26T07:21:54.867294+0000","last_clean":"2023-11-26T07:21:54.867294+0000","last_became_active":"2023-11-26T07:21:53.865673+0000","last_became_peered":"2023-11-26T07:21:53.865673+0000","last_unstale":"2023-11-26T07:21:54.867294+0000","last_undegraded":"2023-11-26T07:21:54.867294+0000","last_fullsized":"2023-11-26T07:21:54.867294+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:16:18.566593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899012+0000","last_change":"2023-11-26T07:21:54.886118+0000","last_active":"2023-11-26T07:21:54.899012+0000","last_peered":"2023-11-26T07:21:54.899012+0000","last_clean":"2023-11-26T07:21:54.899012+0000","last_became_active":"2023-11-26T07:21:54.883548+0000","last_became_peered":"2023-11-26T07:21:54.883548+0000","last_unstale":"2023-11-26T07:21:54.899012+0000","last_undegraded":"2023-11-26T07:21:54.899012+0000","last_fullsized":"2023-11-26T07:21:54.899012+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:43:48.445792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.861004+0000","last_change":"2023-11-26T07:21:53.862124+0000","last_active":"2023-11-26T07:21:54.861004+0000","last_peered":"2023-11-26T07:21:54.861004+0000","last_clean":"2023-11-26T07:21:54.861004+0000","last_became_active":"2023-11-26T07:21:53.860513+0000","last_became_peered":"2023-11-26T07:21:53.860513+0000","last_unstale":"2023-11-26T07:21:54.861004+0000","last_undegraded":"2023-11-26T07:21:54.861004+0000","last_fullsized":"2023-11-26T07:21:54.861004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:13:50.088439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888700+0000","last_change":"2023-11-26T07:21:54.882256+0000","last_active":"2023-11-26T07:21:54.888700+0000","last_peered":"2023-11-26T07:21:54.888700+0000","last_clean":"2023-11-26T07:21:54.888700+0000","last_became_active":"2023-11-26T07:21:54.879609+0000","last_became_peered":"2023-11-26T07:21:54.879609+0000","last_unstale":"2023-11-26T07:21:54.888700+0000","last_undegraded":"2023-11-26T07:21:54.888700+0000","last_fullsized":"2023-11-26T07:21:54.888700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:14:34.745594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.860197+0000","last_change":"2023-11-26T07:21:53.860629+0000","last_active":"2023-11-26T07:21:54.860197+0000","last_peered":"2023-11-26T07:21:54.860197+0000","last_clean":"2023-11-26T07:21:54.860197+0000","last_became_active":"2023-11-26T07:21:53.860303+0000","last_became_peered":"2023-11-26T07:21:53.860303+0000","last_unstale":"2023-11-26T07:21:54.860197+0000","last_undegraded":"2023-11-26T07:21:54.860197+0000","last_fullsized":"2023-11-26T07:21:54.860197+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:05:19.659681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.888058+0000","last_change":"2023-11-26T07:21:54.885675+0000","last_active":"2023-11-26T07:21:54.888058+0000","last_peered":"2023-11-26T07:21:54.888058+0000","last_clean":"2023-11-26T07:21:54.888058+0000","last_became_active":"2023-11-26T07:21:54.885356+0000","last_became_peered":"2023-11-26T07:21:54.885356+0000","last_unstale":"2023-11-26T07:21:54.888058+0000","last_undegraded":"2023-11-26T07:21:54.888058+0000","last_fullsized":"2023-11-26T07:21:54.888058+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:06.741623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.886500+0000","last_change":"2023-11-26T07:21:53.862863+0000","last_active":"2023-11-26T07:21:54.886500+0000","last_peered":"2023-11-26T07:21:54.886500+0000","last_clean":"2023-11-26T07:21:54.886500+0000","last_became_active":"2023-11-26T07:21:53.862485+0000","last_became_peered":"2023-11-26T07:21:53.862485+0000","last_unstale":"2023-11-26T07:21:54.886500+0000","last_undegraded":"2023-11-26T07:21:54.886500+0000","last_fullsized":"2023-11-26T07:21:54.886500+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:29:59.489612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.892143+0000","last_change":"2023-11-26T07:21:54.886728+0000","last_active":"2023-11-26T07:21:54.892143+0000","last_peered":"2023-11-26T07:21:54.892143+0000","last_clean":"2023-11-26T07:21:54.892143+0000","last_became_active":"2023-11-26T07:21:54.886404+0000","last_became_peered":"2023-11-26T07:21:54.886404+0000","last_unstale":"2023-11-26T07:21:54.892143+0000","last_undegraded":"2023-11-26T07:21:54.892143+0000","last_fullsized":"2023-11-26T07:21:54.892143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:36:29.351495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.858310+0000","last_change":"2023-11-26T07:21:53.859481+0000","last_active":"2023-11-26T07:21:54.858310+0000","last_peered":"2023-11-26T07:21:54.858310+0000","last_clean":"2023-11-26T07:21:54.858310+0000","last_became_active":"2023-11-26T07:21:53.859199+0000","last_became_peered":"2023-11-26T07:21:53.859199+0000","last_unstale":"2023-11-26T07:21:54.858310+0000","last_undegraded":"2023-11-26T07:21:54.858310+0000","last_fullsized":"2023-11-26T07:21:54.858310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:39:16.286424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.899474+0000","last_change":"2023-11-26T07:21:54.891701+0000","last_active":"2023-11-26T07:21:54.899474+0000","last_peered":"2023-11-26T07:21:54.899474+0000","last_clean":"2023-11-26T07:21:54.899474+0000","last_became_active":"2023-11-26T07:21:54.891442+0000","last_became_peered":"2023-11-26T07:21:54.891442+0000","last_unstale":"2023-11-26T07:21:54.899474+0000","last_undegraded":"2023-11-26T07:21:54.899474+0000","last_fullsized":"2023-11-26T07:21:54.899474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:28:32.992318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.883596+0000","last_change":"2023-11-26T07:21:53.862844+0000","last_active":"2023-11-26T07:21:54.883596+0000","last_peered":"2023-11-26T07:21:54.883596+0000","last_clean":"2023-11-26T07:21:54.883596+0000","last_became_active":"2023-11-26T07:21:53.862500+0000","last_became_peered":"2023-11-26T07:21:53.862500+0000","last_unstale":"2023-11-26T07:21:54.883596+0000","last_undegraded":"2023-11-26T07:21:54.883596+0000","last_fullsized":"2023-11-26T07:21:54.883596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:18:16.873706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.887157+0000","last_change":"2023-11-26T07:21:54.879805+0000","last_active":"2023-11-26T07:21:54.887157+0000","last_peered":"2023-11-26T07:21:54.887157+0000","last_clean":"2023-11-26T07:21:54.887157+0000","last_became_active":"2023-11-26T07:21:54.878973+0000","last_became_peered":"2023-11-26T07:21:54.878973+0000","last_unstale":"2023-11-26T07:21:54.887157+0000","last_undegraded":"2023-11-26T07:21:54.887157+0000","last_fullsized":"2023-11-26T07:21:54.887157+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:09:50.992422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.864662+0000","last_change":"2023-11-26T07:21:53.868320+0000","last_active":"2023-11-26T07:21:54.864662+0000","last_peered":"2023-11-26T07:21:54.864662+0000","last_clean":"2023-11-26T07:21:54.864662+0000","last_became_active":"2023-11-26T07:21:53.867342+0000","last_became_peered":"2023-11-26T07:21:53.867342+0000","last_unstale":"2023-11-26T07:21:54.864662+0000","last_undegraded":"2023-11-26T07:21:54.864662+0000","last_fullsized":"2023-11-26T07:21:54.864662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:16:34.866649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.871536+0000","last_change":"2023-11-26T07:21:54.869316+0000","last_active":"2023-11-26T07:21:54.871536+0000","last_peered":"2023-11-26T07:21:54.871536+0000","last_clean":"2023-11-26T07:21:54.871536+0000","last_became_active":"2023-11-26T07:21:54.868991+0000","last_became_peered":"2023-11-26T07:21:54.868991+0000","last_unstale":"2023-11-26T07:21:54.871536+0000","last_undegraded":"2023-11-26T07:21:54.871536+0000","last_fullsized":"2023-11-26T07:21:54.871536+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:53.839871+0000","last_clean_scrub_stamp":"2023-11-26T07:21:53.839871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:31:42.991063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.860624+0000","last_change":"2023-11-26T07:21:53.863103+0000","last_active":"2023-11-26T07:21:54.860624+0000","last_peered":"2023-11-26T07:21:54.860624+0000","last_clean":"2023-11-26T07:21:54.860624+0000","last_became_active":"2023-11-26T07:21:53.862789+0000","last_became_peered":"2023-11-26T07:21:53.862789+0000","last_unstale":"2023-11-26T07:21:54.860624+0000","last_undegraded":"2023-11-26T07:21:54.860624+0000","last_fullsized":"2023-11-26T07:21:54.860624+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:21:52.833883+0000","last_clean_scrub_stamp":"2023-11-26T07:21:52.833883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:29:59.489612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-26T07:21:54.863594+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:21:54.863594+0000","last_peered":"2023-11-26T07:21:54.863594+0000","last_clean":"2023-11-26T07:21:54.863594+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:21:54.863594+0000","last_undegraded":"2023-11-26T07:21:54.863594+0000","last_fullsized":"2023-11-26T07:21:54.863594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1359872,"data_stored":909469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63200000000000001,"15min":0.624},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84999999999999998,"5min":0.876,"15min":0.876},"last":0.77000000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81299999999999994,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90700000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.70099999999999996,"15min":0.71099999999999997},"min":{"1min":0.501,"5min":0.441,"15min":0.441},"max":{"1min":0.877,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68300000000000005,"15min":0.69499999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85899999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.91000000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.624,"15min":0.64900000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70599999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81899999999999995,"5min":1.923,"15min":1.923},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64400000000000002},"min":{"1min":0.40200000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.65900000000000003,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91700000000000004,"5min":1,"15min":1},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82599999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99099999999999999,"5min":1.863,"15min":1.863},"last":0.877}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":745472,"data_stored":312166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.85599999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.96999999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.876,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":1.0149999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68700000000000006,"15min":0.69599999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90800000000000003,"5min":1.089,"15min":1.089},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69299999999999995,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83399999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.046,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65800000000000003,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98899999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.69299999999999995},"min":{"1min":0.41199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94199999999999995,"5min":1.018,"15min":1.018},"last":0.71999999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.70799999999999996,"15min":0.73599999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.038,"5min":1.133,"15min":1.133},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.016,"5min":1.042,"15min":1.042},"last":0.95399999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0820000000000001,"5min":1.196,"15min":1.196},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77900000000000003,"15min":0.80800000000000005},"min":{"1min":0.51800000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0980000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.93799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":319593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.90000000000000002,"15min":1.018},"min":{"1min":0.43099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.87,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.93200000000000005,"15min":1.048},"min":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.77200000000000002,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.94199999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.995,"15min":1.119},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.85399999999999998,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.95699999999999996,"15min":0.98899999999999999},"min":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82299999999999995,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.746}]},{"osd":2,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.85799999999999998,"15min":0.83399999999999996},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86399999999999999,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.90600000000000003,"15min":1.018},"min":{"1min":0.48399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78700000000000003,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":1.02,"15min":1.159},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80600000000000005,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":1.1140000000000001,"15min":1.194},"min":{"1min":0.51700000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88900000000000001,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.86099999999999999,"15min":0.98699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83499999999999996,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.96999999999999997,"15min":1.1000000000000001},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.622}]},{"osd":6,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89200000000000002,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.667,"15min":2.0870000000000002},"min":{"1min":0.53800000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92400000000000004,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:20:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":1.081,"15min":1.2290000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84399999999999997,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69699999999999995,"5min":1.139,"15min":1.2250000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.89300000000000002,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":770048,"data_stored":320553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91200000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.87,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66900000000000004,"15min":0.64400000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98899999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69199999999999995,"15min":0.71199999999999997},"min":{"1min":0.48199999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.876,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69299999999999995,"15min":0.68700000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94199999999999995,"5min":1.218,"15min":1.218},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.58699999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.94199999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92800000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72999999999999998,"15min":0.747},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91600000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.36899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98199999999999998,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.44700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96999999999999997,"5min":1.238,"15min":1.238},"last":0.46300000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.72799999999999998,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.89600000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.497},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76100000000000001,"15min":0.81399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":1.095,"15min":1.095},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:21:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0149999999999999,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.78700000000000003,"15min":0.83099999999999996},"min":{"1min":0.49099999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":1.302,"15min":1.302},"last":0.70999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":318997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.41499999999999998,"15min":0.43099999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53300000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.42899999999999999,"15min":0.435},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.52500000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53700000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.56299999999999994,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.56599999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.625,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67600000000000005,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.495}]},{"osd":4,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.80400000000000005,"15min":0.88600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0289999999999999,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.755},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.71499999999999997,"15min":0.747},"min":{"1min":0.48199999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91700000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.82199999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.82599999999999996,"15min":0.90800000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.113,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.74199999999999999,"15min":0.78500000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.871}]},{"osd":6,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72699999999999998,"15min":0.754},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.84499999999999997,"15min":0.92600000000000005},"min":{"1min":0.53700000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.99299999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:20:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86299999999999999,"15min":0.95199999999999996},"min":{"1min":0.54000000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.0880000000000001,"5min":3.476,"15min":3.476},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.75,"15min":0.78200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.85199999999999998,"5min":1.03,"15min":1.03},"last":0.79400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":765952,"data_stored":318997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.41099999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.433,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.62,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42899999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46999999999999997,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.61299999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52900000000000003,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.746,"15min":0.746},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68200000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.94599999999999995,"5min":1.258,"15min":1.258},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96599999999999997,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0629999999999999,"5min":1.169,"15min":1.169},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.98399999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0529999999999999,"5min":1.167,"15min":1.167},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.56999999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1140000000000001,"5min":1.24,"15min":1.24},"last":0.93799999999999994}]},{"osd":7,"last update":"Sun Nov 26 07:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.753},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0429999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.1240000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":319031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.46999999999999997,"15min":0.504},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.752,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48299999999999998},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68200000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.372}]},{"osd":2,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.497,"15min":0.52100000000000002},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61799999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.53900000000000003,"15min":0.57099999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71599999999999997,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.48899999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58999999999999997,"15min":0.63},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69999999999999996,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.54100000000000004,"15min":0.56699999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70199999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.43099999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79900000000000004,"15min":0.83099999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.075,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.47899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0069999999999999,"5min":1.329,"15min":1.329},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.749,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96299999999999997,"5min":1.101,"15min":1.101},"last":0.83799999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81999999999999995,"15min":0.85399999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.99299999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.747},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.80400000000000005,"15min":0.83199999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0900000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0549999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93899999999999995,"5min":1.173,"15min":1.173},"last":0.78300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1368064,"data_stored":911503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.56499999999999995,"15min":0.63600000000000001},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.68400000000000005,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.52600000000000002,"15min":0.55600000000000005},"min":{"1min":0.34200000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58699999999999997,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.437}]},{"osd":2,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54600000000000004,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":2.415,"15min":2.415},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.65800000000000003,"15min":0.73999999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.56699999999999995,"5min":5.234,"15min":5.234},"last":0.51600000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56499999999999995,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68000000000000005,"5min":3.726,"15min":3.726},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.71599999999999997,"15min":0.80000000000000004},"min":{"1min":0.42999999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.85399999999999998,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.73299999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.875,"15min":0.96099999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96699999999999997,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.83299999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89600000000000002,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.79200000000000004,"15min":0.83699999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92800000000000005,"5min":2.835,"15min":2.835},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97699999999999998,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":0.88900000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.81200000000000006,"15min":0.85499999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1200000000000001,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.84099999999999997,"15min":0.89300000000000002},"min":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.873,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.81599999999999995,"15min":0.86599999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0760000000000001,"5min":2.798,"15min":2.798},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:21:59.316 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:21:59.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:21:59.502 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.496+0000 7f6c67c79640 1 Processor -- start 2023-11-26T07:21:59.503 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.496+0000 7f6c67c79640 1 -- start start 2023-11-26T07:21:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c67c79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 0x7f6c600b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c67c79640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c60071550 0x7f6c600719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c67c79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600b25f0 con 0x7f6c60143c00 2023-11-26T07:21:59.504 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c67c79640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c60071f20 con 0x7f6c60071550 2023-11-26T07:21:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c67c79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600b28d0 con 0x7f6c60070390 2023-11-26T07:21:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6c60143c00 0x7f6c600cc7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45584/0 (socket says 172.21.15.70:45584) 2023-11-26T07:21:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 -- 172.21.15.70:0/1670896471 learned_addr learned my addr 172.21.15.70:0/1670896471 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:21:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65214640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 0x7f6c600b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.505 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c66216640 1 --2- 172.21.15.70:0/1670896471 >> v2:172.21.15.120:3300/0 conn(0x7f6c60071550 0x7f6c600719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542791130 0 0) 0x7f6c600b25f0 con 0x7f6c60143c00 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c4c003530 con 0x7f6c60143c00 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1991918886 0 0) 0x7f6c4c003530 con 0x7f6c60143c00 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 msgr2=0x7f6c600b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 0x7f6c600b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 >> v2:172.21.15.120:3300/0 conn(0x7f6c60071550 msgr2=0x7f6c600719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 --2- 172.21.15.70:0/1670896471 >> v2:172.21.15.120:3300/0 conn(0x7f6c60071550 0x7f6c600719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600b2bb0 con 0x7f6c60143c00 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f6c5c001680 con 0x7f6c60143c00 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65214640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 0x7f6c600b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:59.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 >> v1:172.21.15.70:6789/0 conn(0x7f6c60143c00 legacy=0x7f6c600cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c4c003980 0x7f6c4c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 0x7f6c4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c004d10 0x7f6c4c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60071f20 con 0x7f6c4c003980 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600b28d0 con 0x7f6c4c004d10 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c00dba0 con 0x7f6c60070390 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c66216640 1 --2- 172.21.15.70:0/1670896471 >> v2:172.21.15.120:3300/0 conn(0x7f6c60071550 0x7f6c600719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c4c003980 0x7f6c4c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65214640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 0x7f6c4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c66216640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c004d10 0x7f6c4c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 -- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 msgr2=0x7f6c4c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c60070390 0x7f6c4c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 -- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c004d10 msgr2=0x7f6c4c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c004d10 0x7f6c4c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c65a15640 1 -- 172.21.15.70:0/1670896471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50009420 con 0x7f6c4c003980 2023-11-26T07:21:59.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.500+0000 7f6c66216640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c004d10 0x7f6c4c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c65a15640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c4c003980 0x7f6c4c003da0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c240 tx=0x7f6c5c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f1d0ec89d1c0da server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0058e0 con 0x7f6c4c003980 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c005a40 con 0x7f6c4c003980 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c64a13640 1 -- 172.21.15.70:0/1670896471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c005e10 con 0x7f6c4c003980 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c67c79640 1 -- 172.21.15.70:0/1670896471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c4c003980 msgr2=0x7f6c4c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c67c79640 1 --2- 172.21.15.70:0/1670896471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c4c003980 0x7f6c4c003da0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c240 tx=0x7f6c5c01cbd0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c66216640 1 -- 172.21.15.70:0/1670896471 reap_dead start 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c67c79640 1 -- 172.21.15.70:0/1670896471 shutdown_connections 2023-11-26T07:21:59.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c67c79640 1 -- 172.21.15.70:0/1670896471 >> 172.21.15.70:0/1670896471 conn(0x7f6c600b0bf0 msgr2=0x7f6c600b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c67c79640 1 -- 172.21.15.70:0/1670896471 shutdown_connections 2023-11-26T07:21:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.504+0000 7f6c67c79640 1 -- 172.21.15.70:0/1670896471 wait complete. 2023-11-26T07:21:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 Processor -- start 2023-11-26T07:21:59.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 -- start start 2023-11-26T07:21:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c003980 0x7f6c60142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c6015a630 0x7f6c6015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c6015be50 0x7f6c6013f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6015adb0 con 0x7f6c6015a630 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6015b090 con 0x7f6c4c003980 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6015b370 con 0x7f6c6015be50 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c6015a630 0x7f6c6015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c6015a630 0x7f6c6015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46326/0 (socket says 172.21.15.70:46326) 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 -- 172.21.15.70:0/3749559026 learned_addr learned my addr 172.21.15.70:0/3749559026 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65a15640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c003980 0x7f6c60142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c66216640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c6015be50 0x7f6c6013f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 -- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c6015be50 msgr2=0x7f6c6013f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c6015be50 0x7f6c6013f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 -- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c003980 msgr2=0x7f6c60142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c003980 0x7f6c60142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 -- 172.21.15.70:0/3749559026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6015b650 con 0x7f6c6015a630 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c65214640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c6015a630 0x7f6c6015c9b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6c50011ca0 tx=0x7f6c5000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c567fc640 1 -- 172.21.15.70:0/3749559026 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000fd20 con 0x7f6c6015a630 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c567fc640 1 -- 172.21.15.70:0/3749559026 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5000fe80 con 0x7f6c6015a630 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c567fc640 1 -- 172.21.15.70:0/3749559026 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50004240 con 0x7f6c6015a630 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6015b930 con 0x7f6c6015a630 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6015cef0 con 0x7f6c6015a630 2023-11-26T07:21:59.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.508+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c60067720 con 0x7f6c6015a630 2023-11-26T07:21:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.512+0000 7f6c567fc640 1 -- 172.21.15.70:0/3749559026 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f6c500043a0 con 0x7f6c6015a630 2023-11-26T07:21:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.512+0000 7f6c567fc640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c44066a40 0x7f6c44068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.512+0000 7f6c567fc640 1 -- 172.21.15.70:0/3749559026 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c50085070 con 0x7f6c6015a630 2023-11-26T07:21:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.512+0000 7f6c65a15640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c44066a40 0x7f6c44068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.512+0000 7f6c65a15640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c44066a40 0x7f6c44068f00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0aa000 tx=0x7f6c5c001a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.516+0000 7f6c567fc640 1 -- 172.21.15.70:0/3749559026 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c50051c60 con 0x7f6c6015a630 2023-11-26T07:21:59.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:59.635 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:21:59.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.720+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6c600b17a0 con 0x7f6c6015a630 2023-11-26T07:21:59.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.720+0000 7f6c567fc640 1 -- 172.21.15.70:0/3749559026 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6c50022030 con 0x7f6c6015a630 2023-11-26T07:21:59.727 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-11-26T07:21:59.727 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA== 2023-11-26T07:21:59.727 INFO:teuthology.orchestra.run.smithi070.stdout: caps mds = "allow" 2023-11-26T07:21:59.727 INFO:teuthology.orchestra.run.smithi070.stdout: caps mon = "allow r" 2023-11-26T07:21:59.727 INFO:teuthology.orchestra.run.smithi070.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:21:59.727 INFO:teuthology.orchestra.run.smithi070.stderr:updated caps for client.0 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c44066a40 msgr2=0x7f6c44068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c44066a40 0x7f6c44068f00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0aa000 tx=0x7f6c5c001a80 comp rx=0 tx=0).stop 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c6015a630 msgr2=0x7f6c6015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c6015a630 0x7f6c6015c9b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6c50011ca0 tx=0x7f6c5000f610 comp rx=0 tx=0).stop 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 shutdown_connections 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c44066a40 0x7f6c44068f00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c6015a630 0x7f6c6015c9b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c6015be50 0x7f6c6013f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 --2- 172.21.15.70:0/3749559026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4c003980 0x7f6c60142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 >> 172.21.15.70:0/3749559026 conn(0x7f6c600b0bf0 msgr2=0x7f6c600cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:59.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 shutdown_connections 2023-11-26T07:21:59.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.724+0000 7f6c67c79640 1 -- 172.21.15.70:0/3749559026 wait complete. 2023-11-26T07:21:59.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:21:59.835 INFO:tasks.ceph.mds.a.smithi070.stderr:2023-11-26T07:21:59.832+0000 7f15483b3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:21:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.880+0000 7fb1e878d640 1 Processor -- start 2023-11-26T07:21:59.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.880+0000 7fb1e878d640 1 -- start start 2023-11-26T07:21:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.880+0000 7fb1e878d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.880+0000 7fb1e878d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb1e00cf990 0x7fb1e00cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.880+0000 7fb1e878d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e00cc730 con 0x7fb1e00708b0 2023-11-26T07:21:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.880+0000 7fb1e878d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e0143ea0 con 0x7fb1e00cf990 2023-11-26T07:21:59.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.880+0000 7fb1e878d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0070ee0 con 0x7fb1e0143ac0 2023-11-26T07:21:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb1e00cf990 0x7fb1e00cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb1e00cf990 0x7fb1e00cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46330/0 (socket says 172.21.15.70:46330) 2023-11-26T07:21:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 -- 172.21.15.70:0/1413418835 learned_addr learned my addr 172.21.15.70:0/1413418835 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6529640 1 --2- 172.21.15.70:0/1413418835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 -- 172.21.15.70:0/1413418835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 msgr2=0x7fb1e0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 --2- 172.21.15.70:0/1413418835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e0070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 -- 172.21.15.70:0/1413418835 >> v1:172.21.15.120:6789/0 conn(0x7fb1e00708b0 legacy=0x7fb1e00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:21:59.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 -- 172.21.15.70:0/1413418835 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00711c0 con 0x7fb1e00cf990 2023-11-26T07:21:59.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e6d2a640 1 --2- 172.21.15.70:0/1413418835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e00cd1b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009e50 tx=0x7fb1d801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acd47fa0b2d8279 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e5527640 1 -- 172.21.15.70:0/1413418835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a57f0 con 0x7fb1e00cf990 2023-11-26T07:21:59.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e5527640 1 -- 172.21.15.70:0/1413418835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d80a5950 con 0x7fb1e00cf990 2023-11-26T07:21:59.891 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.884+0000 7fb1e5527640 1 -- 172.21.15.70:0/1413418835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a5ce0 con 0x7fb1e00cf990 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 -- 172.21.15.70:0/1413418835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 msgr2=0x7fb1e00cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1413418835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e00cd1b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009e50 tx=0x7fb1d801ca10 comp rx=0 tx=0).stop 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 -- 172.21.15.70:0/1413418835 shutdown_connections 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1413418835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e00cd1b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1413418835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 -- 172.21.15.70:0/1413418835 >> 172.21.15.70:0/1413418835 conn(0x7fb1e006a890 msgr2=0x7fb1e006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 -- 172.21.15.70:0/1413418835 shutdown_connections 2023-11-26T07:21:59.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 -- 172.21.15.70:0/1413418835 wait complete. 2023-11-26T07:21:59.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 Processor -- start 2023-11-26T07:21:59.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.888+0000 7fb1e878d640 1 -- start start 2023-11-26T07:21:59.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1e00708b0 0x7fb1e00b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e00a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e014bdf0 con 0x7fb1e00cf990 2023-11-26T07:21:59.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00a96b0 con 0x7fb1e00708b0 2023-11-26T07:21:59.896 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00a9400 con 0x7fb1e0143ac0 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e014b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46338/0 (socket says 172.21.15.70:46338) 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 -- 172.21.15.70:0/1466885044 learned_addr learned my addr 172.21.15.70:0/1466885044 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e6529640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1e00708b0 0x7fb1e00b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e6d2a640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e00a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 -- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 msgr2=0x7fb1e00a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e00a8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 -- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1e00708b0 msgr2=0x7fb1e00b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1e00708b0 0x7fb1e00b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 -- 172.21.15.70:0/1466885044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8009b30 con 0x7fb1e00cf990 2023-11-26T07:21:59.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e5d28640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e014b8b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c450 tx=0x7fb1d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1d6ffd640 1 -- 172.21.15.70:0/1466885044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00052d0 con 0x7fb1e00cf990 2023-11-26T07:21:59.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1d6ffd640 1 -- 172.21.15.70:0/1466885044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0005450 con 0x7fb1e00cf990 2023-11-26T07:21:59.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e00b0360 con 0x7fb1e00cf990 2023-11-26T07:21:59.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1d6ffd640 1 -- 172.21.15.70:0/1466885044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0012870 con 0x7fb1e00cf990 2023-11-26T07:21:59.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e00b0920 con 0x7fb1e00cf990 2023-11-26T07:21:59.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e0067680 con 0x7fb1e00cf990 2023-11-26T07:21:59.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.892+0000 7fb1d6ffd640 1 -- 172.21.15.70:0/1466885044 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb1d00129d0 con 0x7fb1e00cf990 2023-11-26T07:21:59.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.896+0000 7fb1d6ffd640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb1c4066a10 0x7fb1c4068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:21:59.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.896+0000 7fb1d6ffd640 1 -- 172.21.15.70:0/1466885044 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1d00843a0 con 0x7fb1e00cf990 2023-11-26T07:21:59.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.896+0000 7fb1e6529640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb1c4066a10 0x7fb1c4068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:21:59.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.896+0000 7fb1e6529640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb1c4066a10 0x7fb1c4068ed0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0079c0 tx=0x7fb1dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:21:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:21:59.900+0000 7fb1d6ffd640 1 -- 172.21.15.70:0/1466885044 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1d0050f90 con 0x7fb1e00cf990 2023-11-26T07:22:00.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.092+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1e013a150 con 0x7fb1e00cf990 2023-11-26T07:22:00.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1d6ffd640 1 -- 172.21.15.70:0/1466885044 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fb1d00545b0 con 0x7fb1e00cf990 2023-11-26T07:22:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:00.099 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/3935694912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3935694912},{"type":"v1","addr":"172.21.15.120:6834","nonce":3935694912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/886224003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":886224003},{"type":"v1","addr":"172.21.15.120:6835","nonce":886224003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1027556569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1027556569},{"type":"v1","addr":"172.21.15.70:6835","nonce":1027556569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:54.236576+0000","modified":"2023-11-26T07:21:57.243631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3834969891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3834969891},{"type":"v1","addr":"172.21.15.70:6837","nonce":3834969891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:00.100 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2023-11-26T07:22:00.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb1c4066a10 msgr2=0x7fb1c4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb1c4066a10 0x7fb1c4068ed0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0079c0 tx=0x7fb1dc008040 comp rx=0 tx=0).stop 2023-11-26T07:22:00.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 msgr2=0x7fb1e014b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e014b8b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c450 tx=0x7fb1d000c910 comp rx=0 tx=0).stop 2023-11-26T07:22:00.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 shutdown_connections 2023-11-26T07:22:00.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb1c4066a10 0x7fb1c4068ed0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1e00cf990 0x7fb1e014b8b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1e0143ac0 0x7fb1e00a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 --2- 172.21.15.70:0/1466885044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1e00708b0 0x7fb1e00b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 >> 172.21.15.70:0/1466885044 conn(0x7fb1e006a890 msgr2=0x7fb1e015c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 shutdown_connections 2023-11-26T07:22:00.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.096+0000 7fb1e878d640 1 -- 172.21.15.70:0/1466885044 wait complete. 2023-11-26T07:22:00.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:21:54.236576+0000', 'modified': '2023-11-26T07:21:57.243631+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6366}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6366': {'gid': 6366, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.70:6837/3834969891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6836', 'nonce': 3834969891}, {'type': 'v1', 'addr': '172.21.15.70:6837', 'nonce': 3834969891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:22:00.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:22:00.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-26T07:22:00.662 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.656+0000 7f9e93b1c640 1 Processor -- start 2023-11-26T07:22:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.656+0000 7f9e93b1c640 1 -- start start 2023-11-26T07:22:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e93b1c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9e8c143ac0 0x7f9e8c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e93b1c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e8c0cf990 0x7f9e8c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e93b1c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0cc730 con 0x7f9e8c0708b0 2023-11-26T07:22:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e93b1c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c143ea0 con 0x7f9e8c0cf990 2023-11-26T07:22:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e93b1c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c070ee0 con 0x7f9e8c143ac0 2023-11-26T07:22:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e920b9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e8c0cf990 0x7f9e8c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e910b7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9e8c0708b0 0x7f9e8c0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45586/0 (socket says 172.21.15.70:45586) 2023-11-26T07:22:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e920b9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e8c0cf990 0x7f9e8c0cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46340/0 (socket says 172.21.15.70:46340) 2023-11-26T07:22:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e910b7640 1 -- 172.21.15.70:0/395320945 learned_addr learned my addr 172.21.15.70:0/395320945 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e918b8640 1 --2- 172.21.15.70:0/395320945 >> v2:172.21.15.120:3300/0 conn(0x7f9e8c143ac0 0x7f9e8c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e920b9640 1 -- 172.21.15.70:0/395320945 >> v2:172.21.15.120:3300/0 conn(0x7f9e8c143ac0 msgr2=0x7f9e8c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e920b9640 1 --2- 172.21.15.70:0/395320945 >> v2:172.21.15.120:3300/0 conn(0x7f9e8c143ac0 0x7f9e8c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e920b9640 1 -- 172.21.15.70:0/395320945 >> v1:172.21.15.70:6789/0 conn(0x7f9e8c0708b0 legacy=0x7f9e8c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.660+0000 7f9e920b9640 1 -- 172.21.15.70:0/395320945 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0711c0 con 0x7f9e8c0cf990 2023-11-26T07:22:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e920b9640 1 --2- 172.21.15.70:0/395320945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c0cd1b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c06dca0 tx=0x7f9e8401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0ee2fd70773d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e908b6640 1 -- 172.21.15.70:0/395320945 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840a58e0 con 0x7f9e8c0cf990 2023-11-26T07:22:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e908b6640 1 -- 172.21.15.70:0/395320945 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e840a5a40 con 0x7f9e8c0cf990 2023-11-26T07:22:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e908b6640 1 -- 172.21.15.70:0/395320945 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840a5dd0 con 0x7f9e8c0cf990 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 -- 172.21.15.70:0/395320945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 msgr2=0x7f9e8c0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/395320945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c0cd1b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c06dca0 tx=0x7f9e8401c910 comp rx=0 tx=0).stop 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 -- 172.21.15.70:0/395320945 shutdown_connections 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/395320945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c0cd1b0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/395320945 >> v2:172.21.15.120:3300/0 conn(0x7f9e8c143ac0 0x7f9e8c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 -- 172.21.15.70:0/395320945 >> 172.21.15.70:0/395320945 conn(0x7f9e8c06a890 msgr2=0x7f9e8c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 -- 172.21.15.70:0/395320945 shutdown_connections 2023-11-26T07:22:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 -- 172.21.15.70:0/395320945 wait complete. 2023-11-26T07:22:00.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 Processor -- start 2023-11-26T07:22:00.670 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.664+0000 7f9e93b1c640 1 -- start start 2023-11-26T07:22:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e8c0708b0 0x7f9e8c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c1389a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e8c143ac0 0x7f9e8c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c15cc70 con 0x7f9e8c0cf990 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c156c60 con 0x7f9e8c0708b0 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c138ee0 con 0x7f9e8c143ac0 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c1389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c1389a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46352/0 (socket says 172.21.15.70:46352) 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 -- 172.21.15.70:0/3185873766 learned_addr learned my addr 172.21.15.70:0/3185873766 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e918b8640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e8c0708b0 0x7f9e8c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 -- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e8c143ac0 msgr2=0x7f9e8c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e8c143ac0 0x7f9e8c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 -- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e8c0708b0 msgr2=0x7f9e8c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e8c0708b0 0x7f9e8c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 -- 172.21.15.70:0/3185873766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84009a70 con 0x7f9e8c0cf990 2023-11-26T07:22:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e918b8640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e8c0708b0 0x7f9e8c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e910b7640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c1389a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c450 tx=0x7f9e7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e827fc640 1 -- 172.21.15.70:0/3185873766 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c005cf0 con 0x7f9e8c0cf990 2023-11-26T07:22:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e827fc640 1 -- 172.21.15.70:0/3185873766 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c005e50 con 0x7f9e8c0cf990 2023-11-26T07:22:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e827fc640 1 -- 172.21.15.70:0/3185873766 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c007290 con 0x7f9e8c0cf990 2023-11-26T07:22:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c15ab40 con 0x7f9e8c0cf990 2023-11-26T07:22:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c15d1a0 con 0x7f9e8c0cf990 2023-11-26T07:22:00.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.668+0000 7f9e827fc640 1 -- 172.21.15.70:0/3185873766 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f9e7c0073f0 con 0x7f9e8c0cf990 2023-11-26T07:22:00.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e827fc640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066a40 0x7f9e70068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e827fc640 1 -- 172.21.15.70:0/3185873766 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e7c083f00 con 0x7f9e8c0cf990 2023-11-26T07:22:00.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e918b8640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066a40 0x7f9e70068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 Processor -- start 2023-11-26T07:22:00.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 -- start start 2023-11-26T07:22:00.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e918b8640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066a40 0x7f9e70068f00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9e880097a0 tx=0x7f9e88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08550070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08505de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08506700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.677 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f08370130 con 0x555f08506320 2023-11-26T07:22:00.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0835d9a0 con 0x555f085505b0 2023-11-26T07:22:00.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f0835aed0 con 0x555f0854fc90 2023-11-26T07:22:00.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08506700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08506700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46364/0 (socket says 172.21.15.70:46364) 2023-11-26T07:22:00.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 -- 172.21.15.70:0/947840595 learned_addr learned my addr 172.21.15.70:0/947840595 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:00.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e910b7640 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08505de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e918b8640 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08550070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 -- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 msgr2=0x555f08550070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08550070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 -- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 msgr2=0x555f08505de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08505de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 -- 172.21.15.70:0/947840595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f0804e890 con 0x555f08506320 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e918b8640 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08550070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e920b9640 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08506700 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9e84019520 tx=0x7f9e84004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144e2e75605fe4f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e6f7fe640 1 -- 172.21.15.70:0/947840595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840a5bb0 con 0x555f08506320 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e6f7fe640 1 -- 172.21.15.70:0/947840595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e840a5d10 con 0x555f08506320 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e6f7fe640 1 -- 172.21.15.70:0/947840595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ad660 con 0x555f08506320 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 -- 172.21.15.70:0/947840595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 msgr2=0x555f08506700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.672+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08506700 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9e84019520 tx=0x7f9e84004a50 comp rx=0 tx=0).stop 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- 172.21.15.70:0/947840595 shutdown_connections 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08506700 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08505de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/947840595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08550070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- 172.21.15.70:0/947840595 >> 172.21.15.70:0/947840595 conn(0x555f085022d0 msgr2=0x555f085046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- 172.21.15.70:0/947840595 shutdown_connections 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- 172.21.15.70:0/947840595 wait complete. 2023-11-26T07:22:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- start start 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 Processor -- start 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08534ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08534ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08535530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f083567c0 con 0x555f08506320 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0830ebf0 con 0x555f085505b0 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f08314a90 con 0x555f0854fc90 2023-11-26T07:22:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 10 client.0 _ll_register_callbacks cb 0x555f084f13c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08534ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08534ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46370/0 (socket says 172.21.15.70:46370) 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 -- 172.21.15.70:0/2821252732 learned_addr learned my addr 172.21.15.70:0/2821252732 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e910b7640 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08534ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e920b9640 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08535530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 -- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 msgr2=0x555f08534ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08534ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 -- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 msgr2=0x555f08535530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08535530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 -- 172.21.15.70:0/2821252732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c0711c0 con 0x555f08506320 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e918b8640 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08534ab0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800ea70 tx=0x7f9e880046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907f0ed0c9519b2d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:22:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e6cff9640 1 -- 172.21.15.70:0/2821252732 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88009e30 con 0x555f08506320 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f08318470 con 0x555f08506320 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e6cff9640 1 -- 172.21.15.70:0/2821252732 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e88013430 con 0x555f08506320 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e6cff9640 1 -- 172.21.15.70:0/2821252732 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e880135f0 con 0x555f08506320 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 10 client.6492 fetch_fsmap learned FSMap version 38 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x555f08317190 con 0x555f08506320 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.676+0000 7f9e6cff9640 1 -- 172.21.15.70:0/2821252732 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f08318470 con 0x555f08506320 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e6cff9640 1 -- 172.21.15.70:0/2821252732 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9e88013750 con 0x555f08506320 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 10 client.6492 fetch_fsmap finished waiting for FSMap version 38 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 10 client.6492 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 20 client.6492 populate_metadata read hostname 'smithi070' 2023-11-26T07:22:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f08535f40 0x555f08561f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 4 client.6492 mds_command: new command op to 6366 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:22:00.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 --> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f0831bb50 con 0x555f08535f40 2023-11-26T07:22:00.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e910b7640 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f08535f40 0x555f08561f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e910b7640 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f08535f40 0x555f08561f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54050660dbedab7 server_cookie=2f7f9b92877fa3de in_seq=0 out_seq=0 2023-11-26T07:22:00.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e6cff9640 10 client.6492 ms_handle_connect on v2:172.21.15.70:6836/3834969891 2023-11-26T07:22:00.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e6cff9640 1 -- 172.21.15.70:0/2821252732 <== mds.0 v2:172.21.15.70:6836/3834969891 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555f0831bb50 con 0x555f08535f40 2023-11-26T07:22:00.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e6cff9640 10 client.6492 handle_command_reply: tid=0 2023-11-26T07:22:00.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 client.6492 shutdown 2023-11-26T07:22:00.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 msgr2=0x555f08534ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08534ab0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800ea70 tx=0x7f9e880046d0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 shutdown_connections 2023-11-26T07:22:00.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f08535f40 0x555f08561f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f08535530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f08534ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e6cff9640 0 client.6492 ms_handle_reset on v2:172.21.15.70:6836/3834969891 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/2821252732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08534ab0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 >> 172.21.15.70:0/2821252732 conn(0x555f085022d0 msgr2=0x555f085046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 shutdown_connections 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 1 -- 172.21.15.70:0/2821252732 wait complete. 2023-11-26T07:22:00.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.680+0000 7f9e96e8f000 20 client.6492 trim_cache size 0 max 16384 2023-11-26T07:22:00.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 Processor -- start 2023-11-26T07:22:00.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 -- start start 2023-11-26T07:22:00.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f08506320 0x555f0854e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f0854fc90 0x555f0854e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f085505b0 0x555f08506700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0800f940 con 0x555f0854fc90 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f082f18a0 con 0x555f08506320 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f085098a0 con 0x555f085505b0 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f0854fc90 0x555f0854e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f0854fc90 0x555f0854e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46382/0 (socket says 172.21.15.70:46382) 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 -- 172.21.15.70:0/4247729569 learned_addr learned my addr 172.21.15.70:0/4247729569 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e918b8640 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f08506320 0x555f0854e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e920b9640 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f085505b0 0x555f08506700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 -- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f085505b0 msgr2=0x555f08506700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f085505b0 0x555f08506700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 -- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f08506320 msgr2=0x555f0854e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f08506320 0x555f0854e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 -- 172.21.15.70:0/4247729569 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f085099e0 con 0x555f0854fc90 2023-11-26T07:22:00.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e920b9640 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f085505b0 0x555f08506700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:00.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e910b7640 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f0854fc90 0x555f0854e920 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c081cd0 tx=0x7f9e7c057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ed6eb162473a50 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e6ffff640 1 -- 172.21.15.70:0/4247729569 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c081a50 con 0x555f0854fc90 2023-11-26T07:22:00.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e6ffff640 1 -- 172.21.15.70:0/4247729569 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c052aa0 con 0x555f0854fc90 2023-11-26T07:22:00.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e6ffff640 1 -- 172.21.15.70:0/4247729569 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c053bf0 con 0x555f0854fc90 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 -- 172.21.15.70:0/4247729569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f0854fc90 msgr2=0x555f0854e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.696+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f0854fc90 0x555f0854e920 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c081cd0 tx=0x7f9e7c057040 comp rx=0 tx=0).stop 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- 172.21.15.70:0/4247729569 shutdown_connections 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f0854fc90 0x555f0854e920 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f085505b0 0x555f08506700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/4247729569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f08506320 0x555f0854e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- 172.21.15.70:0/4247729569 >> 172.21.15.70:0/4247729569 conn(0x555f085022d0 msgr2=0x555f085046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- 172.21.15.70:0/4247729569 shutdown_connections 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- 172.21.15.70:0/4247729569 wait complete. 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- start start 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 Processor -- start 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08562fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f085634e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f085761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f083158f0 con 0x555f08506320 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f083139b0 con 0x555f085505b0 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f08353550 con 0x555f0854fc90 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 10 client.0 _ll_register_callbacks cb 0x555f083a4c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08562fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08562fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46386/0 (socket says 172.21.15.70:46386) 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 -- 172.21.15.70:0/3476873285 learned_addr learned my addr 172.21.15.70:0/3476873285 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e910b7640 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f085634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e920b9640 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f085761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 -- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 msgr2=0x555f085634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f085634e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 -- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 msgr2=0x555f085761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.708 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f085761f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 -- 172.21.15.70:0/3476873285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c15d1a0 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e918b8640 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08562fa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006aa0 tx=0x7f9e88013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd7499f8aeaf82c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e6cff9640 1 -- 172.21.15.70:0/3476873285 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880043d0 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e6cff9640 1 -- 172.21.15.70:0/3476873285 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e88009d80 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f08355110 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e6cff9640 1 -- 172.21.15.70:0/3476873285 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e88009f40 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 10 client.6498 fetch_fsmap learned FSMap version 38 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x555f082fd490 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e6cff9640 1 -- 172.21.15.70:0/3476873285 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f08355110 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e6cff9640 1 -- 172.21.15.70:0/3476873285 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9e880059a0 con 0x555f08506320 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 10 client.6498 fetch_fsmap finished waiting for FSMap version 38 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 10 client.6498 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-26T07:22:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 20 client.6498 populate_metadata read hostname 'smithi070' 2023-11-26T07:22:00.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f085bf650 0x555f085c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 4 client.6498 mds_command: new command op to 6366 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:22:00.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.700+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 --> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f083849a0 con 0x555f085bf650 2023-11-26T07:22:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e910b7640 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f085bf650 0x555f085c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e6cff9640 10 client.6498 ms_handle_connect on v2:172.21.15.70:6836/3834969891 2023-11-26T07:22:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e910b7640 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f085bf650 0x555f085c1a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19cbebcfce9df63d server_cookie=ea06574364808633 in_seq=0 out_seq=0 2023-11-26T07:22:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e6cff9640 1 -- 172.21.15.70:0/3476873285 <== mds.0 v2:172.21.15.70:6836/3834969891 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555f083849a0 con 0x555f085bf650 2023-11-26T07:22:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e6cff9640 10 client.6498 handle_command_reply: tid=0 2023-11-26T07:22:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 client.6498 shutdown 2023-11-26T07:22:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 msgr2=0x555f08562fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08562fa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006aa0 tx=0x7f9e88013000 comp rx=0 tx=0).stop 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 shutdown_connections 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:6836/3834969891,v1:172.21.15.70:6837/3834969891] conn(0x555f085bf650 0x555f085c1a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f085505b0 0x555f085761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x555f0854fc90 0x555f085634e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 --2- 172.21.15.70:0/3476873285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f08506320 0x555f08562fa0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e6cff9640 0 client.6498 ms_handle_reset on v2:172.21.15.70:6836/3834969891 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 >> 172.21.15.70:0/3476873285 conn(0x555f085022d0 msgr2=0x555f08504f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 shutdown_connections 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 1 -- 172.21.15.70:0/3476873285 wait complete. 2023-11-26T07:22:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e96e8f000 20 client.6498 trim_cache size 0 max 16384 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "35961970-1319-4bbb-b3aa-e783ca1e0d4a", 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 6366, 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 5.8456597199999996, 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 38, 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 64, 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 64, 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 11.181880831000001 2023-11-26T07:22:00.713 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:22:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066a40 msgr2=0x7f9e70068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066a40 0x7f9e70068f00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9e880097a0 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2023-11-26T07:22:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 msgr2=0x7f9e8c1389a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c1389a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c450 tx=0x7f9e7c00c910 comp rx=0 tx=0).stop 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 shutdown_connections 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9e70066a40 0x7f9e70068f00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e8c0cf990 0x7f9e8c1389a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e8c143ac0 0x7f9e8c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 --2- 172.21.15.70:0/3185873766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e8c0708b0 0x7f9e8c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 >> 172.21.15.70:0/3185873766 conn(0x7f9e8c06a890 msgr2=0x7f9e8c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 shutdown_connections 2023-11-26T07:22:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.704+0000 7f9e93b1c640 1 -- 172.21.15.70:0/3185873766 wait complete. 2023-11-26T07:22:00.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:22:00.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.860+0000 7feaadae3640 1 Processor -- start 2023-11-26T07:22:00.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.860+0000 7feaadae3640 1 -- start start 2023-11-26T07:22:00.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.860+0000 7feaadae3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feaa813e290 0x7feaa80cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaadae3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa815fb20 con 0x7feaa815f6b0 2023-11-26T07:22:00.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaadae3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa806c520 con 0x7feaa80cf7c0 2023-11-26T07:22:00.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaadae3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa80cfc40 con 0x7feaa813e290 2023-11-26T07:22:00.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa77fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feaa813e290 0x7feaa80cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa77fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feaa813e290 0x7feaa80cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46392/0 (socket says 172.21.15.70:46392) 2023-11-26T07:22:00.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa77fe640 1 -- 172.21.15.70:0/3338150229 learned_addr learned my addr 172.21.15.70:0/3338150229 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:00.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa77fe640 1 -- 172.21.15.70:0/3338150229 >> v1:172.21.15.120:6789/0 conn(0x7feaa80cf7c0 legacy=0x7feaa815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:00.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa77fe640 1 -- 172.21.15.70:0/3338150229 >> v1:172.21.15.70:6789/0 conn(0x7feaa815f6b0 legacy=0x7feaa80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa6ffd640 1 -- 172.21.15.70:0/3338150229 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803433373 0 0) 0x7feaa00014a0 con 0x7feaa815f6b0 2023-11-26T07:22:00.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa77fe640 1 -- 172.21.15.70:0/3338150229 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa806c800 con 0x7feaa813e290 2023-11-26T07:22:00.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa77fe640 1 --2- 172.21.15.70:0/3338150229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa813e290 0x7feaa80cf280 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fea98009870 tx=0x7fea9801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97878ab3292a595d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa6ffd640 1 -- 172.21.15.70:0/3338150229 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980aa670 con 0x7feaa813e290 2023-11-26T07:22:00.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa6ffd640 1 -- 172.21.15.70:0/3338150229 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea980aa7d0 con 0x7feaa813e290 2023-11-26T07:22:00.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.864+0000 7feaa6ffd640 1 -- 172.21.15.70:0/3338150229 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980aab60 con 0x7feaa813e290 2023-11-26T07:22:00.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- 172.21.15.70:0/3338150229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa813e290 msgr2=0x7feaa80cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 --2- 172.21.15.70:0/3338150229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa813e290 0x7feaa80cf280 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fea98009870 tx=0x7fea9801c510 comp rx=0 tx=0).stop 2023-11-26T07:22:00.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- 172.21.15.70:0/3338150229 shutdown_connections 2023-11-26T07:22:00.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 --2- 172.21.15.70:0/3338150229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa813e290 0x7feaa80cf280 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- 172.21.15.70:0/3338150229 >> 172.21.15.70:0/3338150229 conn(0x7feaa806a890 msgr2=0x7feaa806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:00.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- 172.21.15.70:0/3338150229 shutdown_connections 2023-11-26T07:22:00.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- 172.21.15.70:0/3338150229 wait complete. 2023-11-26T07:22:00.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 Processor -- start 2023-11-26T07:22:00.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- start start 2023-11-26T07:22:00.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feaa80cf7c0 0x7feaa813a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feaa813e290 0x7feaa80a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa815f6b0 0x7feaa813bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80a9c30 con 0x7feaa815f6b0 2023-11-26T07:22:00.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa813c500 con 0x7feaa80cf7c0 2023-11-26T07:22:00.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaadae3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa813af20 con 0x7feaa813e290 2023-11-26T07:22:00.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa815f6b0 0x7feaa813bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa815f6b0 0x7feaa813bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46398/0 (socket says 172.21.15.70:46398) 2023-11-26T07:22:00.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 -- 172.21.15.70:0/2259481333 learned_addr learned my addr 172.21.15.70:0/2259481333 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:00.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa77fe640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feaa80cf7c0 0x7feaa813a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7fea9ffff640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feaa813e290 0x7feaa80a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 -- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feaa813e290 msgr2=0x7feaa80a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feaa813e290 0x7feaa80a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 -- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feaa80cf7c0 msgr2=0x7feaa813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:00.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feaa80cf7c0 0x7feaa813a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:00.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.868+0000 7feaa7fff640 1 -- 172.21.15.70:0/2259481333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980094d0 con 0x7feaa815f6b0 2023-11-26T07:22:00.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa7fff640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa815f6b0 0x7feaa813bfc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c780 tx=0x7feaa000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa4ff9640 1 -- 172.21.15.70:0/2259481333 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0003ba0 con 0x7feaa815f6b0 2023-11-26T07:22:00.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa4ff9640 1 -- 172.21.15.70:0/2259481333 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0003d20 con 0x7feaa815f6b0 2023-11-26T07:22:00.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa813b200 con 0x7feaa815f6b0 2023-11-26T07:22:00.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa4ff9640 1 -- 172.21.15.70:0/2259481333 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000aa90 con 0x7feaa815f6b0 2023-11-26T07:22:00.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa813b7c0 con 0x7feaa815f6b0 2023-11-26T07:22:00.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa8067680 con 0x7feaa815f6b0 2023-11-26T07:22:00.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa4ff9640 1 -- 172.21.15.70:0/2259481333 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7feaa000abf0 con 0x7feaa815f6b0 2023-11-26T07:22:00.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa4ff9640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fea88066a40 0x7fea88068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:00.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa4ff9640 1 -- 172.21.15.70:0/2259481333 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaa0084370 con 0x7feaa815f6b0 2023-11-26T07:22:00.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.872+0000 7feaa77fe640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fea88066a40 0x7fea88068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:00.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.876+0000 7feaa77fe640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fea88066a40 0x7fea88068f00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fea980ae000 tx=0x7fea980a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:00.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:00.876+0000 7feaa4ff9640 1 -- 172.21.15.70:0/2259481333 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feaa0050ff0 con 0x7feaa815f6b0 2023-11-26T07:22:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.060+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feaa815fb20 con 0x7feaa815f6b0 2023-11-26T07:22:01.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.060+0000 7feaa4ff9640 1 -- 172.21.15.70:0/2259481333 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7feaa815fb20 con 0x7feaa815f6b0 2023-11-26T07:22:01.066 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:22:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fea88066a40 msgr2=0x7fea88068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fea88066a40 0x7fea88068f00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fea980ae000 tx=0x7fea980a7000 comp rx=0 tx=0).stop 2023-11-26T07:22:01.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa815f6b0 msgr2=0x7feaa813bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa815f6b0 0x7feaa813bfc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c780 tx=0x7feaa000cc40 comp rx=0 tx=0).stop 2023-11-26T07:22:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 shutdown_connections 2023-11-26T07:22:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fea88066a40 0x7fea88068f00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaa815f6b0 0x7feaa813bfc0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feaa813e290 0x7feaa80a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 --2- 172.21.15.70:0/2259481333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feaa80cf7c0 0x7feaa813a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:01.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 >> 172.21.15.70:0/2259481333 conn(0x7feaa806a890 msgr2=0x7feaa80b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 shutdown_connections 2023-11-26T07:22:01.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01.064+0000 7feaadae3640 1 -- 172.21.15.70:0/2259481333 wait complete. 2023-11-26T07:22:01.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:22:01.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:22:01.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-11-26T07:22:01.087 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:22:01.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:01.088 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:22:01.088 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:22:01.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:22:01.088 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:22:01.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.089 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2023-11-26T07:22:01.098 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42171sec preferred_lft 42171sec 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 02:42:99:81:d5:52 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:01.099 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:22:01.100 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:22:01.101 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:01.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.101 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:22:01.161 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-11-26T07:22:01.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.163 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-11-26T07:22:01.217 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-11-26T07:22:01.217 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:22:01.217 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:22:01.217 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:22:01.217 INFO:teuthology.orchestra.run.smithi070.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:22:01.217 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:22:01.217 INFO:teuthology.orchestra.run.smithi070.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:22:01.218 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:22:01.218 INFO:teuthology.orchestra.run.smithi070.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:22:01.218 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:22:01.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.218 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:22:01.218 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:22:01.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:22:01.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:22:01.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:22:01.219 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:22:01.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.313 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:22:01.322 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:22:01.322 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:22:01.323 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:22:01.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2023-11-26T07:22:01.383 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-26T07:22:01.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:22:01.383 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:01.435 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:22:01.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:22:01.435 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:01.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:22:01.547 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:22:01.604 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:22:01.604 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:22:01.604 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:22:01.605 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:22:01.606 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:22:01.607 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:22:01.607 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:22:01.607 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:22:01.607 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:22:01.607 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:22:01.607 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:22:01.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.608 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:22:01.662 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:22:01.663 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-26T07:22:01.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:22:01.730 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:22:01.786 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:22:01.786 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:22:01.786 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:22:01.786 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:22:01.786 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:22:01.787 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:22:01.788 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:22:01.789 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:22:01.789 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:22:01.789 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:22:01.789 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:22:01.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.790 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:22:01.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2023-11-26T07:22:01.800+0000 7f12bd1c6580 -1 init, newargv = 0x55ccea21a130 newargc=15 2023-11-26T07:22:01.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[52857]: starting ceph client 2023-11-26T07:22:01.813 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[52857]: starting fuse 2023-11-26T07:22:01.816 INFO:teuthology.orchestra.run.smithi070.stdout:43 2023-11-26T07:22:01.816 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:22:01.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> import re 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> import os 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2023-11-26T07:22:01.817 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> return f 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:22:01.818 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2023-11-26T07:22:01.819 DEBUG:teuthology.orchestra.run.smithi070:> ' 2023-11-26T07:22:01.947 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.52857.asok 2023-11-26T07:22:01.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:22:01.958 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52857.asok 2023-11-26T07:22:01.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:01.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52857.asok status 2023-11-26T07:22:02.127 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:22:02.127 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2023-11-26T07:22:02.127 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:22:02.127 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:22:02.127 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2023-11-26T07:22:02.127 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2023-11-26T07:22:02.127 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "52857", 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 6510, 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 6510 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:22:02.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3305282691 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3305282691 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.6510 192.168.0.1:0/3305282691", 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/3305282691", 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2023-11-26T07:22:02.129 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 38, 2023-11-26T07:22:02.130 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 64, 2023-11-26T07:22:02.130 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:22:02.130 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2023-11-26T07:22:02.130 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2023-11-26T07:22:02.130 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:22:02.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.142 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2023-11-26T07:22:02.142 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:02.152 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2023-11-26T07:22:02.152 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:02.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:02.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:22:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.392+0000 7f07a6565640 1 Processor -- start 2023-11-26T07:22:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.392+0000 7f07a6565640 1 -- start start 2023-11-26T07:22:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f07a6565640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 0x7f07a01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f07a6565640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a006c750 con 0x7f07a0071850 2023-11-26T07:22:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f07a6565640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a00b3550 con 0x7f07a00ce680 2023-11-26T07:22:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f07a6565640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00cbe00 con 0x7f07a00b2f80 2023-11-26T07:22:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079f7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f07a0071850 0x7f07a00b2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:45612/0 (socket says 172.21.15.70:45612) 2023-11-26T07:22:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079f7fe640 1 -- 172.21.15.70:0/1149738339 learned_addr learned my addr 172.21.15.70:0/1149738339 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f07a4b02640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 0x7f07a01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516407707 0 0) 0x7f07a006c750 con 0x7f07a0071850 2023-11-26T07:22:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0788003530 con 0x7f07a0071850 2023-11-26T07:22:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370087932 0 0) 0x7f07a00b3550 con 0x7f07a00ce680 2023-11-26T07:22:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a006c750 con 0x7f07a00ce680 2023-11-26T07:22:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2271599060 0 0) 0x7f0788003530 con 0x7f07a0071850 2023-11-26T07:22:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 msgr2=0x7f07a01596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 0x7f07a01596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 >> v1:172.21.15.120:6789/0 conn(0x7f07a00ce680 legacy=0x7f07a00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0071e80 con 0x7f07a0071850 2023-11-26T07:22:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f0794001680 con 0x7f07a0071850 2023-11-26T07:22:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 >> v1:172.21.15.70:6789/0 conn(0x7f07a0071850 legacy=0x7f07a00b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0788003b40 0x7f0788003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 0x7f07880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0788004d10 0x7f0788005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a00cbe00 con 0x7f0788003b40 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078800dc80 con 0x7f0788004d10 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078800de40 con 0x7f07a00b2f80 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079ffff640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0788003b40 0x7f0788003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079f7fe640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 0x7f07880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f07a4b02640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0788004d10 0x7f0788005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079ffff640 1 -- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 msgr2=0x7f07880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079ffff640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07a00b2f80 0x7f07880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079ffff640 1 -- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0788004d10 msgr2=0x7f0788005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079ffff640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0788004d10 0x7f0788005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.396+0000 7f079ffff640 1 -- 172.21.15.70:0/1149738339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788003530 con 0x7f0788003b40 2023-11-26T07:22:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f079ffff640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0788003b40 0x7f0788003f60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0790007fd0 tx=0x7f079001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d419cec88449c982 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900052d0 con 0x7f0788003b40 2023-11-26T07:22:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07900a7050 con 0x7f0788003b40 2023-11-26T07:22:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f079effd640 1 -- 172.21.15.70:0/1149738339 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790003600 con 0x7f0788003b40 2023-11-26T07:22:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a6565640 1 -- 172.21.15.70:0/1149738339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0788003b40 msgr2=0x7f0788003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:02.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a6565640 1 --2- 172.21.15.70:0/1149738339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0788003b40 0x7f0788003f60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0790007fd0 tx=0x7f079001c540 comp rx=0 tx=0).stop 2023-11-26T07:22:02.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a4b02640 1 -- 172.21.15.70:0/1149738339 reap_dead start 2023-11-26T07:22:02.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a6565640 1 -- 172.21.15.70:0/1149738339 shutdown_connections 2023-11-26T07:22:02.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a6565640 1 -- 172.21.15.70:0/1149738339 >> 172.21.15.70:0/1149738339 conn(0x7f07a006a890 msgr2=0x7f07a006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:02.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a6565640 1 -- 172.21.15.70:0/1149738339 shutdown_connections 2023-11-26T07:22:02.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a6565640 1 -- 172.21.15.70:0/1149738339 wait complete. 2023-11-26T07:22:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.400+0000 7f07a6565640 1 Processor -- start 2023-11-26T07:22:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 -- start start 2023-11-26T07:22:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0788003b40 0x7f07a014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a015c100 0x7f07a0158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07a0145b70 0x7f07a01585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a014d9d0 con 0x7f07a0145b70 2023-11-26T07:22:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a014dcb0 con 0x7f07a015c100 2023-11-26T07:22:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a014df90 con 0x7f0788003b40 2023-11-26T07:22:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07a0145b70 0x7f07a01585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07a0145b70 0x7f07a01585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46430/0 (socket says 172.21.15.70:46430) 2023-11-26T07:22:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 -- 172.21.15.70:0/600499644 learned_addr learned my addr 172.21.15.70:0/600499644 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f079f7fe640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a015c100 0x7f07a0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f079ffff640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0788003b40 0x7f07a014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 -- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0788003b40 msgr2=0x7f07a014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0788003b40 0x7f07a014d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 -- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a015c100 msgr2=0x7f07a0158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a015c100 0x7f07a0158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 -- 172.21.15.70:0/600499644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a01475c0 con 0x7f07a0145b70 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a4b02640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07a0145b70 0x7f07a01585d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f07a006e880 tx=0x7f079800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f079cff9640 1 -- 172.21.15.70:0/600499644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800e040 con 0x7f07a0145b70 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f079cff9640 1 -- 172.21.15.70:0/600499644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800f040 con 0x7f07a0145b70 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f079cff9640 1 -- 172.21.15.70:0/600499644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798015430 con 0x7f07a0145b70 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a014d6c0 con 0x7f07a0145b70 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a0159cf0 con 0x7f07a0145b70 2023-11-26T07:22:02.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.404+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a014e150 con 0x7f07a0145b70 2023-11-26T07:22:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.408+0000 7f079cff9640 1 -- 172.21.15.70:0/600499644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f0798015590 con 0x7f07a0145b70 2023-11-26T07:22:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.408+0000 7f079cff9640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f078c066a40 0x7f078c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:02.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.408+0000 7f079cff9640 1 -- 172.21.15.70:0/600499644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0798084f20 con 0x7f07a0145b70 2023-11-26T07:22:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.408+0000 7f079ffff640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f078c066a40 0x7f078c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.408+0000 7f079ffff640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f078c066a40 0x7f078c068f00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f07900ac000 tx=0x7f07900a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.412+0000 7f079cff9640 1 -- 172.21.15.70:0/600499644 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0798051b20 con 0x7f07a0145b70 2023-11-26T07:22:02.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.592+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f07a0067680 con 0x7f07a0145b70 2023-11-26T07:22:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.592+0000 7f079cff9640 1 -- 172.21.15.70:0/600499644 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0798055140 con 0x7f07a0145b70 2023-11-26T07:22:02.598 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:22:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f078c066a40 msgr2=0x7f078c068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f078c066a40 0x7f078c068f00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f07900ac000 tx=0x7f07900a6000 comp rx=0 tx=0).stop 2023-11-26T07:22:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07a0145b70 msgr2=0x7f07a01585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07a0145b70 0x7f07a01585d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f07a006e880 tx=0x7f079800f580 comp rx=0 tx=0).stop 2023-11-26T07:22:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 shutdown_connections 2023-11-26T07:22:02.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f078c066a40 0x7f078c068f00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07a0145b70 0x7f07a01585d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07a015c100 0x7f07a0158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 --2- 172.21.15.70:0/600499644 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0788003b40 0x7f07a014d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 >> 172.21.15.70:0/600499644 conn(0x7f07a006a890 msgr2=0x7f07a00afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 shutdown_connections 2023-11-26T07:22:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:02.596+0000 7f07a6565640 1 -- 172.21.15.70:0/600499644 wait complete. 2023-11-26T07:22:02.619 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:22:02.620 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:22:02.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.621 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2023-11-26T07:22:02.631 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:22:02.631 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:22:02.632 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42166sec preferred_lft 42166sec 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:29:fb:62:88 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:22:02.633 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:22:02.634 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:22:02.635 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:22:02.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.635 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:22:02.699 INFO:teuthology.orchestra.run.smithi120.stdout:1 2023-11-26T07:22:02.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.701 DEBUG:teuthology.orchestra.run.smithi120:> route 2023-11-26T07:22:02.753 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:22:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:22:02.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.755 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:22:02.755 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:22:02.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:22:02.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:22:02.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:22:02.755 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:22:02.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.850 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:22:02.859 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:22:02.860 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:22:02.860 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:22:02.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:02.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2023-11-26T07:22:02.927 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-26T07:22:02.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:22:02.928 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:02.982 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:22:02.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:22:02.983 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:03.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:22:03.099 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:22:03.152 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:22:03.153 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:22:03.154 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:22:03.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.155 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:22:03.206 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:22:03.206 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-26T07:22:03.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:22:03.274 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:22:03.324 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:22:03.324 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:22:03.324 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:22:03.324 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:22:03.324 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:22:03.324 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:22:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:22:03.326 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:22:03.327 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:22:03.327 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:22:03.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.328 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:22:03.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:2023-11-26T07:22:03.345+0000 7f05597a0580 -1 init, newargv = 0x55e74aab7290 newargc=15 2023-11-26T07:22:03.347 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44481]: starting ceph client 2023-11-26T07:22:03.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44481]: starting fuse 2023-11-26T07:22:03.357 INFO:teuthology.orchestra.run.smithi120.stdout:43 2023-11-26T07:22:03.357 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:22:03.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> import re 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> import os 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2023-11-26T07:22:03.358 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> return f 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.1")) 2023-11-26T07:22:03.359 DEBUG:teuthology.orchestra.run.smithi120:> ' 2023-11-26T07:22:03.482 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.1.44481.asok 2023-11-26T07:22:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:22:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:22:03.493 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44481.asok 2023-11-26T07:22:03.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.494 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44481.asok status 2023-11-26T07:22:03.666 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-11-26T07:22:03.666 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "1", 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "44481", 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2023-11-26T07:22:03.667 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5705, 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 5705 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 4032376641 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-11-26T07:22:03.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 4032376641 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.5705 192.168.0.1:0/4032376641", 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/4032376641", 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 38, 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 64, 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:22:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2023-11-26T07:22:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2023-11-26T07:22:03.670 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-11-26T07:22:03.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.681 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2023-11-26T07:22:03.681 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:03.691 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2023-11-26T07:22:03.691 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:03.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:03.691 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:03.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:22:03.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.900+0000 7f5b17901640 1 Processor -- start 2023-11-26T07:22:03.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.900+0000 7f5b17901640 1 -- start start 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b17901640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5b10143ac0 0x7f5b10070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b17901640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b17901640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100cfbf0 con 0x7f5b100cf7c0 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b17901640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b10143ea0 con 0x7f5b10143ac0 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b17901640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100cc730 con 0x7f5b100708b0 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b1569d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5b10143ac0 0x7f5b10070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b1569d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5b10143ac0 0x7f5b10070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33570/0 (socket says 172.21.15.70:33570) 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b1569d640 1 -- 172.21.15.70:0/3704517463 learned_addr learned my addr 172.21.15.70:0/3704517463 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b14e9c640 1 --2- 172.21.15.70:0/3704517463 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b1569d640 1 -- 172.21.15.70:0/3704517463 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 msgr2=0x7f5b100cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:03.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b1569d640 1 --2- 172.21.15.70:0/3704517463 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:03.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b1569d640 1 -- 172.21.15.70:0/3704517463 >> v1:172.21.15.120:6789/0 conn(0x7f5b100cf7c0 legacy=0x7f5b100b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:03.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b1569d640 1 -- 172.21.15.70:0/3704517463 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10070ee0 con 0x7f5b10143ac0 2023-11-26T07:22:03.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.904+0000 7f5b14e9c640 1 --2- 172.21.15.70:0/3704517463 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:03.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b1569d640 1 --2- 172.21.15.70:0/3704517463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b10070370 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00bb10 tx=0x7f5b0c01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6070bf5c92855168 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:03.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b07fff640 1 -- 172.21.15.70:0/3704517463 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0a7bf0 con 0x7f5b10143ac0 2023-11-26T07:22:03.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b07fff640 1 -- 172.21.15.70:0/3704517463 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0a7d50 con 0x7f5b10143ac0 2023-11-26T07:22:03.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b07fff640 1 -- 172.21.15.70:0/3704517463 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0af660 con 0x7f5b10143ac0 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 -- 172.21.15.70:0/3704517463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 msgr2=0x7f5b10070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 --2- 172.21.15.70:0/3704517463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b10070370 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00bb10 tx=0x7f5b0c01ec10 comp rx=0 tx=0).stop 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 -- 172.21.15.70:0/3704517463 shutdown_connections 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 --2- 172.21.15.70:0/3704517463 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 --2- 172.21.15.70:0/3704517463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b10070370 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 -- 172.21.15.70:0/3704517463 >> 172.21.15.70:0/3704517463 conn(0x7f5b1006a890 msgr2=0x7f5b1006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 -- 172.21.15.70:0/3704517463 shutdown_connections 2023-11-26T07:22:03.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 -- 172.21.15.70:0/3704517463 wait complete. 2023-11-26T07:22:03.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 Processor -- start 2023-11-26T07:22:03.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.908+0000 7f5b17901640 1 -- start start 2023-11-26T07:22:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:03.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b100cf7c0 0x7f5b1013f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b1013fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1015f5a0 con 0x7f5b10143ac0 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1013ead0 con 0x7f5b100cf7c0 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1013edb0 con 0x7f5b100708b0 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b15e9e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b1013fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b14e9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b100cf7c0 0x7f5b1013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b1569d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b14e9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b100cf7c0 0x7f5b1013f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:34428/0 (socket says 172.21.15.70:34428) 2023-11-26T07:22:03.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b14e9c640 1 -- 172.21.15.70:0/1398417442 learned_addr learned my addr 172.21.15.70:0/1398417442 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b1569d640 1 -- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b100cf7c0 msgr2=0x7f5b1013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b1569d640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b100cf7c0 0x7f5b1013f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:03.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b1569d640 1 -- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 msgr2=0x7f5b1013fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b1569d640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b1013fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b1569d640 1 -- 172.21.15.70:0/1398417442 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c00b770 con 0x7f5b100708b0 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b14e9c640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b100cf7c0 0x7f5b1013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b15e9e640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b1013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b1569d640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100afb60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0ae000 tx=0x7f5b0c01b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b05ffb640 1 -- 172.21.15.70:0/1398417442 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0a7bf0 con 0x7f5b100708b0 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b05ffb640 1 -- 172.21.15.70:0/1398417442 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0ba440 con 0x7f5b100708b0 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b05ffb640 1 -- 172.21.15.70:0/1398417442 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0ba7f0 con 0x7f5b100708b0 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1013f090 con 0x7f5b100708b0 2023-11-26T07:22:03.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100b00a0 con 0x7f5b100708b0 2023-11-26T07:22:03.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10067680 con 0x7f5b100708b0 2023-11-26T07:22:03.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.912+0000 7f5b05ffb640 1 -- 172.21.15.70:0/1398417442 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f5b0c0b93e0 con 0x7f5b100708b0 2023-11-26T07:22:03.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.916+0000 7f5b05ffb640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5af4066a40 0x7f5af4068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:03.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.916+0000 7f5b05ffb640 1 -- 172.21.15.70:0/1398417442 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b0c11ede0 con 0x7f5b100708b0 2023-11-26T07:22:03.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.916+0000 7f5b14e9c640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5af4066a40 0x7f5af4068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:03.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.916+0000 7f5b14e9c640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5af4066a40 0x7f5af4068f00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5b100ccef0 tx=0x7f5b00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:03.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:03.920+0000 7f5b05ffb640 1 -- 172.21.15.70:0/1398417442 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b0c0ebbc0 con 0x7f5b100708b0 2023-11-26T07:22:04.106 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.100+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5b1013ec10 con 0x7f5b100708b0 2023-11-26T07:22:04.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.828+0000 7f5b05ffb640 1 -- 172.21.15.70:0/1398417442 <== mon.2 v2:172.21.15.120:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5b1013ec10 con 0x7f5b100708b0 2023-11-26T07:22:04.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5af4066a40 msgr2=0x7f5af4068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:04.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5af4066a40 0x7f5af4068f00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5b100ccef0 tx=0x7f5b00008040 comp rx=0 tx=0).stop 2023-11-26T07:22:04.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 msgr2=0x7f5b100afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:04.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100afb60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0ae000 tx=0x7f5b0c01b9b0 comp rx=0 tx=0).stop 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 shutdown_connections 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5af4066a40 0x7f5af4068f00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b10143ac0 0x7f5b1013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b100cf7c0 0x7f5b1013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 --2- 172.21.15.70:0/1398417442 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5b100708b0 0x7f5b100afb60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 >> 172.21.15.70:0/1398417442 conn(0x7f5b1006a890 msgr2=0x7f5b100b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 shutdown_connections 2023-11-26T07:22:04.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.832+0000 7f5b17901640 1 -- 172.21.15.70:0/1398417442 wait complete. 2023-11-26T07:22:04.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:22:04.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.992+0000 7fb6af59e640 1 Processor -- start 2023-11-26T07:22:04.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.992+0000 7fb6af59e640 1 -- start start 2023-11-26T07:22:05.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6af59e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6b015e0f0 0x7fb6b00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6af59e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b015e860 con 0x7fb6b00b1e10 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6af59e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b00cdba0 con 0x7fb6b015e0f0 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6af59e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0143bf0 con 0x7fb6b0143810 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6aed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6b015e0f0 0x7fb6b00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6aed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6b015e0f0 0x7fb6b00ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33586/0 (socket says 172.21.15.70:33586) 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6aed9d640 1 -- 172.21.15.70:0/3466742763 learned_addr learned my addr 172.21.15.70:0/3466742763 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:05.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6ae59c640 1 --2- 172.21.15.70:0/3466742763 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6aed9d640 1 -- 172.21.15.70:0/3466742763 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 msgr2=0x7fb6b0072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6aed9d640 1 --2- 172.21.15.70:0/3466742763 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0072140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6aed9d640 1 -- 172.21.15.70:0/3466742763 >> v1:172.21.15.120:6789/0 conn(0x7fb6b00b1e10 legacy=0x7fb6b015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:04.996+0000 7fb6aed9d640 1 -- 172.21.15.70:0/3466742763 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00714f0 con 0x7fb6b015e0f0 2023-11-26T07:22:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6aed9d640 1 --2- 172.21.15.70:0/3466742763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b015e0f0 0x7fb6b00ce030 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009e50 tx=0x7fb6a801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684a3e59235f43f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6ad59a640 1 -- 172.21.15.70:0/3466742763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a58d0 con 0x7fb6b015e0f0 2023-11-26T07:22:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6ad59a640 1 -- 172.21.15.70:0/3466742763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a80a5a30 con 0x7fb6b015e0f0 2023-11-26T07:22:05.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6ad59a640 1 -- 172.21.15.70:0/3466742763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a5dc0 con 0x7fb6b015e0f0 2023-11-26T07:22:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 -- 172.21.15.70:0/3466742763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b015e0f0 msgr2=0x7fb6b00ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 --2- 172.21.15.70:0/3466742763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b015e0f0 0x7fb6b00ce030 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009e50 tx=0x7fb6a801c9e0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 -- 172.21.15.70:0/3466742763 shutdown_connections 2023-11-26T07:22:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 --2- 172.21.15.70:0/3466742763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b015e0f0 0x7fb6b00ce030 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 --2- 172.21.15.70:0/3466742763 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 -- 172.21.15.70:0/3466742763 >> 172.21.15.70:0/3466742763 conn(0x7fb6b006a890 msgr2=0x7fb6b006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:05.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 -- 172.21.15.70:0/3466742763 shutdown_connections 2023-11-26T07:22:05.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 -- 172.21.15.70:0/3466742763 wait complete. 2023-11-26T07:22:05.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 Processor -- start 2023-11-26T07:22:05.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.000+0000 7fb6af59e640 1 -- start start 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b00b1e10 0x7fb6b0165fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6b015e0f0 0x7fb6b01525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b013f500 con 0x7fb6b00b1e10 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0152c00 con 0x7fb6b015e0f0 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0152ee0 con 0x7fb6b0143810 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b00b1e10 0x7fb6b0165fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b00b1e10 0x7fb6b0165fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33600/0 (socket says 172.21.15.70:33600) 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 -- 172.21.15.70:0/1140467466 learned_addr learned my addr 172.21.15.70:0/1140467466 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6aed9d640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6b015e0f0 0x7fb6b01525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6add9b640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 -- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 msgr2=0x7fb6b0152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 -- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6b015e0f0 msgr2=0x7fb6b01525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6b015e0f0 0x7fb6b01525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 -- 172.21.15.70:0/1140467466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8009b30 con 0x7fb6b00b1e10 2023-11-26T07:22:05.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6ae59c640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b00b1e10 0x7fb6b0165fc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000d800 tx=0x7fb6a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb69effd640 1 -- 172.21.15.70:0/1140467466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a000b6c0 con 0x7fb6b00b1e10 2023-11-26T07:22:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb69effd640 1 -- 172.21.15.70:0/1140467466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a000b820 con 0x7fb6b00b1e10 2023-11-26T07:22:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b01531c0 con 0x7fb6b00b1e10 2023-11-26T07:22:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb69effd640 1 -- 172.21.15.70:0/1140467466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a000bb90 con 0x7fb6b00b1e10 2023-11-26T07:22:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b01534a0 con 0x7fb6b00b1e10 2023-11-26T07:22:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.004+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b013f770 con 0x7fb6b00b1e10 2023-11-26T07:22:05.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.008+0000 7fb69effd640 1 -- 172.21.15.70:0/1140467466 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fb6a000bcf0 con 0x7fb6b00b1e10 2023-11-26T07:22:05.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.008+0000 7fb69effd640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb690066a10 0x7fb690068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.008+0000 7fb69effd640 1 -- 172.21.15.70:0/1140467466 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6a0084ca0 con 0x7fb6b00b1e10 2023-11-26T07:22:05.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.008+0000 7fb6add9b640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb690066a10 0x7fb690068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.008+0000 7fb6add9b640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb690066a10 0x7fb690068ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6b013e1c0 tx=0x7fb6a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.012+0000 7fb69effd640 1 -- 172.21.15.70:0/1140467466 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6a00519b0 con 0x7fb6b00b1e10 2023-11-26T07:22:05.186 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.180+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6b0071e10 con 0x7fb690066a10 2023-11-26T07:22:05.187 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb69effd640 1 -- 172.21.15.70:0/1140467466 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb6b0071e10 con 0x7fb690066a10 2023-11-26T07:22:05.187 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:22:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:22:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephfs" 2023-11-26T07:22:05.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:22:05.188 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:22:05.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb690066a10 msgr2=0x7fb690068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb690066a10 0x7fb690068ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6b013e1c0 tx=0x7fb6a4009040 comp rx=0 tx=0).stop 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b00b1e10 msgr2=0x7fb6b0165fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b00b1e10 0x7fb6b0165fc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000d800 tx=0x7fb6a000dcc0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 shutdown_connections 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6b015e0f0 0x7fb6b01525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb6b0143810 0x7fb6b0152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb690066a10 0x7fb690068ed0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 --2- 172.21.15.70:0/1140467466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6b00b1e10 0x7fb6b0165fc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 >> 172.21.15.70:0/1140467466 conn(0x7fb6b006a890 msgr2=0x7fb6b006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 shutdown_connections 2023-11-26T07:22:05.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.184+0000 7fb6af59e640 1 -- 172.21.15.70:0/1140467466 wait complete. 2023-11-26T07:22:05.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:22:05.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.344+0000 7f50bbfdf640 1 Processor -- start 2023-11-26T07:22:05.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.344+0000 7f50bbfdf640 1 -- start start 2023-11-26T07:22:05.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.344+0000 7f50bbfdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b40cd610 0x7f50b4071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.344+0000 7f50bbfdf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f50b4070ba0 0x7f50b4071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.344+0000 7f50bbfdf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b4071eb0 con 0x7f50b41614b0 2023-11-26T07:22:05.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.344+0000 7f50bbfdf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b4071550 con 0x7f50b4070ba0 2023-11-26T07:22:05.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.344+0000 7f50bbfdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b415d970 con 0x7f50b40cd610 2023-11-26T07:22:05.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b9d7b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f50b41614b0 0x7f50b4161890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:51780/0 (socket says 172.21.15.70:51780) 2023-11-26T07:22:05.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b9d7b640 1 -- 172.21.15.70:0/1705012917 learned_addr learned my addr 172.21.15.70:0/1705012917 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50ba57c640 1 --2- 172.21.15.70:0/1705012917 >> v2:172.21.15.70:3300/0 conn(0x7f50b4070ba0 0x7f50b4071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b957a640 1 --2- 172.21.15.70:0/1705012917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b40cd610 0x7f50b4071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b8d79640 1 -- 172.21.15.70:0/1705012917 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40708859 0 0) 0x7f50b4071eb0 con 0x7f50b41614b0 2023-11-26T07:22:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b8d79640 1 -- 172.21.15.70:0/1705012917 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a0003530 con 0x7f50b41614b0 2023-11-26T07:22:05.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50ba57c640 1 -- 172.21.15.70:0/1705012917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b40cd610 msgr2=0x7f50b4071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50ba57c640 1 --2- 172.21.15.70:0/1705012917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b40cd610 0x7f50b4071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50ba57c640 1 -- 172.21.15.70:0/1705012917 >> v1:172.21.15.120:6789/0 conn(0x7f50b41614b0 legacy=0x7f50b4161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50ba57c640 1 -- 172.21.15.70:0/1705012917 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b415dc30 con 0x7f50b4070ba0 2023-11-26T07:22:05.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b957a640 1 --2- 172.21.15.70:0/1705012917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b40cd610 0x7f50b4071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:22:05.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50ba57c640 1 --2- 172.21.15.70:0/1705012917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b4070ba0 0x7f50b4071010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009d90 tx=0x7f50ac01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7062e9b81a3272b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b8d79640 1 -- 172.21.15.70:0/1705012917 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0a5a10 con 0x7f50b4070ba0 2023-11-26T07:22:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b8d79640 1 -- 172.21.15.70:0/1705012917 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac0a5b70 con 0x7f50b4070ba0 2023-11-26T07:22:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.348+0000 7f50b8d79640 1 -- 172.21.15.70:0/1705012917 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0ad440 con 0x7f50b4070ba0 2023-11-26T07:22:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- 172.21.15.70:0/1705012917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b4070ba0 msgr2=0x7f50b4071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/1705012917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b4070ba0 0x7f50b4071010 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009d90 tx=0x7f50ac01c950 comp rx=0 tx=0).stop 2023-11-26T07:22:05.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- 172.21.15.70:0/1705012917 shutdown_connections 2023-11-26T07:22:05.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/1705012917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b4070ba0 0x7f50b4071010 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/1705012917 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b40cd610 0x7f50b4071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- 172.21.15.70:0/1705012917 >> 172.21.15.70:0/1705012917 conn(0x7f50b40cf710 msgr2=0x7f50b40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:05.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- 172.21.15.70:0/1705012917 shutdown_connections 2023-11-26T07:22:05.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- 172.21.15.70:0/1705012917 wait complete. 2023-11-26T07:22:05.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 Processor -- start 2023-11-26T07:22:05.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- start start 2023-11-26T07:22:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b4070ba0 0x7f50b41450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b40cd610 0x7f50b4158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50b41614b0 0x7f50b4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4153d60 con 0x7f50b40cd610 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4154040 con 0x7f50b41614b0 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50bbfdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4154320 con 0x7f50b4070ba0 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b40cd610 0x7f50b4158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b40cd610 0x7f50b4158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33612/0 (socket says 172.21.15.70:33612) 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 -- 172.21.15.70:0/2230674567 learned_addr learned my addr 172.21.15.70:0/2230674567 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50ba57c640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50b41614b0 0x7f50b4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b9d7b640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b4070ba0 0x7f50b41450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 -- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b4070ba0 msgr2=0x7f50b41450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b4070ba0 0x7f50b41450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 -- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50b41614b0 msgr2=0x7f50b4158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50b41614b0 0x7f50b4158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.352+0000 7f50b957a640 1 -- 172.21.15.70:0/2230674567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4009420 con 0x7f50b40cd610 2023-11-26T07:22:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50b957a640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b40cd610 0x7f50b4158600 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f50a400ebe0 tx=0x7f50a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50aa7fc640 1 -- 172.21.15.70:0/2230674567 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a400eee0 con 0x7f50b40cd610 2023-11-26T07:22:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50aa7fc640 1 -- 172.21.15.70:0/2230674567 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a400cc30 con 0x7f50b40cd610 2023-11-26T07:22:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac009a70 con 0x7f50b40cd610 2023-11-26T07:22:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50aa7fc640 1 -- 172.21.15.70:0/2230674567 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4013470 con 0x7f50b40cd610 2023-11-26T07:22:05.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b40b2a10 con 0x7f50b40cd610 2023-11-26T07:22:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b4067680 con 0x7f50b40cd610 2023-11-26T07:22:05.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50aa7fc640 1 -- 172.21.15.70:0/2230674567 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f50a40135d0 con 0x7f50b40cd610 2023-11-26T07:22:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50aa7fc640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5098066a40 0x7f5098068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.356+0000 7f50aa7fc640 1 -- 172.21.15.70:0/2230674567 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50a4084bb0 con 0x7f50b40cd610 2023-11-26T07:22:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.360+0000 7f50b9d7b640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5098066a40 0x7f5098068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.360+0000 7f50b9d7b640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5098066a40 0x7f5098068f00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f50b00011f0 tx=0x7f50b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.360+0000 7f50aa7fc640 1 -- 172.21.15.70:0/2230674567 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50a4051780 con 0x7f50b40cd610 2023-11-26T07:22:05.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f50b4071020 con 0x7f50b40cd610 2023-11-26T07:22:05.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50aa7fc640 1 -- 172.21.15.70:0/2230674567 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f50a4054da0 con 0x7f50b40cd610 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5098066a40 msgr2=0x7f5098068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5098066a40 0x7f5098068f00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f50b00011f0 tx=0x7f50b0009040 comp rx=0 tx=0).stop 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b40cd610 msgr2=0x7f50b4158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b40cd610 0x7f50b4158600 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f50a400ebe0 tx=0x7f50a400c520 comp rx=0 tx=0).stop 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 shutdown_connections 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5098066a40 0x7f5098068f00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50b40cd610 0x7f50b4158600 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50b41614b0 0x7f50b4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 --2- 172.21.15.70:0/2230674567 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f50b4070ba0 0x7f50b41450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 >> 172.21.15.70:0/2230674567 conn(0x7f50b40cf710 msgr2=0x7f50b40b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:05.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 shutdown_connections 2023-11-26T07:22:05.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.512+0000 7f50bbfdf640 1 -- 172.21.15.70:0/2230674567 wait complete. 2023-11-26T07:22:05.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol30380 --mode=777 2023-11-26T07:22:05.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc56ce9f640 1 Processor -- start 2023-11-26T07:22:05.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc56ce9f640 1 -- start start 2023-11-26T07:22:05.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc56ce9f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc56815e0f0 0x7fc5680ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc56ce9f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56815e860 con 0x7fc568143810 2023-11-26T07:22:05.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc56ce9f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680cdba0 con 0x7fc5680b1e10 2023-11-26T07:22:05.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc56ce9f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc568143bf0 con 0x7fc56815e0f0 2023-11-26T07:22:05.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5677fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc568143810 0x7fc568072140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50406/0 (socket says 172.21.15.70:50406) 2023-11-26T07:22:05.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5677fe640 1 -- 172.21.15.70:0/1557510349 learned_addr learned my addr 172.21.15.70:0/1557510349 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:05.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc567fff640 1 --2- 172.21.15.70:0/1557510349 >> v2:172.21.15.120:3300/0 conn(0x7fc56815e0f0 0x7fc5680ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747239237 0 0) 0x7fc56815e860 con 0x7fc568143810 2023-11-26T07:22:05.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc550003530 con 0x7fc568143810 2023-11-26T07:22:05.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821510093 0 0) 0x7fc550003530 con 0x7fc568143810 2023-11-26T07:22:05.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 >> v2:172.21.15.120:3300/0 conn(0x7fc56815e0f0 msgr2=0x7fc5680ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:05.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 --2- 172.21.15.70:0/1557510349 >> v2:172.21.15.120:3300/0 conn(0x7fc56815e0f0 0x7fc5680ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 >> v1:172.21.15.120:6789/0 conn(0x7fc5680b1e10 legacy=0x7fc56815d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680714f0 con 0x7fc568143810 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fc558001680 con 0x7fc568143810 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 >> v1:172.21.15.70:6789/0 conn(0x7fc568143810 legacy=0x7fc568072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc550003980 0x7fc550003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc5500047d0 0x7fc550004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc550005190 0x7fc55000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568143bf0 con 0x7fc550005190 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55000c030 con 0x7fc550003980 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55000c1f0 con 0x7fc5500047d0 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc567fff640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc550005190 0x7fc55000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc5677fe640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc550003980 0x7fc550003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc566ffd640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc5500047d0 0x7fc550004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc567fff640 1 -- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc5500047d0 msgr2=0x7fc550004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:05.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc567fff640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc5500047d0 0x7fc550004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc567fff640 1 -- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc550003980 msgr2=0x7fc550003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:05.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc567fff640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc550003980 0x7fc550003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.676+0000 7fc567fff640 1 -- 172.21.15.70:0/1557510349 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc550003530 con 0x7fc550005190 2023-11-26T07:22:05.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc567fff640 1 -- 172.21.15.70:0/1557510349 reap_dead start 2023-11-26T07:22:05.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc567fff640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc550005190 0x7fc55000b990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc560009fc0 tx=0x7fc56001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418fb154fb490b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600a5cb0 con 0x7fc550005190 2023-11-26T07:22:05.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000f040 con 0x7fc550005190 2023-11-26T07:22:05.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc5667fc640 1 -- 172.21.15.70:0/1557510349 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560003be0 con 0x7fc550005190 2023-11-26T07:22:05.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc56ce9f640 1 -- 172.21.15.70:0/1557510349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc550005190 msgr2=0x7fc55000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc550005190 0x7fc55000b990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc560009fc0 tx=0x7fc56001cca0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc56ce9f640 1 -- 172.21.15.70:0/1557510349 shutdown_connections 2023-11-26T07:22:05.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/1557510349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc550005190 0x7fc55000b990 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc56ce9f640 1 -- 172.21.15.70:0/1557510349 >> 172.21.15.70:0/1557510349 conn(0x7fc56806a890 msgr2=0x7fc56806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:05.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc56ce9f640 1 -- 172.21.15.70:0/1557510349 shutdown_connections 2023-11-26T07:22:05.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.680+0000 7fc56ce9f640 1 -- 172.21.15.70:0/1557510349 wait complete. 2023-11-26T07:22:05.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 Processor -- start 2023-11-26T07:22:05.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 -- start start 2023-11-26T07:22:05.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc550005190 0x7fc568150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc56815cd70 0x7fc568141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5681418a0 0x7fc56813be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568141d50 con 0x7fc56815cd70 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56813bc70 con 0x7fc5681418a0 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568151980 con 0x7fc550005190 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc56815cd70 0x7fc568141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc56815cd70 0x7fc568141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33626/0 (socket says 172.21.15.70:33626) 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 -- 172.21.15.70:0/3890011338 learned_addr learned my addr 172.21.15.70:0/3890011338 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc5677fe640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc550005190 0x7fc568150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc567fff640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5681418a0 0x7fc56813be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 -- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc550005190 msgr2=0x7fc568150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc550005190 0x7fc568150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 -- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5681418a0 msgr2=0x7fc56813be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5681418a0 0x7fc56813be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 -- 172.21.15.70:0/3890011338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568153dc0 con 0x7fc56815cd70 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc567fff640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5681418a0 0x7fc56813be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc566ffd640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc56815cd70 0x7fc568141360 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00f510 tx=0x7fc55c00f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc54ffff640 1 -- 172.21.15.70:0/3890011338 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0052e0 con 0x7fc56815cd70 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc54ffff640 1 -- 172.21.15.70:0/3890011338 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c005440 con 0x7fc56815cd70 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc54ffff640 1 -- 172.21.15.70:0/3890011338 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c003800 con 0x7fc56815cd70 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5681540a0 con 0x7fc56815cd70 2023-11-26T07:22:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.684+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568151c60 con 0x7fc56815cd70 2023-11-26T07:22:05.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.688+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc568067500 con 0x7fc56815cd70 2023-11-26T07:22:05.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.688+0000 7fc54ffff640 1 -- 172.21.15.70:0/3890011338 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7fc55c003960 con 0x7fc56815cd70 2023-11-26T07:22:05.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.688+0000 7fc54ffff640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc554066a40 0x7fc554068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:05.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.688+0000 7fc54ffff640 1 -- 172.21.15.70:0/3890011338 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc55c084660 con 0x7fc56815cd70 2023-11-26T07:22:05.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.688+0000 7fc5677fe640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc554066a40 0x7fc554068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:05.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.688+0000 7fc5677fe640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc554066a40 0x7fc554068f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc5680cd280 tx=0x7fc558000ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:05.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.692+0000 7fc54ffff640 1 -- 172.21.15.70:0/3890011338 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc55c051370 con 0x7fc56815cd70 2023-11-26T07:22:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.868+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol30380", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5680cd520 con 0x7fc554066a40 2023-11-26T07:22:05.878 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:05.872+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:05.878 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:05.872+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:05.878 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:05.872+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:05.878 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:05.872+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:05.878 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:05.872+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc54ffff640 1 -- 172.21.15.70:0/3890011338 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc558007e10 con 0x7fc554066a40 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc554066a40 msgr2=0x7fc554068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc554066a40 0x7fc554068f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc5680cd280 tx=0x7fc558000ee0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc56815cd70 msgr2=0x7fc568141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc56815cd70 0x7fc568141360 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00f510 tx=0x7fc55c00f910 comp rx=0 tx=0).stop 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 shutdown_connections 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc554066a40 0x7fc554068f00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc56815cd70 0x7fc568141360 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5681418a0 0x7fc56813be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 --2- 172.21.15.70:0/3890011338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc550005190 0x7fc568150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:05.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 >> 172.21.15.70:0/3890011338 conn(0x7fc56806a890 msgr2=0x7fc5680aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:05.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 shutdown_connections 2023-11-26T07:22:05.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:05.908+0000 7fc56ce9f640 1 -- 172.21.15.70:0/3890011338 wait complete. 2023-11-26T07:22:05.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol30380 2023-11-26T07:22:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.068+0000 7f1939267640 1 Processor -- start 2023-11-26T07:22:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.068+0000 7f1939267640 1 -- start start 2023-11-26T07:22:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1939267640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1934153b90 0x7f193415a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1939267640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340b1e10 con 0x7f19340b2b40 2023-11-26T07:22:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1939267640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193415ab40 con 0x7f193406d820 2023-11-26T07:22:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1939267640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340b4160 con 0x7f1934153b90 2023-11-26T07:22:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f19337fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f19340b2b40 0x7f193406d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50416/0 (socket says 172.21.15.70:50416) 2023-11-26T07:22:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f19337fe640 1 -- 172.21.15.70:0/2453584901 learned_addr learned my addr 172.21.15.70:0/2453584901 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1933fff640 1 --2- 172.21.15.70:0/2453584901 >> v2:172.21.15.120:3300/0 conn(0x7f1934153b90 0x7f193415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1932ffd640 1 -- 172.21.15.70:0/2453584901 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897370163 0 0) 0x7f19340b1e10 con 0x7f19340b2b40 2023-11-26T07:22:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1932ffd640 1 -- 172.21.15.70:0/2453584901 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f191c003450 con 0x7f19340b2b40 2023-11-26T07:22:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1933fff640 1 -- 172.21.15.70:0/2453584901 >> v1:172.21.15.120:6789/0 conn(0x7f193406d820 legacy=0x7f19340ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1933fff640 1 -- 172.21.15.70:0/2453584901 >> v1:172.21.15.70:6789/0 conn(0x7f19340b2b40 legacy=0x7f193406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.072+0000 7f1933fff640 1 -- 172.21.15.70:0/2453584901 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340cea00 con 0x7f1934153b90 2023-11-26T07:22:06.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1933fff640 1 --2- 172.21.15.70:0/2453584901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1934153b90 0x7f193415a600 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f19240097c0 tx=0x7f192401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80032df2a1a9192 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:06.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1932ffd640 1 -- 172.21.15.70:0/2453584901 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240ac630 con 0x7f1934153b90 2023-11-26T07:22:06.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1932ffd640 1 -- 172.21.15.70:0/2453584901 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19240ac790 con 0x7f1934153b90 2023-11-26T07:22:06.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1932ffd640 1 -- 172.21.15.70:0/2453584901 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240acb20 con 0x7f1934153b90 2023-11-26T07:22:06.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 -- 172.21.15.70:0/2453584901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1934153b90 msgr2=0x7f193415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:06.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 --2- 172.21.15.70:0/2453584901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1934153b90 0x7f193415a600 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f19240097c0 tx=0x7f192401c450 comp rx=0 tx=0).stop 2023-11-26T07:22:06.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 -- 172.21.15.70:0/2453584901 shutdown_connections 2023-11-26T07:22:06.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 --2- 172.21.15.70:0/2453584901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1934153b90 0x7f193415a600 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:06.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 -- 172.21.15.70:0/2453584901 >> 172.21.15.70:0/2453584901 conn(0x7f193406a890 msgr2=0x7f193406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 -- 172.21.15.70:0/2453584901 shutdown_connections 2023-11-26T07:22:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 -- 172.21.15.70:0/2453584901 wait complete. 2023-11-26T07:22:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 Processor -- start 2023-11-26T07:22:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 -- start start 2023-11-26T07:22:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.076+0000 7f1939267640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f193406d820 0x7f19340aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19340b2b40 0x7f19341f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1934153b90 0x7f19340ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19340ad250 con 0x7f19340b2b40 2023-11-26T07:22:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19340ad530 con 0x7f193406d820 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19340ad810 con 0x7f1934153b90 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19340b2b40 0x7f19341f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19340b2b40 0x7f19341f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33652/0 (socket says 172.21.15.70:33652) 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 -- 172.21.15.70:0/781118076 learned_addr learned my addr 172.21.15.70:0/781118076 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1933fff640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f193406d820 0x7f19340aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1938a66640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1934153b90 0x7f19340ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 -- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1934153b90 msgr2=0x7f19340ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1934153b90 0x7f19340ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 -- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f193406d820 msgr2=0x7f19340aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f193406d820 0x7f19340aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 -- 172.21.15.70:0/781118076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009420 con 0x7f19340b2b40 2023-11-26T07:22:06.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f19337fe640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19340b2b40 0x7f19341f5750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f192800c4d0 tx=0x7f192800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1930ff9640 1 -- 172.21.15.70:0/781118076 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928005cf0 con 0x7f19340b2b40 2023-11-26T07:22:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1930ff9640 1 -- 172.21.15.70:0/781118076 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1928005e50 con 0x7f19340b2b40 2023-11-26T07:22:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1930ff9640 1 -- 172.21.15.70:0/781118076 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928007270 con 0x7f19340b2b40 2023-11-26T07:22:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19340adaf0 con 0x7f19340b2b40 2023-11-26T07:22:06.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19341f5c90 con 0x7f19340b2b40 2023-11-26T07:22:06.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934157a80 con 0x7f19340b2b40 2023-11-26T07:22:06.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.080+0000 7f1930ff9640 1 -- 172.21.15.70:0/781118076 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 11) v1 ==== 86362+0+0 (secure 0 0 0) 0x7f19280073d0 con 0x7f19340b2b40 2023-11-26T07:22:06.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.084+0000 7f1930ff9640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1920066a10 0x7f1920068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:06.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.084+0000 7f1930ff9640 1 -- 172.21.15.70:0/781118076 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1928083df0 con 0x7f19340b2b40 2023-11-26T07:22:06.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.084+0000 7f1933fff640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1920066a10 0x7f1920068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.084+0000 7f1933fff640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1920066a10 0x7f1920068ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19240ae000 tx=0x7f1924008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.084+0000 7f1930ff9640 1 -- 172.21.15.70:0/781118076 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1934157a80 con 0x7f19340b2b40 2023-11-26T07:22:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.260+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol30380", "target": ["mon-mgr", ""]}) v1 -- 0x7f1934153f70 con 0x7f1920066a10 2023-11-26T07:22:06.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1930ff9640 1 -- 172.21.15.70:0/781118076 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f19240ac900 con 0x7f1920066a10 2023-11-26T07:22:06.268 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5 2023-11-26T07:22:06.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1920066a10 msgr2=0x7f1920068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1920066a10 0x7f1920068ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19240ae000 tx=0x7f1924008040 comp rx=0 tx=0).stop 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19340b2b40 msgr2=0x7f19341f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19340b2b40 0x7f19341f5750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f192800c4d0 tx=0x7f192800c990 comp rx=0 tx=0).stop 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 shutdown_connections 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1920066a10 0x7f1920068ed0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19340b2b40 0x7f19341f5750 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1934153b90 0x7f19340ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 --2- 172.21.15.70:0/781118076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f193406d820 0x7f19340aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 >> 172.21.15.70:0/781118076 conn(0x7f193406a890 msgr2=0x7f19340cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 shutdown_connections 2023-11-26T07:22:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:06.264+0000 7f1939267640 1 -- 172.21.15.70:0/781118076 wait complete. 2023-11-26T07:22:06.289 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol30380 with 200 files each 1MB size under directory volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5 2023-11-26T07:22:06.289 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:06.290 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.299 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.385 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:06.385 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:06.385 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204624 s, 51.2 MB/s 2023-11-26T07:22:06.386 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:06.386 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.435 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.507 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:06.507 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:06.507 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166259 s, 63.1 MB/s 2023-11-26T07:22:06.508 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:06.508 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.559 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:06.633 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:06.634 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161464 s, 64.9 MB/s 2023-11-26T07:22:06.634 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:06.635 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.687 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.760 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156427 s, 67.0 MB/s 2023-11-26T07:22:06.762 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:06.762 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.811 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:06.886 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:06.886 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:06.887 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173405 s, 60.5 MB/s 2023-11-26T07:22:06.887 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:06.888 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:06.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:06.939 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152007 s, 69.0 MB/s 2023-11-26T07:22:07.014 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.014 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.063 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.138 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.138 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.138 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163558 s, 64.1 MB/s 2023-11-26T07:22:07.139 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.139 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.191 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.269 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161527 s, 64.9 MB/s 2023-11-26T07:22:07.270 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.271 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.324 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.397 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.397 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.397 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161534 s, 64.9 MB/s 2023-11-26T07:22:07.398 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.398 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.447 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.525 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.525 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.525 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016291 s, 64.4 MB/s 2023-11-26T07:22:07.526 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.526 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.579 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.655 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.655 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.655 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138223 s, 75.9 MB/s 2023-11-26T07:22:07.656 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.656 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.711 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.783 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132852 s, 78.9 MB/s 2023-11-26T07:22:07.784 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.784 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.839 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:07.913 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:07.913 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:07.913 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158186 s, 66.3 MB/s 2023-11-26T07:22:07.914 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:07.914 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:07.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:07.963 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.038 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.038 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.038 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172285 s, 60.9 MB/s 2023-11-26T07:22:08.039 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.039 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.091 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150445 s, 69.7 MB/s 2023-11-26T07:22:08.165 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.165 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.215 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143908 s, 72.9 MB/s 2023-11-26T07:22:08.292 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.292 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.347 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.420 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.420 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.420 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014924 s, 70.3 MB/s 2023-11-26T07:22:08.421 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.421 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.471 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.541 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.541 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.541 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121594 s, 86.2 MB/s 2023-11-26T07:22:08.542 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.542 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.595 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.667 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.667 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.667 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144964 s, 72.3 MB/s 2023-11-26T07:22:08.668 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.668 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.719 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158236 s, 66.3 MB/s 2023-11-26T07:22:08.794 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.794 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.843 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:08.917 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:08.917 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:08.917 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016099 s, 65.1 MB/s 2023-11-26T07:22:08.918 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:08.918 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:08.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:08.972 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.045 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162503 s, 64.5 MB/s 2023-11-26T07:22:09.047 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.047 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.103 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.176 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.177 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.177 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154817 s, 67.7 MB/s 2023-11-26T07:22:09.178 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.178 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.228 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.303 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.304 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.304 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141116 s, 74.3 MB/s 2023-11-26T07:22:09.304 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.305 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.359 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.432 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.433 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151777 s, 69.1 MB/s 2023-11-26T07:22:09.433 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.434 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.483 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.553 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.554 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.554 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142776 s, 73.4 MB/s 2023-11-26T07:22:09.555 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.555 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.611 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.686 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.686 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.686 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135532 s, 77.4 MB/s 2023-11-26T07:22:09.687 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.687 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.739 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.814 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129885 s, 80.7 MB/s 2023-11-26T07:22:09.815 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.815 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.868 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:09.937 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:09.938 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127341 s, 82.3 MB/s 2023-11-26T07:22:09.939 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:09.939 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:09.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:09.995 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.075 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.076 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.076 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181501 s, 57.8 MB/s 2023-11-26T07:22:10.077 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.077 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.127 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.200 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.201 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.201 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015229 s, 68.9 MB/s 2023-11-26T07:22:10.201 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.202 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.251 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.327 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145468 s, 72.1 MB/s 2023-11-26T07:22:10.328 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.328 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.379 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.450 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.451 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.451 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133168 s, 78.7 MB/s 2023-11-26T07:22:10.451 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.452 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.503 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.574 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.574 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.574 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133862 s, 78.3 MB/s 2023-11-26T07:22:10.575 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.575 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.631 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.702 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.703 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.703 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138362 s, 75.8 MB/s 2023-11-26T07:22:10.704 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.704 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.755 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146606 s, 71.5 MB/s 2023-11-26T07:22:10.829 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.829 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:10.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:10.879 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:10.952 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:10.952 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:10.952 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153437 s, 68.3 MB/s 2023-11-26T07:22:10.953 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:10.953 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.007 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.082 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.082 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161339 s, 65.0 MB/s 2023-11-26T07:22:11.083 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.083 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.135 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.208 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.208 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146009 s, 71.8 MB/s 2023-11-26T07:22:11.209 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.209 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.263 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.341 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.341 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.341 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153121 s, 68.5 MB/s 2023-11-26T07:22:11.342 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.342 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.391 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.464 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.464 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.464 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153825 s, 68.2 MB/s 2023-11-26T07:22:11.465 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.465 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.515 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.587 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.587 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.587 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146115 s, 71.8 MB/s 2023-11-26T07:22:11.588 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.588 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.639 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144015 s, 72.8 MB/s 2023-11-26T07:22:11.712 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.712 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.763 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.835 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.835 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.835 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126324 s, 83.0 MB/s 2023-11-26T07:22:11.836 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.836 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:11.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:11.888 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:11.960 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139763 s, 75.0 MB/s 2023-11-26T07:22:11.961 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:11.961 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.011 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.082 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.082 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.082 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129732 s, 80.8 MB/s 2023-11-26T07:22:12.083 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.083 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.135 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.208 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.208 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.208 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154518 s, 67.9 MB/s 2023-11-26T07:22:12.209 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.209 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.259 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.331 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.332 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.332 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143098 s, 73.3 MB/s 2023-11-26T07:22:12.333 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.333 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.383 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.460 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152807 s, 68.6 MB/s 2023-11-26T07:22:12.461 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.461 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.515 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01456 s, 72.0 MB/s 2023-11-26T07:22:12.588 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.588 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.639 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150621 s, 69.6 MB/s 2023-11-26T07:22:12.714 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.714 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.763 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.841 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.842 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.842 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144631 s, 72.5 MB/s 2023-11-26T07:22:12.843 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.843 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:12.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:12.899 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:12.977 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:12.977 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:12.977 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155744 s, 67.3 MB/s 2023-11-26T07:22:12.978 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:12.978 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.027 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.103 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.103 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.103 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173691 s, 60.4 MB/s 2023-11-26T07:22:13.104 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.104 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.155 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163078 s, 64.3 MB/s 2023-11-26T07:22:13.230 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.231 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.283 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.358 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.358 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.358 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129167 s, 81.2 MB/s 2023-11-26T07:22:13.359 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.359 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.411 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.484 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.484 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.484 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148697 s, 70.5 MB/s 2023-11-26T07:22:13.485 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.485 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.535 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.608 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146849 s, 71.4 MB/s 2023-11-26T07:22:13.609 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.609 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.663 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01313 s, 79.9 MB/s 2023-11-26T07:22:13.736 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.736 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.787 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178259 s, 58.8 MB/s 2023-11-26T07:22:13.865 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.865 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:13.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:13.915 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145689 s, 72.0 MB/s 2023-11-26T07:22:13.989 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:13.989 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.043 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.120 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:14.120 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:14.120 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143802 s, 72.9 MB/s 2023-11-26T07:22:14.121 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:14.121 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.175 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.249 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:14.249 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:14.249 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162847 s, 64.4 MB/s 2023-11-26T07:22:14.250 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:14.250 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.303 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158764 s, 66.0 MB/s 2023-11-26T07:22:14.378 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:14.378 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.431 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.507 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:14.507 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:14.507 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137494 s, 76.3 MB/s 2023-11-26T07:22:14.508 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:14.508 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.559 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.628 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:14.628 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:14.628 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139038 s, 75.4 MB/s 2023-11-26T07:22:14.629 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:14.629 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.679 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149787 s, 70.0 MB/s 2023-11-26T07:22:14.757 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:14.757 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.811 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:14.883 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:14.883 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:14.883 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136815 s, 76.6 MB/s 2023-11-26T07:22:14.884 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:14.884 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:14.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:14.935 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.006 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.006 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.006 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130654 s, 80.3 MB/s 2023-11-26T07:22:15.007 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.007 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.059 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.134 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.134 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.135 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171355 s, 61.2 MB/s 2023-11-26T07:22:15.136 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.136 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.187 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.262 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.263 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.263 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175048 s, 59.9 MB/s 2023-11-26T07:22:15.264 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.264 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.319 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.392 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.392 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.392 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147493 s, 71.1 MB/s 2023-11-26T07:22:15.393 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.393 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.443 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.516 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.516 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.516 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151713 s, 69.1 MB/s 2023-11-26T07:22:15.517 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.517 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.567 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.640 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148342 s, 70.7 MB/s 2023-11-26T07:22:15.641 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.641 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.695 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.769 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.769 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.769 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123621 s, 84.8 MB/s 2023-11-26T07:22:15.770 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.770 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.820 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:15.899 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:15.899 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:15.899 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016835 s, 62.3 MB/s 2023-11-26T07:22:15.900 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:15.900 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:15.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:15.955 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.034 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.034 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.034 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164103 s, 63.9 MB/s 2023-11-26T07:22:16.035 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.035 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.091 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.169 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.169 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.169 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148246 s, 70.7 MB/s 2023-11-26T07:22:16.170 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.170 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.219 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.296 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.296 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.297 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153418 s, 68.3 MB/s 2023-11-26T07:22:16.297 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.297 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.347 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.419 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.419 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.419 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142077 s, 73.8 MB/s 2023-11-26T07:22:16.420 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.420 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.475 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.549 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.549 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156622 s, 66.9 MB/s 2023-11-26T07:22:16.549 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.550 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.599 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.670 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.671 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.671 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137896 s, 76.0 MB/s 2023-11-26T07:22:16.671 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.672 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.727 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142646 s, 73.5 MB/s 2023-11-26T07:22:16.804 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.804 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.859 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:16.935 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:16.935 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:16.936 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132967 s, 78.9 MB/s 2023-11-26T07:22:16.937 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:16.937 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:16.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:16.987 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170785 s, 61.4 MB/s 2023-11-26T07:22:17.064 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.064 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.115 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.188 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151747 s, 69.1 MB/s 2023-11-26T07:22:17.189 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.189 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.239 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.316 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.316 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147599 s, 71.0 MB/s 2023-11-26T07:22:17.317 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.317 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.367 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133834 s, 78.3 MB/s 2023-11-26T07:22:17.444 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.444 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.499 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149245 s, 70.3 MB/s 2023-11-26T07:22:17.573 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.573 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.623 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159295 s, 65.8 MB/s 2023-11-26T07:22:17.698 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.698 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.747 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.825 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.825 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.825 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154626 s, 67.8 MB/s 2023-11-26T07:22:17.826 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.826 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:17.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:17.880 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:17.953 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150708 s, 69.6 MB/s 2023-11-26T07:22:17.954 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:17.954 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.003 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159478 s, 65.8 MB/s 2023-11-26T07:22:18.083 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.083 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.139 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152085 s, 68.9 MB/s 2023-11-26T07:22:18.214 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.214 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.263 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.340 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.341 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.341 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147179 s, 71.2 MB/s 2023-11-26T07:22:18.342 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.342 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.391 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.461 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127077 s, 82.5 MB/s 2023-11-26T07:22:18.462 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.462 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.515 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.586 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.586 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.587 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135133 s, 77.6 MB/s 2023-11-26T07:22:18.587 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.588 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.639 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137212 s, 76.4 MB/s 2023-11-26T07:22:18.712 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.712 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.767 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.846 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.847 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.847 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156601 s, 67.0 MB/s 2023-11-26T07:22:18.848 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.848 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:18.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:18.903 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165266 s, 63.4 MB/s 2023-11-26T07:22:18.979 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:18.979 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.035 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.114 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.114 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.114 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142845 s, 73.4 MB/s 2023-11-26T07:22:19.114 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.114 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.163 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.238 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.238 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.238 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162351 s, 64.6 MB/s 2023-11-26T07:22:19.239 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.239 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.291 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.365 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153009 s, 68.5 MB/s 2023-11-26T07:22:19.366 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.366 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.419 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.492 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.492 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.492 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137422 s, 76.3 MB/s 2023-11-26T07:22:19.493 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.493 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.547 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.618 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.618 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.618 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151801 s, 69.1 MB/s 2023-11-26T07:22:19.619 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.619 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.671 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124924 s, 83.9 MB/s 2023-11-26T07:22:19.743 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.743 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.795 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.865 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.865 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.865 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122576 s, 85.5 MB/s 2023-11-26T07:22:19.866 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.867 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:19.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:19.919 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:19.996 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:19.996 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:19.996 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153368 s, 68.4 MB/s 2023-11-26T07:22:19.997 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:19.997 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.052 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.125 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:20.125 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015705 s, 66.8 MB/s 2023-11-26T07:22:20.126 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:20.127 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.183 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.261 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:20.261 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:20.262 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163832 s, 64.0 MB/s 2023-11-26T07:22:20.263 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:20.263 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.315 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.393 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:20.393 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:20.393 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153924 s, 68.1 MB/s 2023-11-26T07:22:20.394 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:20.394 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.447 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:20.520 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:20.520 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144371 s, 72.6 MB/s 2023-11-26T07:22:20.521 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:20.521 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.575 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.652 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:20.652 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:20.652 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147567 s, 71.1 MB/s 2023-11-26T07:22:20.653 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:20.653 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.703 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150178 s, 69.8 MB/s 2023-11-26T07:22:20.781 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:20.781 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.835 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:20.912 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:20.912 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:20.912 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137462 s, 76.3 MB/s 2023-11-26T07:22:20.913 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:20.913 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:20.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:20.963 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.040 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.041 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.041 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158222 s, 66.3 MB/s 2023-11-26T07:22:21.042 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.042 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.095 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.171 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.171 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.171 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131392 s, 79.8 MB/s 2023-11-26T07:22:21.172 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.172 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.223 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.296 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.296 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.296 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146995 s, 71.3 MB/s 2023-11-26T07:22:21.297 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.297 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.351 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.423 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.424 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.424 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014391 s, 72.9 MB/s 2023-11-26T07:22:21.425 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.425 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.479 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132394 s, 79.2 MB/s 2023-11-26T07:22:21.551 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.551 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.603 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149617 s, 70.1 MB/s 2023-11-26T07:22:21.677 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.677 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.727 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.800 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.800 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.800 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146604 s, 71.5 MB/s 2023-11-26T07:22:21.801 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.801 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.851 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141843 s, 73.9 MB/s 2023-11-26T07:22:21.925 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:21.925 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:21.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:21.975 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.048 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.048 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.048 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147363 s, 71.2 MB/s 2023-11-26T07:22:22.049 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.049 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.100 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013362 s, 78.5 MB/s 2023-11-26T07:22:22.171 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.171 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.223 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167694 s, 62.5 MB/s 2023-11-26T07:22:22.299 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.299 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.351 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151056 s, 69.4 MB/s 2023-11-26T07:22:22.426 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.426 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.479 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139002 s, 75.4 MB/s 2023-11-26T07:22:22.551 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.551 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.603 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.679 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.680 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.680 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014147 s, 74.1 MB/s 2023-11-26T07:22:22.681 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.681 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.731 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.805 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.806 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.806 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128257 s, 81.8 MB/s 2023-11-26T07:22:22.807 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.807 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.859 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:22.930 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:22.931 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137403 s, 76.3 MB/s 2023-11-26T07:22:22.932 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:22.932 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:22.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:22.987 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.061 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.061 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.061 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158863 s, 66.0 MB/s 2023-11-26T07:22:23.062 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.062 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:23.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:23.115 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156853 s, 66.9 MB/s 2023-11-26T07:22:23.189 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.190 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:23.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:23.239 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.313 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.313 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.313 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162441 s, 64.6 MB/s 2023-11-26T07:22:23.314 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.314 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:23.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:23.371 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137692 s, 76.2 MB/s 2023-11-26T07:22:23.444 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.444 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:23.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:23.495 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.570 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136182 s, 77.0 MB/s 2023-11-26T07:22:23.571 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.571 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:23.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:23.623 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.695 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136282 s, 76.9 MB/s 2023-11-26T07:22:23.696 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.696 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:23.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:23.789 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.821 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.821 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.821 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148131 s, 70.8 MB/s 2023-11-26T07:22:23.822 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.822 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:23.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:23.880 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:23.951 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:23.952 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:23.952 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130593 s, 80.3 MB/s 2023-11-26T07:22:23.953 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:23.953 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.009 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.085 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.085 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.085 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164374 s, 63.8 MB/s 2023-11-26T07:22:24.086 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.086 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.140 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.213 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.213 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.213 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149103 s, 70.3 MB/s 2023-11-26T07:22:24.214 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.215 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.269 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.349 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.349 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155998 s, 67.2 MB/s 2023-11-26T07:22:24.351 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.351 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.404 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.478 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.479 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.479 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151129 s, 69.4 MB/s 2023-11-26T07:22:24.480 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.480 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.534 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.563 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.563 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.563 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156248 s, 67.1 MB/s 2023-11-26T07:22:24.564 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.564 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.625 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.704 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.704 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.704 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160214 s, 65.4 MB/s 2023-11-26T07:22:24.706 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.706 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.757 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136505 s, 76.8 MB/s 2023-11-26T07:22:24.829 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.829 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:24.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:24.884 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:24.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:24.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:24.957 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143286 s, 73.2 MB/s 2023-11-26T07:22:24.958 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:24.958 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.017 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.090 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.091 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151399 s, 69.3 MB/s 2023-11-26T07:22:25.091 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.091 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.144 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.216 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.216 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.216 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148606 s, 70.6 MB/s 2023-11-26T07:22:25.217 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.217 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.268 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.340 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.340 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.341 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153867 s, 68.1 MB/s 2023-11-26T07:22:25.341 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.342 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.395 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.471 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.471 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138244 s, 75.8 MB/s 2023-11-26T07:22:25.472 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.472 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.523 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.596 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.596 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142887 s, 73.4 MB/s 2023-11-26T07:22:25.597 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.597 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.647 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.720 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.720 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.720 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154729 s, 67.8 MB/s 2023-11-26T07:22:25.721 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.721 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.771 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.849 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.849 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.849 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147634 s, 71.0 MB/s 2023-11-26T07:22:25.850 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.850 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:25.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:25.907 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:25.980 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:25.981 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:25.981 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156803 s, 66.9 MB/s 2023-11-26T07:22:25.982 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:25.982 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.031 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.104 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.105 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.105 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015127 s, 69.3 MB/s 2023-11-26T07:22:26.106 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.106 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.155 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.228 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.228 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.228 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151915 s, 69.0 MB/s 2023-11-26T07:22:26.229 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.229 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.279 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.352 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.352 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.352 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144495 s, 72.6 MB/s 2023-11-26T07:22:26.353 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.353 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.403 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144621 s, 72.5 MB/s 2023-11-26T07:22:26.476 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.476 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.527 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.600 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.601 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.601 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144987 s, 72.3 MB/s 2023-11-26T07:22:26.601 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.602 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.651 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.723 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.724 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.724 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014505 s, 72.3 MB/s 2023-11-26T07:22:26.725 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.725 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.775 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.848 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135158 s, 77.6 MB/s 2023-11-26T07:22:26.849 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.849 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:26.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:26.903 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:26.975 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144289 s, 72.7 MB/s 2023-11-26T07:22:26.977 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:26.977 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.027 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161449 s, 64.9 MB/s 2023-11-26T07:22:27.103 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:27.103 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.155 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:27.229 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:27.229 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:27.229 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152727 s, 68.7 MB/s 2023-11-26T07:22:27.230 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:27.230 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.279 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:27.357 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:27.357 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:27.357 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151698 s, 69.1 MB/s 2023-11-26T07:22:27.358 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:27.358 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.415 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:27.493 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:27.493 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:27.493 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155483 s, 67.4 MB/s 2023-11-26T07:22:27.494 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:27.494 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.547 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:27.619 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:27.619 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:27.619 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139223 s, 75.3 MB/s 2023-11-26T07:22:27.620 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:27.620 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.675 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:27.751 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:27.751 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:27.751 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144165 s, 72.7 MB/s 2023-11-26T07:22:27.752 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:27.752 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.803 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:27.879 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:27.879 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:27.879 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139738 s, 75.0 MB/s 2023-11-26T07:22:27.880 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:27.880 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:27.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:27.931 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.003 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.004 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.004 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014147 s, 74.1 MB/s 2023-11-26T07:22:28.005 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.005 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.055 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.129 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.130 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.130 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160315 s, 65.4 MB/s 2023-11-26T07:22:28.130 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.131 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.183 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147473 s, 71.1 MB/s 2023-11-26T07:22:28.257 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.257 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.307 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.382 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.382 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.382 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128715 s, 81.5 MB/s 2023-11-26T07:22:28.383 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.383 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.439 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.520 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176519 s, 59.4 MB/s 2023-11-26T07:22:28.520 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.521 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.575 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.653 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.653 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.653 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152601 s, 68.7 MB/s 2023-11-26T07:22:28.654 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.654 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.707 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.783 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013918 s, 75.3 MB/s 2023-11-26T07:22:28.784 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.784 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.839 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:28.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142765 s, 73.4 MB/s 2023-11-26T07:22:28.917 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:28.918 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:28.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:28.967 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.043 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.043 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.043 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135018 s, 77.7 MB/s 2023-11-26T07:22:29.044 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.044 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.095 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.168 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.168 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.169 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148804 s, 70.5 MB/s 2023-11-26T07:22:29.169 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.170 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.219 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.292 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.292 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.292 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157839 s, 66.4 MB/s 2023-11-26T07:22:29.293 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.293 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.343 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.416 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.416 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.416 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146419 s, 71.6 MB/s 2023-11-26T07:22:29.417 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.417 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.467 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.540 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.540 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.540 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015433 s, 67.9 MB/s 2023-11-26T07:22:29.541 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.541 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.591 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.661 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.661 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.661 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143534 s, 73.1 MB/s 2023-11-26T07:22:29.662 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.662 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:22:29.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:22:29.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.715 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.791 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.791 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.791 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135175 s, 77.6 MB/s 2023-11-26T07:22:29.792 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.793 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.843 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:29.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:29.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:29.916 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147968 s, 70.9 MB/s 2023-11-26T07:22:29.917 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:29.917 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:29.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:29.967 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.040 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148343 s, 70.7 MB/s 2023-11-26T07:22:30.041 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.041 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.091 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.164 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.164 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.164 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140861 s, 74.4 MB/s 2023-11-26T07:22:30.165 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.165 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.215 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.289 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.289 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.289 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016691 s, 62.8 MB/s 2023-11-26T07:22:30.290 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.290 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.347 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.421 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.422 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.422 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163805 s, 64.0 MB/s 2023-11-26T07:22:30.423 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.423 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.479 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.555 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.555 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.555 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137209 s, 76.4 MB/s 2023-11-26T07:22:30.556 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.556 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.607 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135778 s, 77.2 MB/s 2023-11-26T07:22:30.680 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.680 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.731 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.804 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151774 s, 69.1 MB/s 2023-11-26T07:22:30.805 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.806 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.855 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:30.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:30.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:30.927 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129628 s, 80.9 MB/s 2023-11-26T07:22:30.928 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:30.928 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:30.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:30.979 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:31.053 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:31.053 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:31.053 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148403 s, 70.7 MB/s 2023-11-26T07:22:31.054 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:31.054 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:31.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:31.107 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:31.179 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:31.180 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:31.180 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139329 s, 75.3 MB/s 2023-11-26T07:22:31.181 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:31.181 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:31.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:31.231 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136643 s, 76.7 MB/s 2023-11-26T07:22:31.308 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:31.308 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:31.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:31.363 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:31.435 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:31.436 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:31.436 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152193 s, 68.9 MB/s 2023-11-26T07:22:31.437 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:31.437 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:31.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:31.487 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:31.564 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156999 s, 66.8 MB/s 2023-11-26T07:22:31.566 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:31.566 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:31.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:31.615 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol30380/a327d805-3a51-4f7c-b86d-1aae219eccf5/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:22:31.687 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:22:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:22:31.688 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148585 s, 70.6 MB/s 2023-11-26T07:22:31.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol30380 subvol_snap5440 2023-11-26T07:22:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.872+0000 7f122990f640 1 Processor -- start 2023-11-26T07:22:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.872+0000 7f122990f640 1 -- start start 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.872+0000 7f122990f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f12241596d0 0x7f1224071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.872+0000 7f122990f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f12240b2f80 0x7f122406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.872+0000 7f122990f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122406c750 con 0x7f12240ce680 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.872+0000 7f122990f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12240cbe00 con 0x7f12240b2f80 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.872+0000 7f122990f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12240b3550 con 0x7f12241596d0 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f12240b2f80 0x7f122406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f12240b2f80 0x7f122406cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48698/0 (socket says 172.21.15.70:48698) 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 -- 172.21.15.70:0/2450792441 learned_addr learned my addr 172.21.15.70:0/2450792441 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:31.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 -- 172.21.15.70:0/2450792441 >> v2:172.21.15.120:3300/0 conn(0x7f12241596d0 msgr2=0x7f1224071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f1222ffd640 1 --2- 172.21.15.70:0/2450792441 >> v2:172.21.15.120:3300/0 conn(0x7f12241596d0 0x7f1224071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 --2- 172.21.15.70:0/2450792441 >> v2:172.21.15.120:3300/0 conn(0x7f12241596d0 0x7f1224071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 -- 172.21.15.70:0/2450792441 >> v1:172.21.15.120:6789/0 conn(0x7f12240ce680 legacy=0x7f12240b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 -- 172.21.15.70:0/2450792441 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224071e80 con 0x7f12240b2f80 2023-11-26T07:22:31.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f1222ffd640 1 --2- 172.21.15.70:0/2450792441 >> v2:172.21.15.120:3300/0 conn(0x7f12241596d0 0x7f1224071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:31.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12237fe640 1 --2- 172.21.15.70:0/2450792441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122406cbe0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f122406e4d0 tx=0x7f121c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b6b9486fa2047c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:31.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12227fc640 1 -- 172.21.15.70:0/2450792441 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0a56c0 con 0x7f12240b2f80 2023-11-26T07:22:31.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12227fc640 1 -- 172.21.15.70:0/2450792441 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c0a5820 con 0x7f12240b2f80 2023-11-26T07:22:31.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.876+0000 7f12227fc640 1 -- 172.21.15.70:0/2450792441 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0a5bb0 con 0x7f12240b2f80 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- 172.21.15.70:0/2450792441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 msgr2=0x7f122406cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 --2- 172.21.15.70:0/2450792441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122406cbe0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f122406e4d0 tx=0x7f121c01c990 comp rx=0 tx=0).stop 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- 172.21.15.70:0/2450792441 shutdown_connections 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 --2- 172.21.15.70:0/2450792441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122406cbe0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 --2- 172.21.15.70:0/2450792441 >> v2:172.21.15.120:3300/0 conn(0x7f12241596d0 0x7f1224071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- 172.21.15.70:0/2450792441 >> 172.21.15.70:0/2450792441 conn(0x7f122406a890 msgr2=0x7f122406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- 172.21.15.70:0/2450792441 shutdown_connections 2023-11-26T07:22:31.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- 172.21.15.70:0/2450792441 wait complete. 2023-11-26T07:22:31.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 Processor -- start 2023-11-26T07:22:31.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- start start 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122414a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12240ce680 0x7f12240cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f12241596d0 0x7f1224070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122415b630 con 0x7f12240b2f80 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12240cd280 con 0x7f12240ce680 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f122990f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122415a6d0 con 0x7f12241596d0 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f1222ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122414a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f1222ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122414a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48706/0 (socket says 172.21.15.70:48706) 2023-11-26T07:22:31.887 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f1222ffd640 1 -- 172.21.15.70:0/1987006075 learned_addr learned my addr 172.21.15.70:0/1987006075 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f121bfff640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12240ce680 0x7f12240cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.880+0000 7f12237fe640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f12241596d0 0x7f1224070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1222ffd640 1 -- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f12241596d0 msgr2=0x7f1224070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1222ffd640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f12241596d0 0x7f1224070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1222ffd640 1 -- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12240ce680 msgr2=0x7f12240cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1222ffd640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12240ce680 0x7f12240cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1222ffd640 1 -- 172.21.15.70:0/1987006075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c009b30 con 0x7f12240b2f80 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1222ffd640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122414a190 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f121400c7f0 tx=0x7f121400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1220ff9640 1 -- 172.21.15.70:0/1987006075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214007820 con 0x7f12240b2f80 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1220ff9640 1 -- 172.21.15.70:0/1987006075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1214007980 con 0x7f12240b2f80 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1220ff9640 1 -- 172.21.15.70:0/1987006075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214007d30 con 0x7f12240b2f80 2023-11-26T07:22:31.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122415a9b0 con 0x7f12240b2f80 2023-11-26T07:22:31.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122415af70 con 0x7f12240b2f80 2023-11-26T07:22:31.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1224067680 con 0x7f12240b2f80 2023-11-26T07:22:31.889 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1220ff9640 1 -- 172.21.15.70:0/1987006075 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f12140113f0 con 0x7f12240b2f80 2023-11-26T07:22:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1220ff9640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1204066ad0 0x7f1204068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f1220ff9640 1 -- 172.21.15.70:0/1987006075 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1214084d80 con 0x7f12240b2f80 2023-11-26T07:22:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.884+0000 7f121bfff640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1204066ad0 0x7f1204068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:31.890 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.888+0000 7f121bfff640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1204066ad0 0x7f1204068f90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f12240ae050 tx=0x7f120c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:31.894 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:31.888+0000 7f1220ff9640 1 -- 172.21.15.70:0/1987006075 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1214051840 con 0x7f12240b2f80 2023-11-26T07:22:32.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.068+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol30380", "snap_name": "subvol_snap5440", "target": ["mon-mgr", ""]}) v1 -- 0x7f12240709f0 con 0x7f1204066ad0 2023-11-26T07:22:32.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.084+0000 7f1220ff9640 1 -- 172.21.15.70:0/1987006075 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f12240709f0 con 0x7f1204066ad0 2023-11-26T07:22:32.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1204066ad0 msgr2=0x7f1204068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1204066ad0 0x7f1204068f90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f12240ae050 tx=0x7f120c009040 comp rx=0 tx=0).stop 2023-11-26T07:22:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 msgr2=0x7f122414a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122414a190 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f121400c7f0 tx=0x7f121400ccb0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 shutdown_connections 2023-11-26T07:22:32.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f12241596d0 0x7f1224070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12240ce680 0x7f12240cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1204066ad0 0x7f1204068f90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 --2- 172.21.15.70:0/1987006075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12240b2f80 0x7f122414a190 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 >> 172.21.15.70:0/1987006075 conn(0x7f122406a890 msgr2=0x7f1224150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 shutdown_connections 2023-11-26T07:22:32.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.088+0000 7f122990f640 1 -- 172.21.15.70:0/1987006075 wait complete. 2023-11-26T07:22:32.111 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:22:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f4815e5a640 1 Processor -- start 2023-11-26T07:22:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f4815e5a640 1 -- start start 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f4815e5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f48100cf990 0x7f481015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f4815e5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f481015f4e0 0x7f48100cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f4815e5a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481006c520 con 0x7f481013e290 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f4815e5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481006c800 con 0x7f48100cf990 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f4815e5a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481006cae0 con 0x7f481015f4e0 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.248+0000 7f480effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f48100cf990 0x7f481015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f48100cf990 0x7f481015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48720/0 (socket says 172.21.15.70:48720) 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480effd640 1 -- 172.21.15.70:0/2441449781 learned_addr learned my addr 172.21.15.70:0/2441449781 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480ffff640 1 --2- 172.21.15.70:0/2441449781 >> v2:172.21.15.120:3300/0 conn(0x7f481015f4e0 0x7f48100cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480effd640 1 -- 172.21.15.70:0/2441449781 >> v2:172.21.15.120:3300/0 conn(0x7f481015f4e0 msgr2=0x7f48100cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:32.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480effd640 1 --2- 172.21.15.70:0/2441449781 >> v2:172.21.15.120:3300/0 conn(0x7f481015f4e0 0x7f48100cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480effd640 1 -- 172.21.15.70:0/2441449781 >> v1:172.21.15.120:6789/0 conn(0x7f481013e290 legacy=0x7f48100cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480effd640 1 -- 172.21.15.70:0/2441449781 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481006cdc0 con 0x7f48100cf990 2023-11-26T07:22:32.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480effd640 1 --2- 172.21.15.70:0/2441449781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f481015efa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4810155cf0 tx=0x7f480401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70b5c4bd986acfb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480e7fc640 1 -- 172.21.15.70:0/2441449781 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040aa650 con 0x7f48100cf990 2023-11-26T07:22:32.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480e7fc640 1 -- 172.21.15.70:0/2441449781 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48040aa7b0 con 0x7f48100cf990 2023-11-26T07:22:32.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.252+0000 7f480e7fc640 1 -- 172.21.15.70:0/2441449781 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040aab40 con 0x7f48100cf990 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- 172.21.15.70:0/2441449781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 msgr2=0x7f481015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 --2- 172.21.15.70:0/2441449781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f481015efa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4810155cf0 tx=0x7f480401c4d0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- 172.21.15.70:0/2441449781 shutdown_connections 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 --2- 172.21.15.70:0/2441449781 >> v2:172.21.15.120:3300/0 conn(0x7f481015f4e0 0x7f48100cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 --2- 172.21.15.70:0/2441449781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f481015efa0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- 172.21.15.70:0/2441449781 >> 172.21.15.70:0/2441449781 conn(0x7f481006a890 msgr2=0x7f481006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- 172.21.15.70:0/2441449781 shutdown_connections 2023-11-26T07:22:32.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- 172.21.15.70:0/2441449781 wait complete. 2023-11-26T07:22:32.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 Processor -- start 2023-11-26T07:22:32.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- start start 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f4810137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f481013e290 0x7f4810138d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f481015f4e0 0x7f48101351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48101375b0 con 0x7f48100cf990 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48100aed90 con 0x7f481015f4e0 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f4815e5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4810070370 con 0x7f481013e290 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f4810137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f4810137070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48732/0 (socket says 172.21.15.70:48732) 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 -- 172.21.15.70:0/131895188 learned_addr learned my addr 172.21.15.70:0/131895188 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:32.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480ffff640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f481015f4e0 0x7f48101351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480effd640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f481013e290 0x7f4810138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 -- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f481013e290 msgr2=0x7f4810138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f481013e290 0x7f4810138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 -- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f481015f4e0 msgr2=0x7f48101351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f481015f4e0 0x7f48101351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.256+0000 7f480f7fe640 1 -- 172.21.15.70:0/131895188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48040094d0 con 0x7f48100cf990 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f480f7fe640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f4810137070 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f480000c500 tx=0x7f480000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f47f7fff640 1 -- 172.21.15.70:0/131895188 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800005220 con 0x7f48100cf990 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f47f7fff640 1 -- 172.21.15.70:0/131895188 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4800005380 con 0x7f48100cf990 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f47f7fff640 1 -- 172.21.15.70:0/131895188 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800007270 con 0x7f48100cf990 2023-11-26T07:22:32.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4810070650 con 0x7f48100cf990 2023-11-26T07:22:32.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4810070c10 con 0x7f48100cf990 2023-11-26T07:22:32.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4810067680 con 0x7f48100cf990 2023-11-26T07:22:32.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f47f7fff640 1 -- 172.21.15.70:0/131895188 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f48000073d0 con 0x7f48100cf990 2023-11-26T07:22:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f47f7fff640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47fc066aa0 0x7f47fc068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f47f7fff640 1 -- 172.21.15.70:0/131895188 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4800084190 con 0x7f48100cf990 2023-11-26T07:22:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.260+0000 7f480effd640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47fc066aa0 0x7f47fc068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.264+0000 7f480effd640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47fc066aa0 0x7f47fc068f60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f48040ae000 tx=0x7f48040b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.264+0000 7f47f7fff640 1 -- 172.21.15.70:0/131895188 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48000b5280 con 0x7f48100cf990 2023-11-26T07:22:32.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.416+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f481013da50 con 0x7f48100cf990 2023-11-26T07:22:32.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.420+0000 7f47f7fff640 1 -- 172.21.15.70:0/131895188 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v19)=0 v19) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4800050d50 con 0x7f48100cf990 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47fc066aa0 msgr2=0x7f47fc068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47fc066aa0 0x7f47fc068f60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f48040ae000 tx=0x7f48040b5040 comp rx=0 tx=0).stop 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 msgr2=0x7f4810137070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f4810137070 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f480000c500 tx=0x7f480000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 shutdown_connections 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f481015f4e0 0x7f48101351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f481013e290 0x7f4810138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47fc066aa0 0x7f47fc068f60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 --2- 172.21.15.70:0/131895188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48100cf990 0x7f4810137070 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 >> 172.21.15.70:0/131895188 conn(0x7f481006a890 msgr2=0x7f481013c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:32.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 shutdown_connections 2023-11-26T07:22:32.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.424+0000 7f4815e5a640 1 -- 172.21.15.70:0/131895188 wait complete. 2023-11-26T07:22:32.435 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.432+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.436 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.432+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.436 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.432+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.436 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.432+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.436 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.432+0000 7ff293115640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol30380 subvol_snap5440 subvol_clone33170 2023-11-26T07:22:32.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.588+0000 7f24c689c640 1 Processor -- start 2023-11-26T07:22:32.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.588+0000 7f24c689c640 1 -- start start 2023-11-26T07:22:32.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24c689c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f24c00cf990 0x7f24c015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24c689c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c015f4e0 0x7f24c00cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24c689c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c006c520 con 0x7f24c013e290 2023-11-26T07:22:32.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24c689c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c006c800 con 0x7f24c00cf990 2023-11-26T07:22:32.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24c689c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c006cae0 con 0x7f24c015f4e0 2023-11-26T07:22:32.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f24c00cf990 0x7f24c015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f24c00cf990 0x7f24c015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48766/0 (socket says 172.21.15.70:48766) 2023-11-26T07:22:32.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 -- 172.21.15.70:0/890824886 learned_addr learned my addr 172.21.15.70:0/890824886 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:32.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24c4e39640 1 --2- 172.21.15.70:0/890824886 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c015f4e0 0x7f24c00cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 -- 172.21.15.70:0/890824886 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c015f4e0 msgr2=0x7f24c00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:32.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 --2- 172.21.15.70:0/890824886 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c015f4e0 0x7f24c00cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 -- 172.21.15.70:0/890824886 >> v1:172.21.15.120:6789/0 conn(0x7f24c013e290 legacy=0x7f24c00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 -- 172.21.15.70:0/890824886 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c006cdc0 con 0x7f24c00cf990 2023-11-26T07:22:32.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24bf7fe640 1 --2- 172.21.15.70:0/890824886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c00cf990 0x7f24c015efa0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009870 tx=0x7f24b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f23f38fa643dd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.592+0000 7f24beffd640 1 -- 172.21.15.70:0/890824886 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40a95f0 con 0x7f24c00cf990 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24beffd640 1 -- 172.21.15.70:0/890824886 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b40a9750 con 0x7f24c00cf990 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24beffd640 1 -- 172.21.15.70:0/890824886 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b40a9ae0 con 0x7f24c00cf990 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- 172.21.15.70:0/890824886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c00cf990 msgr2=0x7f24c015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 --2- 172.21.15.70:0/890824886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c00cf990 0x7f24c015efa0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009870 tx=0x7f24b401c510 comp rx=0 tx=0).stop 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- 172.21.15.70:0/890824886 shutdown_connections 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 --2- 172.21.15.70:0/890824886 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c015f4e0 0x7f24c00cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 --2- 172.21.15.70:0/890824886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c00cf990 0x7f24c015efa0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- 172.21.15.70:0/890824886 >> 172.21.15.70:0/890824886 conn(0x7f24c006a890 msgr2=0x7f24c006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:32.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- 172.21.15.70:0/890824886 shutdown_connections 2023-11-26T07:22:32.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- 172.21.15.70:0/890824886 wait complete. 2023-11-26T07:22:32.600 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 Processor -- start 2023-11-26T07:22:32.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- start start 2023-11-26T07:22:32.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c00cf990 0x7f24c015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.602 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24c013e290 0x7f24c01564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c015f4e0 0x7f24c0158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c0156a00 con 0x7f24c015f4e0 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c0158660 con 0x7f24c013e290 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c689c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c015cf10 con 0x7f24c00cf990 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c4e39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c015f4e0 0x7f24c0158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.596+0000 7f24c4e39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c015f4e0 0x7f24c0158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48778/0 (socket says 172.21.15.70:48778) 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c4e39640 1 -- 172.21.15.70:0/964929959 learned_addr learned my addr 172.21.15.70:0/964929959 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bffff640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c00cf990 0x7f24c015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.603 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bf7fe640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24c013e290 0x7f24c01564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.604 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c4e39640 1 -- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c00cf990 msgr2=0x7f24c015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c4e39640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c00cf990 0x7f24c015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c4e39640 1 -- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24c013e290 msgr2=0x7f24c01564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c4e39640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24c013e290 0x7f24c01564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c4e39640 1 -- 172.21.15.70:0/964929959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40094d0 con 0x7f24c015f4e0 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c4e39640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c015f4e0 0x7f24c0158120 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f24b8007e40 tx=0x7f24b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bcff9640 1 -- 172.21.15.70:0/964929959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8014620 con 0x7f24c015f4e0 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bcff9640 1 -- 172.21.15.70:0/964929959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800ee90 con 0x7f24c015f4e0 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bcff9640 1 -- 172.21.15.70:0/964929959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80149e0 con 0x7f24c015f4e0 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c015d1f0 con 0x7f24c015f4e0 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c015d7b0 con 0x7f24c015f4e0 2023-11-26T07:22:32.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c0067680 con 0x7f24c015f4e0 2023-11-26T07:22:32.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bcff9640 1 -- 172.21.15.70:0/964929959 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7f24b8014b40 con 0x7f24c015f4e0 2023-11-26T07:22:32.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bcff9640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f24ac066aa0 0x7f24ac068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:32.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.600+0000 7f24bcff9640 1 -- 172.21.15.70:0/964929959 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24b8085210 con 0x7f24c015f4e0 2023-11-26T07:22:32.606 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.604+0000 7f24bffff640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f24ac066aa0 0x7f24ac068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:32.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.604+0000 7f24bffff640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f24ac066aa0 0x7f24ac068f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f24b0007fd0 tx=0x7f24b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:32.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.604+0000 7f24bcff9640 1 -- 172.21.15.70:0/964929959 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24b8051e50 con 0x7f24c015f4e0 2023-11-26T07:22:32.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.784+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol30380", "snap_name": "subvol_snap5440", "target_sub_name": "subvol_clone33170", "target": ["mon-mgr", ""]}) v1 -- 0x7f24c015d080 con 0x7f24ac066aa0 2023-11-26T07:22:32.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24bcff9640 1 -- 172.21.15.70:0/964929959 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f24c015d080 con 0x7f24ac066aa0 2023-11-26T07:22:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f24ac066aa0 msgr2=0x7f24ac068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f24ac066aa0 0x7f24ac068f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f24b0007fd0 tx=0x7f24b0009040 comp rx=0 tx=0).stop 2023-11-26T07:22:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c015f4e0 msgr2=0x7f24c0158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c015f4e0 0x7f24c0158120 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f24b8007e40 tx=0x7f24b800e4b0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 shutdown_connections 2023-11-26T07:22:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f24ac066aa0 0x7f24ac068f60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24c015f4e0 0x7f24c0158120 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24c013e290 0x7f24c01564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 --2- 172.21.15.70:0/964929959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f24c00cf990 0x7f24c015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 >> 172.21.15.70:0/964929959 conn(0x7f24c006a890 msgr2=0x7f24c013a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 shutdown_connections 2023-11-26T07:22:32.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:32.844+0000 7f24c689c640 1 -- 172.21.15.70:0/964929959 wait complete. 2023-11-26T07:22:32.855 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.852+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.855 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.852+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.855 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.852+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.855 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.852+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.855 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.852+0000 7ff29611b640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.872 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.868+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.872 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.868+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.872 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.868+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.872 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.868+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.872 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:32.868+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:32.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone33170 2023-11-26T07:22:33.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0f51c4640 1 Processor -- start 2023-11-26T07:22:33.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0f51c4640 1 -- start start 2023-11-26T07:22:33.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0f51c4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb0f00cf990 0x7fb0f015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0f51c4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f006c520 con 0x7fb0f013e290 2023-11-26T07:22:33.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0f51c4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f006c800 con 0x7fb0f015f4e0 2023-11-26T07:22:33.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0f51c4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f006cae0 con 0x7fb0f00cf990 2023-11-26T07:22:33.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0eed9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb0f013e290 0x7fb0f00cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42548/0 (socket says 172.21.15.70:42548) 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0eed9d640 1 -- 172.21.15.70:0/1064160579 learned_addr learned my addr 172.21.15.70:0/1064160579 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569127342 0 0) 0x7fb0f006c520 con 0x7fb0f013e290 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/1064160579 >> v2:172.21.15.120:3300/0 conn(0x7fb0f00cf990 0x7fb0f015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0dc003530 con 0x7fb0f013e290 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371325581 0 0) 0x7fb0dc003530 con 0x7fb0f013e290 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 >> v2:172.21.15.120:3300/0 conn(0x7fb0f00cf990 msgr2=0x7fb0f015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 --2- 172.21.15.70:0/1064160579 >> v2:172.21.15.120:3300/0 conn(0x7fb0f00cf990 0x7fb0f015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 >> v1:172.21.15.120:6789/0 conn(0x7fb0f015f4e0 legacy=0x7fb0f00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f006cdc0 con 0x7fb0f013e290 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.012+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fb0e0001680 con 0x7fb0f013e290 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 >> v1:172.21.15.70:6789/0 conn(0x7fb0f013e290 legacy=0x7fb0f00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ee59c640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0dc003980 0x7fb0dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ee59c640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ee59c640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0dc005190 0x7fb0dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f006cae0 con 0x7fb0dc005190 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc00c0e0 con 0x7fb0dc003980 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc00c2a0 con 0x7fb0dc0047d0 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ef59e640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0dc005190 0x7fb0dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0eed9d640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0dc003980 0x7fb0dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0e7fff640 1 -- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0dc003980 msgr2=0x7fb0dc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0dc003980 0x7fb0dc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0e7fff640 1 -- 172.21.15.70:0/1064160579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0dc005190 msgr2=0x7fb0dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0dc005190 0x7fb0dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0e7fff640 1 -- 172.21.15.70:0/1064160579 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc003530 con 0x7fb0dc0047d0 2023-11-26T07:22:33.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0ef59e640 1 -- 172.21.15.70:0/1064160579 reap_dead start 2023-11-26T07:22:33.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.016+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0dc004c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800ba30 tx=0x7fb0d801c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9479a44aaa3e00e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:33.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a9660 con 0x7fb0dc0047d0 2023-11-26T07:22:33.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d80a97c0 con 0x7fb0dc0047d0 2023-11-26T07:22:33.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0ee59c640 1 -- 172.21.15.70:0/1064160579 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a9b70 con 0x7fb0dc0047d0 2023-11-26T07:22:33.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 -- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 msgr2=0x7fb0dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0dc004c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800ba30 tx=0x7fb0d801c680 comp rx=0 tx=0).stop 2023-11-26T07:22:33.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 -- 172.21.15.70:0/1064160579 shutdown_connections 2023-11-26T07:22:33.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/1064160579 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0dc004c50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 -- 172.21.15.70:0/1064160579 >> 172.21.15.70:0/1064160579 conn(0x7fb0f006a890 msgr2=0x7fb0f006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:33.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 -- 172.21.15.70:0/1064160579 shutdown_connections 2023-11-26T07:22:33.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 -- 172.21.15.70:0/1064160579 wait complete. 2023-11-26T07:22:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 Processor -- start 2023-11-26T07:22:33.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 -- start start 2023-11-26T07:22:33.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.020+0000 7fb0f51c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0f00a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f0139af0 0x7fb0f0071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0f01548a0 0x7fb0f0159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f00a9630 con 0x7fb0f0139af0 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0070d80 con 0x7fb0f01548a0 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f00a9390 con 0x7fb0dc0047d0 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f0139af0 0x7fb0f0071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f0139af0 0x7fb0f0071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48822/0 (socket says 172.21.15.70:48822) 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3021386636 learned_addr learned my addr 172.21.15.70:0/3021386636 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0eed9d640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0f00a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0ef59e640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0f01548a0 0x7fb0f0159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 msgr2=0x7fb0f00a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0f00a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0f01548a0 msgr2=0x7fb0f0159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0f01548a0 0x7fb0f0159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 -- 172.21.15.70:0/3021386636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f0070f90 con 0x7fb0f0139af0 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e7fff640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f0139af0 0x7fb0f0071d50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb0d801c6c0 tx=0x7fb0dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8004220 con 0x7fb0f0139af0 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8004380 con 0x7fb0f0139af0 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8003840 con 0x7fb0f0139af0 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f0071270 con 0x7fb0f0139af0 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f0071830 con 0x7fb0f0139af0 2023-11-26T07:22:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.024+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f0067680 con 0x7fb0f0139af0 2023-11-26T07:22:33.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.028+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) v1 ==== 86413+0+0 (secure 0 0 0) 0x7fb0d80039a0 con 0x7fb0f0139af0 2023-11-26T07:22:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.028+0000 7fb0e77fe640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0d0066ad0 0x7fb0d0068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.028+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0d811f4b0 con 0x7fb0f0139af0 2023-11-26T07:22:33.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.028+0000 7fb0eed9d640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0d0066ad0 0x7fb0d0068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:33.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.028+0000 7fb0eed9d640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0d0066ad0 0x7fb0d0068f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00011f0 tx=0x7fb0e0000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:33.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.032+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0d80ec060 con 0x7fb0f0139af0 2023-11-26T07:22:33.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:33.208+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone33170", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0f015efa0 con 0x7fb0d0066ad0 2023-11-26T07:22:34.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:34.840+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 13) v1 ==== 86566+0+0 (secure 0 0 0) 0x7fb0d80ec430 con 0x7fb0f0139af0 2023-11-26T07:22:39.605 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.599+0000 7fb0e77fe640 1 -- 172.21.15.70:0/3021386636 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb0e0004c80 con 0x7fb0d0066ad0 2023-11-26T07:22:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0d0066ad0 msgr2=0x7fb0d0068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0d0066ad0 0x7fb0d0068f90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00011f0 tx=0x7fb0e0000bd0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f0139af0 msgr2=0x7fb0f0071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f0139af0 0x7fb0f0071d50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb0d801c6c0 tx=0x7fb0dc005800 comp rx=0 tx=0).stop 2023-11-26T07:22:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 shutdown_connections 2023-11-26T07:22:39.607 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb0d0066ad0 0x7fb0d0068f90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0f0139af0 0x7fb0f0071d50 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0f01548a0 0x7fb0f0159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 --2- 172.21.15.70:0/3021386636 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb0dc0047d0 0x7fb0f00a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 >> 172.21.15.70:0/3021386636 conn(0x7fb0f006a890 msgr2=0x7fb0f00b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 shutdown_connections 2023-11-26T07:22:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.603+0000 7fb0f51c4640 1 -- 172.21.15.70:0/3021386636 wait complete. 2023-11-26T07:22:39.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone33170 2023-11-26T07:22:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f86997f8640 1 Processor -- start 2023-11-26T07:22:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f86997f8640 1 -- start start 2023-11-26T07:22:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f86997f8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8694141660 0x7f86940ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f86997f8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694071d00 0x7f8694072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f86997f8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869415f310 con 0x7f869415ec80 2023-11-26T07:22:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f86997f8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869415fbb0 con 0x7f8694141660 2023-11-26T07:22:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f86997f8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869415f130 con 0x7f8694071d00 2023-11-26T07:22:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.763+0000 7f868a7fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f869415ec80 0x7f8694141f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36446/0 (socket says 172.21.15.70:36446) 2023-11-26T07:22:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f868a7fc640 1 -- 172.21.15.70:0/3645981902 learned_addr learned my addr 172.21.15.70:0/3645981902 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f8692ffd640 1 --2- 172.21.15.70:0/3645981902 >> v2:172.21.15.120:3300/0 conn(0x7f8694141660 0x7f86940ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86937fe640 1 --2- 172.21.15.70:0/3645981902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694071d00 0x7f8694072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86927fc640 1 -- 172.21.15.70:0/3645981902 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766029470 0 0) 0x7f869415f310 con 0x7f869415ec80 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86927fc640 1 -- 172.21.15.70:0/3645981902 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8680003530 con 0x7f869415ec80 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86937fe640 1 -- 172.21.15.70:0/3645981902 >> v2:172.21.15.120:3300/0 conn(0x7f8694141660 msgr2=0x7f86940ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86937fe640 1 --2- 172.21.15.70:0/3645981902 >> v2:172.21.15.120:3300/0 conn(0x7f8694141660 0x7f86940ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86937fe640 1 -- 172.21.15.70:0/3645981902 >> v1:172.21.15.70:6789/0 conn(0x7f869415ec80 legacy=0x7f8694141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86937fe640 1 -- 172.21.15.70:0/3645981902 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869415f5f0 con 0x7f8694071d00 2023-11-26T07:22:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f8692ffd640 1 --2- 172.21.15.70:0/3645981902 >> v2:172.21.15.120:3300/0 conn(0x7f8694141660 0x7f86940ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:22:39.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86937fe640 1 --2- 172.21.15.70:0/3645981902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694071d00 0x7f8694072150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f868c009d90 tx=0x7f868c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9bc08ac68ce99aa server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:39.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86927fc640 1 -- 172.21.15.70:0/3645981902 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0a5900 con 0x7f8694071d00 2023-11-26T07:22:39.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86927fc640 1 -- 172.21.15.70:0/3645981902 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c0a5a60 con 0x7f8694071d00 2023-11-26T07:22:39.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.767+0000 7f86927fc640 1 -- 172.21.15.70:0/3645981902 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0a5df0 con 0x7f8694071d00 2023-11-26T07:22:39.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- 172.21.15.70:0/3645981902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694071d00 msgr2=0x7f8694072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:39.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 --2- 172.21.15.70:0/3645981902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694071d00 0x7f8694072150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f868c009d90 tx=0x7f868c01c950 comp rx=0 tx=0).stop 2023-11-26T07:22:39.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- 172.21.15.70:0/3645981902 shutdown_connections 2023-11-26T07:22:39.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 --2- 172.21.15.70:0/3645981902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694071d00 0x7f8694072150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 --2- 172.21.15.70:0/3645981902 >> v2:172.21.15.120:3300/0 conn(0x7f8694141660 0x7f86940ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- 172.21.15.70:0/3645981902 >> 172.21.15.70:0/3645981902 conn(0x7f869406c3f0 msgr2=0x7f869406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:39.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- 172.21.15.70:0/3645981902 shutdown_connections 2023-11-26T07:22:39.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- 172.21.15.70:0/3645981902 wait complete. 2023-11-26T07:22:39.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 Processor -- start 2023-11-26T07:22:39.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- start start 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8694071d00 0x7f869415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694141660 0x7f86940acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869415ec80 0x7f86941f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869415b230 con 0x7f8694071d00 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940b1ea0 con 0x7f869415ec80 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86997f8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940b2a20 con 0x7f8694141660 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8694071d00 0x7f869415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8694071d00 0x7f869415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59734/0 (socket says 172.21.15.70:59734) 2023-11-26T07:22:39.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 -- 172.21.15.70:0/1574379290 learned_addr learned my addr 172.21.15.70:0/1574379290 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f868a7fc640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694141660 0x7f86940acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f86937fe640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869415ec80 0x7f86941f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 -- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694141660 msgr2=0x7f86940acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694141660 0x7f86940acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 -- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869415ec80 msgr2=0x7f86941f94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869415ec80 0x7f86941f94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.771+0000 7f8692ffd640 1 -- 172.21.15.70:0/1574379290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c009420 con 0x7f8694071d00 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f8692ffd640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8694071d00 0x7f869415acf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ebe0 tx=0x7f867c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f868bfff640 1 -- 172.21.15.70:0/1574379290 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00eee0 con 0x7f8694071d00 2023-11-26T07:22:39.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f868bfff640 1 -- 172.21.15.70:0/1574379290 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c00cc30 con 0x7f8694071d00 2023-11-26T07:22:39.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c009a70 con 0x7f8694071d00 2023-11-26T07:22:39.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f868bfff640 1 -- 172.21.15.70:0/1574379290 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c013470 con 0x7f8694071d00 2023-11-26T07:22:39.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940cd150 con 0x7f8694071d00 2023-11-26T07:22:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8694067500 con 0x7f8694071d00 2023-11-26T07:22:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f868bfff640 1 -- 172.21.15.70:0/1574379290 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) v1 ==== 86566+0+0 (secure 0 0 0) 0x7f867c0135d0 con 0x7f8694071d00 2023-11-26T07:22:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f868bfff640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8674066c80 0x7f8674069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f868bfff640 1 -- 172.21.15.70:0/1574379290 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f867c082770 con 0x7f8694071d00 2023-11-26T07:22:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.775+0000 7f868a7fc640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8674066c80 0x7f8674069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:39.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.779+0000 7f868a7fc640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8674066c80 0x7f8674069140 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f86940ad480 tx=0x7f8684007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:39.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.783+0000 7f868bfff640 1 -- 172.21.15.70:0/1574379290 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f867c0b6280 con 0x7f8694071d00 2023-11-26T07:22:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:39.963+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone33170", "target": ["mon-mgr", ""]}) v1 -- 0x7f86940ccfd0 con 0x7f8674066c80 2023-11-26T07:22:40.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.611+0000 7f868bfff640 1 -- 172.21.15.70:0/1574379290 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+263 (secure 0 0 0) 0x7f8684006b50 con 0x7f8674066c80 2023-11-26T07:22:40.616 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "canceled", 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol30380", 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap5440" 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "failure": { 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "errno": "4", 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: "error_msg": "user interrupted clone operation" 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:22:40.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:22:40.618 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.611+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8674066c80 msgr2=0x7f8674069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.611+0000 7f86997f8640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8674066c80 0x7f8674069140 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f86940ad480 tx=0x7f8684007d40 comp rx=0 tx=0).stop 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.611+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8694071d00 msgr2=0x7f869415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.611+0000 7f86997f8640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8694071d00 0x7f869415acf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ebe0 tx=0x7f867c00c520 comp rx=0 tx=0).stop 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 shutdown_connections 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869415ec80 0x7f86941f94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8694141660 0x7f86940acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8674066c80 0x7f8674069140 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 --2- 172.21.15.70:0/1574379290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8694071d00 0x7f869415acf0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 >> 172.21.15.70:0/1574379290 conn(0x7f869406c3f0 msgr2=0x7f869406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:40.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 shutdown_connections 2023-11-26T07:22:40.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.615+0000 7f86997f8640 1 -- 172.21.15.70:0/1574379290 wait complete. 2023-11-26T07:22:40.637 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone33170 --force 2023-11-26T07:22:40.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0ce79640 1 Processor -- start 2023-11-26T07:22:40.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0ce79640 1 -- start start 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0ce79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a0815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0ce79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0815b2f0 con 0x7f6a0806cd50 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0ce79640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0806c5c0 con 0x7f6a080cf280 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0ce79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0815e1a0 con 0x7f6a08070d10 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0659c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6a080cf280 0x7f6a080cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:50086/0 (socket says 172.21.15.70:50086) 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a0659c640 1 -- 172.21.15.70:0/1435266231 learned_addr learned my addr 172.21.15.70:0/1435266231 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a06d9d640 1 --1- 172.21.15.70:0/1435266231 >> v1:172.21.15.70:6789/0 conn(0x7f6a0806cd50 0x7f6a080b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36454/0 (socket says 172.21.15.70:36454) 2023-11-26T07:22:40.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f69fffff640 1 --2- 172.21.15.70:0/1435266231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a0815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a05d9b640 1 -- 172.21.15.70:0/1435266231 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970031112 0 0) 0x7f6a000014a0 con 0x7f6a0806cd50 2023-11-26T07:22:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a05d9b640 1 -- 172.21.15.70:0/1435266231 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f4003530 con 0x7f6a0806cd50 2023-11-26T07:22:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a05d9b640 1 -- 172.21.15.70:0/1435266231 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871126794 0 0) 0x7f6a0806c5c0 con 0x7f6a080cf280 2023-11-26T07:22:40.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f6a05d9b640 1 -- 172.21.15.70:0/1435266231 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a000014a0 con 0x7f6a080cf280 2023-11-26T07:22:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f69fffff640 1 -- 172.21.15.70:0/1435266231 >> v1:172.21.15.120:6789/0 conn(0x7f6a080cf280 legacy=0x7f6a080cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f69fffff640 1 -- 172.21.15.70:0/1435266231 >> v1:172.21.15.70:6789/0 conn(0x7f6a0806cd50 legacy=0x7f6a080b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.775+0000 7f69fffff640 1 -- 172.21.15.70:0/1435266231 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0815e480 con 0x7f6a08070d10 2023-11-26T07:22:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f69fffff640 1 --2- 172.21.15.70:0/1435266231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a0815d900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097f0 tx=0x7f69f001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd13c2744470ffd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:40.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a05d9b640 1 -- 172.21.15.70:0/1435266231 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00a89b0 con 0x7f6a08070d10 2023-11-26T07:22:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a05d9b640 1 -- 172.21.15.70:0/1435266231 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00a8b10 con 0x7f6a08070d10 2023-11-26T07:22:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a05d9b640 1 -- 172.21.15.70:0/1435266231 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00a8ea0 con 0x7f6a08070d10 2023-11-26T07:22:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1435266231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 msgr2=0x7f6a0815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1435266231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a0815d900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097f0 tx=0x7f69f001ecb0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1435266231 shutdown_connections 2023-11-26T07:22:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1435266231 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a0815d900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1435266231 >> 172.21.15.70:0/1435266231 conn(0x7f6a0806a890 msgr2=0x7f6a0806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1435266231 shutdown_connections 2023-11-26T07:22:40.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.779+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1435266231 wait complete. 2023-11-26T07:22:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 Processor -- start 2023-11-26T07:22:40.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 -- start start 2023-11-26T07:22:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a0806cd50 0x7f6a081e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a081e9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a080cf280 0x7f6a08145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08145f30 con 0x7f6a080cf280 2023-11-26T07:22:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08146210 con 0x7f6a0806cd50 2023-11-26T07:22:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081464f0 con 0x7f6a08070d10 2023-11-26T07:22:40.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a080cf280 0x7f6a08145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a080cf280 0x7f6a08145240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59738/0 (socket says 172.21.15.70:59738) 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 -- 172.21.15.70:0/1237651004 learned_addr learned my addr 172.21.15.70:0/1237651004 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f69fffff640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a081e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0659c640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a0806cd50 0x7f6a081e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 -- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 msgr2=0x7f6a081e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a081e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 -- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a0806cd50 msgr2=0x7f6a081e8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a0806cd50 0x7f6a081e8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 -- 172.21.15.70:0/1237651004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0009420 con 0x7f6a080cf280 2023-11-26T07:22:40.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a06d9d640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a080cf280 0x7f6a08145240 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000ca50 tx=0x7f6a0000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:40.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f69feffd640 1 -- 172.21.15.70:0/1237651004 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000a680 con 0x7f6a080cf280 2023-11-26T07:22:40.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f69feffd640 1 -- 172.21.15.70:0/1237651004 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000a7e0 con 0x7f6a080cf280 2023-11-26T07:22:40.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f69feffd640 1 -- 172.21.15.70:0/1237651004 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000ab70 con 0x7f6a080cf280 2023-11-26T07:22:40.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a081467d0 con 0x7f6a080cf280 2023-11-26T07:22:40.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.783+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a08146fd0 con 0x7f6a080cf280 2023-11-26T07:22:40.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.787+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a08067680 con 0x7f6a080cf280 2023-11-26T07:22:40.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.787+0000 7f69feffd640 1 -- 172.21.15.70:0/1237651004 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) v1 ==== 86566+0+0 (secure 0 0 0) 0x7f6a0000acd0 con 0x7f6a080cf280 2023-11-26T07:22:40.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.787+0000 7f69feffd640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f69e8066c50 0x7f69e8069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:40.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.787+0000 7f69feffd640 1 -- 172.21.15.70:0/1237651004 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a00081d90 con 0x7f6a080cf280 2023-11-26T07:22:40.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.787+0000 7f6a0659c640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f69e8066c50 0x7f69e8069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:40.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.787+0000 7f6a0659c640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f69e8066c50 0x7f69e8069110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f69f8007fd0 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:40.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.791+0000 7f69feffd640 1 -- 172.21.15.70:0/1237651004 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a00050e30 con 0x7f6a080cf280 2023-11-26T07:22:40.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.971+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone33170", "force": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6a080cf660 con 0x7f69e8066c50 2023-11-26T07:22:40.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f69feffd640 1 -- 172.21.15.70:0/1237651004 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6a080cf660 con 0x7f69e8066c50 2023-11-26T07:22:40.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f69e8066c50 msgr2=0x7f69e8069110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f69e8066c50 0x7f69e8069110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f69f8007fd0 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2023-11-26T07:22:40.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a080cf280 msgr2=0x7f6a08145240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a080cf280 0x7f6a08145240 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000ca50 tx=0x7f6a0000cf10 comp rx=0 tx=0).stop 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 shutdown_connections 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f69e8066c50 0x7f69e8069110 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a080cf280 0x7f6a08145240 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6a08070d10 0x7f6a081e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 --2- 172.21.15.70:0/1237651004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a0806cd50 0x7f6a081e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 >> 172.21.15.70:0/1237651004 conn(0x7f6a0806a890 msgr2=0x7f6a080b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 shutdown_connections 2023-11-26T07:22:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:40.983+0000 7f6a0ce79640 1 -- 172.21.15.70:0/1237651004 wait complete. 2023-11-26T07:22:40.999 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:40.995+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:40.999 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:40.995+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:40.999 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:40.995+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:41.000 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:40.995+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:41.000 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:22:40.995+0000 7ff291912640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:22:41.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol30380 subvol_snap5440 2023-11-26T07:22:41.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.151+0000 7f6796da4640 1 Processor -- start 2023-11-26T07:22:41.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.151+0000 7f6796da4640 1 -- start start 2023-11-26T07:22:41.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.151+0000 7f6796da4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160850 0x7f67900d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.151+0000 7f6796da4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900ce290 con 0x7f6790160f60 2023-11-26T07:22:41.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.151+0000 7f6796da4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900ce570 con 0x7f67900cf330 2023-11-26T07:22:41.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.151+0000 7f6796da4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900ce850 con 0x7f6790160850 2023-11-26T07:22:41.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f67965a3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6790160f60 0x7f67900b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36456/0 (socket says 172.21.15.70:36456) 2023-11-26T07:22:41.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f67965a3640 1 -- 172.21.15.70:0/844285704 learned_addr learned my addr 172.21.15.70:0/844285704 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:41.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6795da2640 1 --2- 172.21.15.70:0/844285704 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160850 0x7f67900d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6794da0640 1 -- 172.21.15.70:0/844285704 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004940862 0 0) 0x7f67900ce290 con 0x7f6790160f60 2023-11-26T07:22:41.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6794da0640 1 -- 172.21.15.70:0/844285704 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f677c003530 con 0x7f6790160f60 2023-11-26T07:22:41.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6794da0640 1 -- 172.21.15.70:0/844285704 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342552816 0 0) 0x7f67900ce570 con 0x7f67900cf330 2023-11-26T07:22:41.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6794da0640 1 -- 172.21.15.70:0/844285704 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67900ce290 con 0x7f67900cf330 2023-11-26T07:22:41.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6795da2640 1 -- 172.21.15.70:0/844285704 >> v1:172.21.15.120:6789/0 conn(0x7f67900cf330 legacy=0x7f67900cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6795da2640 1 -- 172.21.15.70:0/844285704 >> v1:172.21.15.70:6789/0 conn(0x7f6790160f60 legacy=0x7f67900b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6795da2640 1 -- 172.21.15.70:0/844285704 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900ceb30 con 0x7f6790160850 2023-11-26T07:22:41.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.155+0000 7f6795da2640 1 --2- 172.21.15.70:0/844285704 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160850 0x7f67900d3d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f678c0097f0 tx=0x7f678c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aabe581dc21f4d5b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6794da0640 1 -- 172.21.15.70:0/844285704 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0aa640 con 0x7f6790160850 2023-11-26T07:22:41.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6794da0640 1 -- 172.21.15.70:0/844285704 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c0aa7a0 con 0x7f6790160850 2023-11-26T07:22:41.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6794da0640 1 -- 172.21.15.70:0/844285704 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0aab30 con 0x7f6790160850 2023-11-26T07:22:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- 172.21.15.70:0/844285704 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160850 msgr2=0x7f67900d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 --2- 172.21.15.70:0/844285704 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160850 0x7f67900d3d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f678c0097f0 tx=0x7f678c01c4c0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- 172.21.15.70:0/844285704 shutdown_connections 2023-11-26T07:22:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 --2- 172.21.15.70:0/844285704 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160850 0x7f67900d3d30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- 172.21.15.70:0/844285704 >> 172.21.15.70:0/844285704 conn(0x7f679009c5a0 msgr2=0x7f67900d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- 172.21.15.70:0/844285704 shutdown_connections 2023-11-26T07:22:41.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- 172.21.15.70:0/844285704 wait complete. 2023-11-26T07:22:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 Processor -- start 2023-11-26T07:22:41.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- start start 2023-11-26T07:22:41.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67900cf330 0x7f6790157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6790160850 0x7f6790158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160f60 0x7f679014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900cca20 con 0x7f6790160850 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900ca6a0 con 0x7f67900cf330 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.159+0000 7f6796da4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900ca980 con 0x7f6790160f60 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6790160850 0x7f6790158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6790160850 0x7f6790158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59764/0 (socket says 172.21.15.70:59764) 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 -- 172.21.15.70:0/3902205312 learned_addr learned my addr 172.21.15.70:0/3902205312 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f6795da2640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67900cf330 0x7f6790157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67965a3640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160f60 0x7f679014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 -- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160f60 msgr2=0x7f679014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160f60 0x7f679014e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 -- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67900cf330 msgr2=0x7f6790157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67900cf330 0x7f6790157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 -- 172.21.15.70:0/3902205312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c009420 con 0x7f6790160850 2023-11-26T07:22:41.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67955a1640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6790160850 0x7f6790158380 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f678000c490 tx=0x7f678000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67867fc640 1 -- 172.21.15.70:0/3902205312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800052d0 con 0x7f6790160850 2023-11-26T07:22:41.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67867fc640 1 -- 172.21.15.70:0/3902205312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780005430 con 0x7f6790160850 2023-11-26T07:22:41.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6790161900 con 0x7f6790160850 2023-11-26T07:22:41.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67867fc640 1 -- 172.21.15.70:0/3902205312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780012870 con 0x7f6790160850 2023-11-26T07:22:41.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67900caf40 con 0x7f6790160850 2023-11-26T07:22:41.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6790067500 con 0x7f6790160850 2023-11-26T07:22:41.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67867fc640 1 -- 172.21.15.70:0/3902205312 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) v1 ==== 86566+0+0 (secure 0 0 0) 0x7f67800129d0 con 0x7f6790160850 2023-11-26T07:22:41.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.163+0000 7f67867fc640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6774066c50 0x7f6774069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.167+0000 7f67867fc640 1 -- 172.21.15.70:0/3902205312 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67800820a0 con 0x7f6790160850 2023-11-26T07:22:41.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.167+0000 7f6795da2640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6774066c50 0x7f6774069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.167+0000 7f6795da2640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6774066c50 0x7f6774069110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f678c0ae000 tx=0x7f678c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.171+0000 7f67867fc640 1 -- 172.21.15.70:0/3902205312 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6780051120 con 0x7f6790160850 2023-11-26T07:22:41.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.347+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol30380", "snap_name": "subvol_snap5440", "target": ["mon-mgr", ""]}) v1 -- 0x7f6790161780 con 0x7f6774066c50 2023-11-26T07:22:41.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.375+0000 7f67867fc640 1 -- 172.21.15.70:0/3902205312 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f678c0aa540 con 0x7f6774066c50 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6774066c50 msgr2=0x7f6774069110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6774066c50 0x7f6774069110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f678c0ae000 tx=0x7f678c0a7000 comp rx=0 tx=0).stop 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6790160850 msgr2=0x7f6790158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6790160850 0x7f6790158380 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f678000c490 tx=0x7f678000c950 comp rx=0 tx=0).stop 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 shutdown_connections 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6774066c50 0x7f6774069110 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6790160850 0x7f6790158380 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6790160f60 0x7f679014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 --2- 172.21.15.70:0/3902205312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67900cf330 0x7f6790157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 >> 172.21.15.70:0/3902205312 conn(0x7f679009c5a0 msgr2=0x7f679006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 shutdown_connections 2023-11-26T07:22:41.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.379+0000 7f6796da4640 1 -- 172.21.15.70:0/3902205312 wait complete. 2023-11-26T07:22:41.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol30380 2023-11-26T07:22:41.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.535+0000 7f5ed1e9a640 1 Processor -- start 2023-11-26T07:22:41.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.535+0000 7f5ed1e9a640 1 -- start start 2023-11-26T07:22:41.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ed1e9a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5ecc0ce7c0 0x7f5ecc15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ed1e9a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc06c520 con 0x7f5ecc13e290 2023-11-26T07:22:41.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ed1e9a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc06c800 con 0x7f5ecc0cf990 2023-11-26T07:22:41.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ed1e9a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc06cae0 con 0x7f5ecc0ce7c0 2023-11-26T07:22:41.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ecb7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5ecc13e290 0x7f5ecc0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:36470/0 (socket says 172.21.15.70:36470) 2023-11-26T07:22:41.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ecb7fe640 1 -- 172.21.15.70:0/2193577139 learned_addr learned my addr 172.21.15.70:0/2193577139 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:41.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ecbfff640 1 --2- 172.21.15.70:0/2193577139 >> v2:172.21.15.70:3300/0 conn(0x7f5ecc0ce7c0 0x7f5ecc15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ecbfff640 1 -- 172.21.15.70:0/2193577139 >> v1:172.21.15.120:6789/0 conn(0x7f5ecc0cf990 legacy=0x7f5ecc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ecbfff640 1 -- 172.21.15.70:0/2193577139 >> v1:172.21.15.70:6789/0 conn(0x7f5ecc13e290 legacy=0x7f5ecc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5eca7fc640 1 -- 172.21.15.70:0/2193577139 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908828636 0 0) 0x7f5ecc06c520 con 0x7f5ecc13e290 2023-11-26T07:22:41.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.539+0000 7f5ecbfff640 1 -- 172.21.15.70:0/2193577139 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc06cdc0 con 0x7f5ecc0ce7c0 2023-11-26T07:22:41.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ecbfff640 1 --2- 172.21.15.70:0/2193577139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ce7c0 0x7f5ecc15f6b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009d90 tx=0x7f5ec401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c370f19b4a4b80d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5eca7fc640 1 -- 172.21.15.70:0/2193577139 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40a5970 con 0x7f5ecc0ce7c0 2023-11-26T07:22:41.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5eca7fc640 1 -- 172.21.15.70:0/2193577139 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40a5ad0 con 0x7f5ecc0ce7c0 2023-11-26T07:22:41.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5eca7fc640 1 -- 172.21.15.70:0/2193577139 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40a5e60 con 0x7f5ecc0ce7c0 2023-11-26T07:22:41.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/2193577139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ce7c0 msgr2=0x7f5ecc15f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/2193577139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ce7c0 0x7f5ecc15f6b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009d90 tx=0x7f5ec401c890 comp rx=0 tx=0).stop 2023-11-26T07:22:41.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/2193577139 shutdown_connections 2023-11-26T07:22:41.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/2193577139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc0ce7c0 0x7f5ecc15f6b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/2193577139 >> 172.21.15.70:0/2193577139 conn(0x7f5ecc06a890 msgr2=0x7f5ecc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/2193577139 shutdown_connections 2023-11-26T07:22:41.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/2193577139 wait complete. 2023-11-26T07:22:41.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 Processor -- start 2023-11-26T07:22:41.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.543+0000 7f5ed1e9a640 1 -- start start 2023-11-26T07:22:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ecc0ce7c0 0x7f5ecc137b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ecc0cf990 0x7f5ecc15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc13e290 0x7f5ecc139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1380d0 con 0x7f5ecc13e290 2023-11-26T07:22:41.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc15c770 con 0x7f5ecc0ce7c0 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc15ca50 con 0x7f5ecc0cf990 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc13e290 0x7f5ecc139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc13e290 0x7f5ecc139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59772/0 (socket says 172.21.15.70:59772) 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 -- 172.21.15.70:0/3402724210 learned_addr learned my addr 172.21.15.70:0/3402724210 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecb7fe640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ecc0ce7c0 0x7f5ecc137b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecaffd640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ecc0cf990 0x7f5ecc15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 -- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ecc0cf990 msgr2=0x7f5ecc15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ecc0cf990 0x7f5ecc15bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 -- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ecc0ce7c0 msgr2=0x7f5ecc137b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ecc0ce7c0 0x7f5ecc137b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 -- 172.21.15.70:0/3402724210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009a70 con 0x7f5ecc13e290 2023-11-26T07:22:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecaffd640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ecc0cf990 0x7f5ecc15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ecbfff640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc13e290 0x7f5ecc139970 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40194a0 tx=0x7f5ec4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.553 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5eb3fff640 1 -- 172.21.15.70:0/3402724210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4003ba0 con 0x7f5ecc13e290 2023-11-26T07:22:41.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5eb3fff640 1 -- 172.21.15.70:0/3402724210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4003d00 con 0x7f5ecc13e290 2023-11-26T07:22:41.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5eb3fff640 1 -- 172.21.15.70:0/3402724210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4004230 con 0x7f5ecc13e290 2023-11-26T07:22:41.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc15cd30 con 0x7f5ecc13e290 2023-11-26T07:22:41.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc1f5d50 con 0x7f5ecc13e290 2023-11-26T07:22:41.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc1f5f40 con 0x7f5ecc13e290 2023-11-26T07:22:41.554 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.547+0000 7f5eb3fff640 1 -- 172.21.15.70:0/3402724210 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) v1 ==== 86566+0+0 (secure 0 0 0) 0x7f5ec40b4050 con 0x7f5ecc13e290 2023-11-26T07:22:41.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.551+0000 7f5eb3fff640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5eb8066c50 0x7f5eb8069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:41.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.551+0000 7f5eb3fff640 1 -- 172.21.15.70:0/3402724210 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ec411da10 con 0x7f5ecc13e290 2023-11-26T07:22:41.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.551+0000 7f5ecb7fe640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5eb8066c50 0x7f5eb8069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:41.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.551+0000 7f5ecb7fe640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5eb8066c50 0x7f5eb8069110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc000f70 tx=0x7f5ebc007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:41.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.555+0000 7f5eb3fff640 1 -- 172.21.15.70:0/3402724210 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ec40ecb50 con 0x7f5ecc13e290 2023-11-26T07:22:41.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.727+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol30380", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ecc13d500 con 0x7f5eb8066c50 2023-11-26T07:22:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.739+0000 7f5eb3fff640 1 -- 172.21.15.70:0/3402724210 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5ecc13d500 con 0x7f5eb8066c50 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5eb8066c50 msgr2=0x7f5eb8069110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5eb8066c50 0x7f5eb8069110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc000f70 tx=0x7f5ebc007240 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc13e290 msgr2=0x7f5ecc139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc13e290 0x7f5ecc139970 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40194a0 tx=0x7f5ec4019630 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 shutdown_connections 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5eb8066c50 0x7f5eb8069110 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ecc13e290 0x7f5ecc139970 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5ecc0cf990 0x7f5ecc15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 --2- 172.21.15.70:0/3402724210 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ecc0ce7c0 0x7f5ecc137b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 >> 172.21.15.70:0/3402724210 conn(0x7f5ecc06a890 msgr2=0x7f5ecc15a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 shutdown_connections 2023-11-26T07:22:41.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:41.743+0000 7f5ed1e9a640 1 -- 172.21.15.70:0/3402724210 wait complete. 2023-11-26T07:22:41.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:41.771 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:22:41.786 INFO:teuthology.orchestra.run.smithi070.stdout:3 2023-11-26T07:22:46.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:46.788 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-26T07:22:46.804 INFO:teuthology.orchestra.run.smithi070.stdout:2 2023-11-26T07:22:46.805 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:22:46.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:22:46.936 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:22:46.997 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:22:46.997 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:46.997 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:47.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:47.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabccd0f640 1 Processor -- start 2023-11-26T07:22:47.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabccd0f640 1 -- start start 2023-11-26T07:22:47.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabccd0f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc8143ac0 0x7fabc8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabccd0f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fabc80cf990 0x7fabc80cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabccd0f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80cc730 con 0x7fabc80708b0 2023-11-26T07:22:47.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabccd0f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc8143ea0 con 0x7fabc80cf990 2023-11-26T07:22:47.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabccd0f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8070ee0 con 0x7fabc8143ac0 2023-11-26T07:22:47.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabbdd9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fabc80708b0 0x7fabc80cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35930/0 (socket says 172.21.15.70:35930) 2023-11-26T07:22:47.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabbdd9b640 1 -- 172.21.15.70:0/1767209301 learned_addr learned my addr 172.21.15.70:0/1767209301 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:47.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc6d9d640 1 --2- 172.21.15.70:0/1767209301 >> v2:172.21.15.70:3300/0 conn(0x7fabc80cf990 0x7fabc80cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc659c640 1 --2- 172.21.15.70:0/1767209301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc8143ac0 0x7fabc8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc5d9b640 1 -- 172.21.15.70:0/1767209301 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750635348 0 0) 0x7fabc80cc730 con 0x7fabc80708b0 2023-11-26T07:22:47.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc5d9b640 1 -- 172.21.15.70:0/1767209301 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb4003530 con 0x7fabc80708b0 2023-11-26T07:22:47.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc6d9d640 1 -- 172.21.15.70:0/1767209301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc8143ac0 msgr2=0x7fabc8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:47.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc6d9d640 1 --2- 172.21.15.70:0/1767209301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc8143ac0 0x7fabc8070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc6d9d640 1 -- 172.21.15.70:0/1767209301 >> v1:172.21.15.70:6789/0 conn(0x7fabc80708b0 legacy=0x7fabc80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.187+0000 7fabc6d9d640 1 -- 172.21.15.70:0/1767209301 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80711c0 con 0x7fabc80cf990 2023-11-26T07:22:47.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabc6d9d640 1 --2- 172.21.15.70:0/1767209301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80cf990 0x7fabc80cd1b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fabc00097c0 tx=0x7fabc001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a536ce12cd5eee0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabc5d9b640 1 -- 172.21.15.70:0/1767209301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00ad640 con 0x7fabc80cf990 2023-11-26T07:22:47.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabc5d9b640 1 -- 172.21.15.70:0/1767209301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc00ad7a0 con 0x7fabc80cf990 2023-11-26T07:22:47.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabc5d9b640 1 -- 172.21.15.70:0/1767209301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00adb30 con 0x7fabc80cf990 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 -- 172.21.15.70:0/1767209301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80cf990 msgr2=0x7fabc80cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 --2- 172.21.15.70:0/1767209301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80cf990 0x7fabc80cd1b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fabc00097c0 tx=0x7fabc001c480 comp rx=0 tx=0).stop 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 -- 172.21.15.70:0/1767209301 shutdown_connections 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 --2- 172.21.15.70:0/1767209301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80cf990 0x7fabc80cd1b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 --2- 172.21.15.70:0/1767209301 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc8143ac0 0x7fabc8070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 -- 172.21.15.70:0/1767209301 >> 172.21.15.70:0/1767209301 conn(0x7fabc806a890 msgr2=0x7fabc806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 -- 172.21.15.70:0/1767209301 shutdown_connections 2023-11-26T07:22:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.191+0000 7fabccd0f640 1 -- 172.21.15.70:0/1767209301 wait complete. 2023-11-26T07:22:47.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 Processor -- start 2023-11-26T07:22:47.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 -- start start 2023-11-26T07:22:47.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80708b0 0x7fabc80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc80cf990 0x7fabc80b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabc8143ac0 0x7fabc8147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8156100 con 0x7fabc80708b0 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b1900 con 0x7fabc8143ac0 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabccd0f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc81557d0 con 0x7fabc80cf990 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80708b0 0x7fabc80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80708b0 0x7fabc80b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50714/0 (socket says 172.21.15.70:50714) 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 -- 172.21.15.70:0/3788417338 learned_addr learned my addr 172.21.15.70:0/3788417338 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabbdd9b640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc80cf990 0x7fabc80b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc6d9d640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabc8143ac0 0x7fabc8147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 -- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc80cf990 msgr2=0x7fabc80b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc80cf990 0x7fabc80b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 -- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabc8143ac0 msgr2=0x7fabc8147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabc8143ac0 0x7fabc8147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 -- 172.21.15.70:0/3788417338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0009420 con 0x7fabc80708b0 2023-11-26T07:22:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc6d9d640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabc8143ac0 0x7fabc8147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabbdd9b640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc80cf990 0x7fabc80b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.195+0000 7fabc659c640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80708b0 0x7fabc80b0a70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009f50 tx=0x7fabb800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbf7fe640 1 -- 172.21.15.70:0/3788417338 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80153f0 con 0x7fabc80708b0 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbf7fe640 1 -- 172.21.15.70:0/3788417338 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8011040 con 0x7fabc80708b0 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbf7fe640 1 -- 172.21.15.70:0/3788417338 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80157b0 con 0x7fabc80708b0 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc8155ab0 con 0x7fabc80708b0 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc8157e90 con 0x7fabc80708b0 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc8067680 con 0x7fabc80708b0 2023-11-26T07:22:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbf7fe640 1 -- 172.21.15.70:0/3788417338 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fabb8015910 con 0x7fabc80708b0 2023-11-26T07:22:47.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbf7fe640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faba8066ce0 0x7faba80691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbf7fe640 1 -- 172.21.15.70:0/3788417338 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fabb8084ee0 con 0x7fabc80708b0 2023-11-26T07:22:47.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbdd9b640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faba8066ce0 0x7faba80691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.199+0000 7fabbdd9b640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faba8066ce0 0x7faba80691a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fabc806aee0 tx=0x7fabb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.203+0000 7fabbf7fe640 1 -- 172.21.15.70:0/3788417338 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabb8053be0 con 0x7fabc80708b0 2023-11-26T07:22:47.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.355+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabc813e120 con 0x7fabc80708b0 2023-11-26T07:22:47.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabbf7fe640 1 -- 172.21.15.70:0/3788417338 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16673 (secure 0 0 0) 0x7fabb8057200 con 0x7fabc80708b0 2023-11-26T07:22:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:47.364 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":65,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:22:44.835078+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faba8066ce0 msgr2=0x7faba80691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faba8066ce0 0x7faba80691a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fabc806aee0 tx=0x7fabb0009040 comp rx=0 tx=0).stop 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80708b0 msgr2=0x7fabc80b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80708b0 0x7fabc80b0a70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009f50 tx=0x7fabb800f4a0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 shutdown_connections 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabc8143ac0 0x7fabc8147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabc80cf990 0x7fabc80b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faba8066ce0 0x7faba80691a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 --2- 172.21.15.70:0/3788417338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabc80708b0 0x7fabc80b0a70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.366 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 >> 172.21.15.70:0/3788417338 conn(0x7fabc806a890 msgr2=0x7fabc8141ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 shutdown_connections 2023-11-26T07:22:47.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.359+0000 7fabccd0f640 1 -- 172.21.15.70:0/3788417338 wait complete. 2023-11-26T07:22:47.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:21:52.577151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:21:53.232441+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:22:47.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:22:47.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.519+0000 7fd8942fe640 1 Processor -- start 2023-11-26T07:22:47.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.519+0000 7fd8942fe640 1 -- start start 2023-11-26T07:22:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd8942fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd8942fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd88c0b2f80 0x7fd88c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd8942fe640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c06c750 con 0x7fd88c0ce680 2023-11-26T07:22:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd8942fe640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c0cbe00 con 0x7fd88c0b2f80 2023-11-26T07:22:47.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd8942fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0b3550 con 0x7fd88c1596d0 2023-11-26T07:22:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89209a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89209a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:36506/0 (socket says 172.21.15.70:36506) 2023-11-26T07:22:47.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89209a640 1 -- 172.21.15.70:0/250929971 learned_addr learned my addr 172.21.15.70:0/250929971 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89289b640 1 --2- 172.21.15.70:0/250929971 >> v2:172.21.15.120:3300/0 conn(0x7fd88c0b2f80 0x7fd88c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89209a640 1 -- 172.21.15.70:0/250929971 >> v2:172.21.15.120:3300/0 conn(0x7fd88c0b2f80 msgr2=0x7fd88c06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89209a640 1 --2- 172.21.15.70:0/250929971 >> v2:172.21.15.120:3300/0 conn(0x7fd88c0b2f80 0x7fd88c06cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89209a640 1 -- 172.21.15.70:0/250929971 >> v1:172.21.15.120:6789/0 conn(0x7fd88c0ce680 legacy=0x7fd88c0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd89209a640 1 -- 172.21.15.70:0/250929971 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c071e80 con 0x7fd88c1596d0 2023-11-26T07:22:47.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.523+0000 7fd891098640 1 -- 172.21.15.70:0/250929971 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426274916 0 0) 0x7fd88c06c750 con 0x7fd88c0ce680 2023-11-26T07:22:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd89209a640 1 --2- 172.21.15.70:0/250929971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c071850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd888009870 tx=0x7fd88801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed718231b879676 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd891098640 1 -- 172.21.15.70:0/250929971 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880ab600 con 0x7fd88c1596d0 2023-11-26T07:22:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd891098640 1 -- 172.21.15.70:0/250929971 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8880a7050 con 0x7fd88c1596d0 2023-11-26T07:22:47.531 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd891098640 1 -- 172.21.15.70:0/250929971 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880ab980 con 0x7fd88c1596d0 2023-11-26T07:22:47.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 -- 172.21.15.70:0/250929971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 msgr2=0x7fd88c071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 --2- 172.21.15.70:0/250929971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c071850 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd888009870 tx=0x7fd88801c540 comp rx=0 tx=0).stop 2023-11-26T07:22:47.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 -- 172.21.15.70:0/250929971 shutdown_connections 2023-11-26T07:22:47.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 --2- 172.21.15.70:0/250929971 >> v2:172.21.15.120:3300/0 conn(0x7fd88c0b2f80 0x7fd88c06cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 --2- 172.21.15.70:0/250929971 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c071850 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 -- 172.21.15.70:0/250929971 >> 172.21.15.70:0/250929971 conn(0x7fd88c06a890 msgr2=0x7fd88c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 -- 172.21.15.70:0/250929971 shutdown_connections 2023-11-26T07:22:47.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 -- 172.21.15.70:0/250929971 wait complete. 2023-11-26T07:22:47.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 Processor -- start 2023-11-26T07:22:47.534 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.527+0000 7fd8942fe640 1 -- start start 2023-11-26T07:22:47.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd88c0b2f80 0x7fd88c0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd88c0ce680 0x7fd88c146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0cd910 con 0x7fd88c0ce680 2023-11-26T07:22:47.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0cc980 con 0x7fd88c0b2f80 2023-11-26T07:22:47.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0afbc0 con 0x7fd88c1596d0 2023-11-26T07:22:47.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd88c0ce680 0x7fd88c146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd88c0ce680 0x7fd88c146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50720/0 (socket says 172.21.15.70:50720) 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 -- 172.21.15.70:0/1782926884 learned_addr learned my addr 172.21.15.70:0/1782926884 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd89209a640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd88c0b2f80 0x7fd88c0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd89289b640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 -- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 msgr2=0x7fd88c146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 -- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd88c0b2f80 msgr2=0x7fd88c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd88c0b2f80 0x7fd88c0cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 -- 172.21.15.70:0/1782926884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880094d0 con 0x7fd88c0ce680 2023-11-26T07:22:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd89209a640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd88c0b2f80 0x7fd88c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd891899640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd88c0ce680 0x7fd88c146560 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c4d0 tx=0x7fd87c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd882ffd640 1 -- 172.21.15.70:0/1782926884 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c005480 con 0x7fd88c0ce680 2023-11-26T07:22:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd882ffd640 1 -- 172.21.15.70:0/1782926884 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c003600 con 0x7fd88c0ce680 2023-11-26T07:22:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c0afea0 con 0x7fd88c0ce680 2023-11-26T07:22:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd882ffd640 1 -- 172.21.15.70:0/1782926884 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0039b0 con 0x7fd88c0ce680 2023-11-26T07:22:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c0cceb0 con 0x7fd88c0ce680 2023-11-26T07:22:47.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.531+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c0cd0a0 con 0x7fd88c0ce680 2023-11-26T07:22:47.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.535+0000 7fd882ffd640 1 -- 172.21.15.70:0/1782926884 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd87c003b10 con 0x7fd88c0ce680 2023-11-26T07:22:47.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.535+0000 7fd882ffd640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd870066ce0 0x7fd8700691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.535+0000 7fd882ffd640 1 -- 172.21.15.70:0/1782926884 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fd87c0846c0 con 0x7fd88c0ce680 2023-11-26T07:22:47.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.535+0000 7fd89209a640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd870066ce0 0x7fd8700691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.535+0000 7fd89209a640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd870066ce0 0x7fd8700691a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd8880ad000 tx=0x7fd8880a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.539+0000 7fd882ffd640 1 -- 172.21.15.70:0/1782926884 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd87c050ca0 con 0x7fd88c0ce680 2023-11-26T07:22:47.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd88c067680 con 0x7fd88c0ce680 2023-11-26T07:22:47.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd882ffd640 1 -- 172.21.15.70:0/1782926884 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd87c017070 con 0x7fd88c0ce680 2023-11-26T07:22:47.692 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:22:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd870066ce0 msgr2=0x7fd8700691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd870066ce0 0x7fd8700691a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd8880ad000 tx=0x7fd8880a6000 comp rx=0 tx=0).stop 2023-11-26T07:22:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd88c0ce680 msgr2=0x7fd88c146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd88c0ce680 0x7fd88c146560 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c4d0 tx=0x7fd87c00c990 comp rx=0 tx=0).stop 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 shutdown_connections 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd870066ce0 0x7fd8700691a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd88c0ce680 0x7fd88c146560 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.687+0000 7fd8942fe640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd88c1596d0 0x7fd88c146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.691+0000 7fd8942fe640 1 --2- 172.21.15.70:0/1782926884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd88c0b2f80 0x7fd88c0cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.691+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 >> 172.21.15.70:0/1782926884 conn(0x7fd88c06a890 msgr2=0x7fd88c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.691+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 shutdown_connections 2023-11-26T07:22:47.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.691+0000 7fd8942fe640 1 -- 172.21.15.70:0/1782926884 wait complete. 2023-11-26T07:22:47.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:22:47.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5d072a640 1 Processor -- start 2023-11-26T07:22:47.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5d072a640 1 -- start start 2023-11-26T07:22:47.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5d072a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa5c80cdd10 0x7fa5c806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5d072a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c80cd610 con 0x7fa5c8161cf0 2023-11-26T07:22:47.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5d072a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c80cd8f0 con 0x7fa5c8070ba0 2023-11-26T07:22:47.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5d072a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c8161210 con 0x7fa5c80cdd10 2023-11-26T07:22:47.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cecc7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa5c80cdd10 0x7fa5c806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cdcc5640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa5c8161cf0 0x7fa5c806d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35944/0 (socket says 172.21.15.70:35944) 2023-11-26T07:22:47.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5ce4c6640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa5c8070ba0 0x7fa5c8070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:46120/0 (socket says 172.21.15.70:46120) 2023-11-26T07:22:47.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cdcc5640 1 -- 172.21.15.70:0/4055097258 learned_addr learned my addr 172.21.15.70:0/4055097258 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:47.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cd4c4640 1 -- 172.21.15.70:0/4055097258 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073892714 0 0) 0x7fa5c80cd610 con 0x7fa5c8161cf0 2023-11-26T07:22:47.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cd4c4640 1 -- 172.21.15.70:0/4055097258 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b4003530 con 0x7fa5c8161cf0 2023-11-26T07:22:47.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cd4c4640 1 -- 172.21.15.70:0/4055097258 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101696890 0 0) 0x7fa5c80cd8f0 con 0x7fa5c8070ba0 2023-11-26T07:22:47.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cecc7640 1 -- 172.21.15.70:0/4055097258 >> v1:172.21.15.120:6789/0 conn(0x7fa5c8070ba0 legacy=0x7fa5c8070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cecc7640 1 -- 172.21.15.70:0/4055097258 >> v1:172.21.15.70:6789/0 conn(0x7fa5c8161cf0 legacy=0x7fa5c806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.851+0000 7fa5cecc7640 1 -- 172.21.15.70:0/4055097258 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c81614f0 con 0x7fa5c80cdd10 2023-11-26T07:22:47.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5cecc7640 1 --2- 172.21.15.70:0/4055097258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c80cdd10 0x7fa5c806bae0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009d90 tx=0x7fa5c001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498e73a0a859dff1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5cd4c4640 1 -- 172.21.15.70:0/4055097258 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00a59f0 con 0x7fa5c80cdd10 2023-11-26T07:22:47.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5cd4c4640 1 -- 172.21.15.70:0/4055097258 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c00a5b50 con 0x7fa5c80cdd10 2023-11-26T07:22:47.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5cd4c4640 1 -- 172.21.15.70:0/4055097258 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00ad440 con 0x7fa5c80cdd10 2023-11-26T07:22:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5d072a640 1 -- 172.21.15.70:0/4055097258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c80cdd10 msgr2=0x7fa5c806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5d072a640 1 --2- 172.21.15.70:0/4055097258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c80cdd10 0x7fa5c806bae0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009d90 tx=0x7fa5c001c950 comp rx=0 tx=0).stop 2023-11-26T07:22:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5d072a640 1 -- 172.21.15.70:0/4055097258 shutdown_connections 2023-11-26T07:22:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5d072a640 1 --2- 172.21.15.70:0/4055097258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c80cdd10 0x7fa5c806bae0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5d072a640 1 -- 172.21.15.70:0/4055097258 >> 172.21.15.70:0/4055097258 conn(0x7fa5c80cf710 msgr2=0x7fa5c80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5d072a640 1 -- 172.21.15.70:0/4055097258 shutdown_connections 2023-11-26T07:22:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.855+0000 7fa5d072a640 1 -- 172.21.15.70:0/4055097258 wait complete. 2023-11-26T07:22:47.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 Processor -- start 2023-11-26T07:22:47.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 -- start start 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c8070ba0 0x7fa5c80b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5c80cdd10 0x7fa5c8154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa5c8161cf0 0x7fa5c8144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b3950 con 0x7fa5c8070ba0 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b2cd0 con 0x7fa5c80cdd10 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80b2fb0 con 0x7fa5c8161cf0 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c8070ba0 0x7fa5c80b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c8070ba0 0x7fa5c80b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50742/0 (socket says 172.21.15.70:50742) 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 -- 172.21.15.70:0/1352171355 learned_addr learned my addr 172.21.15.70:0/1352171355 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5cdcc5640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5c80cdd10 0x7fa5c8154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5cecc7640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa5c8161cf0 0x7fa5c8144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 -- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa5c8161cf0 msgr2=0x7fa5c8144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa5c8161cf0 0x7fa5c8144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 -- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5c80cdd10 msgr2=0x7fa5c8154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5c80cdd10 0x7fa5c8154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 -- 172.21.15.70:0/1352171355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009a70 con 0x7fa5c8070ba0 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5ce4c6640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c8070ba0 0x7fa5c80b23d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40011f0 tx=0x7fa5c400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5beffd640 1 -- 172.21.15.70:0/1352171355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40074e0 con 0x7fa5c8070ba0 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5beffd640 1 -- 172.21.15.70:0/1352171355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c4007640 con 0x7fa5c8070ba0 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5beffd640 1 -- 172.21.15.70:0/1352171355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4004a10 con 0x7fa5c8070ba0 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c80b3290 con 0x7fa5c8070ba0 2023-11-26T07:22:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c80b3d70 con 0x7fa5c8070ba0 2023-11-26T07:22:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.859+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c80b3bc0 con 0x7fa5c8070ba0 2023-11-26T07:22:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.863+0000 7fa5beffd640 1 -- 172.21.15.70:0/1352171355 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fa5c4004b70 con 0x7fa5c8070ba0 2023-11-26T07:22:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.863+0000 7fa5beffd640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5ac066ce0 0x7fa5ac0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.863+0000 7fa5beffd640 1 -- 172.21.15.70:0/1352171355 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fa5c4081bc0 con 0x7fa5c8070ba0 2023-11-26T07:22:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.863+0000 7fa5cdcc5640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5ac066ce0 0x7fa5ac0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.863+0000 7fa5cdcc5640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5ac066ce0 0x7fa5ac0691a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa5c81f95c0 tx=0x7fa5b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:47.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:47.867+0000 7fa5beffd640 1 -- 172.21.15.70:0/1352171355 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5c4050900 con 0x7fa5c8070ba0 2023-11-26T07:22:48.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5c80ce260 con 0x7fa5c8070ba0 2023-11-26T07:22:48.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5beffd640 1 -- 172.21.15.70:0/1352171355 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5c4053f20 con 0x7fa5c8070ba0 2023-11-26T07:22:48.024 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:22:48.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5ac066ce0 msgr2=0x7fa5ac0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5ac066ce0 0x7fa5ac0691a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa5c81f95c0 tx=0x7fa5b8009040 comp rx=0 tx=0).stop 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c8070ba0 msgr2=0x7fa5c80b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c8070ba0 0x7fa5c80b23d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40011f0 tx=0x7fa5c400c9b0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 shutdown_connections 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa5c8161cf0 0x7fa5c8144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5c80cdd10 0x7fa5c8154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa5ac066ce0 0x7fa5ac0691a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 --2- 172.21.15.70:0/1352171355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa5c8070ba0 0x7fa5c80b23d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 >> 172.21.15.70:0/1352171355 conn(0x7fa5c80cf710 msgr2=0x7fa5c80cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 shutdown_connections 2023-11-26T07:22:48.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.019+0000 7fa5d072a640 1 -- 172.21.15.70:0/1352171355 wait complete. 2023-11-26T07:22:48.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:22:48.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.179+0000 7fd49a1d0640 1 Processor -- start 2023-11-26T07:22:48.185 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.179+0000 7fd49a1d0640 1 -- start start 2023-11-26T07:22:48.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd49a1d0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd4940b1860 0x7fd4940d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd49a1d0640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 0x7fd4940ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd49a1d0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4940d3d20 con 0x7fd4940cfa70 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd49a1d0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940d4000 con 0x7fd4940b1860 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd49a1d0640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940afd70 con 0x7fd4940cdd20 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd4940cfa70 0x7fd4940cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35948/0 (socket says 172.21.15.70:35948) 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 -- 172.21.15.70:0/3818838417 learned_addr learned my addr 172.21.15.70:0/3818838417 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4999cf640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 0x7fd4940ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4989cd640 1 --2- 172.21.15.70:0/3818838417 >> v2:172.21.15.120:3300/0 conn(0x7fd4940b1860 0x7fd4940d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731326590 0 0) 0x7fd4940d3d20 con 0x7fd4940cfa70 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd480003530 con 0x7fd4940cfa70 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303988971 0 0) 0x7fd480003530 con 0x7fd4940cfa70 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 msgr2=0x7fd4940ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 0x7fd4940ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 >> v2:172.21.15.120:3300/0 conn(0x7fd4940b1860 msgr2=0x7fd4940d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 --2- 172.21.15.70:0/3818838417 >> v2:172.21.15.120:3300/0 conn(0x7fd4940b1860 0x7fd4940d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940b0050 con 0x7fd4940cfa70 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fd490001680 con 0x7fd4940cfa70 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 >> v1:172.21.15.70:6789/0 conn(0x7fd4940cfa70 legacy=0x7fd4940cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd480003980 0x7fd480003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4800047d0 0x7fd480004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 0x7fd480005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940d4000 con 0x7fd480003980 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940afd70 con 0x7fd4800047d0 2023-11-26T07:22:48.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48000b990 con 0x7fd4940cdd20 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd480003980 0x7fd480003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4989cd640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4800047d0 0x7fd480004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4999cf640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 0x7fd480005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 -- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 msgr2=0x7fd480005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4940cdd20 0x7fd480005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 -- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4800047d0 msgr2=0x7fd480004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4800047d0 0x7fd480004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.183+0000 7fd4991ce640 1 -- 172.21.15.70:0/3818838417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480003530 con 0x7fd480003980 2023-11-26T07:22:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd4991ce640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd480003980 0x7fd480003da0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c240 tx=0x7fd49001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb35b7549a5a4acb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4900058e0 con 0x7fd480003980 2023-11-26T07:22:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490005a40 con 0x7fd480003980 2023-11-26T07:22:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd48bfff640 1 -- 172.21.15.70:0/3818838417 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490005e10 con 0x7fd480003980 2023-11-26T07:22:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd49a1d0640 1 -- 172.21.15.70:0/3818838417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd480003980 msgr2=0x7fd480003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd49a1d0640 1 --2- 172.21.15.70:0/3818838417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd480003980 0x7fd480003da0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c240 tx=0x7fd49001cc30 comp rx=0 tx=0).stop 2023-11-26T07:22:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd4999cf640 1 -- 172.21.15.70:0/3818838417 reap_dead start 2023-11-26T07:22:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd49a1d0640 1 -- 172.21.15.70:0/3818838417 shutdown_connections 2023-11-26T07:22:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd49a1d0640 1 -- 172.21.15.70:0/3818838417 >> 172.21.15.70:0/3818838417 conn(0x7fd4940d3060 msgr2=0x7fd4940d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd49a1d0640 1 -- 172.21.15.70:0/3818838417 shutdown_connections 2023-11-26T07:22:48.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd49a1d0640 1 -- 172.21.15.70:0/3818838417 wait complete. 2023-11-26T07:22:48.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.187+0000 7fd49a1d0640 1 Processor -- start 2023-11-26T07:22:48.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 -- start start 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd49415a440 0x7fd4940b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4940b51b0 0x7fd49415af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd49415b460 0x7fd4940b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49415b8e0 con 0x7fd49415b460 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941f6810 con 0x7fd4940b51b0 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941f6af0 con 0x7fd49415a440 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd49415b460 0x7fd4940b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd49415b460 0x7fd4940b6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50750/0 (socket says 172.21.15.70:50750) 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 -- 172.21.15.70:0/951792837 learned_addr learned my addr 172.21.15.70:0/951792837 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4991ce640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd49415a440 0x7fd4940b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4989cd640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4940b51b0 0x7fd49415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 -- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd49415a440 msgr2=0x7fd4940b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd49415a440 0x7fd4940b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 -- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4940b51b0 msgr2=0x7fd49415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4940b51b0 0x7fd49415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 -- 172.21.15.70:0/951792837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4941f6dd0 con 0x7fd49415b460 2023-11-26T07:22:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd4999cf640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd49415b460 0x7fd4940b6950 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd49408d7d0 tx=0x7fd48c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd489ffb640 1 -- 172.21.15.70:0/951792837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00e070 con 0x7fd49415b460 2023-11-26T07:22:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd489ffb640 1 -- 172.21.15.70:0/951792837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c011ed0 con 0x7fd49415b460 2023-11-26T07:22:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4941f70b0 con 0x7fd49415b460 2023-11-26T07:22:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd489ffb640 1 -- 172.21.15.70:0/951792837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0039a0 con 0x7fd49415b460 2023-11-26T07:22:48.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4941f63d0 con 0x7fd49415b460 2023-11-26T07:22:48.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.191+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd494067500 con 0x7fd49415b460 2023-11-26T07:22:48.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.195+0000 7fd489ffb640 1 -- 172.21.15.70:0/951792837 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd48c003b00 con 0x7fd49415b460 2023-11-26T07:22:48.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.195+0000 7fd489ffb640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd478066ce0 0x7fd4780691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.195+0000 7fd489ffb640 1 -- 172.21.15.70:0/951792837 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5765+0+0 (secure 0 0 0) 0x7fd48c082e30 con 0x7fd49415b460 2023-11-26T07:22:48.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.195+0000 7fd4991ce640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd478066ce0 0x7fd4780691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.195+0000 7fd4991ce640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd478066ce0 0x7fd4780691a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4900aa000 tx=0x7fd490001a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.199+0000 7fd489ffb640 1 -- 172.21.15.70:0/951792837 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd48c051b90 con 0x7fd49415b460 2023-11-26T07:22:48.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.347+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4941f7560 con 0x7fd49415b460 2023-11-26T07:22:48.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.347+0000 7fd489ffb640 1 -- 172.21.15.70:0/951792837 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd48c0551b0 con 0x7fd49415b460 2023-11-26T07:22:48.354 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:22:48.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd478066ce0 msgr2=0x7fd4780691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd478066ce0 0x7fd4780691a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4900aa000 tx=0x7fd490001a80 comp rx=0 tx=0).stop 2023-11-26T07:22:48.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd49415b460 msgr2=0x7fd4940b6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd49415b460 0x7fd4940b6950 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd49408d7d0 tx=0x7fd48c0115a0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 shutdown_connections 2023-11-26T07:22:48.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd478066ce0 0x7fd4780691a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd49415b460 0x7fd4940b6950 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4940b51b0 0x7fd49415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 --2- 172.21.15.70:0/951792837 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd49415a440 0x7fd4940b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 >> 172.21.15.70:0/951792837 conn(0x7fd4940d3060 msgr2=0x7fd4940b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 shutdown_connections 2023-11-26T07:22:48.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.351+0000 7fd49a1d0640 1 -- 172.21.15.70:0/951792837 wait complete. 2023-11-26T07:22:48.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:22:48.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.507+0000 7f3b2c7b8640 1 Processor -- start 2023-11-26T07:22:48.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.507+0000 7f3b2c7b8640 1 -- start start 2023-11-26T07:22:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2c7b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b240cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2c7b8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2406c520 con 0x7f3b240cf7c0 2023-11-26T07:22:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2c7b8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2406c800 con 0x7f3b2415f6b0 2023-11-26T07:22:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2c7b8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240cfc40 con 0x7f3b2413e290 2023-11-26T07:22:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b29d53640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3b240cf7c0 0x7f3b2415efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35950/0 (socket says 172.21.15.70:35950) 2023-11-26T07:22:48.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b29d53640 1 -- 172.21.15.70:0/290095700 learned_addr learned my addr 172.21.15.70:0/290095700 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:48.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2a554640 1 --2- 172.21.15.70:0/290095700 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b240cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658798174 0 0) 0x7f3b2406c520 con 0x7f3b240cf7c0 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b10003530 con 0x7f3b240cf7c0 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000940780 0 0) 0x7f3b2406c800 con 0x7f3b2415f6b0 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b2406c520 con 0x7f3b2415f6b0 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2a554640 1 -- 172.21.15.70:0/290095700 >> v1:172.21.15.120:6789/0 conn(0x7f3b2415f6b0 legacy=0x7f3b240cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2a554640 1 -- 172.21.15.70:0/290095700 >> v1:172.21.15.70:6789/0 conn(0x7f3b240cf7c0 legacy=0x7f3b2415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245938218 0 0) 0x7f3b10003530 con 0x7f3b240cf7c0 2023-11-26T07:22:48.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.511+0000 7f3b2a554640 1 -- 172.21.15.70:0/290095700 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2406cae0 con 0x7f3b2413e290 2023-11-26T07:22:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2a554640 1 --2- 172.21.15.70:0/290095700 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b240cf280 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b200097f0 tx=0x7f3b2001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b4afa1be1a94fcd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14001680 con 0x7f3b2413e290 2023-11-26T07:22:48.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200a7050 con 0x7f3b2413e290 2023-11-26T07:22:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b29552640 1 -- 172.21.15.70:0/290095700 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200ab620 con 0x7f3b2413e290 2023-11-26T07:22:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/290095700 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 msgr2=0x7f3b240cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/290095700 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b240cf280 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3b200097f0 tx=0x7f3b2001c3e0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/290095700 shutdown_connections 2023-11-26T07:22:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/290095700 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b240cf280 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/290095700 >> 172.21.15.70:0/290095700 conn(0x7f3b2406a890 msgr2=0x7f3b2406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/290095700 shutdown_connections 2023-11-26T07:22:48.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/290095700 wait complete. 2023-11-26T07:22:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.515+0000 7f3b2c7b8640 1 Processor -- start 2023-11-26T07:22:48.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 -- start start 2023-11-26T07:22:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b240cf7c0 0x7f3b24136e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b24135a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2415f6b0 0x7f3b241f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2413b6e0 con 0x7f3b2415f6b0 2023-11-26T07:22:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2413b9c0 con 0x7f3b240cf7c0 2023-11-26T07:22:48.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2413bca0 con 0x7f3b2413e290 2023-11-26T07:22:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2415f6b0 0x7f3b241f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2415f6b0 0x7f3b241f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50754/0 (socket says 172.21.15.70:50754) 2023-11-26T07:22:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 -- 172.21.15.70:0/2384326139 learned_addr learned my addr 172.21.15.70:0/2384326139 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2a554640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b240cf7c0 0x7f3b24136e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b29d53640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b24135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 -- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 msgr2=0x7f3b24135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b24135a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 -- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b240cf7c0 msgr2=0x7f3b24136e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b240cf7c0 0x7f3b24136e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 -- 172.21.15.70:0/2384326139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009420 con 0x7f3b2415f6b0 2023-11-26T07:22:48.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b29d53640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b24135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2ad55640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2415f6b0 0x7f3b241f7480 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c730 tx=0x7f3b1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b1affd640 1 -- 172.21.15.70:0/2384326139 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c003b80 con 0x7f3b2415f6b0 2023-11-26T07:22:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b1affd640 1 -- 172.21.15.70:0/2384326139 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c003ce0 con 0x7f3b2415f6b0 2023-11-26T07:22:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2413bf80 con 0x7f3b2415f6b0 2023-11-26T07:22:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b1affd640 1 -- 172.21.15.70:0/2384326139 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00aa90 con 0x7f3b2415f6b0 2023-11-26T07:22:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2413b300 con 0x7f3b2415f6b0 2023-11-26T07:22:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.519+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b24067680 con 0x7f3b2415f6b0 2023-11-26T07:22:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.523+0000 7f3b1affd640 1 -- 172.21.15.70:0/2384326139 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f3b1c00abf0 con 0x7f3b2415f6b0 2023-11-26T07:22:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.523+0000 7f3b1affd640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b08066ce0 0x7f3b080691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.523+0000 7f3b1affd640 1 -- 172.21.15.70:0/2384326139 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5765+0+0 (secure 0 0 0) 0x7f3b1c082740 con 0x7f3b2415f6b0 2023-11-26T07:22:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.523+0000 7f3b2a554640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b08066ce0 0x7f3b080691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:48.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.523+0000 7f3b2a554640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b08066ce0 0x7f3b080691a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3b200ad000 tx=0x7f3b200a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:48.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.527+0000 7f3b1affd640 1 -- 172.21.15.70:0/2384326139 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b1c0513b0 con 0x7f3b2415f6b0 2023-11-26T07:22:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b2406df50 con 0x7f3b2415f6b0 2023-11-26T07:22:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b1affd640 1 -- 172.21.15.70:0/2384326139 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3b1c0549d0 con 0x7f3b2415f6b0 2023-11-26T07:22:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:22:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b08066ce0 msgr2=0x7f3b080691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b08066ce0 0x7f3b080691a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3b200ad000 tx=0x7f3b200a6000 comp rx=0 tx=0).stop 2023-11-26T07:22:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2415f6b0 msgr2=0x7f3b241f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2415f6b0 0x7f3b241f7480 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c730 tx=0x7f3b1c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 shutdown_connections 2023-11-26T07:22:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b08066ce0 0x7f3b080691a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2415f6b0 0x7f3b241f7480 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3b2413e290 0x7f3b24135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 --2- 172.21.15.70:0/2384326139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b240cf7c0 0x7f3b24136e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 >> 172.21.15.70:0/2384326139 conn(0x7f3b2406a890 msgr2=0x7f3b2406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.687+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 shutdown_connections 2023-11-26T07:22:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.691+0000 7f3b2c7b8640 1 -- 172.21.15.70:0/2384326139 wait complete. 2023-11-26T07:22:48.713 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2023-11-26T07:22:48.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:48.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-26T07:22:48.736 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:22:48.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:48.736 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:22:48.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[52857]: fuse finished with error 0 and tester_r 0 2023-11-26T07:22:48.850 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:22:48.850 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:48.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:49.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.995+0000 7f94ccce3640 1 Processor -- start 2023-11-26T07:22:49.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.995+0000 7f94ccce3640 1 -- start start 2023-11-26T07:22:49.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94ccce3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c8070ba0 0x7f94c806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94ccce3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80cd610 con 0x7f94c80cdd10 2023-11-26T07:22:49.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94ccce3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80cd8f0 con 0x7f94c8161cf0 2023-11-26T07:22:49.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94ccce3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8161210 con 0x7f94c8070ba0 2023-11-26T07:22:49.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c6d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f94c80cdd10 0x7f94c806d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35960/0 (socket says 172.21.15.70:35960) 2023-11-26T07:22:49.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c6d9d640 1 -- 172.21.15.70:0/1609608705 learned_addr learned my addr 172.21.15.70:0/1609608705 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:49.004 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c659c640 1 --2- 172.21.15.70:0/1609608705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c8070ba0 0x7f94c806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c5d9b640 1 -- 172.21.15.70:0/1609608705 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763361938 0 0) 0x7f94c80cd610 con 0x7f94c80cdd10 2023-11-26T07:22:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c5d9b640 1 -- 172.21.15.70:0/1609608705 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b4003530 con 0x7f94c80cdd10 2023-11-26T07:22:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c5d9b640 1 -- 172.21.15.70:0/1609608705 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051310458 0 0) 0x7f94c80cd8f0 con 0x7f94c8161cf0 2023-11-26T07:22:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c5d9b640 1 -- 172.21.15.70:0/1609608705 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c80cd610 con 0x7f94c8161cf0 2023-11-26T07:22:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c659c640 1 -- 172.21.15.70:0/1609608705 >> v1:172.21.15.120:6789/0 conn(0x7f94c8161cf0 legacy=0x7f94c8070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c659c640 1 -- 172.21.15.70:0/1609608705 >> v1:172.21.15.70:6789/0 conn(0x7f94c80cdd10 legacy=0x7f94c806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:48.999+0000 7f94c659c640 1 -- 172.21.15.70:0/1609608705 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c81614f0 con 0x7f94c8070ba0 2023-11-26T07:22:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94c659c640 1 --2- 172.21.15.70:0/1609608705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c8070ba0 0x7f94c806bae0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009820 tx=0x7f94b801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5c7fcf74245423b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94c5d9b640 1 -- 172.21.15.70:0/1609608705 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b80ac410 con 0x7f94c8070ba0 2023-11-26T07:22:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94c5d9b640 1 -- 172.21.15.70:0/1609608705 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b80ac570 con 0x7f94c8070ba0 2023-11-26T07:22:49.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94c5d9b640 1 -- 172.21.15.70:0/1609608705 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b80ac900 con 0x7f94c8070ba0 2023-11-26T07:22:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 -- 172.21.15.70:0/1609608705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c8070ba0 msgr2=0x7f94c806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 --2- 172.21.15.70:0/1609608705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c8070ba0 0x7f94c806bae0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009820 tx=0x7f94b801c4a0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 -- 172.21.15.70:0/1609608705 shutdown_connections 2023-11-26T07:22:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 --2- 172.21.15.70:0/1609608705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c8070ba0 0x7f94c806bae0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 -- 172.21.15.70:0/1609608705 >> 172.21.15.70:0/1609608705 conn(0x7f94c80cf710 msgr2=0x7f94c80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 -- 172.21.15.70:0/1609608705 shutdown_connections 2023-11-26T07:22:49.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 -- 172.21.15.70:0/1609608705 wait complete. 2023-11-26T07:22:49.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.003+0000 7f94ccce3640 1 Processor -- start 2023-11-26T07:22:49.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 -- start start 2023-11-26T07:22:49.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8070ba0 0x7f94c814bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c80cdd10 0x7f94c8146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94c8161cf0 0x7f94c8150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c814f530 con 0x7f94c8161cf0 2023-11-26T07:22:49.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8151790 con 0x7f94c8070ba0 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c81514b0 con 0x7f94c80cdd10 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94c8161cf0 0x7f94c8150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94c8161cf0 0x7f94c8150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50764/0 (socket says 172.21.15.70:50764) 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 -- 172.21.15.70:0/3469954024 learned_addr learned my addr 172.21.15.70:0/3469954024 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c659c640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8070ba0 0x7f94c814bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94bdd9b640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c80cdd10 0x7f94c8146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 -- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c80cdd10 msgr2=0x7f94c8146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c80cdd10 0x7f94c8146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 -- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8070ba0 msgr2=0x7f94c814bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8070ba0 0x7f94c814bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 -- 172.21.15.70:0/3469954024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8009420 con 0x7f94c8161cf0 2023-11-26T07:22:49.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94c6d9d640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94c8161cf0 0x7f94c8150220 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f94c000cbc0 tx=0x7f94c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94bf7fe640 1 -- 172.21.15.70:0/3469954024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000ace0 con 0x7f94c8161cf0 2023-11-26T07:22:49.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94bf7fe640 1 -- 172.21.15.70:0/3469954024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000ae40 con 0x7f94c8161cf0 2023-11-26T07:22:49.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94bf7fe640 1 -- 172.21.15.70:0/3469954024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0012600 con 0x7f94c8161cf0 2023-11-26T07:22:49.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c814f740 con 0x7f94c8161cf0 2023-11-26T07:22:49.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c814fd00 con 0x7f94c8161cf0 2023-11-26T07:22:49.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.007+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c814ff20 con 0x7f94c8161cf0 2023-11-26T07:22:49.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.011+0000 7f94bf7fe640 1 -- 172.21.15.70:0/3469954024 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f94c0007070 con 0x7f94c8161cf0 2023-11-26T07:22:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.011+0000 7f94bf7fe640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94a8066d10 0x7f94a80691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.011+0000 7f94bf7fe640 1 -- 172.21.15.70:0/3469954024 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f94c0082800 con 0x7f94c8161cf0 2023-11-26T07:22:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.011+0000 7f94c659c640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94a8066d10 0x7f94a80691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.011+0000 7f94c659c640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94a8066d10 0x7f94a80691d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f94b80ae000 tx=0x7f94b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.015+0000 7f94bf7fe640 1 -- 172.21.15.70:0/3469954024 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94c00515b0 con 0x7f94c8161cf0 2023-11-26T07:22:49.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.167+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94c8067680 con 0x7f94c8161cf0 2023-11-26T07:22:49.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94bf7fe640 1 -- 172.21.15.70:0/3469954024 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f94c0017090 con 0x7f94c8161cf0 2023-11-26T07:22:49.175 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:49.175 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":66,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:22:48.833584+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:49.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94a8066d10 msgr2=0x7f94a80691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94a8066d10 0x7f94a80691d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f94b80ae000 tx=0x7f94b8008040 comp rx=0 tx=0).stop 2023-11-26T07:22:49.176 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94c8161cf0 msgr2=0x7f94c8150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94c8161cf0 0x7f94c8150220 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f94c000cbc0 tx=0x7f94c000a430 comp rx=0 tx=0).stop 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 shutdown_connections 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f94a8066d10 0x7f94a80691d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94c8161cf0 0x7f94c8150220 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f94c80cdd10 0x7f94c8146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 --2- 172.21.15.70:0/3469954024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f94c8070ba0 0x7f94c814bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 >> 172.21.15.70:0/3469954024 conn(0x7f94c80cf710 msgr2=0x7f94c80b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 shutdown_connections 2023-11-26T07:22:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.171+0000 7f94ccce3640 1 -- 172.21.15.70:0/3469954024 wait complete. 2023-11-26T07:22:49.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:21:52.577151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:21:53.232441+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:22:49.196 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:22:49.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f05633df640 1 Processor -- start 2023-11-26T07:22:49.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f05633df640 1 -- start start 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f05633df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c06f000 0x7f055c06d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f05633df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f055c06f3e0 0x7f055c06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f05633df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0cf260 con 0x7f055c099a70 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f05633df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c06d570 con 0x7f055c06f3e0 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f05633df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c09a010 con 0x7f055c06f000 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f056117b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c06f000 0x7f055c06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.331+0000 7f056097a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f055c06f3e0 0x7f055c06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f056197c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f055c099a70 0x7f055c06bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:46134/0 (socket says 172.21.15.70:46134) 2023-11-26T07:22:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f056197c640 1 -- 172.21.15.70:0/2399111128 learned_addr learned my addr 172.21.15.70:0/2399111128 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f056097a640 1 -- 172.21.15.70:0/2399111128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c06f000 msgr2=0x7f055c06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f056097a640 1 --2- 172.21.15.70:0/2399111128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c06f000 0x7f055c06d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f056097a640 1 -- 172.21.15.70:0/2399111128 >> v1:172.21.15.120:6789/0 conn(0x7f055c099a70 legacy=0x7f055c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f056097a640 1 -- 172.21.15.70:0/2399111128 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c09a2f0 con 0x7f055c06f3e0 2023-11-26T07:22:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f0553fff640 1 -- 172.21.15.70:0/2399111128 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742218388 0 0) 0x7f055c0cf260 con 0x7f055c099a70 2023-11-26T07:22:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f056097a640 1 --2- 172.21.15.70:0/2399111128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f3e0 0x7f055c06b5a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097c0 tx=0x7f054c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9085eca04ecee7af server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f0553fff640 1 -- 172.21.15.70:0/2399111128 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ab600 con 0x7f055c06f3e0 2023-11-26T07:22:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f0553fff640 1 -- 172.21.15.70:0/2399111128 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0a7050 con 0x7f055c06f3e0 2023-11-26T07:22:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.335+0000 7f0553fff640 1 -- 172.21.15.70:0/2399111128 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ab980 con 0x7f055c06f3e0 2023-11-26T07:22:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- 172.21.15.70:0/2399111128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f3e0 msgr2=0x7f055c06b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 --2- 172.21.15.70:0/2399111128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f3e0 0x7f055c06b5a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097c0 tx=0x7f054c01c480 comp rx=0 tx=0).stop 2023-11-26T07:22:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- 172.21.15.70:0/2399111128 shutdown_connections 2023-11-26T07:22:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 --2- 172.21.15.70:0/2399111128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f3e0 0x7f055c06b5a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 --2- 172.21.15.70:0/2399111128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c06f000 0x7f055c06d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- 172.21.15.70:0/2399111128 >> 172.21.15.70:0/2399111128 conn(0x7f055c0b2d10 msgr2=0x7f055c0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- 172.21.15.70:0/2399111128 shutdown_connections 2023-11-26T07:22:49.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- 172.21.15.70:0/2399111128 wait complete. 2023-11-26T07:22:49.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 Processor -- start 2023-11-26T07:22:49.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- start start 2023-11-26T07:22:49.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f000 0x7f055c0b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055c06f3e0 0x7f055c0c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c099a70 0x7f055c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1604d0 con 0x7f055c06f3e0 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0b48c0 con 0x7f055c06f000 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f05633df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0b4ba0 con 0x7f055c099a70 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056097a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055c06f3e0 0x7f055c0c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056117b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f000 0x7f055c0b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056097a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055c06f3e0 0x7f055c0c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50772/0 (socket says 172.21.15.70:50772) 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056097a640 1 -- 172.21.15.70:0/3115165071 learned_addr learned my addr 172.21.15.70:0/3115165071 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056197c640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c099a70 0x7f055c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056117b640 1 -- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c099a70 msgr2=0x7f055c0c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056117b640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c099a70 0x7f055c0c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056117b640 1 -- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055c06f3e0 msgr2=0x7f055c0c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056117b640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055c06f3e0 0x7f055c0c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.339+0000 7f056117b640 1 -- 172.21.15.70:0/3115165071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c009420 con 0x7f055c06f000 2023-11-26T07:22:49.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f056117b640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f000 0x7f055c0b4070 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f055800e870 tx=0x7f055800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f0551ffb640 1 -- 172.21.15.70:0/3115165071 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580095d0 con 0x7f055c06f000 2023-11-26T07:22:49.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f0551ffb640 1 -- 172.21.15.70:0/3115165071 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800c940 con 0x7f055c06f000 2023-11-26T07:22:49.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f0551ffb640 1 -- 172.21.15.70:0/3115165071 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800ccb0 con 0x7f055c06f000 2023-11-26T07:22:49.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c160160 con 0x7f055c06f000 2023-11-26T07:22:49.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c0b45b0 con 0x7f055c06f000 2023-11-26T07:22:49.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c1602f0 con 0x7f055c06f000 2023-11-26T07:22:49.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f0551ffb640 1 -- 172.21.15.70:0/3115165071 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f05580059a0 con 0x7f055c06f000 2023-11-26T07:22:49.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f0551ffb640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0540066ce0 0x7f05400691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f0551ffb640 1 -- 172.21.15.70:0/3115165071 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f0558082ad0 con 0x7f055c06f000 2023-11-26T07:22:49.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.343+0000 7f056097a640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0540066ce0 0x7f05400691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.347+0000 7f056097a640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0540066ce0 0x7f05400691a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f054c000c10 tx=0x7f054c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.347+0000 7f0551ffb640 1 -- 172.21.15.70:0/3115165071 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0558051880 con 0x7f055c06f000 2023-11-26T07:22:49.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f055c067680 con 0x7f055c06f000 2023-11-26T07:22:49.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f0551ffb640 1 -- 172.21.15.70:0/3115165071 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0558021020 con 0x7f055c06f000 2023-11-26T07:22:49.508 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:22:49.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0540066ce0 msgr2=0x7f05400691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f05633df640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0540066ce0 0x7f05400691a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f054c000c10 tx=0x7f054c0a6000 comp rx=0 tx=0).stop 2023-11-26T07:22:49.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f000 msgr2=0x7f055c0b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.510 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f05633df640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f000 0x7f055c0b4070 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f055800e870 tx=0x7f055800ed30 comp rx=0 tx=0).stop 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 shutdown_connections 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.503+0000 7f05633df640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0540066ce0 0x7f05400691a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.507+0000 7f05633df640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055c06f3e0 0x7f055c0c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.507+0000 7f05633df640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f055c099a70 0x7f055c0c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.507+0000 7f05633df640 1 --2- 172.21.15.70:0/3115165071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f055c06f000 0x7f055c0b4070 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.507+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 >> 172.21.15.70:0/3115165071 conn(0x7f055c0b2d10 msgr2=0x7f055c0cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.507+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 shutdown_connections 2023-11-26T07:22:49.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.507+0000 7f05633df640 1 -- 172.21.15.70:0/3115165071 wait complete. 2023-11-26T07:22:49.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:22:49.671 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f8ddd1640 1 Processor -- start 2023-11-26T07:22:49.680 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f8ddd1640 1 -- start start 2023-11-26T07:22:49.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f8ddd1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f88161cf0 0x7f7f8806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f8ddd1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f8806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f8ddd1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f880cd610 con 0x7f7f88070ba0 2023-11-26T07:22:49.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f8ddd1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f880cd8f0 con 0x7f7f88161cf0 2023-11-26T07:22:49.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f8ddd1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88161210 con 0x7f7f880cdd10 2023-11-26T07:22:49.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f7ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f88161cf0 0x7f7f8806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f7ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7f88161cf0 0x7f7f8806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50776/0 (socket says 172.21.15.70:50776) 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f7ffff640 1 -- 172.21.15.70:0/1409768212 learned_addr learned my addr 172.21.15.70:0/1409768212 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f87fff640 1 --2- 172.21.15.70:0/1409768212 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f8806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f7ffff640 1 -- 172.21.15.70:0/1409768212 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 msgr2=0x7f7f8806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f7ffff640 1 --2- 172.21.15.70:0/1409768212 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f8806d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f7ffff640 1 -- 172.21.15.70:0/1409768212 >> v1:172.21.15.120:6789/0 conn(0x7f7f88070ba0 legacy=0x7f7f88070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.667+0000 7f7f7ffff640 1 -- 172.21.15.70:0/1409768212 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f881614f0 con 0x7f7f88161cf0 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f7ffff640 1 --2- 172.21.15.70:0/1409768212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f8806bae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009870 tx=0x7f7f7001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e66a1362e2a92a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f86ffd640 1 -- 172.21.15.70:0/1409768212 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700a9620 con 0x7f7f88161cf0 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f86ffd640 1 -- 172.21.15.70:0/1409768212 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700a9780 con 0x7f7f88161cf0 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f86ffd640 1 -- 172.21.15.70:0/1409768212 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700a9b10 con 0x7f7f88161cf0 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/1409768212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 msgr2=0x7f7f8806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/1409768212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f8806bae0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009870 tx=0x7f7f7001c540 comp rx=0 tx=0).stop 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/1409768212 shutdown_connections 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/1409768212 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f8806d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/1409768212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f8806bae0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/1409768212 >> 172.21.15.70:0/1409768212 conn(0x7f7f880cf710 msgr2=0x7f7f880cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/1409768212 shutdown_connections 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.671+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/1409768212 wait complete. 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 Processor -- start 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 -- start start 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f88070ba0 0x7f7f880aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f880add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f881527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880ae2a0 con 0x7f7f88161cf0 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880ad8d0 con 0x7f7f88070ba0 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88152100 con 0x7f7f880cdd10 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f881527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f881527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50790/0 (socket says 172.21.15.70:50790) 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 -- 172.21.15.70:0/3778150993 learned_addr learned my addr 172.21.15.70:0/3778150993 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f877fe640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f88070ba0 0x7f7f880aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f7ffff640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f880add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 -- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 msgr2=0x7f7f880add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f880add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 -- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f88070ba0 msgr2=0x7f7f880aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f88070ba0 0x7f7f880aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 -- 172.21.15.70:0/3778150993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700094d0 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f87fff640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f881527e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000efc0 tx=0x7f7f8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f84ff9640 1 -- 172.21.15.70:0/3778150993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80014480 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f84ff9640 1 -- 172.21.15.70:0/3778150993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8000f040 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f84ff9640 1 -- 172.21.15.70:0/3778150993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80014820 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f880ad280 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.675+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f880acea0 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.679+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880ada40 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.679+0000 7f7f84ff9640 1 -- 172.21.15.70:0/3778150993 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f7f80014980 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.679+0000 7f7f84ff9640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7f68066ce0 0x7f7f680691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.679+0000 7f7f84ff9640 1 -- 172.21.15.70:0/3778150993 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f7f80083600 con 0x7f7f88161cf0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.679+0000 7f7f877fe640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7f68066ce0 0x7f7f680691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:49.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.679+0000 7f7f877fe640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7f68066ce0 0x7f7f680691a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7f880b0f90 tx=0x7f7f78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:49.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.683+0000 7f7f84ff9640 1 -- 172.21.15.70:0/3778150993 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f800523f0 con 0x7f7f88161cf0 2023-11-26T07:22:49.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.831+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f88067680 con 0x7f7f88161cf0 2023-11-26T07:22:49.838 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.831+0000 7f7f84ff9640 1 -- 172.21.15.70:0/3778150993 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f80055a10 con 0x7f7f88161cf0 2023-11-26T07:22:49.838 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:22:49.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7f68066ce0 msgr2=0x7f7f680691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7f68066ce0 0x7f7f680691a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7f880b0f90 tx=0x7f7f78009040 comp rx=0 tx=0).stop 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 msgr2=0x7f7f881527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f881527e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000efc0 tx=0x7f7f8000c490 comp rx=0 tx=0).stop 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 shutdown_connections 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7f68066ce0 0x7f7f680691a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f88161cf0 0x7f7f881527e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7f880cdd10 0x7f7f880add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 --2- 172.21.15.70:0/3778150993 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f88070ba0 0x7f7f880aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:49.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 >> 172.21.15.70:0/3778150993 conn(0x7f7f880cf710 msgr2=0x7f7f8815cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 shutdown_connections 2023-11-26T07:22:49.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.835+0000 7f7f8ddd1640 1 -- 172.21.15.70:0/3778150993 wait complete. 2023-11-26T07:22:49.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:22:50.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd199101640 1 Processor -- start 2023-11-26T07:22:50.003 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd199101640 1 -- start start 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd199101640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd19415d6e0 0x7fd1940d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd199101640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd1940b2160 0x7fd1940d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd199101640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940cf0e0 con 0x7fd1940d19f0 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd199101640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19415dac0 con 0x7fd1940b2160 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd199101640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940d1e80 con 0x7fd19415d6e0 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd18bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd1940b2160 0x7fd1940d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd18bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd1940b2160 0x7fd1940d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50802/0 (socket says 172.21.15.70:50802) 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd18bfff640 1 -- 172.21.15.70:0/2335913314 learned_addr learned my addr 172.21.15.70:0/2335913314 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:50.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd192d9d640 1 --2- 172.21.15.70:0/2335913314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd19415d6e0 0x7fd1940d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd18bfff640 1 -- 172.21.15.70:0/2335913314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd19415d6e0 msgr2=0x7fd1940d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd18bfff640 1 --2- 172.21.15.70:0/2335913314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd19415d6e0 0x7fd1940d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd18bfff640 1 -- 172.21.15.70:0/2335913314 >> v1:172.21.15.120:6789/0 conn(0x7fd1940d19f0 legacy=0x7fd1940cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.006 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:49.999+0000 7fd18bfff640 1 -- 172.21.15.70:0/2335913314 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940ceb20 con 0x7fd1940b2160 2023-11-26T07:22:50.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd18bfff640 1 --2- 172.21.15.70:0/2335913314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1940b2160 0x7fd1940d14b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009870 tx=0x7fd17c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc10f1e088afa116 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd19259c640 1 -- 172.21.15.70:0/2335913314 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0a7070 con 0x7fd1940b2160 2023-11-26T07:22:50.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd19259c640 1 -- 172.21.15.70:0/2335913314 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c0ab430 con 0x7fd1940b2160 2023-11-26T07:22:50.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd19259c640 1 -- 172.21.15.70:0/2335913314 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0ab7c0 con 0x7fd1940b2160 2023-11-26T07:22:50.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 -- 172.21.15.70:0/2335913314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1940b2160 msgr2=0x7fd1940d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 --2- 172.21.15.70:0/2335913314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1940b2160 0x7fd1940d14b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009870 tx=0x7fd17c01c540 comp rx=0 tx=0).stop 2023-11-26T07:22:50.009 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 -- 172.21.15.70:0/2335913314 shutdown_connections 2023-11-26T07:22:50.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 --2- 172.21.15.70:0/2335913314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1940b2160 0x7fd1940d14b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 --2- 172.21.15.70:0/2335913314 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd19415d6e0 0x7fd1940d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 -- 172.21.15.70:0/2335913314 >> 172.21.15.70:0/2335913314 conn(0x7fd19409c550 msgr2=0x7fd1940d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 -- 172.21.15.70:0/2335913314 shutdown_connections 2023-11-26T07:22:50.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.003+0000 7fd199101640 1 -- 172.21.15.70:0/2335913314 wait complete. 2023-11-26T07:22:50.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 Processor -- start 2023-11-26T07:22:50.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 -- start start 2023-11-26T07:22:50.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1940b2160 0x7fd1940c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd1940d19f0 0x7fd1940b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd19415d6e0 0x7fd19415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940c82a0 con 0x7fd19415d6e0 2023-11-26T07:22:50.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940c90a0 con 0x7fd1940b2160 2023-11-26T07:22:50.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940b5b50 con 0x7fd1940d19f0 2023-11-26T07:22:50.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd19415d6e0 0x7fd19415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd19415d6e0 0x7fd19415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50816/0 (socket says 172.21.15.70:50816) 2023-11-26T07:22:50.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 -- 172.21.15.70:0/4199190739 learned_addr learned my addr 172.21.15.70:0/4199190739 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:50.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd18bfff640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd1940d19f0 0x7fd1940b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd192d9d640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1940b2160 0x7fd1940c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 -- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd1940d19f0 msgr2=0x7fd1940b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd1940d19f0 0x7fd1940b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 -- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1940b2160 msgr2=0x7fd1940c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1940b2160 0x7fd1940c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 -- 172.21.15.70:0/4199190739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0094d0 con 0x7fd19415d6e0 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd19359e640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd19415d6e0 0x7fd19415b2a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c7a0 tx=0x7fd18c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd18b7fe640 1 -- 172.21.15.70:0/4199190739 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c003b80 con 0x7fd19415d6e0 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd18b7fe640 1 -- 172.21.15.70:0/4199190739 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c003ce0 con 0x7fd19415d6e0 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1940c8490 con 0x7fd19415d6e0 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd18b7fe640 1 -- 172.21.15.70:0/4199190739 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00aa90 con 0x7fd19415d6e0 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.007+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1940c8a50 con 0x7fd19415d6e0 2023-11-26T07:22:50.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.011+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1940c9250 con 0x7fd19415d6e0 2023-11-26T07:22:50.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.011+0000 7fd18b7fe640 1 -- 172.21.15.70:0/4199190739 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd18c00abf0 con 0x7fd19415d6e0 2023-11-26T07:22:50.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.011+0000 7fd18b7fe640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd174066d10 0x7fd1740691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.011+0000 7fd18b7fe640 1 -- 172.21.15.70:0/4199190739 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd18c0825a0 con 0x7fd19415d6e0 2023-11-26T07:22:50.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.011+0000 7fd192d9d640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd174066d10 0x7fd1740691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.011+0000 7fd192d9d640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd174066d10 0x7fd1740691d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd19415bea0 tx=0x7fd184009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.015+0000 7fd18b7fe640 1 -- 172.21.15.70:0/4199190739 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1940c9250 con 0x7fd19415d6e0 2023-11-26T07:22:50.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1940c9250 con 0x7fd19415d6e0 2023-11-26T07:22:50.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd18b7fe640 1 -- 172.21.15.70:0/4199190739 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1940c9250 con 0x7fd19415d6e0 2023-11-26T07:22:50.172 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:22:50.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd174066d10 msgr2=0x7fd1740691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd174066d10 0x7fd1740691d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd19415bea0 tx=0x7fd184009190 comp rx=0 tx=0).stop 2023-11-26T07:22:50.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd19415d6e0 msgr2=0x7fd19415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd19415d6e0 0x7fd19415b2a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c7a0 tx=0x7fd18c00cc60 comp rx=0 tx=0).stop 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 shutdown_connections 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd174066d10 0x7fd1740691d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd19415d6e0 0x7fd19415b2a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd1940d19f0 0x7fd1940b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 --2- 172.21.15.70:0/4199190739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1940b2160 0x7fd1940c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 >> 172.21.15.70:0/4199190739 conn(0x7fd19409c550 msgr2=0x7fd1940cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 shutdown_connections 2023-11-26T07:22:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.167+0000 7fd199101640 1 -- 172.21.15.70:0/4199190739 wait complete. 2023-11-26T07:22:50.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:22:50.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 Processor -- start 2023-11-26T07:22:50.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 -- start start 2023-11-26T07:22:50.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f693c143ac0 0x7f693c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f693c0708b0 0x7f693c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c0cf7c0 0x7f693c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c143ea0 con 0x7f693c0708b0 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0cc730 con 0x7f693c143ac0 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6940be7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0cfbd0 con 0x7f693c0cf7c0 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f693c0708b0 0x7f693c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f693c0708b0 0x7f693c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50832/0 (socket says 172.21.15.70:50832) 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 -- 172.21.15.70:0/2225544582 learned_addr learned my addr 172.21.15.70:0/2225544582 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:50.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f693a59c640 1 --2- 172.21.15.70:0/2225544582 >> v2:172.21.15.120:3300/0 conn(0x7f693c143ac0 0x7f693c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f693ad9d640 1 --2- 172.21.15.70:0/2225544582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c0cf7c0 0x7f693c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 -- 172.21.15.70:0/2225544582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c0cf7c0 msgr2=0x7f693c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 --2- 172.21.15.70:0/2225544582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c0cf7c0 0x7f693c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 -- 172.21.15.70:0/2225544582 >> v2:172.21.15.120:3300/0 conn(0x7f693c143ac0 msgr2=0x7f693c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 --2- 172.21.15.70:0/2225544582 >> v2:172.21.15.120:3300/0 conn(0x7f693c143ac0 0x7f693c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f6931d9b640 1 -- 172.21.15.70:0/2225544582 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c070ee0 con 0x7f693c0708b0 2023-11-26T07:22:50.335 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.327+0000 7f693a59c640 1 --2- 172.21.15.70:0/2225544582 >> v2:172.21.15.120:3300/0 conn(0x7f693c143ac0 0x7f693c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:50.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6931d9b640 1 --2- 172.21.15.70:0/2225544582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0708b0 0x7f693c0cf280 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f693c06dca0 tx=0x7f692401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc42c4c736021888 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6939d9b640 1 -- 172.21.15.70:0/2225544582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240a5590 con 0x7f693c0708b0 2023-11-26T07:22:50.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6939d9b640 1 -- 172.21.15.70:0/2225544582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240a56f0 con 0x7f693c0708b0 2023-11-26T07:22:50.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6939d9b640 1 -- 172.21.15.70:0/2225544582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240a5a80 con 0x7f693c0708b0 2023-11-26T07:22:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 -- 172.21.15.70:0/2225544582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0708b0 msgr2=0x7f693c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 --2- 172.21.15.70:0/2225544582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0708b0 0x7f693c0cf280 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f693c06dca0 tx=0x7f692401c710 comp rx=0 tx=0).stop 2023-11-26T07:22:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 -- 172.21.15.70:0/2225544582 shutdown_connections 2023-11-26T07:22:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 --2- 172.21.15.70:0/2225544582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c0cf7c0 0x7f693c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 --2- 172.21.15.70:0/2225544582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0708b0 0x7f693c0cf280 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 --2- 172.21.15.70:0/2225544582 >> v2:172.21.15.120:3300/0 conn(0x7f693c143ac0 0x7f693c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 -- 172.21.15.70:0/2225544582 >> 172.21.15.70:0/2225544582 conn(0x7f693c06a890 msgr2=0x7f693c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 -- 172.21.15.70:0/2225544582 shutdown_connections 2023-11-26T07:22:50.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.331+0000 7f6940be7640 1 -- 172.21.15.70:0/2225544582 wait complete. 2023-11-26T07:22:50.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 Processor -- start 2023-11-26T07:22:50.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 -- start start 2023-11-26T07:22:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693c0708b0 0x7f693c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0cf7c0 0x7f693c133800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c143ac0 0x7f693c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c157800 con 0x7f693c0cf7c0 2023-11-26T07:22:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c134250 con 0x7f693c0708b0 2023-11-26T07:22:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6940be7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c134530 con 0x7f693c143ac0 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0cf7c0 0x7f693c133800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0cf7c0 0x7f693c133800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50844/0 (socket says 172.21.15.70:50844) 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 -- 172.21.15.70:0/779635433 learned_addr learned my addr 172.21.15.70:0/779635433 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f693a59c640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693c0708b0 0x7f693c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f693ad9d640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c143ac0 0x7f693c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 -- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c143ac0 msgr2=0x7f693c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c143ac0 0x7f693c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 -- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693c0708b0 msgr2=0x7f693c156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693c0708b0 0x7f693c156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 -- 172.21.15.70:0/779635433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924009b30 con 0x7f693c0cf7c0 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f6931d9b640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0cf7c0 0x7f693c133800 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f692401adc0 tx=0x7f69240194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f69337fe640 1 -- 172.21.15.70:0/779635433 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240b8670 con 0x7f693c0cf7c0 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.335+0000 7f69337fe640 1 -- 172.21.15.70:0/779635433 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240b8810 con 0x7f693c0cf7c0 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c134810 con 0x7f693c0cf7c0 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f69337fe640 1 -- 172.21.15.70:0/779635433 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240b8bc0 con 0x7f693c0cf7c0 2023-11-26T07:22:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c159f30 con 0x7f693c0cf7c0 2023-11-26T07:22:50.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c067680 con 0x7f693c0cf7c0 2023-11-26T07:22:50.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f69337fe640 1 -- 172.21.15.70:0/779635433 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f69240b8d20 con 0x7f693c0cf7c0 2023-11-26T07:22:50.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f69337fe640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f691c066d10 0x7f691c0691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f69337fe640 1 -- 172.21.15.70:0/779635433 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f692411dbf0 con 0x7f693c0cf7c0 2023-11-26T07:22:50.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f693a59c640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f691c066d10 0x7f691c0691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.339+0000 7f693a59c640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f691c066d10 0x7f691c0691d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f692c0045f0 tx=0x7f692c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.349 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.343+0000 7f69337fe640 1 -- 172.21.15.70:0/779635433 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69240ec920 con 0x7f693c0cf7c0 2023-11-26T07:22:50.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.503+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f693c157c70 con 0x7f693c0cf7c0 2023-11-26T07:22:50.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.503+0000 7f69337fe640 1 -- 172.21.15.70:0/779635433 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69240eff40 con 0x7f693c0cf7c0 2023-11-26T07:22:50.509 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:22:50.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f691c066d10 msgr2=0x7f691c0691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f691c066d10 0x7f691c0691d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f692c0045f0 tx=0x7f692c008040 comp rx=0 tx=0).stop 2023-11-26T07:22:50.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0cf7c0 msgr2=0x7f693c133800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0cf7c0 0x7f693c133800 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f692401adc0 tx=0x7f69240194b0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 shutdown_connections 2023-11-26T07:22:50.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f691c066d10 0x7f691c0691d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f693c0cf7c0 0x7f693c133800 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f693c143ac0 0x7f693c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 --2- 172.21.15.70:0/779635433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f693c0708b0 0x7f693c156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 >> 172.21.15.70:0/779635433 conn(0x7f693c06a890 msgr2=0x7f693c142420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 shutdown_connections 2023-11-26T07:22:50.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.507+0000 7f6940be7640 1 -- 172.21.15.70:0/779635433 wait complete. 2023-11-26T07:22:50.530 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2023-11-26T07:22:50.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:50.530 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-26T07:22:50.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44481]: fuse finished with error 0 and tester_r 0 2023-11-26T07:22:50.554 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:22:50.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:50.555 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:22:50.611 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:22:50.611 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:50.620 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:22:50.620 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:22:50.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:50.620 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-26T07:22:50.669 INFO:teuthology.orchestra.run.smithi070.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-26T07:22:50.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:22:50.671 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:22:50.671 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:22:50.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:22:50.680 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:22:50.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:22:50.680 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-26T07:22:50.730 INFO:teuthology.orchestra.run.smithi120.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-26T07:22:50.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:22:50.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.863+0000 7f404b679640 1 Processor -- start 2023-11-26T07:22:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.863+0000 7f404b679640 1 -- start start 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f404b679640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40440d1bc0 0x7f40440d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f404b679640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40440b2160 0x7f40440b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f404b679640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40440cf0e0 con 0x7f404415d6e0 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f404b679640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404415dac0 con 0x7f40440d1bc0 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f404b679640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40440ceb20 con 0x7f40440b2160 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4048c14640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40440d1bc0 0x7f40440d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4048c14640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40440d1bc0 0x7f40440d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50860/0 (socket says 172.21.15.70:50860) 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4048c14640 1 -- 172.21.15.70:0/1202469787 learned_addr learned my addr 172.21.15.70:0/1202469787 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4049c16640 1 --2- 172.21.15.70:0/1202469787 >> v2:172.21.15.120:3300/0 conn(0x7f40440b2160 0x7f40440b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4048c14640 1 -- 172.21.15.70:0/1202469787 >> v2:172.21.15.120:3300/0 conn(0x7f40440b2160 msgr2=0x7f40440b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4048c14640 1 --2- 172.21.15.70:0/1202469787 >> v2:172.21.15.120:3300/0 conn(0x7f40440b2160 0x7f40440b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4048c14640 1 -- 172.21.15.70:0/1202469787 >> v1:172.21.15.120:6789/0 conn(0x7f404415d6e0 legacy=0x7f40440d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4048c14640 1 -- 172.21.15.70:0/1202469787 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40440cee00 con 0x7f40440d1bc0 2023-11-26T07:22:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.867+0000 7f4049c16640 1 --2- 172.21.15.70:0/1202469787 >> v2:172.21.15.120:3300/0 conn(0x7f40440b2160 0x7f40440b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f4048c14640 1 --2- 172.21.15.70:0/1202469787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440d0df0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f404408d820 tx=0x7f403401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438c883670544d7e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f403bfff640 1 -- 172.21.15.70:0/1202469787 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340ab5f0 con 0x7f40440d1bc0 2023-11-26T07:22:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f403bfff640 1 -- 172.21.15.70:0/1202469787 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40340ab750 con 0x7f40440d1bc0 2023-11-26T07:22:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f403bfff640 1 -- 172.21.15.70:0/1202469787 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340abae0 con 0x7f40440d1bc0 2023-11-26T07:22:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 -- 172.21.15.70:0/1202469787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 msgr2=0x7f40440d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 --2- 172.21.15.70:0/1202469787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440d0df0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f404408d820 tx=0x7f403401c500 comp rx=0 tx=0).stop 2023-11-26T07:22:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 -- 172.21.15.70:0/1202469787 shutdown_connections 2023-11-26T07:22:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 --2- 172.21.15.70:0/1202469787 >> v2:172.21.15.120:3300/0 conn(0x7f40440b2160 0x7f40440b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 --2- 172.21.15.70:0/1202469787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440d0df0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 -- 172.21.15.70:0/1202469787 >> 172.21.15.70:0/1202469787 conn(0x7f404409c550 msgr2=0x7f40440d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 -- 172.21.15.70:0/1202469787 shutdown_connections 2023-11-26T07:22:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 -- 172.21.15.70:0/1202469787 wait complete. 2023-11-26T07:22:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.871+0000 7f404b679640 1 Processor -- start 2023-11-26T07:22:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 -- start start 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40440b2160 0x7f4044152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404415d6e0 0x7f4044153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044155f70 con 0x7f40440d1bc0 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044156250 con 0x7f404415d6e0 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440b6ff0 con 0x7f40440b2160 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50864/0 (socket says 172.21.15.70:50864) 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 -- 172.21.15.70:0/2223676543 learned_addr learned my addr 172.21.15.70:0/2223676543 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4049c16640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404415d6e0 0x7f4044153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4049415640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40440b2160 0x7f4044152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 -- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40440b2160 msgr2=0x7f4044152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40440b2160 0x7f4044152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 -- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404415d6e0 msgr2=0x7f4044153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404415d6e0 0x7f4044153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 -- 172.21.15.70:0/2223676543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340094d0 con 0x7f40440d1bc0 2023-11-26T07:22:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4048c14640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440b79c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f403401c9e0 tx=0x7f403401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4039ffb640 1 -- 172.21.15.70:0/2223676543 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340be5f0 con 0x7f40440d1bc0 2023-11-26T07:22:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4039ffb640 1 -- 172.21.15.70:0/2223676543 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40340be770 con 0x7f40440d1bc0 2023-11-26T07:22:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40440b72d0 con 0x7f40440d1bc0 2023-11-26T07:22:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f4039ffb640 1 -- 172.21.15.70:0/2223676543 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340beb20 con 0x7f40440d1bc0 2023-11-26T07:22:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.875+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40440b7f00 con 0x7f40440d1bc0 2023-11-26T07:22:50.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.879+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40440b7780 con 0x7f40440d1bc0 2023-11-26T07:22:50.883 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.879+0000 7f4039ffb640 1 -- 172.21.15.70:0/2223676543 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f40340b43f0 con 0x7f40440d1bc0 2023-11-26T07:22:50.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.879+0000 7f4039ffb640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4028066ce0 0x7f40280691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:50.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.879+0000 7f4039ffb640 1 -- 172.21.15.70:0/2223676543 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f40340a8050 con 0x7f40440d1bc0 2023-11-26T07:22:50.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.879+0000 7f4049415640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4028066ce0 0x7f40280691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:50.885 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.879+0000 7f4049415640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4028066ce0 0x7f40280691a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4040007fd0 tx=0x7f4040009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:50.883+0000 7f4039ffb640 1 -- 172.21.15.70:0/2223676543 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40340ec180 con 0x7f40440d1bc0 2023-11-26T07:22:51.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.067+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4044067680 con 0x7f40440d1bc0 2023-11-26T07:22:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.067+0000 7f4039ffb640 1 -- 172.21.15.70:0/2223676543 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f40340c4020 con 0x7f40440d1bc0 2023-11-26T07:22:51.545 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:51.545 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/3935694912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3935694912},{"type":"v1","addr":"172.21.15.120:6834","nonce":3935694912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/886224003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":886224003},{"type":"v1","addr":"172.21.15.120:6835","nonce":886224003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1027556569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1027556569},{"type":"v1","addr":"172.21.15.70:6835","nonce":1027556569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:54.236576+0000","modified":"2023-11-26T07:21:57.243631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3834969891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3834969891},{"type":"v1","addr":"172.21.15.70:6837","nonce":3834969891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 39 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4028066ce0 msgr2=0x7f40280691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4028066ce0 0x7f40280691a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4040007fd0 tx=0x7f4040009040 comp rx=0 tx=0).stop 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 msgr2=0x7f40440b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440b79c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f403401c9e0 tx=0x7f403401ad40 comp rx=0 tx=0).stop 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 shutdown_connections 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4028066ce0 0x7f40280691a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40440d1bc0 0x7f40440b79c0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f404415d6e0 0x7f4044153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 --2- 172.21.15.70:0/2223676543 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40440b2160 0x7f4044152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 >> 172.21.15.70:0/2223676543 conn(0x7f404409c550 msgr2=0x7f404415c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 shutdown_connections 2023-11-26T07:22:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.071+0000 7f404b679640 1 -- 172.21.15.70:0/2223676543 wait complete. 2023-11-26T07:22:51.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb75f8640 1 Processor -- start 2023-11-26T07:22:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb75f8640 1 -- start start 2023-11-26T07:22:51.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb75f8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3bb015d6e0 0x7f3bb00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb75f8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb00cf0e0 con 0x7f3bb00b2160 2023-11-26T07:22:51.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb75f8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb00ceb20 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb75f8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb015dac0 con 0x7f3bb015d6e0 2023-11-26T07:22:51.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb4b93640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3bb00b2160 0x7f3bb00d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35972/0 (socket says 172.21.15.70:35972) 2023-11-26T07:22:51.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb4b93640 1 -- 172.21.15.70:0/303541169 learned_addr learned my addr 172.21.15.70:0/303541169 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:51.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb5394640 1 --2- 172.21.15.70:0/303541169 >> v2:172.21.15.120:3300/0 conn(0x7f3bb015d6e0 0x7f3bb00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3ba7fff640 1 -- 172.21.15.70:0/303541169 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743162268 0 0) 0x7f3bb00cf0e0 con 0x7f3bb00b2160 2023-11-26T07:22:51.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3ba7fff640 1 -- 172.21.15.70:0/303541169 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b9c003530 con 0x7f3bb00b2160 2023-11-26T07:22:51.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3ba7fff640 1 -- 172.21.15.70:0/303541169 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488633024 0 0) 0x7f3bb00ceb20 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3ba7fff640 1 -- 172.21.15.70:0/303541169 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb00cf0e0 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb5394640 1 -- 172.21.15.70:0/303541169 >> v1:172.21.15.120:6789/0 conn(0x7f3bb00d1bc0 legacy=0x7f3bb00b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb5394640 1 -- 172.21.15.70:0/303541169 >> v1:172.21.15.70:6789/0 conn(0x7f3bb00b2160 legacy=0x7f3bb00d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.683+0000 7f3bb5394640 1 -- 172.21.15.70:0/303541169 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00cee00 con 0x7f3bb015d6e0 2023-11-26T07:22:51.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb5394640 1 --2- 172.21.15.70:0/303541169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 0x7f3bb00d0df0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0097c0 tx=0x7f3bac01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f1acc71b488a3d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:51.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3ba7fff640 1 -- 172.21.15.70:0/303541169 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0ab600 con 0x7f3bb015d6e0 2023-11-26T07:22:51.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3ba7fff640 1 -- 172.21.15.70:0/303541169 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0a7050 con 0x7f3bb015d6e0 2023-11-26T07:22:51.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3ba7fff640 1 -- 172.21.15.70:0/303541169 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0ab980 con 0x7f3bb015d6e0 2023-11-26T07:22:51.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb75f8640 1 -- 172.21.15.70:0/303541169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 msgr2=0x7f3bb00d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/303541169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 0x7f3bb00d0df0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0097c0 tx=0x7f3bac01c480 comp rx=0 tx=0).stop 2023-11-26T07:22:51.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb75f8640 1 -- 172.21.15.70:0/303541169 shutdown_connections 2023-11-26T07:22:51.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/303541169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 0x7f3bb00d0df0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb75f8640 1 -- 172.21.15.70:0/303541169 >> 172.21.15.70:0/303541169 conn(0x7f3bb009c550 msgr2=0x7f3bb00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:51.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb75f8640 1 -- 172.21.15.70:0/303541169 shutdown_connections 2023-11-26T07:22:51.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.687+0000 7f3bb75f8640 1 -- 172.21.15.70:0/303541169 wait complete. 2023-11-26T07:22:51.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 Processor -- start 2023-11-26T07:22:51.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 -- start start 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bb00b2160 0x7f3bb0153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb00d1bc0 0x7f3bb0158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 0x7f3bb01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb015fbb0 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb015f8d0 con 0x7f3bb015d6e0 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00b7730 con 0x7f3bb00b2160 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb00d1bc0 0x7f3bb0158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb00d1bc0 0x7f3bb0158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50876/0 (socket says 172.21.15.70:50876) 2023-11-26T07:22:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 -- 172.21.15.70:0/98991940 learned_addr learned my addr 172.21.15.70:0/98991940 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb5394640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bb00b2160 0x7f3bb0153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb5b95640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 0x7f3bb01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 -- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bb00b2160 msgr2=0x7f3bb0153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bb00b2160 0x7f3bb0153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 -- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 msgr2=0x7f3bb01587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 0x7f3bb01587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 -- 172.21.15.70:0/98991940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009420 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb4b93640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb00d1bc0 0x7f3bb0158270 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000c4f0 tx=0x7f3ba000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3ba5ffb640 1 -- 172.21.15.70:0/98991940 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0005cf0 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3ba5ffb640 1 -- 172.21.15.70:0/98991940 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba0005e50 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3ba5ffb640 1 -- 172.21.15.70:0/98991940 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0007270 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb00b7a10 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.691+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb01542d0 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.695+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0159380 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.695+0000 7f3ba5ffb640 1 -- 172.21.15.70:0/98991940 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f3ba00073d0 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.695+0000 7f3ba5ffb640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b94066ce0 0x7f3b940691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:51.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.695+0000 7f3ba5ffb640 1 -- 172.21.15.70:0/98991940 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f3ba0084670 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.695+0000 7f3bb5394640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b94066ce0 0x7f3b940691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:51.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.695+0000 7f3bb5394640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b94066ce0 0x7f3b940691a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0ad000 tx=0x7f3bac0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:51.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.699+0000 7f3ba5ffb640 1 -- 172.21.15.70:0/98991940 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ba0050b50 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.851+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb0067680 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.857 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.851+0000 7f3ba5ffb640 1 -- 172.21.15.70:0/98991940 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f3ba0054170 con 0x7f3bb00d1bc0 2023-11-26T07:22:51.857 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:51.857 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":66,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:22:48.833584+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:51.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b94066ce0 msgr2=0x7f3b940691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b94066ce0 0x7f3b940691a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0ad000 tx=0x7f3bac0a6000 comp rx=0 tx=0).stop 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb00d1bc0 msgr2=0x7f3bb0158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb00d1bc0 0x7f3bb0158270 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000c4f0 tx=0x7f3ba000c9b0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 shutdown_connections 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b94066ce0 0x7f3b940691a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb00d1bc0 0x7f3bb0158270 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bb015d6e0 0x7f3bb01587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 --2- 172.21.15.70:0/98991940 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bb00b2160 0x7f3bb0153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 >> 172.21.15.70:0/98991940 conn(0x7f3bb009c550 msgr2=0x7f3bb00cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 shutdown_connections 2023-11-26T07:22:51.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:51.855+0000 7f3bb75f8640 1 -- 172.21.15.70:0/98991940 wait complete. 2023-11-26T07:22:51.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:21:52.577151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:21:53.232441+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:22:51.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:22:52.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.015+0000 7fd8be2f7640 1 Processor -- start 2023-11-26T07:22:52.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.015+0000 7fd8be2f7640 1 -- start start 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.015+0000 7fd8be2f7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd8b81596d0 0x7fd8b8071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.015+0000 7fd8be2f7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd8b80ce680 0x7fd8b80b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.015+0000 7fd8be2f7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b80b3200 con 0x7fd8b80b2db0 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.015+0000 7fd8be2f7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b80cbe00 con 0x7fd8b81596d0 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.015+0000 7fd8be2f7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b806c750 con 0x7fd8b80ce680 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd8b81596d0 0x7fd8b8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd8b81596d0 0x7fd8b8071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50882/0 (socket says 172.21.15.70:50882) 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 -- 172.21.15.70:0/3100932750 learned_addr learned my addr 172.21.15.70:0/3100932750 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8bc894640 1 --1- 172.21.15.70:0/3100932750 >> v1:172.21.15.70:6789/0 conn(0x7fd8b80b2db0 0x7fd8b815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35978/0 (socket says 172.21.15.70:35978) 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b77fe640 1 --2- 172.21.15.70:0/3100932750 >> v2:172.21.15.120:3300/0 conn(0x7fd8b80ce680 0x7fd8b80b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 -- 172.21.15.70:0/3100932750 >> v2:172.21.15.120:3300/0 conn(0x7fd8b80ce680 msgr2=0x7fd8b80b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:52.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 --2- 172.21.15.70:0/3100932750 >> v2:172.21.15.120:3300/0 conn(0x7fd8b80ce680 0x7fd8b80b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 -- 172.21.15.70:0/3100932750 >> v1:172.21.15.70:6789/0 conn(0x7fd8b80b2db0 legacy=0x7fd8b815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 -- 172.21.15.70:0/3100932750 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80b3550 con 0x7fd8b81596d0 2023-11-26T07:22:52.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b7fff640 1 --2- 172.21.15.70:0/3100932750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b81596d0 0x7fd8b8071850 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80cbf40 tx=0x7fd8a801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d400eaffc33e45 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b6ffd640 1 -- 172.21.15.70:0/3100932750 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80ab600 con 0x7fd8b81596d0 2023-11-26T07:22:52.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b6ffd640 1 -- 172.21.15.70:0/3100932750 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a80a7050 con 0x7fd8b81596d0 2023-11-26T07:22:52.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.019+0000 7fd8b6ffd640 1 -- 172.21.15.70:0/3100932750 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80ab980 con 0x7fd8b81596d0 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- 172.21.15.70:0/3100932750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b81596d0 msgr2=0x7fd8b8071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/3100932750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b81596d0 0x7fd8b8071850 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80cbf40 tx=0x7fd8a801c500 comp rx=0 tx=0).stop 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- 172.21.15.70:0/3100932750 shutdown_connections 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/3100932750 >> v2:172.21.15.120:3300/0 conn(0x7fd8b80ce680 0x7fd8b80b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/3100932750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b81596d0 0x7fd8b8071850 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- 172.21.15.70:0/3100932750 >> 172.21.15.70:0/3100932750 conn(0x7fd8b806a890 msgr2=0x7fd8b806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- 172.21.15.70:0/3100932750 shutdown_connections 2023-11-26T07:22:52.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- 172.21.15.70:0/3100932750 wait complete. 2023-11-26T07:22:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 Processor -- start 2023-11-26T07:22:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- start start 2023-11-26T07:22:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b80b2db0 0x7fd8b8146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b80ce680 0x7fd8b80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8b81596d0 0x7fd8b814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b814d590 con 0x7fd8b80b2db0 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b814d870 con 0x7fd8b80ce680 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8be2f7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b814db50 con 0x7fd8b81596d0 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b80b2db0 0x7fd8b8146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b80b2db0 0x7fd8b8146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50888/0 (socket says 172.21.15.70:50888) 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8b7fff640 1 -- 172.21.15.70:0/767128141 learned_addr learned my addr 172.21.15.70:0/767128141 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8b77fe640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b80ce680 0x7fd8b80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.023+0000 7fd8bc894640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8b81596d0 0x7fd8b814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b7fff640 1 -- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8b81596d0 msgr2=0x7fd8b814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b7fff640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8b81596d0 0x7fd8b814e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b7fff640 1 -- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b80ce680 msgr2=0x7fd8b80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b7fff640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b80ce680 0x7fd8b80ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b7fff640 1 -- 172.21.15.70:0/767128141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80094d0 con 0x7fd8b80b2db0 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b7fff640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b80b2db0 0x7fd8b8146980 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8019110 tx=0x7fd8a80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b4ff9640 1 -- 172.21.15.70:0/767128141 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80b4620 con 0x7fd8b80b2db0 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b4ff9640 1 -- 172.21.15.70:0/767128141 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a80b4780 con 0x7fd8b80b2db0 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b4ff9640 1 -- 172.21.15.70:0/767128141 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80b4b30 con 0x7fd8b80b2db0 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b814d240 con 0x7fd8b80b2db0 2023-11-26T07:22:52.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b80ace20 con 0x7fd8b80b2db0 2023-11-26T07:22:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b814dd10 con 0x7fd8b80b2db0 2023-11-26T07:22:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b4ff9640 1 -- 172.21.15.70:0/767128141 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd8a80b2070 con 0x7fd8b80b2db0 2023-11-26T07:22:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b4ff9640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd8a4066d10 0x7fd8a40691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.027+0000 7fd8b4ff9640 1 -- 172.21.15.70:0/767128141 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd8a811cf40 con 0x7fd8b80b2db0 2023-11-26T07:22:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.031+0000 7fd8b77fe640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd8a4066d10 0x7fd8a40691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.031+0000 7fd8b77fe640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd8a4066d10 0x7fd8a40691d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8148880 tx=0x7fd8ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.031+0000 7fd8b4ff9640 1 -- 172.21.15.70:0/767128141 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8a80ebc40 con 0x7fd8b80b2db0 2023-11-26T07:22:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.183+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8b814d6d0 con 0x7fd8b80b2db0 2023-11-26T07:22:52.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.183+0000 7fd8b4ff9640 1 -- 172.21.15.70:0/767128141 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8b814d6d0 con 0x7fd8b80b2db0 2023-11-26T07:22:52.189 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:22:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd8a4066d10 msgr2=0x7fd8a40691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd8a4066d10 0x7fd8a40691d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8148880 tx=0x7fd8ac008040 comp rx=0 tx=0).stop 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b80b2db0 msgr2=0x7fd8b8146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b80b2db0 0x7fd8b8146980 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8019110 tx=0x7fd8a80192a0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 shutdown_connections 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8b81596d0 0x7fd8b814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8b80ce680 0x7fd8b80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd8a4066d10 0x7fd8a40691d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 --2- 172.21.15.70:0/767128141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8b80b2db0 0x7fd8b8146980 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 >> 172.21.15.70:0/767128141 conn(0x7fd8b806a890 msgr2=0x7fd8b80cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 shutdown_connections 2023-11-26T07:22:52.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.187+0000 7fd8be2f7640 1 -- 172.21.15.70:0/767128141 wait complete. 2023-11-26T07:22:52.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:22:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e891d640 1 Processor -- start 2023-11-26T07:22:52.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e891d640 1 -- start start 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e891d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8e413e290 0x7fe8e40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e891d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e415fb20 con 0x7fe8e415f6b0 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e891d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e406c520 con 0x7fe8e40cf7c0 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e891d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e40cfc40 con 0x7fe8e413e290 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8e413e290 0x7fe8e40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8e413e290 0x7fe8e40cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50900/0 (socket says 172.21.15.70:50900) 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e259c640 1 -- 172.21.15.70:0/202645628 learned_addr learned my addr 172.21.15.70:0/202645628 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:52.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e2d9d640 1 --1- 172.21.15.70:0/202645628 >> v1:172.21.15.70:6789/0 conn(0x7fe8e415f6b0 0x7fe8e40cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:35992/0 (socket says 172.21.15.70:35992) 2023-11-26T07:22:52.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e259c640 1 -- 172.21.15.70:0/202645628 >> v1:172.21.15.120:6789/0 conn(0x7fe8e40cf7c0 legacy=0x7fe8e415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:52.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e1d9b640 1 -- 172.21.15.70:0/202645628 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188384415 0 0) 0x7fe8dc001120 con 0x7fe8e415f6b0 2023-11-26T07:22:52.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e259c640 1 -- 172.21.15.70:0/202645628 >> v1:172.21.15.70:6789/0 conn(0x7fe8e415f6b0 legacy=0x7fe8e40cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.347+0000 7fe8e259c640 1 -- 172.21.15.70:0/202645628 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e406c800 con 0x7fe8e413e290 2023-11-26T07:22:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e259c640 1 --2- 172.21.15.70:0/202645628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e40cf280 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009e50 tx=0x7fe8d401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89020b88a6808709 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e1d9b640 1 -- 172.21.15.70:0/202645628 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40a58a0 con 0x7fe8e413e290 2023-11-26T07:22:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e1d9b640 1 -- 172.21.15.70:0/202645628 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d40a5a00 con 0x7fe8e413e290 2023-11-26T07:22:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e1d9b640 1 -- 172.21.15.70:0/202645628 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40a5d90 con 0x7fe8e413e290 2023-11-26T07:22:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 -- 172.21.15.70:0/202645628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 msgr2=0x7fe8e40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 --2- 172.21.15.70:0/202645628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e40cf280 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009e50 tx=0x7fe8d401c9e0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 -- 172.21.15.70:0/202645628 shutdown_connections 2023-11-26T07:22:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 --2- 172.21.15.70:0/202645628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e40cf280 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 -- 172.21.15.70:0/202645628 >> 172.21.15.70:0/202645628 conn(0x7fe8e406a890 msgr2=0x7fe8e406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 -- 172.21.15.70:0/202645628 shutdown_connections 2023-11-26T07:22:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 -- 172.21.15.70:0/202645628 wait complete. 2023-11-26T07:22:52.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.351+0000 7fe8e891d640 1 Processor -- start 2023-11-26T07:22:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 -- start start 2023-11-26T07:22:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8e40cf7c0 0x7fe8e4071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e415f6b0 0x7fe8e415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41f8a40 con 0x7fe8e413e290 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41f7b50 con 0x7fe8e415f6b0 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41f7e30 con 0x7fe8e40cf7c0 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e415a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50908/0 (socket says 172.21.15.70:50908) 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 -- 172.21.15.70:0/3227072887 learned_addr learned my addr 172.21.15.70:0/3227072887 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e2d9d640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e415f6b0 0x7fe8e415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e259c640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8e40cf7c0 0x7fe8e4071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 -- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8e40cf7c0 msgr2=0x7fe8e4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8e40cf7c0 0x7fe8e4071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 -- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e415f6b0 msgr2=0x7fe8e415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e415f6b0 0x7fe8e415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 -- 172.21.15.70:0/3227072887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009b30 con 0x7fe8e413e290 2023-11-26T07:22:52.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8d9d9b640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e415a120 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c500 tx=0x7fe8cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8db7fe640 1 -- 172.21.15.70:0/3227072887 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc005220 con 0x7fe8e413e290 2023-11-26T07:22:52.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8db7fe640 1 -- 172.21.15.70:0/3227072887 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc005380 con 0x7fe8e413e290 2023-11-26T07:22:52.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8db7fe640 1 -- 172.21.15.70:0/3227072887 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc007270 con 0x7fe8e413e290 2023-11-26T07:22:52.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e41f8110 con 0x7fe8e413e290 2023-11-26T07:22:52.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e41f86d0 con 0x7fe8e413e290 2023-11-26T07:22:52.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.355+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e41f8bf0 con 0x7fe8e413e290 2023-11-26T07:22:52.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.359+0000 7fe8db7fe640 1 -- 172.21.15.70:0/3227072887 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fe8cc0073d0 con 0x7fe8e413e290 2023-11-26T07:22:52.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.359+0000 7fe8db7fe640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c4066d10 0x7fe8c40691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.359+0000 7fe8db7fe640 1 -- 172.21.15.70:0/3227072887 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe8cc0820f0 con 0x7fe8e413e290 2023-11-26T07:22:52.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.359+0000 7fe8e259c640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c4066d10 0x7fe8c40691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.359+0000 7fe8e259c640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c4066d10 0x7fe8c40691d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ae000 tx=0x7fe8d40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.363+0000 7fe8db7fe640 1 -- 172.21.15.70:0/3227072887 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8e41f8bf0 con 0x7fe8e413e290 2023-11-26T07:22:52.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.511+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8e4067680 con 0x7fe8e413e290 2023-11-26T07:22:52.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.511+0000 7fe8db7fe640 1 -- 172.21.15.70:0/3227072887 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8cc050e20 con 0x7fe8e413e290 2023-11-26T07:22:52.517 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:22:52.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c4066d10 msgr2=0x7fe8c40691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c4066d10 0x7fe8c40691d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ae000 tx=0x7fe8d40a7070 comp rx=0 tx=0).stop 2023-11-26T07:22:52.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 msgr2=0x7fe8e415a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e415a120 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00c500 tx=0x7fe8cc00c9c0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 shutdown_connections 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8c4066d10 0x7fe8c40691d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e413e290 0x7fe8e415a120 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e415f6b0 0x7fe8e415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 --2- 172.21.15.70:0/3227072887 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8e40cf7c0 0x7fe8e4071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 >> 172.21.15.70:0/3227072887 conn(0x7fe8e406a890 msgr2=0x7fe8e415b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 shutdown_connections 2023-11-26T07:22:52.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.515+0000 7fe8e891d640 1 -- 172.21.15.70:0/3227072887 wait complete. 2023-11-26T07:22:52.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:22:52.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23c617640 1 Processor -- start 2023-11-26T07:22:52.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23c617640 1 -- start start 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23c617640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd234143ac0 0x7fd234070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23c617640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd2340cf990 0x7fd2340cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23c617640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2340cc730 con 0x7fd2340708b0 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23c617640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd234143ea0 con 0x7fd234143ac0 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23c617640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd234070ee0 con 0x7fd2340cf990 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23a3b3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd234143ac0 0x7fd234070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23a3b3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd234143ac0 0x7fd234070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50922/0 (socket says 172.21.15.70:50922) 2023-11-26T07:22:52.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23a3b3640 1 -- 172.21.15.70:0/1234196582 learned_addr learned my addr 172.21.15.70:0/1234196582 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:52.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23a3b3640 1 -- 172.21.15.70:0/1234196582 >> v2:172.21.15.120:3300/0 conn(0x7fd2340cf990 msgr2=0x7fd2340cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:52.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23abb4640 1 --2- 172.21.15.70:0/1234196582 >> v2:172.21.15.120:3300/0 conn(0x7fd2340cf990 0x7fd2340cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23a3b3640 1 --2- 172.21.15.70:0/1234196582 >> v2:172.21.15.120:3300/0 conn(0x7fd2340cf990 0x7fd2340cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23a3b3640 1 -- 172.21.15.70:0/1234196582 >> v1:172.21.15.120:6789/0 conn(0x7fd2340708b0 legacy=0x7fd2340cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:52.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23a3b3640 1 -- 172.21.15.70:0/1234196582 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340711c0 con 0x7fd234143ac0 2023-11-26T07:22:52.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.675+0000 7fd23abb4640 1 --2- 172.21.15.70:0/1234196582 >> v2:172.21.15.120:3300/0 conn(0x7fd2340cf990 0x7fd2340cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:52.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23a3b3640 1 --2- 172.21.15.70:0/1234196582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd234070370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd23406e570 tx=0x7fd23001eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65678327c80ad02d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd2393b1640 1 -- 172.21.15.70:0/1234196582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300a7c60 con 0x7fd234143ac0 2023-11-26T07:22:52.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd2393b1640 1 -- 172.21.15.70:0/1234196582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2300a7dc0 con 0x7fd234143ac0 2023-11-26T07:22:52.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd2393b1640 1 -- 172.21.15.70:0/1234196582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300af660 con 0x7fd234143ac0 2023-11-26T07:22:52.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 -- 172.21.15.70:0/1234196582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 msgr2=0x7fd234070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 --2- 172.21.15.70:0/1234196582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd234070370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd23406e570 tx=0x7fd23001eb90 comp rx=0 tx=0).stop 2023-11-26T07:22:52.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 -- 172.21.15.70:0/1234196582 shutdown_connections 2023-11-26T07:22:52.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 --2- 172.21.15.70:0/1234196582 >> v2:172.21.15.120:3300/0 conn(0x7fd2340cf990 0x7fd2340cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 --2- 172.21.15.70:0/1234196582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd234070370 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 -- 172.21.15.70:0/1234196582 >> 172.21.15.70:0/1234196582 conn(0x7fd23406a890 msgr2=0x7fd23406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:52.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 -- 172.21.15.70:0/1234196582 shutdown_connections 2023-11-26T07:22:52.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.679+0000 7fd23c617640 1 -- 172.21.15.70:0/1234196582 wait complete. 2023-11-26T07:22:52.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 Processor -- start 2023-11-26T07:22:52.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 -- start start 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2340708b0 0x7fd234155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2340cf990 0x7fd234137900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd2340ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2341380e0 con 0x7fd234143ac0 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234138630 con 0x7fd2340708b0 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd234155d00 con 0x7fd2340cf990 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd2340ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd2340ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50938/0 (socket says 172.21.15.70:50938) 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 -- 172.21.15.70:0/2611537978 learned_addr learned my addr 172.21.15.70:0/2611537978 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd239bb2640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2340cf990 0x7fd234137900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23a3b3640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2340708b0 0x7fd234155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 -- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2340cf990 msgr2=0x7fd234137900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2340cf990 0x7fd234137900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 -- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2340708b0 msgr2=0x7fd234155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2340708b0 0x7fd234155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 -- 172.21.15.70:0/2611537978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23000b770 con 0x7fd234143ac0 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23abb4640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd2340ac8e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00cf20 tx=0x7fd22c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd22affd640 1 -- 172.21.15.70:0/2611537978 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00d840 con 0x7fd234143ac0 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd22affd640 1 -- 172.21.15.70:0/2611537978 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c00d9a0 con 0x7fd234143ac0 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd22affd640 1 -- 172.21.15.70:0/2611537978 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00dd50 con 0x7fd234143ac0 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd234155fe0 con 0x7fd234143ac0 2023-11-26T07:22:52.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd234137e40 con 0x7fd234143ac0 2023-11-26T07:22:52.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.683+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2341387c0 con 0x7fd234143ac0 2023-11-26T07:22:52.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.687+0000 7fd22affd640 1 -- 172.21.15.70:0/2611537978 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd22c01e3b0 con 0x7fd234143ac0 2023-11-26T07:22:52.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.687+0000 7fd22affd640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd218066ce0 0x7fd2180691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:52.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.687+0000 7fd22affd640 1 -- 172.21.15.70:0/2611537978 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fd22c083480 con 0x7fd234143ac0 2023-11-26T07:22:52.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.687+0000 7fd23a3b3640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd218066ce0 0x7fd2180691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:52.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.687+0000 7fd23a3b3640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd218066ce0 0x7fd2180691a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b1000 tx=0x7fd230008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:52.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.691+0000 7fd22affd640 1 -- 172.21.15.70:0/2611537978 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd22c0520d0 con 0x7fd234143ac0 2023-11-26T07:22:52.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd23406d520 con 0x7fd234143ac0 2023-11-26T07:22:52.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd22affd640 1 -- 172.21.15.70:0/2611537978 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd22c01a020 con 0x7fd234143ac0 2023-11-26T07:22:52.852 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd218066ce0 msgr2=0x7fd2180691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd218066ce0 0x7fd2180691a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b1000 tx=0x7fd230008040 comp rx=0 tx=0).stop 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 msgr2=0x7fd2340ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd2340ac8e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00cf20 tx=0x7fd22c00a7d0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 shutdown_connections 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd218066ce0 0x7fd2180691a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd234143ac0 0x7fd2340ac8e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd2340cf990 0x7fd234137900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 --2- 172.21.15.70:0/2611537978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2340708b0 0x7fd234155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 >> 172.21.15.70:0/2611537978 conn(0x7fd23406a890 msgr2=0x7fd23415a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 shutdown_connections 2023-11-26T07:22:52.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:52.847+0000 7fd23c617640 1 -- 172.21.15.70:0/2611537978 wait complete. 2023-11-26T07:22:52.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.007+0000 7fe8c96bb640 1 Processor -- start 2023-11-26T07:22:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.007+0000 7fe8c96bb640 1 -- start start 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c96bb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe8c415d2a0 0x7fe8c40d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c96bb640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c415d680 0x7fe8c40cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c96bb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8c40d0e80 0x7fe8c40d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c96bb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c40cdc40 con 0x7fe8c40d0e80 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c96bb640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c40ce7a0 con 0x7fe8c415d2a0 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c96bb640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40d1440 con 0x7fe8c415d680 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8c40d0e80 0x7fe8c40d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe8c40d0e80 0x7fe8c40d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50942/0 (socket says 172.21.15.70:50942) 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 -- 172.21.15.70:0/2816723509 learned_addr learned my addr 172.21.15.70:0/2816723509 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c3fff640 1 --2- 172.21.15.70:0/2816723509 >> v2:172.21.15.120:3300/0 conn(0x7fe8c415d2a0 0x7fe8c40d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/2816723509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c415d680 0x7fe8c40cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 -- 172.21.15.70:0/2816723509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c415d680 msgr2=0x7fe8c40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 --2- 172.21.15.70:0/2816723509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c415d680 0x7fe8c40cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 -- 172.21.15.70:0/2816723509 >> v2:172.21.15.120:3300/0 conn(0x7fe8c415d2a0 msgr2=0x7fe8c40d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 --2- 172.21.15.70:0/2816723509 >> v2:172.21.15.120:3300/0 conn(0x7fe8c415d2a0 0x7fe8c40d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 -- 172.21.15.70:0/2816723509 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40cde70 con 0x7fe8c40d0e80 2023-11-26T07:22:53.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.011+0000 7fe8c8eba640 1 --2- 172.21.15.70:0/2816723509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c40d0e80 0x7fe8c40d1680 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe8c408b990 tx=0x7fe8bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e7c31be3d77a41 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c2ffd640 1 -- 172.21.15.70:0/2816723509 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0a56a0 con 0x7fe8c40d0e80 2023-11-26T07:22:53.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c2ffd640 1 -- 172.21.15.70:0/2816723509 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc0a5800 con 0x7fe8c40d0e80 2023-11-26T07:22:53.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c2ffd640 1 -- 172.21.15.70:0/2816723509 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0a5b90 con 0x7fe8c40d0e80 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- 172.21.15.70:0/2816723509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c40d0e80 msgr2=0x7fe8c40d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/2816723509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c40d0e80 0x7fe8c40d1680 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe8c408b990 tx=0x7fe8bc01c910 comp rx=0 tx=0).stop 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- 172.21.15.70:0/2816723509 shutdown_connections 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/2816723509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c40d0e80 0x7fe8c40d1680 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/2816723509 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c415d680 0x7fe8c40cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/2816723509 >> v2:172.21.15.120:3300/0 conn(0x7fe8c415d2a0 0x7fe8c40d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- 172.21.15.70:0/2816723509 >> 172.21.15.70:0/2816723509 conn(0x7fe8c40d30a0 msgr2=0x7fe8c40d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- 172.21.15.70:0/2816723509 shutdown_connections 2023-11-26T07:22:53.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- 172.21.15.70:0/2816723509 wait complete. 2023-11-26T07:22:53.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 Processor -- start 2023-11-26T07:22:53.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- start start 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c40d0e80 0x7fe8c4152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c415d2a0 0x7fe8c406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8c415d680 0x7fe8c4155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c406b000 con 0x7fe8c415d2a0 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c406b2e0 con 0x7fe8c415d680 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c96bb640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c406b5c0 con 0x7fe8c40d0e80 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c415d2a0 0x7fe8c406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c415d2a0 0x7fe8c406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50950/0 (socket says 172.21.15.70:50950) 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.015+0000 7fe8c37fe640 1 -- 172.21.15.70:0/671673664 learned_addr learned my addr 172.21.15.70:0/671673664 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c3fff640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c40d0e80 0x7fe8c4152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c8eba640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8c415d680 0x7fe8c4155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c37fe640 1 -- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c40d0e80 msgr2=0x7fe8c4152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c40d0e80 0x7fe8c4152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c37fe640 1 -- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8c415d680 msgr2=0x7fe8c4155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8c415d680 0x7fe8c4155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c37fe640 1 -- 172.21.15.70:0/671673664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc009b30 con 0x7fe8c415d2a0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c37fe640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c415d2a0 0x7fe8c406c0a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800d7d0 tx=0x7fe8b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c0ff9640 1 -- 172.21.15.70:0/671673664 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b800b6c0 con 0x7fe8c415d2a0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c0ff9640 1 -- 172.21.15.70:0/671673664 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b800b820 con 0x7fe8c415d2a0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c0ff9640 1 -- 172.21.15.70:0/671673664 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b800bbd0 con 0x7fe8c415d2a0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c406b8a0 con 0x7fe8c415d2a0 2023-11-26T07:22:53.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c4154260 con 0x7fe8c415d2a0 2023-11-26T07:22:53.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c4067500 con 0x7fe8c415d2a0 2023-11-26T07:22:53.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c0ff9640 1 -- 172.21.15.70:0/671673664 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fe8b800bd30 con 0x7fe8c415d2a0 2023-11-26T07:22:53.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c0ff9640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8b0066ce0 0x7fe8b00691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c0ff9640 1 -- 172.21.15.70:0/671673664 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fe8b8085690 con 0x7fe8c415d2a0 2023-11-26T07:22:53.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.019+0000 7fe8c3fff640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8b0066ce0 0x7fe8b00691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.023+0000 7fe8c3fff640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8b0066ce0 0x7fe8b00691a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400ba30 tx=0x7fe8b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.023+0000 7fe8c0ff9640 1 -- 172.21.15.70:0/671673664 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8b8051b40 con 0x7fe8c415d2a0 2023-11-26T07:22:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.203+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8c4073530 con 0x7fe8c415d2a0 2023-11-26T07:22:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c0ff9640 1 -- 172.21.15.70:0/671673664 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fe8b8055160 con 0x7fe8c415d2a0 2023-11-26T07:22:53.210 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:53.210 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/3935694912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3935694912},{"type":"v1","addr":"172.21.15.120:6834","nonce":3935694912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/886224003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":886224003},{"type":"v1","addr":"172.21.15.120:6835","nonce":886224003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1027556569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1027556569},{"type":"v1","addr":"172.21.15.70:6835","nonce":1027556569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:54.236576+0000","modified":"2023-11-26T07:21:57.243631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3834969891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3834969891},{"type":"v1","addr":"172.21.15.70:6837","nonce":3834969891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 39 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8b0066ce0 msgr2=0x7fe8b00691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8b0066ce0 0x7fe8b00691a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400ba30 tx=0x7fe8b4008040 comp rx=0 tx=0).stop 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c415d2a0 msgr2=0x7fe8c406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c415d2a0 0x7fe8c406c0a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800d7d0 tx=0x7fe8b800dc90 comp rx=0 tx=0).stop 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 shutdown_connections 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe8b0066ce0 0x7fe8b00691a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8c415d2a0 0x7fe8c406c0a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8c415d680 0x7fe8c4155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 --2- 172.21.15.70:0/671673664 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe8c40d0e80 0x7fe8c4152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 >> 172.21.15.70:0/671673664 conn(0x7fe8c40d30a0 msgr2=0x7fe8c40b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 shutdown_connections 2023-11-26T07:22:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.207+0000 7fe8c96bb640 1 -- 172.21.15.70:0/671673664 wait complete. 2023-11-26T07:22:53.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.363+0000 7fcf0289a640 1 Processor -- start 2023-11-26T07:22:53.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.363+0000 7fcf0289a640 1 -- start start 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf0289a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf0289a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcefc15f4e0 0x7fcefc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf0289a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc06c520 con 0x7fcefc13e290 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf0289a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc06c800 con 0x7fcefc15f4e0 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf0289a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc06cae0 con 0x7fcefc0cf990 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcefc15f4e0 0x7fcefc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcefc15f4e0 0x7fcefc0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50958/0 (socket says 172.21.15.70:50958) 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 -- 172.21.15.70:0/3821005765 learned_addr learned my addr 172.21.15.70:0/3821005765 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcefb7fe640 1 --2- 172.21.15.70:0/3821005765 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 -- 172.21.15.70:0/3821005765 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 msgr2=0x7fcefc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:53.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 --2- 172.21.15.70:0/3821005765 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 -- 172.21.15.70:0/3821005765 >> v1:172.21.15.120:6789/0 conn(0x7fcefc13e290 legacy=0x7fcefc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcefaffd640 1 -- 172.21.15.70:0/3821005765 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920304133 0 0) 0x7fcefc06c520 con 0x7fcefc13e290 2023-11-26T07:22:53.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 -- 172.21.15.70:0/3821005765 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc06cdc0 con 0x7fcefc15f4e0 2023-11-26T07:22:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.367+0000 7fcf00e37640 1 --2- 172.21.15.70:0/3821005765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc15f4e0 0x7fcefc0cd7b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009e50 tx=0x7fcef401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806a0677dff7544e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcefaffd640 1 -- 172.21.15.70:0/3821005765 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40a58d0 con 0x7fcefc15f4e0 2023-11-26T07:22:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcefaffd640 1 -- 172.21.15.70:0/3821005765 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef40a5a30 con 0x7fcefc15f4e0 2023-11-26T07:22:53.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcefaffd640 1 -- 172.21.15.70:0/3821005765 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40a5dc0 con 0x7fcefc15f4e0 2023-11-26T07:22:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- 172.21.15.70:0/3821005765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc15f4e0 msgr2=0x7fcefc0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 --2- 172.21.15.70:0/3821005765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc15f4e0 0x7fcefc0cd7b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009e50 tx=0x7fcef401c9e0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- 172.21.15.70:0/3821005765 shutdown_connections 2023-11-26T07:22:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 --2- 172.21.15.70:0/3821005765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc15f4e0 0x7fcefc0cd7b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 --2- 172.21.15.70:0/3821005765 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- 172.21.15.70:0/3821005765 >> 172.21.15.70:0/3821005765 conn(0x7fcefc06a890 msgr2=0x7fcefc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- 172.21.15.70:0/3821005765 shutdown_connections 2023-11-26T07:22:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- 172.21.15.70:0/3821005765 wait complete. 2023-11-26T07:22:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 Processor -- start 2023-11-26T07:22:53.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- start start 2023-11-26T07:22:53.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc13e290 0x7fcefc138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcefc15f4e0 0x7fcefc15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc138850 con 0x7fcefc13e290 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc138a80 con 0x7fcefc15f4e0 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcf0289a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc138d60 con 0x7fcefc0cf990 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.371+0000 7fcefb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc13e290 0x7fcefc138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc13e290 0x7fcefc138310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50972/0 (socket says 172.21.15.70:50972) 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 -- 172.21.15.70:0/347495979 learned_addr learned my addr 172.21.15.70:0/347495979 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcf00e37640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcefc15f4e0 0x7fcefc15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefbfff640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 -- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 msgr2=0x7fcefc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 -- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcefc15f4e0 msgr2=0x7fcefc15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcefc15f4e0 0x7fcefc15a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 -- 172.21.15.70:0/347495979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4009b30 con 0x7fcefc13e290 2023-11-26T07:22:53.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcefb7fe640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc13e290 0x7fcefc138310 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcef000e9b0 tx=0x7fcef000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcef8ff9640 1 -- 172.21.15.70:0/347495979 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00096b0 con 0x7fcefc13e290 2023-11-26T07:22:53.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcef8ff9640 1 -- 172.21.15.70:0/347495979 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef000c9a0 con 0x7fcefc13e290 2023-11-26T07:22:53.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc139040 con 0x7fcefc13e290 2023-11-26T07:22:53.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcef8ff9640 1 -- 172.21.15.70:0/347495979 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef000cd30 con 0x7fcefc13e290 2023-11-26T07:22:53.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc070410 con 0x7fcefc13e290 2023-11-26T07:22:53.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc070630 con 0x7fcefc13e290 2023-11-26T07:22:53.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcef8ff9640 1 -- 172.21.15.70:0/347495979 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fcef0013470 con 0x7fcefc13e290 2023-11-26T07:22:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcef8ff9640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcee8066ce0 0x7fcee80691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.375+0000 7fcef8ff9640 1 -- 172.21.15.70:0/347495979 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fcef0082b00 con 0x7fcefc13e290 2023-11-26T07:22:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.379+0000 7fcefbfff640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcee8066ce0 0x7fcee80691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.379+0000 7fcefbfff640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcee8066ce0 0x7fcee80691a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fceec000f70 tx=0x7fceec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.379+0000 7fcef8ff9640 1 -- 172.21.15.70:0/347495979 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcef0051880 con 0x7fcefc13e290 2023-11-26T07:22:53.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcefc067680 con 0x7fcefc13e290 2023-11-26T07:22:53.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcef8ff9640 1 -- 172.21.15.70:0/347495979 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16630 (secure 0 0 0) 0x7fcef0054ea0 con 0x7fcefc13e290 2023-11-26T07:22:53.540 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:53.540 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":66,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:22:48.833584+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcee8066ce0 msgr2=0x7fcee80691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcee8066ce0 0x7fcee80691a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fceec000f70 tx=0x7fceec009040 comp rx=0 tx=0).stop 2023-11-26T07:22:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc13e290 msgr2=0x7fcefc138310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc13e290 0x7fcefc138310 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcef000e9b0 tx=0x7fcef000ee70 comp rx=0 tx=0).stop 2023-11-26T07:22:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 shutdown_connections 2023-11-26T07:22:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcee8066ce0 0x7fcee80691a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcefc13e290 0x7fcefc138310 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcefc15f4e0 0x7fcefc15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 --2- 172.21.15.70:0/347495979 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcefc0cf990 0x7fcefc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.535+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 >> 172.21.15.70:0/347495979 conn(0x7fcefc06a890 msgr2=0x7fcefc13aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.539+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 shutdown_connections 2023-11-26T07:22:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.539+0000 7fcf0289a640 1 -- 172.21.15.70:0/347495979 wait complete. 2023-11-26T07:22:53.562 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:22:53.562 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d8654640 1 Processor -- start 2023-11-26T07:22:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d8654640 1 -- start start 2023-11-26T07:22:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d8654640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f35d015d6e0 0x7f35d00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d8654640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00cf0e0 con 0x7f35d00d1bc0 2023-11-26T07:22:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d8654640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00ceb20 con 0x7f35d00b2160 2023-11-26T07:22:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d8654640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d015dac0 con 0x7f35d015d6e0 2023-11-26T07:22:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d6bf1640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f35d00d1bc0 0x7f35d00b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40462/0 (socket says 172.21.15.70:40462) 2023-11-26T07:22:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d6bf1640 1 -- 172.21.15.70:0/3855603066 learned_addr learned my addr 172.21.15.70:0/3855603066 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d63f0640 1 --2- 172.21.15.70:0/3855603066 >> v2:172.21.15.120:3300/0 conn(0x7f35d015d6e0 0x7f35d00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d53ee640 1 -- 172.21.15.70:0/3855603066 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928613271 0 0) 0x7f35d00cf0e0 con 0x7f35d00d1bc0 2023-11-26T07:22:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d53ee640 1 -- 172.21.15.70:0/3855603066 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc003530 con 0x7f35d00d1bc0 2023-11-26T07:22:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d53ee640 1 -- 172.21.15.70:0/3855603066 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013566727 0 0) 0x7f35d00ceb20 con 0x7f35d00b2160 2023-11-26T07:22:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d53ee640 1 -- 172.21.15.70:0/3855603066 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d00cf0e0 con 0x7f35d00b2160 2023-11-26T07:22:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d63f0640 1 -- 172.21.15.70:0/3855603066 >> v1:172.21.15.120:6789/0 conn(0x7f35d00b2160 legacy=0x7f35d00d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d63f0640 1 -- 172.21.15.70:0/3855603066 >> v1:172.21.15.70:6789/0 conn(0x7f35d00d1bc0 legacy=0x7f35d00b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.695+0000 7f35d63f0640 1 -- 172.21.15.70:0/3855603066 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00cee00 con 0x7f35d015d6e0 2023-11-26T07:22:53.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d63f0640 1 --2- 172.21.15.70:0/3855603066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d00d0df0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0097c0 tx=0x7f35cc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158f94dab4ad7013 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d53ee640 1 -- 172.21.15.70:0/3855603066 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0ab600 con 0x7f35d015d6e0 2023-11-26T07:22:53.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d53ee640 1 -- 172.21.15.70:0/3855603066 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc0a7050 con 0x7f35d015d6e0 2023-11-26T07:22:53.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d53ee640 1 -- 172.21.15.70:0/3855603066 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0ab960 con 0x7f35d015d6e0 2023-11-26T07:22:53.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d8654640 1 -- 172.21.15.70:0/3855603066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 msgr2=0x7f35d00d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d8654640 1 --2- 172.21.15.70:0/3855603066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d00d0df0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0097c0 tx=0x7f35cc01c480 comp rx=0 tx=0).stop 2023-11-26T07:22:53.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d8654640 1 -- 172.21.15.70:0/3855603066 shutdown_connections 2023-11-26T07:22:53.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d8654640 1 --2- 172.21.15.70:0/3855603066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d00d0df0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d8654640 1 -- 172.21.15.70:0/3855603066 >> 172.21.15.70:0/3855603066 conn(0x7f35d009c550 msgr2=0x7f35d00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d8654640 1 -- 172.21.15.70:0/3855603066 shutdown_connections 2023-11-26T07:22:53.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.699+0000 7f35d8654640 1 -- 172.21.15.70:0/3855603066 wait complete. 2023-11-26T07:22:53.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 Processor -- start 2023-11-26T07:22:53.707 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 -- start start 2023-11-26T07:22:53.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35d00b2160 0x7f35d0154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35d00d1bc0 0x7f35d00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d015e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0154580 con 0x7f35d00b2160 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0154a20 con 0x7f35d015d6e0 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00c7130 con 0x7f35d00d1bc0 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35d00b2160 0x7f35d0154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35d00b2160 0x7f35d0154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51424/0 (socket says 172.21.15.70:51424) 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 -- 172.21.15.70:0/3451023683 learned_addr learned my addr 172.21.15.70:0/3451023683 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d6bf1640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d015e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d5bef640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35d00d1bc0 0x7f35d00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 -- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35d00d1bc0 msgr2=0x7f35d00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35d00d1bc0 0x7f35d00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 -- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 msgr2=0x7f35d015e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d015e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 -- 172.21.15.70:0/3451023683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc009420 con 0x7f35d00b2160 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d5bef640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35d00d1bc0 0x7f35d00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d6bf1640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d015e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d63f0640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35d00b2160 0x7f35d0154040 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f35cc000c10 tx=0x7f35cc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35c6ffd640 1 -- 172.21.15.70:0/3451023683 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0b4400 con 0x7f35d00b2160 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35c6ffd640 1 -- 172.21.15.70:0/3451023683 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc0b4560 con 0x7f35d00b2160 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35c6ffd640 1 -- 172.21.15.70:0/3451023683 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0b48d0 con 0x7f35d00b2160 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d00c7410 con 0x7f35d00b2160 2023-11-26T07:22:53.711 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.703+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d00c79d0 con 0x7f35d00b2160 2023-11-26T07:22:53.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.707+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d0067680 con 0x7f35d00b2160 2023-11-26T07:22:53.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.707+0000 7f35c6ffd640 1 -- 172.21.15.70:0/3451023683 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f35cc0b2040 con 0x7f35d00b2160 2023-11-26T07:22:53.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.707+0000 7f35c6ffd640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35b4066ce0 0x7f35b40691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:53.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.707+0000 7f35c6ffd640 1 -- 172.21.15.70:0/3451023683 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f35cc11c6e0 con 0x7f35d00b2160 2023-11-26T07:22:53.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.707+0000 7f35d5bef640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35b4066ce0 0x7f35b40691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:53.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.707+0000 7f35d5bef640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35b4066ce0 0x7f35b40691a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f35d015bd00 tx=0x7f35c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:53.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.711+0000 7f35c6ffd640 1 -- 172.21.15.70:0/3451023683 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35cc0eb3e0 con 0x7f35d00b2160 2023-11-26T07:22:53.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35d0154c40 con 0x7f35d00b2160 2023-11-26T07:22:53.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35c6ffd640 1 -- 172.21.15.70:0/3451023683 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f35cc0b0090 con 0x7f35d00b2160 2023-11-26T07:22:53.900 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:53.900 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/3935694912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3935694912},{"type":"v1","addr":"172.21.15.120:6834","nonce":3935694912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/886224003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":886224003},{"type":"v1","addr":"172.21.15.120:6835","nonce":886224003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1027556569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1027556569},{"type":"v1","addr":"172.21.15.70:6835","nonce":1027556569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:54.236576+0000","modified":"2023-11-26T07:21:57.243631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3834969891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3834969891},{"type":"v1","addr":"172.21.15.70:6837","nonce":3834969891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:53.900 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 39 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35b4066ce0 msgr2=0x7f35b40691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35b4066ce0 0x7f35b40691a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f35d015bd00 tx=0x7f35c0009040 comp rx=0 tx=0).stop 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35d00b2160 msgr2=0x7f35d0154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35d00b2160 0x7f35d0154040 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f35cc000c10 tx=0x7f35cc019220 comp rx=0 tx=0).stop 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 shutdown_connections 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35d015d6e0 0x7f35d015e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f35d00d1bc0 0x7f35d00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f35b4066ce0 0x7f35b40691a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 --2- 172.21.15.70:0/3451023683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35d00b2160 0x7f35d0154040 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 >> 172.21.15.70:0/3451023683 conn(0x7f35d009c550 msgr2=0x7f35d0160440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:53.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 shutdown_connections 2023-11-26T07:22:53.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:53.895+0000 7f35d8654640 1 -- 172.21.15.70:0/3451023683 wait complete. 2023-11-26T07:22:53.921 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:22:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fdac8640 1 Processor -- start 2023-11-26T07:22:54.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fdac8640 1 -- start start 2023-11-26T07:22:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fdac8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d230 0x7f56f80d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fdac8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f56f80d01b0 0x7f56f80cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fdac8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80ce180 con 0x7f56f815d610 2023-11-26T07:22:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fdac8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f80ce3b0 con 0x7f56f80d01b0 2023-11-26T07:22:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fdac8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80ce690 con 0x7f56f815d230 2023-11-26T07:22:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fd2c7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f56f80d01b0 0x7f56f80cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fd2c7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f56f80d01b0 0x7f56f80cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51426/0 (socket says 172.21.15.70:51426) 2023-11-26T07:22:54.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fd2c7640 1 -- 172.21.15.70:0/1861666749 learned_addr learned my addr 172.21.15.70:0/1861666749 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:54.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fcac6640 1 --2- 172.21.15.70:0/1861666749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d230 0x7f56f80d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fd2c7640 1 -- 172.21.15.70:0/1861666749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d230 msgr2=0x7f56f80d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fd2c7640 1 --2- 172.21.15.70:0/1861666749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d230 0x7f56f80d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fd2c7640 1 -- 172.21.15.70:0/1861666749 >> v1:172.21.15.120:6789/0 conn(0x7f56f815d610 legacy=0x7f56f80cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.055+0000 7f56fd2c7640 1 -- 172.21.15.70:0/1861666749 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80ce970 con 0x7f56f80d01b0 2023-11-26T07:22:54.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fd2c7640 1 --2- 172.21.15.70:0/1861666749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f80d01b0 0x7f56f80cdc40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009e50 tx=0x7f56f001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8532b4aff3209f0c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56f77fe640 1 -- 172.21.15.70:0/1861666749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00a5840 con 0x7f56f80d01b0 2023-11-26T07:22:54.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56f77fe640 1 -- 172.21.15.70:0/1861666749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f00a59a0 con 0x7f56f80d01b0 2023-11-26T07:22:54.064 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56f77fe640 1 -- 172.21.15.70:0/1861666749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00a5d30 con 0x7f56f80d01b0 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 -- 172.21.15.70:0/1861666749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f80d01b0 msgr2=0x7f56f80cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 --2- 172.21.15.70:0/1861666749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f80d01b0 0x7f56f80cdc40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009e50 tx=0x7f56f001c980 comp rx=0 tx=0).stop 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 -- 172.21.15.70:0/1861666749 shutdown_connections 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 --2- 172.21.15.70:0/1861666749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f80d01b0 0x7f56f80cdc40 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 --2- 172.21.15.70:0/1861666749 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d230 0x7f56f80d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 -- 172.21.15.70:0/1861666749 >> 172.21.15.70:0/1861666749 conn(0x7f56f80d30c0 msgr2=0x7f56f80d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 -- 172.21.15.70:0/1861666749 shutdown_connections 2023-11-26T07:22:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.059+0000 7f56fdac8640 1 -- 172.21.15.70:0/1861666749 wait complete. 2023-11-26T07:22:54.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 Processor -- start 2023-11-26T07:22:54.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 -- start start 2023-11-26T07:22:54.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f80d01b0 0x7f56f8150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f815d230 0x7f56f8153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d610 0x7f56f8157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80cbe10 con 0x7f56f815d230 2023-11-26T07:22:54.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80cb800 con 0x7f56f80d01b0 2023-11-26T07:22:54.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8154270 con 0x7f56f815d610 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f815d230 0x7f56f8153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f815d230 0x7f56f8153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51432/0 (socket says 172.21.15.70:51432) 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 -- 172.21.15.70:0/304667441 learned_addr learned my addr 172.21.15.70:0/304667441 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fd2c7640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d610 0x7f56f8157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fcac6640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f80d01b0 0x7f56f8150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 -- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d610 msgr2=0x7f56f8157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d610 0x7f56f8157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 -- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f80d01b0 msgr2=0x7f56f8150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f80d01b0 0x7f56f8150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 -- 172.21.15.70:0/304667441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0009b30 con 0x7f56f815d230 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fcac6640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f80d01b0 0x7f56f8150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:54.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f7fff640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f815d230 0x7f56f8153c30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c3c0 tx=0x7f56e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f57fa640 1 -- 172.21.15.70:0/304667441 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e40052d0 con 0x7f56f815d230 2023-11-26T07:22:54.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f57fa640 1 -- 172.21.15.70:0/304667441 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4005430 con 0x7f56f815d230 2023-11-26T07:22:54.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56f57fa640 1 -- 172.21.15.70:0/304667441 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4003840 con 0x7f56f815d230 2023-11-26T07:22:54.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f80cbaa0 con 0x7f56f815d230 2023-11-26T07:22:54.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f8158d00 con 0x7f56f815d230 2023-11-26T07:22:54.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.063+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f80b6d20 con 0x7f56f815d230 2023-11-26T07:22:54.071 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.067+0000 7f56f57fa640 1 -- 172.21.15.70:0/304667441 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f56e40039a0 con 0x7f56f815d230 2023-11-26T07:22:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.067+0000 7f56f57fa640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f56dc066ce0 0x7f56dc0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.067+0000 7f56f57fa640 1 -- 172.21.15.70:0/304667441 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7f56e4084670 con 0x7f56f815d230 2023-11-26T07:22:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.067+0000 7f56fcac6640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f56dc066ce0 0x7f56dc0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.067+0000 7f56fcac6640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f56dc066ce0 0x7f56dc0691a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f56f806c8e0 tx=0x7f56ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.071+0000 7f56f57fa640 1 -- 172.21.15.70:0/304667441 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56e4050b50 con 0x7f56f815d230 2023-11-26T07:22:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.251+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56f8067c10 con 0x7f56f815d230 2023-11-26T07:22:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56f57fa640 1 -- 172.21.15.70:0/304667441 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f56e4017090 con 0x7f56f815d230 2023-11-26T07:22:54.258 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:54.259 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/3935694912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3935694912},{"type":"v1","addr":"172.21.15.120:6834","nonce":3935694912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/886224003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":886224003},{"type":"v1","addr":"172.21.15.120:6835","nonce":886224003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1027556569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1027556569},{"type":"v1","addr":"172.21.15.70:6835","nonce":1027556569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:21:54.236576+0000","modified":"2023-11-26T07:21:57.243631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.70:6837/3834969891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":3834969891},{"type":"v1","addr":"172.21.15.70:6837","nonce":3834969891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-26T07:22:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 39 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f56dc066ce0 msgr2=0x7f56dc0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f56dc066ce0 0x7f56dc0691a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f56f806c8e0 tx=0x7f56ec008040 comp rx=0 tx=0).stop 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f815d230 msgr2=0x7f56f8153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f815d230 0x7f56f8153c30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c3c0 tx=0x7f56e400c880 comp rx=0 tx=0).stop 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 shutdown_connections 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f56dc066ce0 0x7f56dc0691a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56f815d230 0x7f56f8153c30 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f56f815d610 0x7f56f8157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 --2- 172.21.15.70:0/304667441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f80d01b0 0x7f56f8150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 >> 172.21.15.70:0/304667441 conn(0x7f56f80d30c0 msgr2=0x7f56f80b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 shutdown_connections 2023-11-26T07:22:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.255+0000 7f56fdac8640 1 -- 172.21.15.70:0/304667441 wait complete. 2023-11-26T07:22:54.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:22:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.411+0000 7faf2906b640 1 Processor -- start 2023-11-26T07:22:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.411+0000 7faf2906b640 1 -- start start 2023-11-26T07:22:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf2906b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faf24145fa0 0x7faf24072420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf2906b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faf2406b190 0x7faf24146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf2906b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf2906b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf24071480 con 0x7faf2406b190 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf2906b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf24072000 con 0x7faf24145fa0 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf2906b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf24146380 con 0x7faf2406a490 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faf2406b190 0x7faf24146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faf2406b190 0x7faf24146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51442/0 (socket says 172.21.15.70:51442) 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 -- 172.21.15.70:0/3845427183 learned_addr learned my addr 172.21.15.70:0/3845427183 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf2359e640 1 --2- 172.21.15.70:0/3845427183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf22d9d640 1 --2- 172.21.15.70:0/3845427183 >> v2:172.21.15.120:3300/0 conn(0x7faf24145fa0 0x7faf24072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 -- 172.21.15.70:0/3845427183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 msgr2=0x7faf2406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 --2- 172.21.15.70:0/3845427183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2406a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 -- 172.21.15.70:0/3845427183 >> v2:172.21.15.120:3300/0 conn(0x7faf24145fa0 msgr2=0x7faf24072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 --2- 172.21.15.70:0/3845427183 >> v2:172.21.15.120:3300/0 conn(0x7faf24145fa0 0x7faf24072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.415+0000 7faf1a59c640 1 -- 172.21.15.70:0/3845427183 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2406ae20 con 0x7faf2406b190 2023-11-26T07:22:54.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf1a59c640 1 --2- 172.21.15.70:0/3845427183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf24146530 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7faf24072b60 tx=0x7faf0c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795d7a61eaa74b10 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2259c640 1 -- 172.21.15.70:0/3845427183 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0ac410 con 0x7faf2406b190 2023-11-26T07:22:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2259c640 1 -- 172.21.15.70:0/3845427183 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0ac570 con 0x7faf2406b190 2023-11-26T07:22:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2259c640 1 -- 172.21.15.70:0/3845427183 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0ac900 con 0x7faf2406b190 2023-11-26T07:22:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 -- 172.21.15.70:0/3845427183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 msgr2=0x7faf24146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 --2- 172.21.15.70:0/3845427183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf24146530 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7faf24072b60 tx=0x7faf0c01c500 comp rx=0 tx=0).stop 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 -- 172.21.15.70:0/3845427183 shutdown_connections 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 --2- 172.21.15.70:0/3845427183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2406a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 --2- 172.21.15.70:0/3845427183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf24146530 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 --2- 172.21.15.70:0/3845427183 >> v2:172.21.15.120:3300/0 conn(0x7faf24145fa0 0x7faf24072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 -- 172.21.15.70:0/3845427183 >> 172.21.15.70:0/3845427183 conn(0x7faf240cff00 msgr2=0x7faf240d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 -- 172.21.15.70:0/3845427183 shutdown_connections 2023-11-26T07:22:54.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 -- 172.21.15.70:0/3845427183 wait complete. 2023-11-26T07:22:54.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 Processor -- start 2023-11-26T07:22:54.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.419+0000 7faf2906b640 1 -- start start 2023-11-26T07:22:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2413a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf241387e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf24145fa0 0x7faf241422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf241393a0 con 0x7faf2406b190 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2413d520 con 0x7faf24145fa0 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf241390c0 con 0x7faf2406a490 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf241387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf241387e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51452/0 (socket says 172.21.15.70:51452) 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 -- 172.21.15.70:0/69150656 learned_addr learned my addr 172.21.15.70:0/69150656 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf22d9d640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2413a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2359e640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf24145fa0 0x7faf241422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 -- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 msgr2=0x7faf2413a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2413a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 -- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf24145fa0 msgr2=0x7faf241422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf24145fa0 0x7faf241422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 -- 172.21.15.70:0/69150656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0094d0 con 0x7faf2406b190 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2359e640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf24145fa0 0x7faf241422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1a59c640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf241387e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0af040 tx=0x7faf0c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1bfff640 1 -- 172.21.15.70:0/69150656 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0bb070 con 0x7faf2406b190 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1bfff640 1 -- 172.21.15.70:0/69150656 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0b7480 con 0x7faf2406b190 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2413d770 con 0x7faf2406b190 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1bfff640 1 -- 172.21.15.70:0/69150656 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0ac410 con 0x7faf2406b190 2023-11-26T07:22:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2413dd30 con 0x7faf2406b190 2023-11-26T07:22:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2413df20 con 0x7faf2406b190 2023-11-26T07:22:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.423+0000 7faf1bfff640 1 -- 172.21.15.70:0/69150656 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7faf0c0b7650 con 0x7faf2406b190 2023-11-26T07:22:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.427+0000 7faf1bfff640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faf04066ce0 0x7faf040691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.427+0000 7faf1bfff640 1 -- 172.21.15.70:0/69150656 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7faf0c11c780 con 0x7faf2406b190 2023-11-26T07:22:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.427+0000 7faf22d9d640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faf04066ce0 0x7faf040691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.427+0000 7faf22d9d640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faf04066ce0 0x7faf040691a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faf240af950 tx=0x7faf14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.434 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.431+0000 7faf1bfff640 1 -- 172.21.15.70:0/69150656 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf0c0eb4e0 con 0x7faf2406b190 2023-11-26T07:22:54.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.579+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf2406ae20 con 0x7faf2406b190 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.579+0000 7faf1bfff640 1 -- 172.21.15.70:0/69150656 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16630 (secure 0 0 0) 0x7faf2406ae20 con 0x7faf2406b190 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:22:54.585 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":66,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:22:48.833584+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:21:52.577151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-26T07:21:53.232441+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faf04066ce0 msgr2=0x7faf040691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faf04066ce0 0x7faf040691a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faf240af950 tx=0x7faf14009190 comp rx=0 tx=0).stop 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 msgr2=0x7faf241387e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf241387e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0af040 tx=0x7faf0c0192a0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 shutdown_connections 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faf04066ce0 0x7faf040691a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf2406b190 0x7faf241387e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf24145fa0 0x7faf241422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 --2- 172.21.15.70:0/69150656 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faf2406a490 0x7faf2413a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 >> 172.21.15.70:0/69150656 conn(0x7faf240cff00 msgr2=0x7faf240ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 shutdown_connections 2023-11-26T07:22:54.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.583+0000 7faf2906b640 1 -- 172.21.15.70:0/69150656 wait complete. 2023-11-26T07:22:54.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:22:54.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.739+0000 7fb23c3df640 1 Processor -- start 2023-11-26T07:22:54.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.739+0000 7fb23c3df640 1 -- start start 2023-11-26T07:22:54.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23c3df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb234143ac0 0x7fb234070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23c3df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb2340cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23c3df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340cc730 con 0x7fb2340708b0 2023-11-26T07:22:54.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23c3df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb234143ea0 con 0x7fb234143ac0 2023-11-26T07:22:54.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23c3df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb234070ee0 con 0x7fb2340cf990 2023-11-26T07:22:54.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23a17b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb234143ac0 0x7fb234070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23997a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb2340708b0 0x7fb2340cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40474/0 (socket says 172.21.15.70:40474) 2023-11-26T07:22:54.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23997a640 1 -- 172.21.15.70:0/1057367195 learned_addr learned my addr 172.21.15.70:0/1057367195 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:54.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23a17b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb234143ac0 0x7fb234070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51460/0 (socket says 172.21.15.70:51460) 2023-11-26T07:22:54.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23a97c640 1 --2- 172.21.15.70:0/1057367195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb2340cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23a17b640 1 -- 172.21.15.70:0/1057367195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 msgr2=0x7fb2340cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:54.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23a17b640 1 --2- 172.21.15.70:0/1057367195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb2340cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23a17b640 1 -- 172.21.15.70:0/1057367195 >> v1:172.21.15.70:6789/0 conn(0x7fb2340708b0 legacy=0x7fb2340cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.743+0000 7fb23a17b640 1 -- 172.21.15.70:0/1057367195 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340711c0 con 0x7fb234143ac0 2023-11-26T07:22:54.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23a17b640 1 --2- 172.21.15.70:0/1057367195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb234143ac0 0x7fb234070370 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097c0 tx=0x7fb23001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7342deb889887de server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb239179640 1 -- 172.21.15.70:0/1057367195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300ad640 con 0x7fb234143ac0 2023-11-26T07:22:54.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb239179640 1 -- 172.21.15.70:0/1057367195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300ad7a0 con 0x7fb234143ac0 2023-11-26T07:22:54.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb239179640 1 -- 172.21.15.70:0/1057367195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300adb30 con 0x7fb234143ac0 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 -- 172.21.15.70:0/1057367195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb234143ac0 msgr2=0x7fb234070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 --2- 172.21.15.70:0/1057367195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb234143ac0 0x7fb234070370 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097c0 tx=0x7fb23001c480 comp rx=0 tx=0).stop 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 -- 172.21.15.70:0/1057367195 shutdown_connections 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 --2- 172.21.15.70:0/1057367195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb2340cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 --2- 172.21.15.70:0/1057367195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb234143ac0 0x7fb234070370 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 -- 172.21.15.70:0/1057367195 >> 172.21.15.70:0/1057367195 conn(0x7fb23406a890 msgr2=0x7fb23406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 -- 172.21.15.70:0/1057367195 shutdown_connections 2023-11-26T07:22:54.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 -- 172.21.15.70:0/1057367195 wait complete. 2023-11-26T07:22:54.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 Processor -- start 2023-11-26T07:22:54.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.747+0000 7fb23c3df640 1 -- start start 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2340708b0 0x7fb2341f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb23413e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb234143ac0 0x7fb23413e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340ae1a0 con 0x7fb2340708b0 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341f90d0 con 0x7fb234143ac0 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340ad2c0 con 0x7fb2340cf990 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2340708b0 0x7fb2341f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2340708b0 0x7fb2341f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51472/0 (socket says 172.21.15.70:51472) 2023-11-26T07:22:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 -- 172.21.15.70:0/3222042180 learned_addr learned my addr 172.21.15.70:0/3222042180 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23997a640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb23413e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a97c640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb234143ac0 0x7fb23413e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 -- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 msgr2=0x7fb23413e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb23413e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 -- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb234143ac0 msgr2=0x7fb23413e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb234143ac0 0x7fb23413e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 -- 172.21.15.70:0/3222042180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009420 con 0x7fb2340708b0 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23997a640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb23413e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a97c640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb234143ac0 0x7fb23413e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23a17b640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2340708b0 0x7fb2341f8b90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb23001a0b0 tx=0x7fb230019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb22affd640 1 -- 172.21.15.70:0/3222042180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300b6610 con 0x7fb2340708b0 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb22affd640 1 -- 172.21.15.70:0/3222042180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300a6040 con 0x7fb2340708b0 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2340ad590 con 0x7fb2340708b0 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb22affd640 1 -- 172.21.15.70:0/3222042180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300b69b0 con 0x7fb2340708b0 2023-11-26T07:22:54.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2340adb50 con 0x7fb2340708b0 2023-11-26T07:22:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb234067680 con 0x7fb2340708b0 2023-11-26T07:22:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.751+0000 7fb22affd640 1 -- 172.21.15.70:0/3222042180 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fb2300b4040 con 0x7fb2340708b0 2023-11-26T07:22:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.755+0000 7fb22affd640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb218066d10 0x7fb2180691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:54.759 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.755+0000 7fb22affd640 1 -- 172.21.15.70:0/3222042180 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5737+0+0 (secure 0 0 0) 0x7fb23011c980 con 0x7fb2340708b0 2023-11-26T07:22:54.760 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.755+0000 7fb23997a640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb218066d10 0x7fb2180691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:54.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.755+0000 7fb23997a640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb218066d10 0x7fb2180691d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb234164b30 tx=0x7fb224009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:54.762 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.759+0000 7fb22affd640 1 -- 172.21.15.70:0/3222042180 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2300eb680 con 0x7fb2340708b0 2023-11-26T07:22:54.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.943+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb23406d270 con 0x7fb2340708b0 2023-11-26T07:22:54.948 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-11-26T07:22:54.943+0000 7fe8c07be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:22:54.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.947+0000 7fb22affd640 1 -- 172.21.15.70:0/3222042180 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb2300b2070 con 0x7fb2340708b0 2023-11-26T07:22:54.951 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:22:54.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.947+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb218066d10 msgr2=0x7fb2180691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.947+0000 7fb23c3df640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb218066d10 0x7fb2180691d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb234164b30 tx=0x7fb224009040 comp rx=0 tx=0).stop 2023-11-26T07:22:54.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.947+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2340708b0 msgr2=0x7fb2341f8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:54.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.947+0000 7fb23c3df640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2340708b0 0x7fb2341f8b90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb23001a0b0 tx=0x7fb230019220 comp rx=0 tx=0).stop 2023-11-26T07:22:54.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 shutdown_connections 2023-11-26T07:22:54.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb234143ac0 0x7fb23413e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2340cf990 0x7fb23413e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb218066d10 0x7fb2180691d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 --2- 172.21.15.70:0/3222042180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2340708b0 0x7fb2341f8b90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:54.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 >> 172.21.15.70:0/3222042180 conn(0x7fb23406a890 msgr2=0x7fb234140460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:54.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 shutdown_connections 2023-11-26T07:22:54.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:54.951+0000 7fb23c3df640 1 -- 172.21.15.70:0/3222042180 wait complete. 2023-11-26T07:22:54.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:22:55.018 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-11-26T07:22:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9be735640 1 Processor -- start 2023-11-26T07:22:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9be735640 1 -- start start 2023-11-26T07:22:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9be735640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b80cf280 0x7fa9b80cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9be735640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b815b2f0 con 0x7fa9b8070d10 2023-11-26T07:22:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9be735640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b806c5c0 con 0x7fa9b806cd50 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9be735640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80cfba0 con 0x7fa9b80cf280 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b77fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa9b8070d10 0x7fa9b815d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40486/0 (socket says 172.21.15.70:40486) 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b77fe640 1 -- 172.21.15.70:0/3857728610 learned_addr learned my addr 172.21.15.70:0/3857728610 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b7fff640 1 --2- 172.21.15.70:0/3857728610 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b80cf280 0x7fa9b80cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255901474 0 0) 0x7fa9ac001120 con 0x7fa9b8070d10 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a0003530 con 0x7fa9b8070d10 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036243235 0 0) 0x7fa9b806c5c0 con 0x7fa9b806cd50 2023-11-26T07:22:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9ac001120 con 0x7fa9b806cd50 2023-11-26T07:22:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 538926199 0 0) 0x7fa9a0003530 con 0x7fa9b8070d10 2023-11-26T07:22:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b7fff640 1 -- 172.21.15.70:0/3857728610 >> v1:172.21.15.120:6789/0 conn(0x7fa9b806cd50 legacy=0x7fa9b80b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b7fff640 1 -- 172.21.15.70:0/3857728610 >> v1:172.21.15.70:6789/0 conn(0x7fa9b8070d10 legacy=0x7fa9b815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.115+0000 7fa9b7fff640 1 -- 172.21.15.70:0/3857728610 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b815e1a0 con 0x7fa9b80cf280 2023-11-26T07:22:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9b7fff640 1 --2- 172.21.15.70:0/3857728610 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b80cf280 0x7fa9b80cf660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80097f0 tx=0x7fa9a801ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e8ea8b275c5602 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac001810 con 0x7fa9b80cf280 2023-11-26T07:22:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a80a8650 con 0x7fa9b80cf280 2023-11-26T07:22:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9b6ffd640 1 -- 172.21.15.70:0/3857728610 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80a89c0 con 0x7fa9b80cf280 2023-11-26T07:22:55.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9be735640 1 -- 172.21.15.70:0/3857728610 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b80cf280 msgr2=0x7fa9b80cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9be735640 1 --2- 172.21.15.70:0/3857728610 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b80cf280 0x7fa9b80cf660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80097f0 tx=0x7fa9a801ebd0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9be735640 1 -- 172.21.15.70:0/3857728610 shutdown_connections 2023-11-26T07:22:55.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9be735640 1 --2- 172.21.15.70:0/3857728610 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b80cf280 0x7fa9b80cf660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9be735640 1 -- 172.21.15.70:0/3857728610 >> 172.21.15.70:0/3857728610 conn(0x7fa9b806a890 msgr2=0x7fa9b806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:55.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9be735640 1 -- 172.21.15.70:0/3857728610 shutdown_connections 2023-11-26T07:22:55.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.119+0000 7fa9be735640 1 -- 172.21.15.70:0/3857728610 wait complete. 2023-11-26T07:22:55.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 Processor -- start 2023-11-26T07:22:55.127 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 -- start start 2023-11-26T07:22:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9b806cd50 0x7fa9b80b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b8070d10 0x7fa9b8155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9b80cf280 0x7fa9b8158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8156f10 con 0x7fa9b806cd50 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b0260 con 0x7fa9b80cf280 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b04b0 con 0x7fa9b8070d10 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9b806cd50 0x7fa9b80b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9b806cd50 0x7fa9b80b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51504/0 (socket says 172.21.15.70:51504) 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 -- 172.21.15.70:0/2647383088 learned_addr learned my addr 172.21.15.70:0/2647383088 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9bccd2640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9b80cf280 0x7fa9b8158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b77fe640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b8070d10 0x7fa9b8155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 -- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b8070d10 msgr2=0x7fa9b8155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b8070d10 0x7fa9b8155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 -- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9b80cf280 msgr2=0x7fa9b8158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9b80cf280 0x7fa9b8158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 -- 172.21.15.70:0/2647383088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8009420 con 0x7fa9b806cd50 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b7fff640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9b806cd50 0x7fa9b80b1550 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80097f0 tx=0x7fa9a801b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b4ff9640 1 -- 172.21.15.70:0/2647383088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80c1070 con 0x7fa9b806cd50 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b4ff9640 1 -- 172.21.15.70:0/2647383088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8006e20 con 0x7fa9b806cd50 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b80b0790 con 0x7fa9b806cd50 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9b4ff9640 1 -- 172.21.15.70:0/2647383088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80bc860 con 0x7fa9b806cd50 2023-11-26T07:22:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.123+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b80b0d50 con 0x7fa9b806cd50 2023-11-26T07:22:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.127+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b8067680 con 0x7fa9b806cd50 2023-11-26T07:22:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.127+0000 7fa9b4ff9640 1 -- 172.21.15.70:0/2647383088 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fa9a80bc9c0 con 0x7fa9b806cd50 2023-11-26T07:22:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.127+0000 7fa9b4ff9640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa9a4066ce0 0x7fa9a40691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.127+0000 7fa9b4ff9640 1 -- 172.21.15.70:0/2647383088 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa9a8120140 con 0x7fa9b806cd50 2023-11-26T07:22:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.127+0000 7fa9b77fe640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa9a4066ce0 0x7fa9a40691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.127+0000 7fa9b77fe640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa9a4066ce0 0x7fa9a40691a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa9b815ab20 tx=0x7fa9ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:55.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.131+0000 7fa9b4ff9640 1 -- 172.21.15.70:0/2647383088 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9a80eeea0 con 0x7fa9b806cd50 2023-11-26T07:22:55.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.315+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa9b806b4a0 con 0x7fa9b806cd50 2023-11-26T07:22:55.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9b4ff9640 1 -- 172.21.15.70:0/2647383088 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa9a80f24c0 con 0x7fa9b806cd50 2023-11-26T07:22:55.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa9a4066ce0 msgr2=0x7fa9a40691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa9a4066ce0 0x7fa9a40691a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa9b815ab20 tx=0x7fa9ac009040 comp rx=0 tx=0).stop 2023-11-26T07:22:55.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9b806cd50 msgr2=0x7fa9b80b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:55.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9b806cd50 0x7fa9b80b1550 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80097f0 tx=0x7fa9a801b970 comp rx=0 tx=0).stop 2023-11-26T07:22:55.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 shutdown_connections 2023-11-26T07:22:55.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9b80cf280 0x7fa9b8158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa9b8070d10 0x7fa9b8155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa9a4066ce0 0x7fa9a40691a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 --2- 172.21.15.70:0/2647383088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9b806cd50 0x7fa9b80b1550 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:55.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 >> 172.21.15.70:0/2647383088 conn(0x7fa9b806a890 msgr2=0x7fa9b806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:55.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 shutdown_connections 2023-11-26T07:22:55.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:55.951+0000 7fa9be735640 1 -- 172.21.15.70:0/2647383088 wait complete. 2023-11-26T07:22:55.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:22:56.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 Processor -- start 2023-11-26T07:22:56.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 -- start start 2023-11-26T07:22:56.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f607c143ac0 0x7f607c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f607c0cf7c0 0x7f607c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c143ea0 con 0x7f607c143ac0 2023-11-26T07:22:56.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c0cfbf0 con 0x7f607c0cf7c0 2023-11-26T07:22:56.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f608452e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0cc730 con 0x7f607c0708b0 2023-11-26T07:22:56.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f60822ca640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f607c143ac0 0x7f607c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f60822ca640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f607c143ac0 0x7f607c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51516/0 (socket says 172.21.15.70:51516) 2023-11-26T07:22:56.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.155+0000 7f60822ca640 1 -- 172.21.15.70:0/641766036 learned_addr learned my addr 172.21.15.70:0/641766036 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f6082acb640 1 --2- 172.21.15.70:0/641766036 >> v2:172.21.15.120:3300/0 conn(0x7f607c0cf7c0 0x7f607c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f6081ac9640 1 --2- 172.21.15.70:0/641766036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60822ca640 1 -- 172.21.15.70:0/641766036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 msgr2=0x7f607c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60822ca640 1 --2- 172.21.15.70:0/641766036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60822ca640 1 -- 172.21.15.70:0/641766036 >> v2:172.21.15.120:3300/0 conn(0x7f607c0cf7c0 msgr2=0x7f607c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60822ca640 1 --2- 172.21.15.70:0/641766036 >> v2:172.21.15.120:3300/0 conn(0x7f607c0cf7c0 0x7f607c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60822ca640 1 -- 172.21.15.70:0/641766036 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c070ee0 con 0x7f607c143ac0 2023-11-26T07:22:56.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f6082acb640 1 --2- 172.21.15.70:0/641766036 >> v2:172.21.15.120:3300/0 conn(0x7f607c0cf7c0 0x7f607c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:56.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60822ca640 1 --2- 172.21.15.70:0/641766036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c143ac0 0x7f607c070370 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f607c0718d0 tx=0x7f607801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa32d76d36f76c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60812c8640 1 -- 172.21.15.70:0/641766036 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780ab600 con 0x7f607c143ac0 2023-11-26T07:22:56.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60812c8640 1 -- 172.21.15.70:0/641766036 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60780a7050 con 0x7f607c143ac0 2023-11-26T07:22:56.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f60812c8640 1 -- 172.21.15.70:0/641766036 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780ab980 con 0x7f607c143ac0 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f608452e640 1 -- 172.21.15.70:0/641766036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c143ac0 msgr2=0x7f607c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f608452e640 1 --2- 172.21.15.70:0/641766036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c143ac0 0x7f607c070370 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f607c0718d0 tx=0x7f607801c240 comp rx=0 tx=0).stop 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f608452e640 1 -- 172.21.15.70:0/641766036 shutdown_connections 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f608452e640 1 --2- 172.21.15.70:0/641766036 >> v2:172.21.15.120:3300/0 conn(0x7f607c0cf7c0 0x7f607c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f608452e640 1 --2- 172.21.15.70:0/641766036 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f608452e640 1 --2- 172.21.15.70:0/641766036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c143ac0 0x7f607c070370 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.159+0000 7f608452e640 1 -- 172.21.15.70:0/641766036 >> 172.21.15.70:0/641766036 conn(0x7f607c06a890 msgr2=0x7f607c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:56.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- 172.21.15.70:0/641766036 shutdown_connections 2023-11-26T07:22:56.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- 172.21.15.70:0/641766036 wait complete. 2023-11-26T07:22:56.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 Processor -- start 2023-11-26T07:22:56.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- start start 2023-11-26T07:22:56.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c0cf7c0 0x7f607c13d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f607c143ac0 0x7f607c14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c13f030 con 0x7f607c0cf7c0 2023-11-26T07:22:56.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c158bc0 con 0x7f607c143ac0 2023-11-26T07:22:56.169 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c13e3b0 con 0x7f607c0708b0 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c0cf7c0 0x7f607c13d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c0cf7c0 0x7f607c13d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51528/0 (socket says 172.21.15.70:51528) 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 -- 172.21.15.70:0/2397390699 learned_addr learned my addr 172.21.15.70:0/2397390699 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6082acb640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f607c143ac0 0x7f607c14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f60822ca640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 -- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 msgr2=0x7f607c13f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c13f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 -- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f607c143ac0 msgr2=0x7f607c14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f607c143ac0 0x7f607c14a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 -- 172.21.15.70:0/2397390699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780094d0 con 0x7f607c0cf7c0 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6082acb640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f607c143ac0 0x7f607c14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:56.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6081ac9640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c0cf7c0 0x7f607c13d4b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f606c00c7f0 tx=0x7f606c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6072ffd640 1 -- 172.21.15.70:0/2397390699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c004220 con 0x7f607c0cf7c0 2023-11-26T07:22:56.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6072ffd640 1 -- 172.21.15.70:0/2397390699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c004380 con 0x7f607c0cf7c0 2023-11-26T07:22:56.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f6072ffd640 1 -- 172.21.15.70:0/2397390699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c003860 con 0x7f607c0cf7c0 2023-11-26T07:22:56.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c13e690 con 0x7f607c0cf7c0 2023-11-26T07:22:56.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.163+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c13ec50 con 0x7f607c0cf7c0 2023-11-26T07:22:56.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.167+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c13f170 con 0x7f607c0cf7c0 2023-11-26T07:22:56.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.167+0000 7f6072ffd640 1 -- 172.21.15.70:0/2397390699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f606c003bd0 con 0x7f607c0cf7c0 2023-11-26T07:22:56.172 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.167+0000 7f6072ffd640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6060066ce0 0x7f60600691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.167+0000 7f6072ffd640 1 -- 172.21.15.70:0/2397390699 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f606c082830 con 0x7f607c0cf7c0 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.167+0000 7f60822ca640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6060066ce0 0x7f60600691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:56.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.167+0000 7f60822ca640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6060066ce0 0x7f60600691a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f60780ad000 tx=0x7f6078008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:56.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.171+0000 7f6072ffd640 1 -- 172.21.15.70:0/2397390699 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f607c13f170 con 0x7f607c0cf7c0 2023-11-26T07:22:56.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.323+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f607c13f170 con 0x7f607c0cf7c0 2023-11-26T07:22:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.955+0000 7f6072ffd640 1 -- 172.21.15.70:0/2397390699 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v68) v1 ==== 181+0+0 (secure 0 0 0) 0x7f607c13f170 con 0x7f607c0cf7c0 2023-11-26T07:22:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:22:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.955+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6060066ce0 msgr2=0x7f60600691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.955+0000 7f608452e640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6060066ce0 0x7f60600691a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f60780ad000 tx=0x7f6078008040 comp rx=0 tx=0).stop 2023-11-26T07:22:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c0cf7c0 msgr2=0x7f607c13d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c0cf7c0 0x7f607c13d4b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f606c00c7f0 tx=0x7f606c00ccb0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 shutdown_connections 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6060066ce0 0x7f60600691a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c0cf7c0 0x7f607c13d4b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f607c143ac0 0x7f607c14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 --2- 172.21.15.70:0/2397390699 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f607c0708b0 0x7f607c13f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 >> 172.21.15.70:0/2397390699 conn(0x7f607c06a890 msgr2=0x7f607c15b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 shutdown_connections 2023-11-26T07:22:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:56.959+0000 7f608452e640 1 -- 172.21.15.70:0/2397390699 wait complete. 2023-11-26T07:22:56.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:22:57.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.123+0000 7fba4a701640 1 Processor -- start 2023-11-26T07:22:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.123+0000 7fba4a701640 1 -- start start 2023-11-26T07:22:57.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba4a701640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba4415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba4a701640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4406c520 con 0x7fba4413e290 2023-11-26T07:22:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba4a701640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4406c800 con 0x7fba4415f4e0 2023-11-26T07:22:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba4a701640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4406cae0 con 0x7fba440cf990 2023-11-26T07:22:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba43fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fba4413e290 0x7fba440cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40494/0 (socket says 172.21.15.70:40494) 2023-11-26T07:22:57.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba43fff640 1 -- 172.21.15.70:0/1590569875 learned_addr learned my addr 172.21.15.70:0/1590569875 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba437fe640 1 --2- 172.21.15.70:0/1590569875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba4415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba42ffd640 1 -- 172.21.15.70:0/1590569875 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926135699 0 0) 0x7fba4406c520 con 0x7fba4413e290 2023-11-26T07:22:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba42ffd640 1 -- 172.21.15.70:0/1590569875 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2c003530 con 0x7fba4413e290 2023-11-26T07:22:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba42ffd640 1 -- 172.21.15.70:0/1590569875 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133225383 0 0) 0x7fba4406c800 con 0x7fba4415f4e0 2023-11-26T07:22:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba42ffd640 1 -- 172.21.15.70:0/1590569875 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4406c520 con 0x7fba4415f4e0 2023-11-26T07:22:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba437fe640 1 -- 172.21.15.70:0/1590569875 >> v1:172.21.15.120:6789/0 conn(0x7fba4415f4e0 legacy=0x7fba440cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba437fe640 1 -- 172.21.15.70:0/1590569875 >> v1:172.21.15.70:6789/0 conn(0x7fba4413e290 legacy=0x7fba440cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.127+0000 7fba437fe640 1 -- 172.21.15.70:0/1590569875 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4406cdc0 con 0x7fba440cf990 2023-11-26T07:22:57.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba437fe640 1 --2- 172.21.15.70:0/1590569875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba4415efa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba380097f0 tx=0x7fba3801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2bf654efc61370 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba42ffd640 1 -- 172.21.15.70:0/1590569875 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380aa610 con 0x7fba440cf990 2023-11-26T07:22:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba42ffd640 1 -- 172.21.15.70:0/1590569875 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba380a6040 con 0x7fba440cf990 2023-11-26T07:22:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba42ffd640 1 -- 172.21.15.70:0/1590569875 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380aa990 con 0x7fba440cf990 2023-11-26T07:22:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 -- 172.21.15.70:0/1590569875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 msgr2=0x7fba4415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 --2- 172.21.15.70:0/1590569875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba4415efa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba380097f0 tx=0x7fba3801c490 comp rx=0 tx=0).stop 2023-11-26T07:22:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 -- 172.21.15.70:0/1590569875 shutdown_connections 2023-11-26T07:22:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 --2- 172.21.15.70:0/1590569875 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba4415efa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 -- 172.21.15.70:0/1590569875 >> 172.21.15.70:0/1590569875 conn(0x7fba4406a890 msgr2=0x7fba4406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 -- 172.21.15.70:0/1590569875 shutdown_connections 2023-11-26T07:22:57.136 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 -- 172.21.15.70:0/1590569875 wait complete. 2023-11-26T07:22:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 Processor -- start 2023-11-26T07:22:57.137 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.131+0000 7fba4a701640 1 -- start start 2023-11-26T07:22:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba44138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba4413e290 0x7fba44150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba4415f4e0 0x7fba44150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440b1a30 con 0x7fba4415f4e0 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440b1750 con 0x7fba4413e290 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44135e90 con 0x7fba440cf990 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba4415f4e0 0x7fba44150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba4415f4e0 0x7fba44150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51544/0 (socket says 172.21.15.70:51544) 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 -- 172.21.15.70:0/777127268 learned_addr learned my addr 172.21.15.70:0/777127268 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba437fe640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba4413e290 0x7fba44150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba43fff640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba44138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 -- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 msgr2=0x7fba44138b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba44138b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 -- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba4413e290 msgr2=0x7fba44150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba4413e290 0x7fba44150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 -- 172.21.15.70:0/777127268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38009420 con 0x7fba4415f4e0 2023-11-26T07:22:57.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba48c9e640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba4415f4e0 0x7fba44150dd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c730 tx=0x7fba3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:57.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba40ff9640 1 -- 172.21.15.70:0/777127268 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c003b80 con 0x7fba4415f4e0 2023-11-26T07:22:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba40ff9640 1 -- 172.21.15.70:0/777127268 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c003ce0 con 0x7fba4415f4e0 2023-11-26T07:22:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba40ff9640 1 -- 172.21.15.70:0/777127268 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00aa90 con 0x7fba4415f4e0 2023-11-26T07:22:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba44136170 con 0x7fba4415f4e0 2023-11-26T07:22:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba44139050 con 0x7fba4415f4e0 2023-11-26T07:22:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.135+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44139240 con 0x7fba4415f4e0 2023-11-26T07:22:57.142 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.139+0000 7fba40ff9640 1 -- 172.21.15.70:0/777127268 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fba3c00abf0 con 0x7fba4415f4e0 2023-11-26T07:22:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.139+0000 7fba40ff9640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba30066ce0 0x7fba300691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.139+0000 7fba40ff9640 1 -- 172.21.15.70:0/777127268 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fba3c082590 con 0x7fba4415f4e0 2023-11-26T07:22:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.139+0000 7fba43fff640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba30066ce0 0x7fba300691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:57.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.139+0000 7fba43fff640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba30066ce0 0x7fba300691a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fba340011f0 tx=0x7fba34007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:57.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.143+0000 7fba40ff9640 1 -- 172.21.15.70:0/777127268 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba44139240 con 0x7fba4415f4e0 2023-11-26T07:22:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.291+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba44139240 con 0x7fba4415f4e0 2023-11-26T07:22:57.962 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.955+0000 7fba40ff9640 1 -- 172.21.15.70:0/777127268 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v69) v1 ==== 169+0+0 (secure 0 0 0) 0x7fba44139240 con 0x7fba4415f4e0 2023-11-26T07:22:57.962 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2023-11-26T07:22:57.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.959+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba30066ce0 msgr2=0x7fba300691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.959+0000 7fba4a701640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba30066ce0 0x7fba300691a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fba340011f0 tx=0x7fba34007d40 comp rx=0 tx=0).stop 2023-11-26T07:22:57.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.959+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba4415f4e0 msgr2=0x7fba44150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:57.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.959+0000 7fba4a701640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba4415f4e0 0x7fba44150dd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c730 tx=0x7fba3c00cbf0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 shutdown_connections 2023-11-26T07:22:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba30066ce0 0x7fba300691a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba4415f4e0 0x7fba44150dd0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba4413e290 0x7fba44150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 --2- 172.21.15.70:0/777127268 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba440cf990 0x7fba44138b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 >> 172.21.15.70:0/777127268 conn(0x7fba4406a890 msgr2=0x7fba441378a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 shutdown_connections 2023-11-26T07:22:57.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:57.963+0000 7fba4a701640 1 -- 172.21.15.70:0/777127268 wait complete. 2023-11-26T07:22:57.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:22:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f86a03f5640 1 Processor -- start 2023-11-26T07:22:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f86a03f5640 1 -- start start 2023-11-26T07:22:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f86a03f5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8698070ba0 0x7f869806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f86a03f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f86980cdd10 0x7f869806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f86a03f5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86980cd610 con 0x7f8698161cf0 2023-11-26T07:22:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f86a03f5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86980cd8f0 con 0x7f8698070ba0 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f86a03f5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8698161210 con 0x7f86980cdd10 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e191640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8698070ba0 0x7f869806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e191640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8698070ba0 0x7f869806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51560/0 (socket says 172.21.15.70:51560) 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e191640 1 -- 172.21.15.70:0/1895276517 learned_addr learned my addr 172.21.15.70:0/1895276517 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e992640 1 --2- 172.21.15.70:0/1895276517 >> v2:172.21.15.120:3300/0 conn(0x7f86980cdd10 0x7f869806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e191640 1 -- 172.21.15.70:0/1895276517 >> v2:172.21.15.120:3300/0 conn(0x7f86980cdd10 msgr2=0x7f869806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e191640 1 --2- 172.21.15.70:0/1895276517 >> v2:172.21.15.120:3300/0 conn(0x7f86980cdd10 0x7f869806d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e191640 1 -- 172.21.15.70:0/1895276517 >> v1:172.21.15.120:6789/0 conn(0x7f8698161cf0 legacy=0x7f8698070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e191640 1 -- 172.21.15.70:0/1895276517 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86981614f0 con 0x7f8698070ba0 2023-11-26T07:22:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.135+0000 7f869e992640 1 --2- 172.21.15.70:0/1895276517 >> v2:172.21.15.120:3300/0 conn(0x7f86980cdd10 0x7f869806d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f869e191640 1 --2- 172.21.15.70:0/1895276517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869806bae0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8698070870 tx=0x7f869401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f375c27ba5f88b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f869d18f640 1 -- 172.21.15.70:0/1895276517 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940aa640 con 0x7f8698070ba0 2023-11-26T07:22:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f869d18f640 1 -- 172.21.15.70:0/1895276517 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940aa7a0 con 0x7f8698070ba0 2023-11-26T07:22:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f869d18f640 1 -- 172.21.15.70:0/1895276517 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940aab30 con 0x7f8698070ba0 2023-11-26T07:22:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 -- 172.21.15.70:0/1895276517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 msgr2=0x7f869806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 --2- 172.21.15.70:0/1895276517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869806bae0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8698070870 tx=0x7f869401c4c0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 -- 172.21.15.70:0/1895276517 shutdown_connections 2023-11-26T07:22:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 --2- 172.21.15.70:0/1895276517 >> v2:172.21.15.120:3300/0 conn(0x7f86980cdd10 0x7f869806d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 --2- 172.21.15.70:0/1895276517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869806bae0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 -- 172.21.15.70:0/1895276517 >> 172.21.15.70:0/1895276517 conn(0x7f86980cf710 msgr2=0x7f86980cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:58.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 -- 172.21.15.70:0/1895276517 shutdown_connections 2023-11-26T07:22:58.145 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 -- 172.21.15.70:0/1895276517 wait complete. 2023-11-26T07:22:58.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.139+0000 7f86a03f5640 1 Processor -- start 2023-11-26T07:22:58.146 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 -- start start 2023-11-26T07:22:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86980cdd10 0x7f869814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8698161cf0 0x7f8698144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86981547f0 con 0x7f8698070ba0 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869814bf90 con 0x7f86980cdd10 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869814c270 con 0x7f8698161cf0 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869814b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51576/0 (socket says 172.21.15.70:51576) 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 -- 172.21.15.70:0/924302705 learned_addr learned my addr 172.21.15.70:0/924302705 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869d990640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86980cdd10 0x7f869814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e992640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8698161cf0 0x7f8698144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 -- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8698161cf0 msgr2=0x7f8698144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8698161cf0 0x7f8698144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 -- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86980cdd10 msgr2=0x7f869814d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86980cdd10 0x7f869814d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 -- 172.21.15.70:0/924302705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940094d0 con 0x7f8698070ba0 2023-11-26T07:22:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869d990640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86980cdd10 0x7f869814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:22:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f869e191640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869814b8b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f869401a0f0 tx=0x7f869401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f868effd640 1 -- 172.21.15.70:0/924302705 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940bd5f0 con 0x7f8698070ba0 2023-11-26T07:22:58.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f868effd640 1 -- 172.21.15.70:0/924302705 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940bd750 con 0x7f8698070ba0 2023-11-26T07:22:58.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f868effd640 1 -- 172.21.15.70:0/924302705 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940bdb00 con 0x7f8698070ba0 2023-11-26T07:22:58.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869814c550 con 0x7f8698070ba0 2023-11-26T07:22:58.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869814cb10 con 0x7f8698070ba0 2023-11-26T07:22:58.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.143+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8698067680 con 0x7f8698070ba0 2023-11-26T07:22:58.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.147+0000 7f868effd640 1 -- 172.21.15.70:0/924302705 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f86940a8050 con 0x7f8698070ba0 2023-11-26T07:22:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.147+0000 7f868effd640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f867c066ce0 0x7f867c0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.147+0000 7f868effd640 1 -- 172.21.15.70:0/924302705 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f869411ce80 con 0x7f8698070ba0 2023-11-26T07:22:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.147+0000 7f869d990640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f867c066ce0 0x7f867c0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.147+0000 7f869d990640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f867c066ce0 0x7f867c0691a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f86981683f0 tx=0x7f8688008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.151+0000 7f868effd640 1 -- 172.21.15.70:0/924302705 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86940ebf20 con 0x7f8698070ba0 2023-11-26T07:22:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.299+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f86980ce260 con 0x7f8698070ba0 2023-11-26T07:22:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.303+0000 7f868effd640 1 -- 172.21.15.70:0/924302705 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7f86940ef540 con 0x7f8698070ba0 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f867c066ce0 msgr2=0x7f867c0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f867c066ce0 0x7f867c0691a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f86981683f0 tx=0x7f8688008040 comp rx=0 tx=0).stop 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 msgr2=0x7f869814b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869814b8b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f869401a0f0 tx=0x7f869401ad00 comp rx=0 tx=0).stop 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 shutdown_connections 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8698161cf0 0x7f8698144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86980cdd10 0x7f869814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f867c066ce0 0x7f867c0691a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 --2- 172.21.15.70:0/924302705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8698070ba0 0x7f869814b8b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 >> 172.21.15.70:0/924302705 conn(0x7f86980cf710 msgr2=0x7f869806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 shutdown_connections 2023-11-26T07:22:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.307+0000 7f86a03f5640 1 -- 172.21.15.70:0/924302705 wait complete. 2023-11-26T07:22:58.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:22:58.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4bbb8d640 1 Processor -- start 2023-11-26T07:22:58.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4bbb8d640 1 -- start start 2023-11-26T07:22:58.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4bbb8d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b4143ac0 0x7fc4b4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4bbb8d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc4b40708b0 0x7fc4b40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4bbb8d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b40cfbf0 con 0x7fc4b40cf7c0 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4bbb8d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b4143ea0 con 0x7fc4b40708b0 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4bbb8d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b40cc730 con 0x7fc4b4143ac0 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9128640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc4b40708b0 0x7fc4b40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9128640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc4b40708b0 0x7fc4b40cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51590/0 (socket says 172.21.15.70:51590) 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9128640 1 -- 172.21.15.70:0/126574166 learned_addr learned my addr 172.21.15.70:0/126574166 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9929640 1 --2- 172.21.15.70:0/126574166 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b4143ac0 0x7fc4b4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9128640 1 -- 172.21.15.70:0/126574166 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b4143ac0 msgr2=0x7fc4b4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9128640 1 --2- 172.21.15.70:0/126574166 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b4143ac0 0x7fc4b4070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9128640 1 -- 172.21.15.70:0/126574166 >> v1:172.21.15.120:6789/0 conn(0x7fc4b40cf7c0 legacy=0x7fc4b40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.475+0000 7fc4b9128640 1 -- 172.21.15.70:0/126574166 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4070ee0 con 0x7fc4b40708b0 2023-11-26T07:22:58.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4b9128640 1 --2- 172.21.15.70:0/126574166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40cf280 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009870 tx=0x7fc4a401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48e1369c5045592 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4b8927640 1 -- 172.21.15.70:0/126574166 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40ab650 con 0x7fc4b40708b0 2023-11-26T07:22:58.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4b8927640 1 -- 172.21.15.70:0/126574166 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a40ab7b0 con 0x7fc4b40708b0 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4b8927640 1 -- 172.21.15.70:0/126574166 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40abb40 con 0x7fc4b40708b0 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/126574166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 msgr2=0x7fc4b40cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/126574166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40cf280 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009870 tx=0x7fc4a401c540 comp rx=0 tx=0).stop 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/126574166 shutdown_connections 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/126574166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40cf280 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/126574166 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b4143ac0 0x7fc4b4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/126574166 >> 172.21.15.70:0/126574166 conn(0x7fc4b406a890 msgr2=0x7fc4b406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/126574166 shutdown_connections 2023-11-26T07:22:58.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.479+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/126574166 wait complete. 2023-11-26T07:22:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 Processor -- start 2023-11-26T07:22:58.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 -- start start 2023-11-26T07:22:58.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b40cf7c0 0x7fc4b40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b4143ac0 0x7fc4b41396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b40ae1e0 con 0x7fc4b40708b0 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b40b1a20 con 0x7fc4b4143ac0 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b4139c30 con 0x7fc4b40cf7c0 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51600/0 (socket says 172.21.15.70:51600) 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 -- 172.21.15.70:0/1988450464 learned_addr learned my addr 172.21.15.70:0/1988450464 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:58.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9128640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b40cf7c0 0x7fc4b40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4ba12a640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b4143ac0 0x7fc4b41396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 -- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b40cf7c0 msgr2=0x7fc4b40b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b40cf7c0 0x7fc4b40b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 -- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b4143ac0 msgr2=0x7fc4b41396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b4143ac0 0x7fc4b41396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 -- 172.21.15.70:0/1988450464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40094d0 con 0x7fc4b40708b0 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9128640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b40cf7c0 0x7fc4b40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4ba12a640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b4143ac0 0x7fc4b41396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4b9929640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40acf40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d800 tx=0x7fc4b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4aa7fc640 1 -- 172.21.15.70:0/1988450464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000b6c0 con 0x7fc4b40708b0 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4aa7fc640 1 -- 172.21.15.70:0/1988450464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b000b820 con 0x7fc4b40708b0 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b40ad5d0 con 0x7fc4b40708b0 2023-11-26T07:22:58.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4aa7fc640 1 -- 172.21.15.70:0/1988450464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000bb90 con 0x7fc4b40708b0 2023-11-26T07:22:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b40adb90 con 0x7fc4b40708b0 2023-11-26T07:22:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.483+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b4067680 con 0x7fc4b40708b0 2023-11-26T07:22:58.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.487+0000 7fc4aa7fc640 1 -- 172.21.15.70:0/1988450464 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fc4b000bcf0 con 0x7fc4b40708b0 2023-11-26T07:22:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.487+0000 7fc4aa7fc640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc498066ce0 0x7fc4980691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.487+0000 7fc4aa7fc640 1 -- 172.21.15.70:0/1988450464 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc4b0082e30 con 0x7fc4b40708b0 2023-11-26T07:22:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.487+0000 7fc4b9128640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc498066ce0 0x7fc4980691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.487+0000 7fc4b9128640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc498066ce0 0x7fc4980691a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40af000 tx=0x7fc4a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.491+0000 7fc4aa7fc640 1 -- 172.21.15.70:0/1988450464 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4b0051b90 con 0x7fc4b40708b0 2023-11-26T07:22:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.643+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc4b4140a20 con 0x7fc4b40708b0 2023-11-26T07:22:58.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4aa7fc640 1 -- 172.21.15.70:0/1988450464 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc4b0011340 con 0x7fc4b40708b0 2023-11-26T07:22:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc498066ce0 msgr2=0x7fc4980691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc498066ce0 0x7fc4980691a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40af000 tx=0x7fc4a4008040 comp rx=0 tx=0).stop 2023-11-26T07:22:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 msgr2=0x7fc4b40acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40acf40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000d800 tx=0x7fc4b000dcc0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 shutdown_connections 2023-11-26T07:22:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4b4143ac0 0x7fc4b41396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc4b40cf7c0 0x7fc4b40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc498066ce0 0x7fc4980691a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 --2- 172.21.15.70:0/1988450464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40708b0 0x7fc4b40acf40 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 >> 172.21.15.70:0/1988450464 conn(0x7fc4b406a890 msgr2=0x7fc4b406ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 shutdown_connections 2023-11-26T07:22:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.647+0000 7fc4bbb8d640 1 -- 172.21.15.70:0/1988450464 wait complete. 2023-11-26T07:22:58.672 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled' 2023-11-26T07:22:58.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.803+0000 7fba66f2a640 1 Processor -- start 2023-11-26T07:22:58.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.803+0000 7fba66f2a640 1 -- start start 2023-11-26T07:22:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba66f2a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fba600cf710 0x7fba600cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba66f2a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba600cc730 con 0x7fba60143ac0 2023-11-26T07:22:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba66f2a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba60070ee0 con 0x7fba600cf280 2023-11-26T07:22:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba66f2a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba60143ea0 con 0x7fba600cf710 2023-11-26T07:22:58.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba64cc6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fba60143ac0 0x7fba60070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40500/0 (socket says 172.21.15.70:40500) 2023-11-26T07:22:58.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba64cc6640 1 -- 172.21.15.70:0/108947947 learned_addr learned my addr 172.21.15.70:0/108947947 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:22:58.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba654c7640 1 --2- 172.21.15.70:0/108947947 >> v2:172.21.15.120:3300/0 conn(0x7fba600cf710 0x7fba600cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907810329 0 0) 0x7fba600cc730 con 0x7fba60143ac0 2023-11-26T07:22:58.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba48003530 con 0x7fba60143ac0 2023-11-26T07:22:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303345816 0 0) 0x7fba60070ee0 con 0x7fba600cf280 2023-11-26T07:22:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba600cc730 con 0x7fba600cf280 2023-11-26T07:22:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102728105 0 0) 0x7fba48003530 con 0x7fba60143ac0 2023-11-26T07:22:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 >> v2:172.21.15.120:3300/0 conn(0x7fba600cf710 msgr2=0x7fba600cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 --2- 172.21.15.70:0/108947947 >> v2:172.21.15.120:3300/0 conn(0x7fba600cf710 0x7fba600cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 >> v1:172.21.15.120:6789/0 conn(0x7fba600cf280 legacy=0x7fba600cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba600711c0 con 0x7fba60143ac0 2023-11-26T07:22:58.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fba5c001680 con 0x7fba60143ac0 2023-11-26T07:22:58.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 >> v1:172.21.15.70:6789/0 conn(0x7fba60143ac0 legacy=0x7fba60070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba48003b60 0x7fba48003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba480047d0 0x7fba48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba4800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4800e270 con 0x7fba48005190 2023-11-26T07:22:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4800e3b0 con 0x7fba480047d0 2023-11-26T07:22:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4800e570 con 0x7fba48003b60 2023-11-26T07:22:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba654c7640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba4800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba64cc6640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba48003b60 0x7fba48003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba57fff640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba480047d0 0x7fba48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba654c7640 1 -- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba48003b60 msgr2=0x7fba48003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba654c7640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba48003b60 0x7fba48003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba654c7640 1 -- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba480047d0 msgr2=0x7fba48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:22:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba654c7640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba480047d0 0x7fba48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.807+0000 7fba654c7640 1 -- 172.21.15.70:0/108947947 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48003530 con 0x7fba48005190 2023-11-26T07:22:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba654c7640 1 -- 172.21.15.70:0/108947947 reap_dead start 2023-11-26T07:22:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba654c7640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba4800dba0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fba58009fc0 tx=0x7fba5801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df91fe4055533e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58003ba0 con 0x7fba48005190 2023-11-26T07:22:58.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800f040 con 0x7fba48005190 2023-11-26T07:22:58.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba577fe640 1 -- 172.21.15.70:0/108947947 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba580a59a0 con 0x7fba48005190 2023-11-26T07:22:58.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 -- 172.21.15.70:0/108947947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 msgr2=0x7fba4800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba4800dba0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fba58009fc0 tx=0x7fba5801cca0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 -- 172.21.15.70:0/108947947 shutdown_connections 2023-11-26T07:22:58.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 --2- 172.21.15.70:0/108947947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba4800dba0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 -- 172.21.15.70:0/108947947 >> 172.21.15.70:0/108947947 conn(0x7fba6006a890 msgr2=0x7fba6006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 -- 172.21.15.70:0/108947947 shutdown_connections 2023-11-26T07:22:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 -- 172.21.15.70:0/108947947 wait complete. 2023-11-26T07:22:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.811+0000 7fba66f2a640 1 Processor -- start 2023-11-26T07:22:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 -- start start 2023-11-26T07:22:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba6014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba601eebb0 0x7fba600aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba601596c0 0x7fba6013e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6014fce0 con 0x7fba48005190 2023-11-26T07:22:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba600b0640 con 0x7fba601eebb0 2023-11-26T07:22:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba600af050 con 0x7fba601596c0 2023-11-26T07:22:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba6014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba6014f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51614/0 (socket says 172.21.15.70:51614) 2023-11-26T07:22:58.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 -- 172.21.15.70:0/132694031 learned_addr learned my addr 172.21.15.70:0/132694031 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:22:58.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 -- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba601596c0 msgr2=0x7fba6013e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba57fff640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba601eebb0 0x7fba600aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba654c7640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba601596c0 0x7fba6013e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba601596c0 0x7fba6013e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 -- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba601eebb0 msgr2=0x7fba600aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba601eebb0 0x7fba600aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 -- 172.21.15.70:0/132694031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba600af2f0 con 0x7fba48005190 2023-11-26T07:22:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba654c7640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba601596c0 0x7fba6013e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:58.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba57fff640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba601eebb0 0x7fba600aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:22:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba64cc6640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba6014f7a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fba5c001b70 tx=0x7fba5c012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba557fa640 1 -- 172.21.15.70:0/132694031 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c014810 con 0x7fba48005190 2023-11-26T07:22:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba557fa640 1 -- 172.21.15.70:0/132694031 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c014970 con 0x7fba48005190 2023-11-26T07:22:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba557fa640 1 -- 172.21.15.70:0/132694031 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c014d00 con 0x7fba48005190 2023-11-26T07:22:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba600af5d0 con 0x7fba48005190 2023-11-26T07:22:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba600b02d0 con 0x7fba48005190 2023-11-26T07:22:58.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.815+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba60067680 con 0x7fba48005190 2023-11-26T07:22:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.819+0000 7fba557fa640 1 -- 172.21.15.70:0/132694031 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fba5c0153e0 con 0x7fba48005190 2023-11-26T07:22:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.819+0000 7fba557fa640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba4c066ce0 0x7fba4c0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:22:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.819+0000 7fba557fa640 1 -- 172.21.15.70:0/132694031 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba5c087380 con 0x7fba48005190 2023-11-26T07:22:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.819+0000 7fba57fff640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba4c066ce0 0x7fba4c0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:22:58.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.819+0000 7fba57fff640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba4c066ce0 0x7fba4c0691a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba601f20b0 tx=0x7fba50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:22:58.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:58.823+0000 7fba557fa640 1 -- 172.21.15.70:0/132694031 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba5c053f20 con 0x7fba48005190 2023-11-26T07:22:59.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.027+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]} v 0) v1 -- 0x7fba600b2940 con 0x7fba48005190 2023-11-26T07:22:59.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba557fa640 1 -- 172.21.15.70:0/132694031 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_cancelled"]}]=0 v270) v1 ==== 176+0+0 (secure 0 0 0) 0x7fba5c057540 con 0x7fba48005190 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba4c066ce0 msgr2=0x7fba4c0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba4c066ce0 0x7fba4c0691a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fba601f20b0 tx=0x7fba50009040 comp rx=0 tx=0).stop 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 msgr2=0x7fba6014f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba6014f7a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fba5c001b70 tx=0x7fba5c012920 comp rx=0 tx=0).stop 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 shutdown_connections 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fba601596c0 0x7fba6013e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba601eebb0 0x7fba600aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fba4c066ce0 0x7fba4c0691a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 --2- 172.21.15.70:0/132694031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba48005190 0x7fba6014f7a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:22:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 >> 172.21.15.70:0/132694031 conn(0x7fba6006a890 msgr2=0x7fba600cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:22:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 shutdown_connections 2023-11-26T07:22:59.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:22:59.975+0000 7fba66f2a640 1 -- 172.21.15.70:0/132694031 wait complete. 2023-11-26T07:23:00.003 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during pending state and validate the reason ... ok 2023-11-26T07:23:00.003 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:23:00.003 INFO:tasks.cephfs_test_runner:test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:23:00.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:00.142 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:00.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:00.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 Processor -- start 2023-11-26T07:23:00.147 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 -- start start 2023-11-26T07:23:00.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6df415d6e0 0x7f6df40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6df40d19f0 0x7f6df40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.148 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df415dac0 con 0x7f6df415d6e0 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40d1e80 con 0x7f6df40d19f0 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6dfa817640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40cf0e0 con 0x7f6df40b2160 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6df415d6e0 0x7f6df40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6df415d6e0 0x7f6df40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51618/0 (socket says 172.21.15.70:51618) 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 -- 172.21.15.70:0/1504200740 learned_addr learned my addr 172.21.15.70:0/1504200740 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df8db4640 1 --2- 172.21.15.70:0/1504200740 >> v2:172.21.15.120:3300/0 conn(0x7f6df40d19f0 0x7f6df40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df37fe640 1 --2- 172.21.15.70:0/1504200740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 -- 172.21.15.70:0/1504200740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 msgr2=0x7f6df40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 --2- 172.21.15.70:0/1504200740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 -- 172.21.15.70:0/1504200740 >> v2:172.21.15.120:3300/0 conn(0x7f6df40d19f0 msgr2=0x7f6df40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 --2- 172.21.15.70:0/1504200740 >> v2:172.21.15.120:3300/0 conn(0x7f6df40d19f0 0x7f6df40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.149 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df3fff640 1 -- 172.21.15.70:0/1504200740 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df40ceb20 con 0x7f6df415d6e0 2023-11-26T07:23:00.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df37fe640 1 --2- 172.21.15.70:0/1504200740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:00.150 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.143+0000 7f6df8db4640 1 --2- 172.21.15.70:0/1504200740 >> v2:172.21.15.120:3300/0 conn(0x7f6df40d19f0 0x7f6df40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:00.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6df3fff640 1 --2- 172.21.15.70:0/1504200740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df40d0df0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6df408d820 tx=0x7f6de401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea2d0d9cbf3b3ef server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6df2ffd640 1 -- 172.21.15.70:0/1504200740 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40ab600 con 0x7f6df415d6e0 2023-11-26T07:23:00.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6df2ffd640 1 -- 172.21.15.70:0/1504200740 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de40a7050 con 0x7f6df415d6e0 2023-11-26T07:23:00.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6df2ffd640 1 -- 172.21.15.70:0/1504200740 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40ab980 con 0x7f6df415d6e0 2023-11-26T07:23:00.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 -- 172.21.15.70:0/1504200740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 msgr2=0x7f6df40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1504200740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df40d0df0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6df408d820 tx=0x7f6de401c240 comp rx=0 tx=0).stop 2023-11-26T07:23:00.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 -- 172.21.15.70:0/1504200740 shutdown_connections 2023-11-26T07:23:00.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1504200740 >> v2:172.21.15.120:3300/0 conn(0x7f6df40d19f0 0x7f6df40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1504200740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1504200740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df40d0df0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 -- 172.21.15.70:0/1504200740 >> 172.21.15.70:0/1504200740 conn(0x7f6df409c550 msgr2=0x7f6df40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 -- 172.21.15.70:0/1504200740 shutdown_connections 2023-11-26T07:23:00.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.147+0000 7f6dfa817640 1 -- 172.21.15.70:0/1504200740 wait complete. 2023-11-26T07:23:00.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 Processor -- start 2023-11-26T07:23:00.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 -- start start 2023-11-26T07:23:00.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6df40d19f0 0x7f6df4152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df41f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df415ec50 con 0x7f6df415d6e0 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40ccf90 con 0x7f6df40d19f0 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df40cd230 con 0x7f6df40b2160 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df41f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df41f9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51632/0 (socket says 172.21.15.70:51632) 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 -- 172.21.15.70:0/1035192058 learned_addr learned my addr 172.21.15.70:0/1035192058 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df3fff640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df37fe640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6df40d19f0 0x7f6df4152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 -- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 msgr2=0x7f6df40ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 -- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6df40d19f0 msgr2=0x7f6df4152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6df40d19f0 0x7f6df4152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 -- 172.21.15.70:0/1035192058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40094d0 con 0x7f6df415d6e0 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df37fe640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6df40d19f0 0x7f6df4152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df8db4640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df41f9260 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6dec007ef0 tx=0x7f6dec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df0ff9640 1 -- 172.21.15.70:0/1035192058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec003ba0 con 0x7f6df415d6e0 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df0ff9640 1 -- 172.21.15.70:0/1035192058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec00f040 con 0x7f6df415d6e0 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6df0ff9640 1 -- 172.21.15.70:0/1035192058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00de80 con 0x7f6df415d6e0 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df40cd510 con 0x7f6df415d6e0 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df40ca830 con 0x7f6df415d6e0 2023-11-26T07:23:00.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.151+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df4067680 con 0x7f6df415d6e0 2023-11-26T07:23:00.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.155+0000 7f6df0ff9640 1 -- 172.21.15.70:0/1035192058 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f6dec004030 con 0x7f6df415d6e0 2023-11-26T07:23:00.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.155+0000 7f6df0ff9640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6de0066ce0 0x7f6de00691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.155+0000 7f6df0ff9640 1 -- 172.21.15.70:0/1035192058 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6dec082b70 con 0x7f6df415d6e0 2023-11-26T07:23:00.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.155+0000 7f6df3fff640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6de0066ce0 0x7f6de00691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.155+0000 7f6df3fff640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6de0066ce0 0x7f6de00691a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6de40ad000 tx=0x7f6de40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.163+0000 7f6df0ff9640 1 -- 172.21.15.70:0/1035192058 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6dec051920 con 0x7f6df415d6e0 2023-11-26T07:23:00.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.311+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6df40740c0 con 0x7f6df415d6e0 2023-11-26T07:23:00.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6df0ff9640 1 -- 172.21.15.70:0/1035192058 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+12986 (secure 0 0 0) 0x7f6dec054f40 con 0x7f6df415d6e0 2023-11-26T07:23:00.318 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:00.319 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":69,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:22:57.960938+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6837/3834969891":"2023-11-27T07:22:54.949770+0000","172.21.15.70:6836/3834969891":"2023-11-27T07:22:54.949770+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:00.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6de0066ce0 msgr2=0x7f6de00691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6de0066ce0 0x7f6de00691a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6de40ad000 tx=0x7f6de40a6000 comp rx=0 tx=0).stop 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 msgr2=0x7f6df41f9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df41f9260 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6dec007ef0 tx=0x7f6dec00d4a0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 shutdown_connections 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6de0066ce0 0x7f6de00691a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df415d6e0 0x7f6df41f9260 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6df40d19f0 0x7f6df4152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 --2- 172.21.15.70:0/1035192058 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6df40b2160 0x7f6df40ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 >> 172.21.15.70:0/1035192058 conn(0x7f6df409c550 msgr2=0x7f6df415c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 shutdown_connections 2023-11-26T07:23:00.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.315+0000 7f6dfa817640 1 -- 172.21.15.70:0/1035192058 wait complete. 2023-11-26T07:23:00.340 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:23:00.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:23:00.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072ae91640 1 Processor -- start 2023-11-26T07:23:00.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072ae91640 1 -- start start 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072ae91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 0x7f072406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072ae91640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0724161cf0 0x7f0724070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072ae91640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07240714c0 con 0x7f07240cdd10 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072ae91640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07240cd610 con 0x7f0724161cf0 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072ae91640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240cd8f0 con 0x7f0724070ba0 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f07240cdd10 0x7f072406a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:40514/0 (socket says 172.21.15.70:40514) 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 -- 172.21.15.70:0/1964998236 learned_addr learned my addr 172.21.15.70:0/1964998236 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f0728c2d640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 0x7f072406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f0723fff640 1 --2- 172.21.15.70:0/1964998236 >> v2:172.21.15.120:3300/0 conn(0x7f0724161cf0 0x7f0724070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606930094 0 0) 0x7f07240714c0 con 0x7f07240cdd10 2023-11-26T07:23:00.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0714003530 con 0x7f07240cdd10 2023-11-26T07:23:00.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210126918 0 0) 0x7f0714003530 con 0x7f07240cdd10 2023-11-26T07:23:00.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 msgr2=0x7f072406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 0x7f072406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 >> v2:172.21.15.120:3300/0 conn(0x7f0724161cf0 msgr2=0x7f0724070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 --2- 172.21.15.70:0/1964998236 >> v2:172.21.15.120:3300/0 conn(0x7f0724161cf0 0x7f0724070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724161210 con 0x7f07240cdd10 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f071c001a00 con 0x7f07240cdd10 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 >> v1:172.21.15.70:6789/0 conn(0x7f07240cdd10 legacy=0x7f072406a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0714003980 0x7f0714003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 0x7f07140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0714005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240cd610 con 0x7f0714004d10 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240cd8f0 con 0x7f0714003980 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071400b990 con 0x7f0724070ba0 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0714005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f0723fff640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 0x7f07140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f0728c2d640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0714003980 0x7f0714003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 -- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 msgr2=0x7f07140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0724070ba0 0x7f07140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 -- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0714003980 msgr2=0x7f0714003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0714003980 0x7f0714003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f072942e640 1 -- 172.21.15.70:0/1964998236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714003530 con 0x7f0714004d10 2023-11-26T07:23:00.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.479+0000 7f0728c2d640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0714003980 0x7f0714003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:00.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072942e640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0714005190 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f071c00a860 tx=0x7f071c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c337ec280c2977d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ad630 con 0x7f0714004d10 2023-11-26T07:23:00.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0a8070 con 0x7f0714004d10 2023-11-26T07:23:00.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f07237fe640 1 -- 172.21.15.70:0/1964998236 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ad9f0 con 0x7f0714004d10 2023-11-26T07:23:00.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072ae91640 1 -- 172.21.15.70:0/1964998236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 msgr2=0x7f0714005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072ae91640 1 --2- 172.21.15.70:0/1964998236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0714005190 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f071c00a860 tx=0x7f071c01d360 comp rx=0 tx=0).stop 2023-11-26T07:23:00.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072942e640 1 -- 172.21.15.70:0/1964998236 reap_dead start 2023-11-26T07:23:00.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072ae91640 1 -- 172.21.15.70:0/1964998236 shutdown_connections 2023-11-26T07:23:00.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072ae91640 1 -- 172.21.15.70:0/1964998236 >> 172.21.15.70:0/1964998236 conn(0x7f07240cf710 msgr2=0x7f07240cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072ae91640 1 -- 172.21.15.70:0/1964998236 shutdown_connections 2023-11-26T07:23:00.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.483+0000 7f072ae91640 1 -- 172.21.15.70:0/1964998236 wait complete. 2023-11-26T07:23:00.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 Processor -- start 2023-11-26T07:23:00.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 -- start start 2023-11-26T07:23:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0724149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072415aee0 0x7f07240cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07240af350 0x7f07240af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072415be80 con 0x7f0714004d10 2023-11-26T07:23:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240afd10 con 0x7f072415aee0 2023-11-26T07:23:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072415b360 con 0x7f07240af350 2023-11-26T07:23:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0724149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0724149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51640/0 (socket says 172.21.15.70:51640) 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 -- 172.21.15.70:0/3536857110 learned_addr learned my addr 172.21.15.70:0/3536857110 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 -- 172.21.15.70:0/3536857110 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07240af350 msgr2=0x7f07240af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07240af350 0x7f07240af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 -- 172.21.15.70:0/3536857110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072415aee0 msgr2=0x7f07240cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072415aee0 0x7f07240cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 -- 172.21.15.70:0/3536857110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724148910 con 0x7f0714004d10 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f0728c2d640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0724149b00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0718009fd0 tx=0x7f0718011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f07217fa640 1 -- 172.21.15.70:0/3536857110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718004220 con 0x7f0714004d10 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f07217fa640 1 -- 172.21.15.70:0/3536857110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718004380 con 0x7f0714004d10 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07240cb610 con 0x7f0714004d10 2023-11-26T07:23:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f07217fa640 1 -- 172.21.15.70:0/3536857110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718015890 con 0x7f0714004d10 2023-11-26T07:23:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.487+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072415b8c0 con 0x7f0714004d10 2023-11-26T07:23:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.491+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724067680 con 0x7f0714004d10 2023-11-26T07:23:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.491+0000 7f07217fa640 1 -- 172.21.15.70:0/3536857110 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f07180159f0 con 0x7f0714004d10 2023-11-26T07:23:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.491+0000 7f07217fa640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0708066d10 0x7f07080691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.491+0000 7f07217fa640 1 -- 172.21.15.70:0/3536857110 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0718082d10 con 0x7f0714004d10 2023-11-26T07:23:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.491+0000 7f0723fff640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0708066d10 0x7f07080691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.491+0000 7f0723fff640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0708066d10 0x7f07080691d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0710006e90 tx=0x7f0710006e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.495+0000 7f07217fa640 1 -- 172.21.15.70:0/3536857110 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0718089070 con 0x7f0714004d10 2023-11-26T07:23:00.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.651+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07240ce260 con 0x7f0714004d10 2023-11-26T07:23:00.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f07217fa640 1 -- 172.21.15.70:0/3536857110 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07180220a0 con 0x7f0714004d10 2023-11-26T07:23:00.658 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:23:00.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0708066d10 msgr2=0x7f07080691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0708066d10 0x7f07080691d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0710006e90 tx=0x7f0710006e00 comp rx=0 tx=0).stop 2023-11-26T07:23:00.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 msgr2=0x7f0724149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.660 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0724149b00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0718009fd0 tx=0x7f0718011a60 comp rx=0 tx=0).stop 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 shutdown_connections 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07240af350 0x7f07240af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072415aee0 0x7f07240cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0708066d10 0x7f07080691d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 --2- 172.21.15.70:0/3536857110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0714004d10 0x7f0724149b00 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 >> 172.21.15.70:0/3536857110 conn(0x7f07240cf710 msgr2=0x7f072406d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 shutdown_connections 2023-11-26T07:23:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.655+0000 7f072ae91640 1 -- 172.21.15.70:0/3536857110 wait complete. 2023-11-26T07:23:00.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-11-26T07:23:00.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.811+0000 7f8a6c0ad640 1 Processor -- start 2023-11-26T07:23:00.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a6c0ad640 1 -- start start 2023-11-26T07:23:00.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a6c0ad640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a640cf990 0x7f8a640708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a6c0ad640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8a64070e00 0x7f8a64162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a6c0ad640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a64162080 con 0x7f8a6414b1e0 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a6c0ad640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a64161d70 con 0x7f8a640cf990 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a6c0ad640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6414b5c0 con 0x7f8a64070e00 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a69648640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a640cf990 0x7f8a640708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a69648640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8a640cf990 0x7f8a640708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51644/0 (socket says 172.21.15.70:51644) 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a69648640 1 -- 172.21.15.70:0/2810612269 learned_addr learned my addr 172.21.15.70:0/2810612269 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:00.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a6a64a640 1 --2- 172.21.15.70:0/2810612269 >> v2:172.21.15.120:3300/0 conn(0x7f8a64070e00 0x7f8a64162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a69648640 1 -- 172.21.15.70:0/2810612269 >> v2:172.21.15.120:3300/0 conn(0x7f8a64070e00 msgr2=0x7f8a64162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:00.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a69648640 1 --2- 172.21.15.70:0/2810612269 >> v2:172.21.15.120:3300/0 conn(0x7f8a64070e00 0x7f8a64162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a69648640 1 -- 172.21.15.70:0/2810612269 >> v1:172.21.15.70:6789/0 conn(0x7f8a6414b1e0 legacy=0x7f8a640cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a69648640 1 -- 172.21.15.70:0/2810612269 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64071580 con 0x7f8a640cf990 2023-11-26T07:23:00.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.815+0000 7f8a68e47640 1 -- 172.21.15.70:0/2810612269 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391536720 0 0) 0x7f8a64162080 con 0x7f8a6414b1e0 2023-11-26T07:23:00.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a69648640 1 --2- 172.21.15.70:0/2810612269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a640cf990 0x7f8a640708c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b4590 tx=0x7f8a5401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50f50480c85c9e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a68e47640 1 -- 172.21.15.70:0/2810612269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a540aa430 con 0x7f8a640cf990 2023-11-26T07:23:00.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a68e47640 1 -- 172.21.15.70:0/2810612269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a540aa590 con 0x7f8a640cf990 2023-11-26T07:23:00.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a68e47640 1 -- 172.21.15.70:0/2810612269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a540aa920 con 0x7f8a640cf990 2023-11-26T07:23:00.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/2810612269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a640cf990 msgr2=0x7f8a640708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/2810612269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a640cf990 0x7f8a640708c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b4590 tx=0x7f8a5401c4d0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/2810612269 shutdown_connections 2023-11-26T07:23:00.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/2810612269 >> v2:172.21.15.120:3300/0 conn(0x7f8a64070e00 0x7f8a64162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/2810612269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a640cf990 0x7f8a640708c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/2810612269 >> 172.21.15.70:0/2810612269 conn(0x7f8a6406a890 msgr2=0x7f8a6406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:00.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/2810612269 shutdown_connections 2023-11-26T07:23:00.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.819+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/2810612269 wait complete. 2023-11-26T07:23:00.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 Processor -- start 2023-11-26T07:23:00.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 -- start start 2023-11-26T07:23:00.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a64070e00 0x7f8a6414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a640cf990 0x7f8a64142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6414b1e0 0x7f8a64145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a64160c30 con 0x7f8a6414b1e0 2023-11-26T07:23:00.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6414bf80 con 0x7f8a640cf990 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6414c260 con 0x7f8a64070e00 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6414b1e0 0x7f8a64145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6414b1e0 0x7f8a64145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51646/0 (socket says 172.21.15.70:51646) 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 -- 172.21.15.70:0/3327368001 learned_addr learned my addr 172.21.15.70:0/3327368001 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 -- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a64070e00 msgr2=0x7f8a6414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a69648640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a640cf990 0x7f8a64142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a69e49640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a64070e00 0x7f8a6414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a64070e00 0x7f8a6414b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 -- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a640cf990 msgr2=0x7f8a64142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a640cf990 0x7f8a64142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 -- 172.21.15.70:0/3327368001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540094d0 con 0x7f8a6414b1e0 2023-11-26T07:23:00.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a69648640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a640cf990 0x7f8a64142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:00.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a69e49640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a64070e00 0x7f8a6414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:00.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6a64a640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6414b1e0 0x7f8a64145a40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c007e40 tx=0x7f8a5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a5a7fc640 1 -- 172.21.15.70:0/3327368001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c014620 con 0x7f8a6414b1e0 2023-11-26T07:23:00.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a5a7fc640 1 -- 172.21.15.70:0/3327368001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c00ee90 con 0x7f8a6414b1e0 2023-11-26T07:23:00.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6414c540 con 0x7f8a6414b1e0 2023-11-26T07:23:00.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a5a7fc640 1 -- 172.21.15.70:0/3327368001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0149e0 con 0x7f8a6414b1e0 2023-11-26T07:23:00.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6414cb00 con 0x7f8a6414b1e0 2023-11-26T07:23:00.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.823+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a64067680 con 0x7f8a6414b1e0 2023-11-26T07:23:00.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.827+0000 7f8a5a7fc640 1 -- 172.21.15.70:0/3327368001 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f8a5c014b40 con 0x7f8a6414b1e0 2023-11-26T07:23:00.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.827+0000 7f8a5a7fc640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a48066d10 0x7f8a480691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:00.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.827+0000 7f8a5a7fc640 1 -- 172.21.15.70:0/3327368001 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8a5c0832a0 con 0x7f8a6414b1e0 2023-11-26T07:23:00.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.827+0000 7f8a69e49640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a48066d10 0x7f8a480691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:00.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.827+0000 7f8a69e49640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a48066d10 0x7f8a480691d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8a60000f70 tx=0x7f8a60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:00.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:00.831+0000 7f8a5a7fc640 1 -- 172.21.15.70:0/3327368001 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a5c051fa0 con 0x7f8a6414b1e0 2023-11-26T07:23:01.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.035+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7f8a640b0870 con 0x7f8a6414b1e0 2023-11-26T07:23:01.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a5a7fc640 1 -- 172.21.15.70:0/3327368001 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v272) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8a5c0555c0 con 0x7f8a6414b1e0 2023-11-26T07:23:01.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a48066d10 msgr2=0x7f8a480691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a48066d10 0x7f8a480691d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8a60000f70 tx=0x7f8a60009040 comp rx=0 tx=0).stop 2023-11-26T07:23:01.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6414b1e0 msgr2=0x7f8a64145a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6414b1e0 0x7f8a64145a40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c007e40 tx=0x7f8a5c00e4b0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 shutdown_connections 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8a48066d10 0x7f8a480691d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6414b1e0 0x7f8a64145a40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a640cf990 0x7f8a64142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 --2- 172.21.15.70:0/3327368001 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8a64070e00 0x7f8a6414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 >> 172.21.15.70:0/3327368001 conn(0x7f8a6406a890 msgr2=0x7f8a640b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 shutdown_connections 2023-11-26T07:23:01.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:01.983+0000 7f8a6c0ad640 1 -- 172.21.15.70:0/3327368001 wait complete. 2023-11-26T07:23:02.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:23:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 Processor -- start 2023-11-26T07:23:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 -- start start 2023-11-26T07:23:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de0143ac0 0x7f5de0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5de00708b0 0x7f5de00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5de00cf7c0 0x7f5de00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de0143ea0 con 0x7f5de00708b0 2023-11-26T07:23:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de00cfbf0 con 0x7f5de00cf7c0 2023-11-26T07:23:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de685a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00cc730 con 0x7f5de0143ac0 2023-11-26T07:23:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5de00708b0 0x7f5de00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5de00708b0 0x7f5de00cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51662/0 (socket says 172.21.15.70:51662) 2023-11-26T07:23:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 -- 172.21.15.70:0/2717365530 learned_addr learned my addr 172.21.15.70:0/2717365530 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddffff640 1 --2- 172.21.15.70:0/2717365530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de0143ac0 0x7f5de0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de4df7640 1 --2- 172.21.15.70:0/2717365530 >> v2:172.21.15.120:3300/0 conn(0x7f5de00cf7c0 0x7f5de00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 -- 172.21.15.70:0/2717365530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de0143ac0 msgr2=0x7f5de0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 --2- 172.21.15.70:0/2717365530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de0143ac0 0x7f5de0070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 -- 172.21.15.70:0/2717365530 >> v2:172.21.15.120:3300/0 conn(0x7f5de00cf7c0 msgr2=0x7f5de00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 --2- 172.21.15.70:0/2717365530 >> v2:172.21.15.120:3300/0 conn(0x7f5de00cf7c0 0x7f5de00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddf7fe640 1 -- 172.21.15.70:0/2717365530 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de0070ee0 con 0x7f5de00708b0 2023-11-26T07:23:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5de4df7640 1 --2- 172.21.15.70:0/2717365530 >> v2:172.21.15.120:3300/0 conn(0x7f5de00cf7c0 0x7f5de00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:02.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.151+0000 7f5ddffff640 1 --2- 172.21.15.70:0/2717365530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de0143ac0 0x7f5de0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:02.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5ddf7fe640 1 --2- 172.21.15.70:0/2717365530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00708b0 0x7f5de00cf280 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5de00718d0 tx=0x7f5dd401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4470e3698d0454b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5ddeffd640 1 -- 172.21.15.70:0/2717365530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40ab600 con 0x7f5de00708b0 2023-11-26T07:23:02.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5ddeffd640 1 -- 172.21.15.70:0/2717365530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd40a7050 con 0x7f5de00708b0 2023-11-26T07:23:02.159 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5ddeffd640 1 -- 172.21.15.70:0/2717365530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40ab980 con 0x7f5de00708b0 2023-11-26T07:23:02.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 -- 172.21.15.70:0/2717365530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00708b0 msgr2=0x7f5de00cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 --2- 172.21.15.70:0/2717365530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00708b0 0x7f5de00cf280 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5de00718d0 tx=0x7f5dd401c240 comp rx=0 tx=0).stop 2023-11-26T07:23:02.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 -- 172.21.15.70:0/2717365530 shutdown_connections 2023-11-26T07:23:02.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 --2- 172.21.15.70:0/2717365530 >> v2:172.21.15.120:3300/0 conn(0x7f5de00cf7c0 0x7f5de00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 --2- 172.21.15.70:0/2717365530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de00708b0 0x7f5de00cf280 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 --2- 172.21.15.70:0/2717365530 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de0143ac0 0x7f5de0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 -- 172.21.15.70:0/2717365530 >> 172.21.15.70:0/2717365530 conn(0x7f5de006a890 msgr2=0x7f5de006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:02.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 -- 172.21.15.70:0/2717365530 shutdown_connections 2023-11-26T07:23:02.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 -- 172.21.15.70:0/2717365530 wait complete. 2023-11-26T07:23:02.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.155+0000 7f5de685a640 1 Processor -- start 2023-11-26T07:23:02.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 -- start start 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de00708b0 0x7f5de0140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5de00cf7c0 0x7f5de015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de0143ac0 0x7f5de014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00b13f0 con 0x7f5de0143ac0 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de015c0e0 con 0x7f5de00cf7c0 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de015be00 con 0x7f5de00708b0 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de0143ac0 0x7f5de014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de0143ac0 0x7f5de014c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51668/0 (socket says 172.21.15.70:51668) 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 -- 172.21.15.70:0/1562599464 learned_addr learned my addr 172.21.15.70:0/1562599464 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5ddffff640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de00708b0 0x7f5de0140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5ddf7fe640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5de00cf7c0 0x7f5de015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 -- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de00708b0 msgr2=0x7f5de0140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de00708b0 0x7f5de0140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 -- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5de00cf7c0 msgr2=0x7f5de015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5de00cf7c0 0x7f5de015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 -- 172.21.15.70:0/1562599464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40094d0 con 0x7f5de0143ac0 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5ddf7fe640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5de00cf7c0 0x7f5de015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5ddffff640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de00708b0 0x7f5de0140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:02.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de4df7640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de0143ac0 0x7f5de014c3a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800cef0 tx=0x7f5dd800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5ddcff9640 1 -- 172.21.15.70:0/1562599464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800d840 con 0x7f5de0143ac0 2023-11-26T07:23:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5ddcff9640 1 -- 172.21.15.70:0/1562599464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd800d9a0 con 0x7f5de0143ac0 2023-11-26T07:23:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5ddcff9640 1 -- 172.21.15.70:0/1562599464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800dd50 con 0x7f5de0143ac0 2023-11-26T07:23:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de00b0d30 con 0x7f5de0143ac0 2023-11-26T07:23:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de015a7b0 con 0x7f5de0143ac0 2023-11-26T07:23:02.166 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.159+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de00b1530 con 0x7f5de0143ac0 2023-11-26T07:23:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.163+0000 7f5ddcff9640 1 -- 172.21.15.70:0/1562599464 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f5dd801e3b0 con 0x7f5de0143ac0 2023-11-26T07:23:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.163+0000 7f5ddcff9640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5dcc066d10 0x7f5dcc0691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.163+0000 7f5ddcff9640 1 -- 172.21.15.70:0/1562599464 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5dd8083300 con 0x7f5de0143ac0 2023-11-26T07:23:02.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.163+0000 7f5ddffff640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5dcc066d10 0x7f5dcc0691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.163+0000 7f5ddffff640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5dcc066d10 0x7f5dcc0691d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000a9b0 tx=0x7f5dd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.167+0000 7f5ddcff9640 1 -- 172.21.15.70:0/1562599464 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5de00b1530 con 0x7f5de0143ac0 2023-11-26T07:23:02.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.315+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5de00b1530 con 0x7f5de0143ac0 2023-11-26T07:23:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.319+0000 7f5ddcff9640 1 -- 172.21.15.70:0/1562599464 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5de00b1530 con 0x7f5de0143ac0 2023-11-26T07:23:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5dcc066d10 msgr2=0x7f5dcc0691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5dcc066d10 0x7f5dcc0691d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000a9b0 tx=0x7f5dd0008040 comp rx=0 tx=0).stop 2023-11-26T07:23:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de0143ac0 msgr2=0x7f5de014c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de0143ac0 0x7f5de014c3a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800cef0 tx=0x7f5dd800a710 comp rx=0 tx=0).stop 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 shutdown_connections 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5dcc066d10 0x7f5dcc0691d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5de0143ac0 0x7f5de014c3a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5de00cf7c0 0x7f5de015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 --2- 172.21.15.70:0/1562599464 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5de00708b0 0x7f5de0140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 >> 172.21.15.70:0/1562599464 conn(0x7f5de006a890 msgr2=0x7f5de00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 shutdown_connections 2023-11-26T07:23:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.323+0000 7f5de685a640 1 -- 172.21.15.70:0/1562599464 wait complete. 2023-11-26T07:23:02.346 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:23:02.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:23:02.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:23:02.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:23:02.573 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:02.573 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:02.581 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:23:02.582 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:23:02.582 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:02.591 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:23:02.591 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:02.591 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:02.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:23:02.633 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:23:02.634 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:02.642 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:23:02.643 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-26T07:23:02.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:23:02.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.807+0000 7f2028e68640 1 Processor -- start 2023-11-26T07:23:02.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.807+0000 7f2028e68640 1 -- start start 2023-11-26T07:23:02.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2028e68640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2024143ac0 0x7f2024070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2028e68640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f20240cf990 0x7f20240cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2028e68640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20240cc730 con 0x7f20240708b0 2023-11-26T07:23:02.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2028e68640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2024143ea0 con 0x7f20240cf990 2023-11-26T07:23:02.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2028e68640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2024070ee0 con 0x7f2024143ac0 2023-11-26T07:23:02.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2022d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f20240cf990 0x7f20240cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2022d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f20240cf990 0x7f20240cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51676/0 (socket says 172.21.15.70:51676) 2023-11-26T07:23:02.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2022d9d640 1 -- 172.21.15.70:0/3757597914 learned_addr learned my addr 172.21.15.70:0/3757597914 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:02.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f202259c640 1 --2- 172.21.15.70:0/3757597914 >> v2:172.21.15.120:3300/0 conn(0x7f2024143ac0 0x7f2024070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2022d9d640 1 -- 172.21.15.70:0/3757597914 >> v2:172.21.15.120:3300/0 conn(0x7f2024143ac0 msgr2=0x7f2024070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:02.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2022d9d640 1 --2- 172.21.15.70:0/3757597914 >> v2:172.21.15.120:3300/0 conn(0x7f2024143ac0 0x7f2024070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2022d9d640 1 -- 172.21.15.70:0/3757597914 >> v1:172.21.15.120:6789/0 conn(0x7f20240708b0 legacy=0x7f20240cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f2022d9d640 1 -- 172.21.15.70:0/3757597914 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240711c0 con 0x7f20240cf990 2023-11-26T07:23:02.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.811+0000 7f202259c640 1 --2- 172.21.15.70:0/3757597914 >> v2:172.21.15.120:3300/0 conn(0x7f2024143ac0 0x7f2024070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:02.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2022d9d640 1 --2- 172.21.15.70:0/3757597914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240cf990 0x7f20240cd1b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f202406dca0 tx=0x7f201c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48846836b7d797a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2021d9b640 1 -- 172.21.15.70:0/3757597914 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0a57a0 con 0x7f20240cf990 2023-11-26T07:23:02.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2021d9b640 1 -- 172.21.15.70:0/3757597914 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0a5900 con 0x7f20240cf990 2023-11-26T07:23:02.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2021d9b640 1 -- 172.21.15.70:0/3757597914 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0a5c90 con 0x7f20240cf990 2023-11-26T07:23:02.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 -- 172.21.15.70:0/3757597914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240cf990 msgr2=0x7f20240cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 --2- 172.21.15.70:0/3757597914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240cf990 0x7f20240cd1b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f202406dca0 tx=0x7f201c01c9d0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 -- 172.21.15.70:0/3757597914 shutdown_connections 2023-11-26T07:23:02.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 --2- 172.21.15.70:0/3757597914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240cf990 0x7f20240cd1b0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 --2- 172.21.15.70:0/3757597914 >> v2:172.21.15.120:3300/0 conn(0x7f2024143ac0 0x7f2024070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 -- 172.21.15.70:0/3757597914 >> 172.21.15.70:0/3757597914 conn(0x7f202406a890 msgr2=0x7f202406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:02.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 -- 172.21.15.70:0/3757597914 shutdown_connections 2023-11-26T07:23:02.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 -- 172.21.15.70:0/3757597914 wait complete. 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 Processor -- start 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.815+0000 7f2028e68640 1 -- start start 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240708b0 0x7f2024139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20240cf990 0x7f20240afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2024143ac0 0x7f202406c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240b1270 con 0x7f20240708b0 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240b0660 con 0x7f20240cf990 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240b0940 con 0x7f2024143ac0 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240708b0 0x7f2024139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240708b0 0x7f2024139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51692/0 (socket says 172.21.15.70:51692) 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 -- 172.21.15.70:0/2524788390 learned_addr learned my addr 172.21.15.70:0/2524788390 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:02.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2019d9b640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20240cf990 0x7f20240afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2022d9d640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2024143ac0 0x7f202406c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 -- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2024143ac0 msgr2=0x7f202406c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2024143ac0 0x7f202406c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 -- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20240cf990 msgr2=0x7f20240afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20240cf990 0x7f20240afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 -- 172.21.15.70:0/2524788390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009b30 con 0x7f20240708b0 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2019d9b640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20240cf990 0x7f20240afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f202259c640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240708b0 0x7f2024139940 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f200c00d800 tx=0x7f200c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f201b7fe640 1 -- 172.21.15.70:0/2524788390 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0096c0 con 0x7f20240708b0 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f201b7fe640 1 -- 172.21.15.70:0/2524788390 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c009820 con 0x7f20240708b0 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f201b7fe640 1 -- 172.21.15.70:0/2524788390 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c009bd0 con 0x7f20240708b0 2023-11-26T07:23:02.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20240b0c20 con 0x7f20240708b0 2023-11-26T07:23:02.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2024139e80 con 0x7f20240708b0 2023-11-26T07:23:02.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2024067680 con 0x7f20240708b0 2023-11-26T07:23:02.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.819+0000 7f201b7fe640 1 -- 172.21.15.70:0/2524788390 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f200c009d30 con 0x7f20240708b0 2023-11-26T07:23:02.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.823+0000 7f201b7fe640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2004066ce0 0x7f20040691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:02.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.823+0000 7f201b7fe640 1 -- 172.21.15.70:0/2524788390 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f200c083010 con 0x7f20240708b0 2023-11-26T07:23:02.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.823+0000 7f2019d9b640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2004066ce0 0x7f20040691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:02.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.823+0000 7f2019d9b640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2004066ce0 0x7f20040691a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f202415ac70 tx=0x7f2014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:02.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:02.827+0000 7f201b7fe640 1 -- 172.21.15.70:0/2524788390 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f200c051d10 con 0x7f20240708b0 2023-11-26T07:23:03.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f202406b0f0 con 0x7f20240708b0 2023-11-26T07:23:03.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f201b7fe640 1 -- 172.21.15.70:0/2524788390 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f200c055330 con 0x7f20240708b0 2023-11-26T07:23:03.022 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:03.023 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5582,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/3935694912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3935694912},{"type":"v1","addr":"172.21.15.120:6834","nonce":3935694912}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":5585,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/886224003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":886224003},{"type":"v1","addr":"172.21.15.120:6835","nonce":886224003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1027556569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1027556569},{"type":"v1","addr":"172.21.15.70:6835","nonce":1027556569}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/1665039610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":1665039610},{"type":"v1","addr":"172.21.15.70:6837","nonce":1665039610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[]} 2023-11-26T07:23:03.023 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 41 2023-11-26T07:23:03.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2004066ce0 msgr2=0x7f20040691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2004066ce0 0x7f20040691a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f202415ac70 tx=0x7f2014009040 comp rx=0 tx=0).stop 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240708b0 msgr2=0x7f2024139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240708b0 0x7f2024139940 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f200c00d800 tx=0x7f200c00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 shutdown_connections 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f2024143ac0 0x7f202406c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20240cf990 0x7f20240afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2004066ce0 0x7f20040691a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 --2- 172.21.15.70:0/2524788390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20240708b0 0x7f2024139940 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 >> 172.21.15.70:0/2524788390 conn(0x7f202406a890 msgr2=0x7f202413c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 shutdown_connections 2023-11-26T07:23:03.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.019+0000 7f2028e68640 1 -- 172.21.15.70:0/2524788390 wait complete. 2023-11-26T07:23:03.044 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-26T07:23:03.044 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-26T07:23:03.045 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:23:03.045 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:23:03.045 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-26T07:23:03.046 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-26T07:23:03.046 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:23:03.046 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:23:03.046 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-26T07:23:03.046 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-26T07:23:03.046 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:23:03.046 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:23:03.047 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-26T07:23:03.047 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-26T07:23:03.047 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:23:03.047 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:23:03.061 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:23:03.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-26T07:23:03.061 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:23:03.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-26T07:23:03.063 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:23:03.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-26T07:23:03.063 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:23:03.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-26T07:23:03.109 INFO:tasks.ceph.mds.b:Started 2023-11-26T07:23:03.109 DEBUG:teuthology.parallel:result is None 2023-11-26T07:23:03.109 INFO:tasks.ceph.mds.a:Started 2023-11-26T07:23:03.110 DEBUG:teuthology.parallel:result is None 2023-11-26T07:23:03.111 INFO:tasks.ceph.mds.c:Started 2023-11-26T07:23:03.111 INFO:tasks.ceph.mds.d:Started 2023-11-26T07:23:03.111 DEBUG:teuthology.parallel:result is None 2023-11-26T07:23:03.111 DEBUG:teuthology.parallel:result is None 2023-11-26T07:23:03.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-26T07:23:03.197 INFO:tasks.ceph.mds.a.smithi070.stdout:starting mds.a at 2023-11-26T07:23:03.200 INFO:tasks.ceph.mds.c.smithi070.stdout:starting mds.c at 2023-11-26T07:23:03.201 INFO:tasks.ceph.mds.b.smithi120.stdout:starting mds.b at 2023-11-26T07:23:03.201 INFO:tasks.ceph.mds.d.smithi120.stdout:starting mds.d at 2023-11-26T07:23:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.251+0000 7f8c82c5a640 1 Processor -- start 2023-11-26T07:23:03.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.251+0000 7f8c82c5a640 1 -- start start 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c82c5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8c7c15d6e0 0x7f8c7c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c82c5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8c7c0b2160 0x7f8c7c0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c82c5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c0d19f0 0x7f8c7c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c82c5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c15dac0 con 0x7f8c7c0b2160 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c82c5a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c0d1e80 con 0x7f8c7c15d6e0 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c82c5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cf0e0 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8c7c0b2160 0x7f8c7c0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8c7c0b2160 0x7f8c7c0d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51732/0 (socket says 172.21.15.70:51732) 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 -- 172.21.15.70:0/3643695613 learned_addr learned my addr 172.21.15.70:0/3643695613 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:03.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c811f7640 1 --2- 172.21.15.70:0/3643695613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c0d19f0 0x7f8c7c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c809f6640 1 --2- 172.21.15.70:0/3643695613 >> v2:172.21.15.120:3300/0 conn(0x7f8c7c15d6e0 0x7f8c7c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 -- 172.21.15.70:0/3643695613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c0d19f0 msgr2=0x7f8c7c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:03.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 --2- 172.21.15.70:0/3643695613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c0d19f0 0x7f8c7c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 -- 172.21.15.70:0/3643695613 >> v2:172.21.15.120:3300/0 conn(0x7f8c7c15d6e0 msgr2=0x7f8c7c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:03.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 --2- 172.21.15.70:0/3643695613 >> v2:172.21.15.120:3300/0 conn(0x7f8c7c15d6e0 0x7f8c7c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.255+0000 7f8c7bfff640 1 -- 172.21.15.70:0/3643695613 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c0ceb20 con 0x7f8c7c0b2160 2023-11-26T07:23:03.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c7bfff640 1 --2- 172.21.15.70:0/3643695613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c0d14b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0b5db0 tx=0x7f8c6801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbe5fdc90163b68 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:03.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c7b7fe640 1 -- 172.21.15.70:0/3643695613 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680ab600 con 0x7f8c7c0b2160 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c7b7fe640 1 -- 172.21.15.70:0/3643695613 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c680a7050 con 0x7f8c7c0b2160 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c7b7fe640 1 -- 172.21.15.70:0/3643695613 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680ab980 con 0x7f8c7c0b2160 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- 172.21.15.70:0/3643695613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 msgr2=0x7f8c7c0d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/3643695613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c0d14b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0b5db0 tx=0x7f8c6801c240 comp rx=0 tx=0).stop 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- 172.21.15.70:0/3643695613 shutdown_connections 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/3643695613 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c0d19f0 0x7f8c7c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/3643695613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c0d14b0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/3643695613 >> v2:172.21.15.120:3300/0 conn(0x7f8c7c15d6e0 0x7f8c7c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- 172.21.15.70:0/3643695613 >> 172.21.15.70:0/3643695613 conn(0x7f8c7c09c550 msgr2=0x7f8c7c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- 172.21.15.70:0/3643695613 shutdown_connections 2023-11-26T07:23:03.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- 172.21.15.70:0/3643695613 wait complete. 2023-11-26T07:23:03.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 Processor -- start 2023-11-26T07:23:03.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- start start 2023-11-26T07:23:03.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c7c0d19f0 0x7f8c7c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c15d6e0 0x7f8c7c15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c15bed0 con 0x7f8c7c0b2160 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c15b250 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.259+0000 7f8c82c5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c15b530 con 0x7f8c7c15d6e0 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c809f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c809f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c1597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51738/0 (socket says 172.21.15.70:51738) 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c7bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c7c0d19f0 0x7f8c7c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c809f6640 1 -- 172.21.15.70:0/2855800125 learned_addr learned my addr 172.21.15.70:0/2855800125 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c811f7640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c15d6e0 0x7f8c7c15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c7bfff640 1 -- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c15d6e0 msgr2=0x7f8c7c15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c7bfff640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c15d6e0 0x7f8c7c15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c7bfff640 1 -- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 msgr2=0x7f8c7c1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:03.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c7bfff640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:03.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c7bfff640 1 -- 172.21.15.70:0/2855800125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680094d0 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c809f6640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:23:03.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c7bfff640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c7c0d19f0 0x7f8c7c15a870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8c680ab000 tx=0x7f8c68018fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:03.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c797fa640 1 -- 172.21.15.70:0/2855800125 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680b8070 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c797fa640 1 -- 172.21.15.70:0/2855800125 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c680b35d0 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c797fa640 1 -- 172.21.15.70:0/2855800125 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c680b3960 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c15b810 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c153900 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c153af0 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.263+0000 7f8c797fa640 1 -- 172.21.15.70:0/2855800125 <== mon.1 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f8c680b2070 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.267+0000 7f8c797fa640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c60066d10 0x7f8c600691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:03.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.267+0000 7f8c797fa640 1 -- 172.21.15.70:0/2855800125 <== mon.1 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8c6811c220 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.267+0000 7f8c809f6640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c60066d10 0x7f8c600691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:03.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.267+0000 7f8c809f6640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c60066d10 0x7f8c600691d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8c70007e60 tx=0x7f8c70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:03.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.271+0000 7f8c797fa640 1 -- 172.21.15.70:0/2855800125 <== mon.1 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c680eaf40 con 0x7f8c7c0d19f0 2023-11-26T07:23:03.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:03.431+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8c7c15c010 con 0x7f8c7c0d19f0 2023-11-26T07:23:04.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c797fa640 1 -- 172.21.15.70:0/2855800125 <== mon.1 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8c680b0080 con 0x7f8c7c0d19f0 2023-11-26T07:23:04.859 INFO:teuthology.orchestra.run.smithi070.stderr: removed all blocklist entries 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c60066d10 msgr2=0x7f8c600691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c60066d10 0x7f8c600691d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8c70007e60 tx=0x7f8c70008040 comp rx=0 tx=0).stop 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c7c0d19f0 msgr2=0x7f8c7c15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c7c0d19f0 0x7f8c7c15a870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8c680ab000 tx=0x7f8c68018fe0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 shutdown_connections 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8c7c15d6e0 0x7f8c7c15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c7c0d19f0 0x7f8c7c15a870 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8c60066d10 0x7f8c600691d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.855+0000 7f8c82c5a640 1 --2- 172.21.15.70:0/2855800125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c7c0b2160 0x7f8c7c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:04.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.859+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 >> 172.21.15.70:0/2855800125 conn(0x7f8c7c09c550 msgr2=0x7f8c7c06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:04.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.859+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 shutdown_connections 2023-11-26T07:23:04.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:04.859+0000 7f8c82c5a640 1 -- 172.21.15.70:0/2855800125 wait complete. 2023-11-26T07:23:04.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-26T07:23:05.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 Processor -- start 2023-11-26T07:23:05.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 -- start start 2023-11-26T07:23:05.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5928143ac0 0x7f5928070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f59280708b0 0x7f59280cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f59280cf7c0 0x7f59280b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5928143ea0 con 0x7f59280cf7c0 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280cfbf0 con 0x7f59280708b0 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592f279640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280cc730 con 0x7f5928143ac0 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f59280cf7c0 0x7f59280b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f59280cf7c0 0x7f59280b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50586/0 (socket says 172.21.15.70:50586) 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 -- 172.21.15.70:0/1641751912 learned_addr learned my addr 172.21.15.70:0/1641751912 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592c814640 1 --2- 172.21.15.70:0/1641751912 >> v2:172.21.15.120:3300/0 conn(0x7f59280708b0 0x7f59280cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d015640 1 --2- 172.21.15.70:0/1641751912 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5928143ac0 0x7f5928070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 -- 172.21.15.70:0/1641751912 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5928143ac0 msgr2=0x7f5928070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:05.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 --2- 172.21.15.70:0/1641751912 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5928143ac0 0x7f5928070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 -- 172.21.15.70:0/1641751912 >> v2:172.21.15.120:3300/0 conn(0x7f59280708b0 msgr2=0x7f59280cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 --2- 172.21.15.70:0/1641751912 >> v2:172.21.15.120:3300/0 conn(0x7f59280708b0 0x7f59280cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.023+0000 7f592d816640 1 -- 172.21.15.70:0/1641751912 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928070ee0 con 0x7f59280cf7c0 2023-11-26T07:23:05.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592d816640 1 --2- 172.21.15.70:0/1641751912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59280cf7c0 0x7f59280b1ef0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f59280cfec0 tx=0x7f592001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73f155e202dffea server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f591ffff640 1 -- 172.21.15.70:0/1641751912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200a64b0 con 0x7f59280cf7c0 2023-11-26T07:23:05.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f591ffff640 1 -- 172.21.15.70:0/1641751912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200a6610 con 0x7f59280cf7c0 2023-11-26T07:23:05.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f591ffff640 1 -- 172.21.15.70:0/1641751912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200a69a0 con 0x7f59280cf7c0 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 -- 172.21.15.70:0/1641751912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59280cf7c0 msgr2=0x7f59280b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 --2- 172.21.15.70:0/1641751912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59280cf7c0 0x7f59280b1ef0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f59280cfec0 tx=0x7f592001c710 comp rx=0 tx=0).stop 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 -- 172.21.15.70:0/1641751912 shutdown_connections 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 --2- 172.21.15.70:0/1641751912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59280cf7c0 0x7f59280b1ef0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 --2- 172.21.15.70:0/1641751912 >> v2:172.21.15.120:3300/0 conn(0x7f59280708b0 0x7f59280cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 --2- 172.21.15.70:0/1641751912 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5928143ac0 0x7f5928070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 -- 172.21.15.70:0/1641751912 >> 172.21.15.70:0/1641751912 conn(0x7f592806a890 msgr2=0x7f592806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 -- 172.21.15.70:0/1641751912 shutdown_connections 2023-11-26T07:23:05.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.027+0000 7f592f279640 1 -- 172.21.15.70:0/1641751912 wait complete. 2023-11-26T07:23:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 Processor -- start 2023-11-26T07:23:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 -- start start 2023-11-26T07:23:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f59280708b0 0x7f59280b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59280cf7c0 0x7f5928137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5928143ac0 0x7f5928137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5928135af0 con 0x7f5928143ac0 2023-11-26T07:23:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5928134ee0 con 0x7f59280cf7c0 2023-11-26T07:23:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59281351c0 con 0x7f59280708b0 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5928143ac0 0x7f5928137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5928143ac0 0x7f5928137990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50588/0 (socket says 172.21.15.70:50588) 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 -- 172.21.15.70:0/3598036958 learned_addr learned my addr 172.21.15.70:0/3598036958 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d015640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f59280708b0 0x7f59280b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592c814640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59280cf7c0 0x7f5928137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 -- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f59280708b0 msgr2=0x7f59280b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f59280708b0 0x7f59280b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 -- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59280cf7c0 msgr2=0x7f5928137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59280cf7c0 0x7f5928137450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 -- 172.21.15.70:0/3598036958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009b30 con 0x7f5928143ac0 2023-11-26T07:23:05.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592d816640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5928143ac0 0x7f5928137990 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f592001cfb0 tx=0x7f59200194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f591dffb640 1 -- 172.21.15.70:0/3598036958 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200b4070 con 0x7f5928143ac0 2023-11-26T07:23:05.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f591dffb640 1 -- 172.21.15.70:0/3598036958 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200090d0 con 0x7f5928143ac0 2023-11-26T07:23:05.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f591dffb640 1 -- 172.21.15.70:0/3598036958 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200a69e0 con 0x7f5928143ac0 2023-11-26T07:23:05.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59281354a0 con 0x7f5928143ac0 2023-11-26T07:23:05.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.031+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59281f1ef0 con 0x7f5928143ac0 2023-11-26T07:23:05.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.035+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5928135ca0 con 0x7f5928143ac0 2023-11-26T07:23:05.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.035+0000 7f591dffb640 1 -- 172.21.15.70:0/3598036958 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f59200b8070 con 0x7f5928143ac0 2023-11-26T07:23:05.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.035+0000 7f591dffb640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f590c066d10 0x7f590c0691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.035+0000 7f591dffb640 1 -- 172.21.15.70:0/3598036958 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f59200aa070 con 0x7f5928143ac0 2023-11-26T07:23:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.035+0000 7f592d015640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f590c066d10 0x7f590c0691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.035+0000 7f592d015640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f590c066d10 0x7f590c0691d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5924009ac0 tx=0x7f5924009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.039+0000 7f591dffb640 1 -- 172.21.15.70:0/3598036958 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5928135ca0 con 0x7f5928143ac0 2023-11-26T07:23:05.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.239+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5928067680 con 0x7f5928143ac0 2023-11-26T07:23:05.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.239+0000 7f591dffb640 1 -- 172.21.15.70:0/3598036958 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f59200bf090 con 0x7f5928143ac0 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_dump": [ 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.a", 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlK818ExAA3Pl7hruKT9tvdseH1RoDNw==", 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:23:05.245 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.b", 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl+74KIBAAAU2yWLE9nGWyh2Eew8a2cQ==", 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.c", 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl2a4KGxAAGVTHr4IYGCxqIbJI4GAlHw==", 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.247 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mds.d", 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlkKVrJxAA/tao4nxlwlxXqNbpcOQO0w==", 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.0", 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDv8GJlMTzJDRAAtRLnzO4hzBrRsOTxU0sn1g==", 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.248 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.1", 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDy8GJlYwIPFBAA08sYURmRGI+e5KAfsYCowQ==", 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.249 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.2", 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD18GJl2yAVGxAAbmsr89meMeh8tOtuLwO2nQ==", 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.3", 2023-11-26T07:23:05.250 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD48GJlgsovIRAAR7B4+PHY5+5A/pLTUYSv/Q==", 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.4", 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQD+8GJllmjnJRAAfX4zIcgsX+H5/jgeJd4fJQ==", 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.251 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.5", 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAB8WJlebhlLBAAXicxjU2Nww1KEts/9c6YWQ==", 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.6", 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAE8WJlrYwEMxAAt996EyIggEIdDG5Jo8pxLg==", 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "osd.7", 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQAH8WJlUqeLOhAAMXAlFPwvIZkjtwDqTqj9Dg==", 2023-11-26T07:23:05.253 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow profile osd", 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile osd", 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.0", 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA==", 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow r", 2023-11-26T07:23:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.1", 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl19ntNBAAm+Na43D/jVnw3XfgG4syqg==", 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.2", 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlbfhnMRAAUU4/Sqog5uGnzt4xD/6M6g==", 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.3", 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlUVjqOhAAg1iYDvnKqcoojshB4YtI7Q==", 2023-11-26T07:23:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow", 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow r", 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow rw", 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow rwx" 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "client.admin", 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDs8GJlRiV4MhAABZ2mWkM6iWcfvniCtWCj4w==", 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:23:05.257 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": "allow *", 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow *", 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.x", 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJl5WcCDxAAAQ7rZ5sJaZ6CGeJ2izEpNA==", 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: "entity": "mgr.y", 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "AQDt8GJlc3stCxAAjCksCvC5/30P/2m2kedt6w==", 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": { 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": "allow *", 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: "mon": "allow profile mgr", 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": "allow *" 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2023-11-26T07:23:05.259 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:05.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f590c066d10 msgr2=0x7f590c0691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f590c066d10 0x7f590c0691d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5924009ac0 tx=0x7f5924009190 comp rx=0 tx=0).stop 2023-11-26T07:23:05.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5928143ac0 msgr2=0x7f5928137990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5928143ac0 0x7f5928137990 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f592001cfb0 tx=0x7f59200194b0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 shutdown_connections 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f590c066d10 0x7f590c0691d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5928143ac0 0x7f5928137990 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59280cf7c0 0x7f5928137450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 --2- 172.21.15.70:0/3598036958 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f59280708b0 0x7f59280b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 >> 172.21.15.70:0/3598036958 conn(0x7f592806a890 msgr2=0x7f5928142420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 shutdown_connections 2023-11-26T07:23:05.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.243+0000 7f592f279640 1 -- 172.21.15.70:0/3598036958 wait complete. 2023-11-26T07:23:05.266 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:05.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624c557640 1 Processor -- start 2023-11-26T07:23:05.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624c557640 1 -- start start 2023-11-26T07:23:05.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624c557640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f624413e290 0x7f62440cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624c557640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624415fb20 con 0x7f624415f6b0 2023-11-26T07:23:05.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624c557640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624406c520 con 0x7f62440cf7c0 2023-11-26T07:23:05.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624c557640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62440cfc40 con 0x7f624413e290 2023-11-26T07:23:05.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624aaf4640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f624415f6b0 0x7f62440cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42902/0 (socket says 172.21.15.70:42902) 2023-11-26T07:23:05.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.399+0000 7f624aaf4640 1 -- 172.21.15.70:0/1071442684 learned_addr learned my addr 172.21.15.70:0/1071442684 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:05.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f624a2f3640 1 --2- 172.21.15.70:0/1071442684 >> v2:172.21.15.120:3300/0 conn(0x7f624413e290 0x7f62440cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f62492f1640 1 -- 172.21.15.70:0/1071442684 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638710674 0 0) 0x7f623c0014a0 con 0x7f624415f6b0 2023-11-26T07:23:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f62492f1640 1 -- 172.21.15.70:0/1071442684 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6230003530 con 0x7f624415f6b0 2023-11-26T07:23:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f62492f1640 1 -- 172.21.15.70:0/1071442684 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334733994 0 0) 0x7f624406c520 con 0x7f62440cf7c0 2023-11-26T07:23:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f624a2f3640 1 -- 172.21.15.70:0/1071442684 >> v1:172.21.15.120:6789/0 conn(0x7f62440cf7c0 legacy=0x7f624415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f624a2f3640 1 -- 172.21.15.70:0/1071442684 >> v1:172.21.15.70:6789/0 conn(0x7f624415f6b0 legacy=0x7f62440cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f624a2f3640 1 -- 172.21.15.70:0/1071442684 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624406c800 con 0x7f624413e290 2023-11-26T07:23:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f624a2f3640 1 --2- 172.21.15.70:0/1071442684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624413e290 0x7f62440cf280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f62400097c0 tx=0x7f624001c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=394c77f9318018b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f62492f1640 1 -- 172.21.15.70:0/1071442684 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c001b30 con 0x7f624413e290 2023-11-26T07:23:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f62492f1640 1 -- 172.21.15.70:0/1071442684 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62400a7050 con 0x7f624413e290 2023-11-26T07:23:05.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.403+0000 7f62492f1640 1 -- 172.21.15.70:0/1071442684 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400ab600 con 0x7f624413e290 2023-11-26T07:23:05.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- 172.21.15.70:0/1071442684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624413e290 msgr2=0x7f62440cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 --2- 172.21.15.70:0/1071442684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624413e290 0x7f62440cf280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f62400097c0 tx=0x7f624001c290 comp rx=0 tx=0).stop 2023-11-26T07:23:05.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- 172.21.15.70:0/1071442684 shutdown_connections 2023-11-26T07:23:05.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 --2- 172.21.15.70:0/1071442684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624413e290 0x7f62440cf280 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- 172.21.15.70:0/1071442684 >> 172.21.15.70:0/1071442684 conn(0x7f624406a890 msgr2=0x7f624406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- 172.21.15.70:0/1071442684 shutdown_connections 2023-11-26T07:23:05.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- 172.21.15.70:0/1071442684 wait complete. 2023-11-26T07:23:05.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 Processor -- start 2023-11-26T07:23:05.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- start start 2023-11-26T07:23:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f62440cf7c0 0x7f62440adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f624413e290 0x7f62440abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624415f6b0 0x7f624413bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624413b800 con 0x7f624413e290 2023-11-26T07:23:05.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440ac330 con 0x7f624415f6b0 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624c557640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624413aed0 con 0x7f62440cf7c0 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f6249af2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f624413e290 0x7f62440abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f6249af2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f624413e290 0x7f62440abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50596/0 (socket says 172.21.15.70:50596) 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f6249af2640 1 -- 172.21.15.70:0/4034813959 learned_addr learned my addr 172.21.15.70:0/4034813959 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624a2f3640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f62440cf7c0 0x7f62440adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.407+0000 7f624aaf4640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624415f6b0 0x7f624413bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f6249af2640 1 -- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f62440cf7c0 msgr2=0x7f62440adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f6249af2640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f62440cf7c0 0x7f62440adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f6249af2640 1 -- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624415f6b0 msgr2=0x7f624413bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f6249af2640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624415f6b0 0x7f624413bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f6249af2640 1 -- 172.21.15.70:0/4034813959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6240009420 con 0x7f624413e290 2023-11-26T07:23:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f6249af2640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f624413e290 0x7f62440abc30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f623400c4a0 tx=0x7f623400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f623affd640 1 -- 172.21.15.70:0/4034813959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234005480 con 0x7f624413e290 2023-11-26T07:23:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f623affd640 1 -- 172.21.15.70:0/4034813959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6234003600 con 0x7f624413e290 2023-11-26T07:23:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f623affd640 1 -- 172.21.15.70:0/4034813959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340039b0 con 0x7f624413e290 2023-11-26T07:23:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624413b1b0 con 0x7f624413e290 2023-11-26T07:23:05.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624413c1d0 con 0x7f624413e290 2023-11-26T07:23:05.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624413b9b0 con 0x7f624413e290 2023-11-26T07:23:05.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f623affd640 1 -- 172.21.15.70:0/4034813959 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f6234003b10 con 0x7f624413e290 2023-11-26T07:23:05.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f623affd640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6228066d10 0x7f62280691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f623affd640 1 -- 172.21.15.70:0/4034813959 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6234084320 con 0x7f624413e290 2023-11-26T07:23:05.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.411+0000 7f624a2f3640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6228066d10 0x7f62280691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.415+0000 7f624a2f3640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6228066d10 0x7f62280691d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f62400ad000 tx=0x7f6240008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.415+0000 7f623affd640 1 -- 172.21.15.70:0/4034813959 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6234050b70 con 0x7f624413e290 2023-11-26T07:23:05.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.567+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6244067680 con 0x7f624413e290 2023-11-26T07:23:05.573 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.567+0000 7f623affd640 1 -- 172.21.15.70:0/4034813959 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f6234017090 con 0x7f624413e290 2023-11-26T07:23:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:05.573 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":74,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:04.852833+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:05.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6228066d10 msgr2=0x7f62280691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6228066d10 0x7f62280691d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f62400ad000 tx=0x7f6240008040 comp rx=0 tx=0).stop 2023-11-26T07:23:05.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f624413e290 msgr2=0x7f62440abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f624413e290 0x7f62440abc30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f623400c4a0 tx=0x7f623400c960 comp rx=0 tx=0).stop 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 shutdown_connections 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6228066d10 0x7f62280691d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f624413e290 0x7f62440abc30 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f624415f6b0 0x7f624413bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 --2- 172.21.15.70:0/4034813959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f62440cf7c0 0x7f62440adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 >> 172.21.15.70:0/4034813959 conn(0x7f624406a890 msgr2=0x7f62440b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 shutdown_connections 2023-11-26T07:23:05.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.571+0000 7f624c557640 1 -- 172.21.15.70:0/4034813959 wait complete. 2023-11-26T07:23:05.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:23:05.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:23:05.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ef59e640 1 Processor -- start 2023-11-26T07:23:05.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ef59e640 1 -- start start 2023-11-26T07:23:05.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ef59e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa7f015d680 0x7fa7f00d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ef59e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00cdc40 con 0x7fa7f015d2a0 2023-11-26T07:23:05.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ef59e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00ce7a0 con 0x7fa7f00d1d90 2023-11-26T07:23:05.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ef59e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f00d1440 con 0x7fa7f015d680 2023-11-26T07:23:05.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ee59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fa7f015d2a0 0x7fa7f00d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42904/0 (socket says 172.21.15.70:42904) 2023-11-26T07:23:05.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7ee59c640 1 -- 172.21.15.70:0/1534682389 learned_addr learned my addr 172.21.15.70:0/1534682389 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:05.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7e7fff640 1 --2- 172.21.15.70:0/1534682389 >> v2:172.21.15.70:3300/0 conn(0x7fa7f015d680 0x7fa7f00d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7edd9b640 1 -- 172.21.15.70:0/1534682389 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240119900 0 0) 0x7fa7f00cdc40 con 0x7fa7f015d2a0 2023-11-26T07:23:05.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7edd9b640 1 -- 172.21.15.70:0/1534682389 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7dc003530 con 0x7fa7f015d2a0 2023-11-26T07:23:05.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7e7fff640 1 -- 172.21.15.70:0/1534682389 >> v1:172.21.15.120:6789/0 conn(0x7fa7f00d1d90 legacy=0x7fa7f00b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7e7fff640 1 -- 172.21.15.70:0/1534682389 >> v1:172.21.15.70:6789/0 conn(0x7fa7f015d2a0 legacy=0x7fa7f00d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.735+0000 7fa7e7fff640 1 -- 172.21.15.70:0/1534682389 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00cde70 con 0x7fa7f015d680 2023-11-26T07:23:05.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7e7fff640 1 --2- 172.21.15.70:0/1534682389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f00d00e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80097f0 tx=0x7fa7d801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55db435484d71297 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7edd9b640 1 -- 172.21.15.70:0/1534682389 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80ad660 con 0x7fa7f015d680 2023-11-26T07:23:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7edd9b640 1 -- 172.21.15.70:0/1534682389 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80ad7c0 con 0x7fa7f015d680 2023-11-26T07:23:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7edd9b640 1 -- 172.21.15.70:0/1534682389 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80adb50 con 0x7fa7f015d680 2023-11-26T07:23:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1534682389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 msgr2=0x7fa7f00d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1534682389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f00d00e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80097f0 tx=0x7fa7d801c450 comp rx=0 tx=0).stop 2023-11-26T07:23:05.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1534682389 shutdown_connections 2023-11-26T07:23:05.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1534682389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f00d00e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1534682389 >> 172.21.15.70:0/1534682389 conn(0x7fa7f00d30a0 msgr2=0x7fa7f00d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1534682389 shutdown_connections 2023-11-26T07:23:05.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.739+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1534682389 wait complete. 2023-11-26T07:23:05.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 Processor -- start 2023-11-26T07:23:05.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 -- start start 2023-11-26T07:23:05.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7f00d1d90 0x7fa7f006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7f015d2a0 0x7fa7f014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f014ead0 con 0x7fa7f015d680 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0152de0 con 0x7fa7f015d2a0 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0151560 con 0x7fa7f00d1d90 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f014e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50614/0 (socket says 172.21.15.70:50614) 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 -- 172.21.15.70:0/1542217663 learned_addr learned my addr 172.21.15.70:0/1542217663 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7e7fff640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7f015d2a0 0x7fa7f014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ee59c640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7f00d1d90 0x7fa7f006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 -- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7f00d1d90 msgr2=0x7fa7f006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7f00d1d90 0x7fa7f006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 -- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7f015d2a0 msgr2=0x7fa7f014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7f015d2a0 0x7fa7f014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 -- 172.21.15.70:0/1542217663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009420 con 0x7fa7f015d680 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ee59c640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7f00d1d90 0x7fa7f006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7eed9d640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f014e590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c730 tx=0x7fa7e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7e6ffd640 1 -- 172.21.15.70:0/1542217663 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8003b80 con 0x7fa7f015d680 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7e6ffd640 1 -- 172.21.15.70:0/1542217663 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8003ce0 con 0x7fa7f015d680 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00c8c40 con 0x7fa7f015d680 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7e6ffd640 1 -- 172.21.15.70:0/1542217663 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800aa30 con 0x7fa7f015d680 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.743+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f00c8270 con 0x7fa7f015d680 2023-11-26T07:23:05.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.747+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f0152f70 con 0x7fa7f015d680 2023-11-26T07:23:05.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.747+0000 7fa7e6ffd640 1 -- 172.21.15.70:0/1542217663 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fa7e800ab90 con 0x7fa7f015d680 2023-11-26T07:23:05.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.747+0000 7fa7e6ffd640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa7d0066d10 0x7fa7d00691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:05.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.747+0000 7fa7e6ffd640 1 -- 172.21.15.70:0/1542217663 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7e8082600 con 0x7fa7f015d680 2023-11-26T07:23:05.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.747+0000 7fa7ee59c640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa7d0066d10 0x7fa7d00691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:05.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.747+0000 7fa7ee59c640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa7d0066d10 0x7fa7d00691d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00011f0 tx=0x7fa7e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:05.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.751+0000 7fa7e6ffd640 1 -- 172.21.15.70:0/1542217663 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7e8051300 con 0x7fa7f015d680 2023-11-26T07:23:05.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.903+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7f0067500 con 0x7fa7f015d680 2023-11-26T07:23:05.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.903+0000 7fa7e6ffd640 1 -- 172.21.15.70:0/1542217663 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7e8054920 con 0x7fa7f015d680 2023-11-26T07:23:05.909 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:23:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa7d0066d10 msgr2=0x7fa7d00691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa7d0066d10 0x7fa7d00691d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00011f0 tx=0x7fa7e0009040 comp rx=0 tx=0).stop 2023-11-26T07:23:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 msgr2=0x7fa7f014e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f014e590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c730 tx=0x7fa7e800cbf0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 shutdown_connections 2023-11-26T07:23:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fa7d0066d10 0x7fa7d00691d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7f015d680 0x7fa7f014e590 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7f015d2a0 0x7fa7f014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 --2- 172.21.15.70:0/1542217663 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fa7f00d1d90 0x7fa7f006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 >> 172.21.15.70:0/1542217663 conn(0x7fa7f00d30a0 msgr2=0x7fa7f0158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 shutdown_connections 2023-11-26T07:23:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:05.907+0000 7fa7ef59e640 1 -- 172.21.15.70:0/1542217663 wait complete. 2023-11-26T07:23:05.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-26T07:23:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.063+0000 7fd84d732640 1 Processor -- start 2023-11-26T07:23:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.063+0000 7fd84d732640 1 -- start start 2023-11-26T07:23:06.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd84d732640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 0x7fd8481613f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd84d732640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8480d4170 con 0x7fd848160850 2023-11-26T07:23:06.072 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd84d732640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8480ce290 con 0x7fd8480d3d30 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd84d732640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd848161930 con 0x7fd848160f60 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd848160850 0x7fd8480cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42920/0 (socket says 172.21.15.70:42920) 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 -- 172.21.15.70:0/3618040516 learned_addr learned my addr 172.21.15.70:0/3618040516 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd84cf31640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 0x7fd8481613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014216845 0 0) 0x7fd8480d4170 con 0x7fd848160850 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd830003530 con 0x7fd848160850 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057598113 0 0) 0x7fd8480ce290 con 0x7fd8480d3d30 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8480d4170 con 0x7fd8480d3d30 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072894499 0 0) 0x7fd830003530 con 0x7fd848160850 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 msgr2=0x7fd8481613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:06.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 0x7fd8481613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 >> v1:172.21.15.120:6789/0 conn(0x7fd8480d3d30 legacy=0x7fd8480cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480ce570 con 0x7fd848160850 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fd838001680 con 0x7fd848160850 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 >> v1:172.21.15.70:6789/0 conn(0x7fd848160850 legacy=0x7fd8480cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd830003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8300047d0 0x7fd830004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 0x7fd830005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848161930 con 0x7fd830003b40 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83000ba40 con 0x7fd8300047d0 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83000bc00 con 0x7fd848160f60 2023-11-26T07:23:06.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd830003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd8477fe640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8300047d0 0x7fd830004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd84cf31640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 0x7fd830005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 -- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 msgr2=0x7fd830005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd848160f60 0x7fd830005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 -- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8300047d0 msgr2=0x7fd830004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8300047d0 0x7fd830004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.067+0000 7fd847fff640 1 -- 172.21.15.70:0/3618040516 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830003530 con 0x7fd830003b40 2023-11-26T07:23:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd847fff640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd830003f40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd838001ec0 tx=0x7fd83801cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ccdd829694eb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380058e0 con 0x7fd830003b40 2023-11-26T07:23:06.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838005a60 con 0x7fd830003b40 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd846ffd640 1 -- 172.21.15.70:0/3618040516 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838005e10 con 0x7fd830003b40 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd84d732640 1 -- 172.21.15.70:0/3618040516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 msgr2=0x7fd830003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd84d732640 1 --2- 172.21.15.70:0/3618040516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd830003f40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd838001ec0 tx=0x7fd83801cb50 comp rx=0 tx=0).stop 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd84cf31640 1 -- 172.21.15.70:0/3618040516 reap_dead start 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd84d732640 1 -- 172.21.15.70:0/3618040516 shutdown_connections 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd84d732640 1 -- 172.21.15.70:0/3618040516 >> 172.21.15.70:0/3618040516 conn(0x7fd84809c5a0 msgr2=0x7fd8480d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd84d732640 1 -- 172.21.15.70:0/3618040516 shutdown_connections 2023-11-26T07:23:06.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.071+0000 7fd84d732640 1 -- 172.21.15.70:0/3618040516 wait complete. 2023-11-26T07:23:06.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 Processor -- start 2023-11-26T07:23:06.078 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 -- start start 2023-11-26T07:23:06.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd848150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8480b1c50 0x7fd8480b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8480b20d0 0x7fd8480b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480b0bb0 con 0x7fd830003b40 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480b0e90 con 0x7fd8480b1c50 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480b1170 con 0x7fd8480b20d0 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd848150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd848150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50632/0 (socket says 172.21.15.70:50632) 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 -- 172.21.15.70:0/3210929860 learned_addr learned my addr 172.21.15.70:0/3210929860 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd8477fe640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8480b1c50 0x7fd8480b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84cf31640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8480b20d0 0x7fd8480b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 -- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8480b20d0 msgr2=0x7fd8480b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8480b20d0 0x7fd8480b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 -- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8480b1c50 msgr2=0x7fd8480b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8480b1c50 0x7fd8480b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 -- 172.21.15.70:0/3210929860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480b1450 con 0x7fd830003b40 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd8477fe640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8480b1c50 0x7fd8480b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd847fff640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd848150650 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd83801c980 tx=0x7fd830005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd844ff9640 1 -- 172.21.15.70:0/3210929860 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380047f0 con 0x7fd830003b40 2023-11-26T07:23:06.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd844ff9640 1 -- 172.21.15.70:0/3210929860 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838004950 con 0x7fd830003b40 2023-11-26T07:23:06.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd844ff9640 1 -- 172.21.15.70:0/3210929860 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838004cc0 con 0x7fd830003b40 2023-11-26T07:23:06.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480b1730 con 0x7fd830003b40 2023-11-26T07:23:06.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.075+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480ca500 con 0x7fd830003b40 2023-11-26T07:23:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.079+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480b18c0 con 0x7fd830003b40 2023-11-26T07:23:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.079+0000 7fd844ff9640 1 -- 172.21.15.70:0/3210929860 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd838007070 con 0x7fd830003b40 2023-11-26T07:23:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.079+0000 7fd844ff9640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd834066d10 0x7fd8340691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.079+0000 7fd844ff9640 1 -- 172.21.15.70:0/3210929860 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd83811e320 con 0x7fd830003b40 2023-11-26T07:23:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.079+0000 7fd8477fe640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd834066d10 0x7fd8340691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.079+0000 7fd8477fe640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd834066d10 0x7fd8340691d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd8480b09a0 tx=0x7fd83c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.083+0000 7fd844ff9640 1 -- 172.21.15.70:0/3210929860 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8380eaf10 con 0x7fd830003b40 2023-11-26T07:23:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.235+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd848067500 con 0x7fd830003b40 2023-11-26T07:23:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.235+0000 7fd844ff9640 1 -- 172.21.15.70:0/3210929860 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd8380ee530 con 0x7fd830003b40 2023-11-26T07:23:06.240 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:23:06.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:06.241 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2023-11-26T07:23:06.241 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2023-11-26T07:23:06.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:23:06.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd834066d10 msgr2=0x7fd8340691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd834066d10 0x7fd8340691d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd8480b09a0 tx=0x7fd83c009040 comp rx=0 tx=0).stop 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 msgr2=0x7fd848150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd848150650 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd83801c980 tx=0x7fd830005800 comp rx=0 tx=0).stop 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 shutdown_connections 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd8480b20d0 0x7fd8480b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8480b1c50 0x7fd8480b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd834066d10 0x7fd8340691d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 --2- 172.21.15.70:0/3210929860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd830003b40 0x7fd848150650 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 >> 172.21.15.70:0/3210929860 conn(0x7fd84809c5a0 msgr2=0x7fd8480d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 shutdown_connections 2023-11-26T07:23:06.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.239+0000 7fd84d732640 1 -- 172.21.15.70:0/3210929860 wait complete. 2023-11-26T07:23:06.261 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-26T07:23:06.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-26T07:23:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd392be7640 1 Processor -- start 2023-11-26T07:23:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd392be7640 1 -- start start 2023-11-26T07:23:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd392be7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd38c0cf280 0x7fd38c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd392be7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd392be7640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38c15b2f0 con 0x7fd38c06cd50 2023-11-26T07:23:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd392be7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c06c5c0 con 0x7fd38c0cf280 2023-11-26T07:23:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd392be7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0cfba0 con 0x7fd38c070d10 2023-11-26T07:23:06.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd390983640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd38c0cf280 0x7fd38c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd383fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd390983640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd38c0cf280 0x7fd38c0cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:58124/0 (socket says 172.21.15.70:58124) 2023-11-26T07:23:06.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd390983640 1 -- 172.21.15.70:0/1662786474 learned_addr learned my addr 172.21.15.70:0/1662786474 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:06.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd391184640 1 --1- 172.21.15.70:0/1662786474 >> v1:172.21.15.120:6789/0 conn(0x7fd38c06cd50 0x7fd38c0b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:46210/0 (socket says 172.21.15.70:46210) 2023-11-26T07:23:06.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd390983640 1 -- 172.21.15.70:0/1662786474 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 msgr2=0x7fd38c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:06.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd390983640 1 --2- 172.21.15.70:0/1662786474 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd390983640 1 -- 172.21.15.70:0/1662786474 >> v1:172.21.15.120:6789/0 conn(0x7fd38c06cd50 legacy=0x7fd38c0b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.399+0000 7fd390983640 1 -- 172.21.15.70:0/1662786474 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c15e1a0 con 0x7fd38c0cf280 2023-11-26T07:23:06.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd390983640 1 --2- 172.21.15.70:0/1662786474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 0x7fd38c0cf660 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd388009870 tx=0x7fd38801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de40d7c66d2c6758 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd3837fe640 1 -- 172.21.15.70:0/1662786474 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880a8a30 con 0x7fd38c0cf280 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd3837fe640 1 -- 172.21.15.70:0/1662786474 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3880a8b90 con 0x7fd38c0cf280 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd3837fe640 1 -- 172.21.15.70:0/1662786474 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880b0440 con 0x7fd38c0cf280 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 -- 172.21.15.70:0/1662786474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 msgr2=0x7fd38c0cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 --2- 172.21.15.70:0/1662786474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 0x7fd38c0cf660 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd388009870 tx=0x7fd38801ed30 comp rx=0 tx=0).stop 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 -- 172.21.15.70:0/1662786474 shutdown_connections 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 --2- 172.21.15.70:0/1662786474 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 --2- 172.21.15.70:0/1662786474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 0x7fd38c0cf660 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 -- 172.21.15.70:0/1662786474 >> 172.21.15.70:0/1662786474 conn(0x7fd38c06a890 msgr2=0x7fd38c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 -- 172.21.15.70:0/1662786474 shutdown_connections 2023-11-26T07:23:06.409 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.403+0000 7fd392be7640 1 -- 172.21.15.70:0/1662786474 wait complete. 2023-11-26T07:23:06.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 Processor -- start 2023-11-26T07:23:06.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 -- start start 2023-11-26T07:23:06.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd38c06cd50 0x7fd38c1e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 0x7fd38c144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c155d30 con 0x7fd38c06cd50 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c144c80 con 0x7fd38c0cf280 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c1550b0 con 0x7fd38c070d10 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd38c06cd50 0x7fd38c1e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd38c06cd50 0x7fd38c1e8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50648/0 (socket says 172.21.15.70:50648) 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 -- 172.21.15.70:0/1921313478 learned_addr learned my addr 172.21.15.70:0/1921313478 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd383fff640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd391184640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 0x7fd38c144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 -- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 msgr2=0x7fd38c144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 -- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 msgr2=0x7fd38c144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 0x7fd38c144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 -- 172.21.15.70:0/1921313478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880094d0 con 0x7fd38c06cd50 2023-11-26T07:23:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd390983640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd38c06cd50 0x7fd38c1e8f40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd3880b3040 tx=0x7fd38801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd3817fa640 1 -- 172.21.15.70:0/1921313478 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880b0dd0 con 0x7fd38c06cd50 2023-11-26T07:23:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd3817fa640 1 -- 172.21.15.70:0/1921313478 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3880bb460 con 0x7fd38c06cd50 2023-11-26T07:23:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd3817fa640 1 -- 172.21.15.70:0/1921313478 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3880bb810 con 0x7fd38c06cd50 2023-11-26T07:23:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c155390 con 0x7fd38c06cd50 2023-11-26T07:23:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.407+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c155950 con 0x7fd38c06cd50 2023-11-26T07:23:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.411+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c067680 con 0x7fd38c06cd50 2023-11-26T07:23:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.411+0000 7fd3817fa640 1 -- 172.21.15.70:0/1921313478 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd3880b83f0 con 0x7fd38c06cd50 2023-11-26T07:23:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.411+0000 7fd3817fa640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd378066ce0 0x7fd3780691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.411+0000 7fd3817fa640 1 -- 172.21.15.70:0/1921313478 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd388122300 con 0x7fd38c06cd50 2023-11-26T07:23:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.411+0000 7fd383fff640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd378066ce0 0x7fd3780691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.411+0000 7fd383fff640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd378066ce0 0x7fd3780691a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0cd530 tx=0x7fd37c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.415+0000 7fd3817fa640 1 -- 172.21.15.70:0/1921313478 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3880eef60 con 0x7fd38c06cd50 2023-11-26T07:23:06.570 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:06.567+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd38c0b1310 con 0x7fd38c06cd50 2023-11-26T07:23:07.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.011+0000 7fd3817fa640 1 -- 172.21.15.70:0/1921313478 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd3880f2580 con 0x7fd38c06cd50 2023-11-26T07:23:07.017 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2023-11-26T07:23:07.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd378066ce0 msgr2=0x7fd3780691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd378066ce0 0x7fd3780691a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0cd530 tx=0x7fd37c009190 comp rx=0 tx=0).stop 2023-11-26T07:23:07.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd38c06cd50 msgr2=0x7fd38c1e8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd38c06cd50 0x7fd38c1e8f40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd3880b3040 tx=0x7fd38801bad0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 shutdown_connections 2023-11-26T07:23:07.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd38c0cf280 0x7fd38c144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd38c070d10 0x7fd38c144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd378066ce0 0x7fd3780691a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 --2- 172.21.15.70:0/1921313478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd38c06cd50 0x7fd38c1e8f40 secure :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd3880b3040 tx=0x7fd38801bad0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 >> 172.21.15.70:0/1921313478 conn(0x7fd38c06a890 msgr2=0x7fd38c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:07.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.015+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 shutdown_connections 2023-11-26T07:23:07.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.019+0000 7fd392be7640 1 -- 172.21.15.70:0/1921313478 wait complete. 2023-11-26T07:23:07.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-26T07:23:07.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49f59e640 1 Processor -- start 2023-11-26T07:23:07.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49f59e640 1 -- start start 2023-11-26T07:23:07.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49f59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb4a0071970 0x7fb4a015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49f59e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a006e3f0 con 0x7fb4a00714e0 2023-11-26T07:23:07.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49f59e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a00722f0 con 0x7fb4a0144720 2023-11-26T07:23:07.190 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49f59e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a006de30 con 0x7fb4a0071970 2023-11-26T07:23:07.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb495d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb4a00714e0 0x7fb4a015bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42924/0 (socket says 172.21.15.70:42924) 2023-11-26T07:23:07.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb495d9b640 1 -- 172.21.15.70:0/3478271517 learned_addr learned my addr 172.21.15.70:0/3478271517 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:07.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49ed9d640 1 --2- 172.21.15.70:0/3478271517 >> v2:172.21.15.120:3300/0 conn(0x7fb4a0071970 0x7fb4a015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49dd9b640 1 -- 172.21.15.70:0/3478271517 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903036519 0 0) 0x7fb4a006e3f0 con 0x7fb4a00714e0 2023-11-26T07:23:07.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49dd9b640 1 -- 172.21.15.70:0/3478271517 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb48c003530 con 0x7fb4a00714e0 2023-11-26T07:23:07.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49dd9b640 1 -- 172.21.15.70:0/3478271517 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801233499 0 0) 0x7fb4a00722f0 con 0x7fb4a0144720 2023-11-26T07:23:07.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49dd9b640 1 -- 172.21.15.70:0/3478271517 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a006e3f0 con 0x7fb4a0144720 2023-11-26T07:23:07.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49ed9d640 1 -- 172.21.15.70:0/3478271517 >> v1:172.21.15.120:6789/0 conn(0x7fb4a0144720 legacy=0x7fb4a006d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49ed9d640 1 -- 172.21.15.70:0/3478271517 >> v1:172.21.15.70:6789/0 conn(0x7fb4a00714e0 legacy=0x7fb4a015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.187+0000 7fb49ed9d640 1 -- 172.21.15.70:0/3478271517 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a006e110 con 0x7fb4a0071970 2023-11-26T07:23:07.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49ed9d640 1 --2- 172.21.15.70:0/3478271517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0071970 0x7fb4a015c4f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb4980097c0 tx=0x7fb49801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b02e39ec9529382 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:07.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49dd9b640 1 -- 172.21.15.70:0/3478271517 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4980ab650 con 0x7fb4a0071970 2023-11-26T07:23:07.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49dd9b640 1 -- 172.21.15.70:0/3478271517 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4980ab7b0 con 0x7fb4a0071970 2023-11-26T07:23:07.194 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49dd9b640 1 -- 172.21.15.70:0/3478271517 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4980abb40 con 0x7fb4a0071970 2023-11-26T07:23:07.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 -- 172.21.15.70:0/3478271517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0071970 msgr2=0x7fb4a015c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3478271517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0071970 0x7fb4a015c4f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb4980097c0 tx=0x7fb49801c450 comp rx=0 tx=0).stop 2023-11-26T07:23:07.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 -- 172.21.15.70:0/3478271517 shutdown_connections 2023-11-26T07:23:07.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3478271517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0071970 0x7fb4a015c4f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 -- 172.21.15.70:0/3478271517 >> 172.21.15.70:0/3478271517 conn(0x7fb4a006a890 msgr2=0x7fb4a006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:07.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 -- 172.21.15.70:0/3478271517 shutdown_connections 2023-11-26T07:23:07.195 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 -- 172.21.15.70:0/3478271517 wait complete. 2023-11-26T07:23:07.196 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 Processor -- start 2023-11-26T07:23:07.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.191+0000 7fb49f59e640 1 -- start start 2023-11-26T07:23:07.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4a00714e0 0x7fb4a01414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4a0071970 0x7fb4a00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0144720 0x7fb4a013d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a01401a0 con 0x7fb4a00714e0 2023-11-26T07:23:07.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a013f620 con 0x7fb4a0144720 2023-11-26T07:23:07.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a013f900 con 0x7fb4a0071970 2023-11-26T07:23:07.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4a00714e0 0x7fb4a01414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4a00714e0 0x7fb4a01414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50652/0 (socket says 172.21.15.70:50652) 2023-11-26T07:23:07.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 -- 172.21.15.70:0/3046989374 learned_addr learned my addr 172.21.15.70:0/3046989374 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:07.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb495d9b640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4a0071970 0x7fb4a00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49ed9d640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0144720 0x7fb4a013d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 -- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4a0071970 msgr2=0x7fb4a00c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4a0071970 0x7fb4a00c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 -- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0144720 msgr2=0x7fb4a013d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0144720 0x7fb4a013d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 -- 172.21.15.70:0/3046989374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009420 con 0x7fb4a00714e0 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49e59c640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4a00714e0 0x7fb4a01414b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb49000c770 tx=0x7fb49000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb4977fe640 1 -- 172.21.15.70:0/3046989374 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490003b80 con 0x7fb4a00714e0 2023-11-26T07:23:07.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb4977fe640 1 -- 172.21.15.70:0/3046989374 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490003ce0 con 0x7fb4a00714e0 2023-11-26T07:23:07.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb4977fe640 1 -- 172.21.15.70:0/3046989374 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000aa90 con 0x7fb4a00714e0 2023-11-26T07:23:07.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a013fbe0 con 0x7fb4a00714e0 2023-11-26T07:23:07.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a01419f0 con 0x7fb4a00714e0 2023-11-26T07:23:07.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.195+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a0067500 con 0x7fb4a00714e0 2023-11-26T07:23:07.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.199+0000 7fb4977fe640 1 -- 172.21.15.70:0/3046989374 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fb49000abf0 con 0x7fb4a00714e0 2023-11-26T07:23:07.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.199+0000 7fb4977fe640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb480066ce0 0x7fb4800691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:07.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.199+0000 7fb4977fe640 1 -- 172.21.15.70:0/3046989374 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb490083180 con 0x7fb4a00714e0 2023-11-26T07:23:07.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.199+0000 7fb495d9b640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb480066ce0 0x7fb4800691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:07.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.199+0000 7fb495d9b640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb480066ce0 0x7fb4800691a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0141440 tx=0x7fb488007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:07.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.203+0000 7fb4977fe640 1 -- 172.21.15.70:0/3046989374 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb490051f30 con 0x7fb4a00714e0 2023-11-26T07:23:07.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:07.351+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4a00b0880 con 0x7fb4a00714e0 2023-11-26T07:23:08.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.015+0000 7fb4977fe640 1 -- 172.21.15.70:0/3046989374 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb490055550 con 0x7fb4a00714e0 2023-11-26T07:23:08.021 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb480066ce0 msgr2=0x7fb4800691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb480066ce0 0x7fb4800691a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0141440 tx=0x7fb488007d40 comp rx=0 tx=0).stop 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4a00714e0 msgr2=0x7fb4a01414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4a00714e0 0x7fb4a01414b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb49000c770 tx=0x7fb49000cc30 comp rx=0 tx=0).stop 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 shutdown_connections 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb4a0144720 0x7fb4a013d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb4a0071970 0x7fb4a00c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb480066ce0 0x7fb4800691a0 secure :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0141440 tx=0x7fb488007d40 comp rx=0 tx=0).stop 2023-11-26T07:23:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 --2- 172.21.15.70:0/3046989374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb4a00714e0 0x7fb4a01414b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.019+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 >> 172.21.15.70:0/3046989374 conn(0x7fb4a006a890 msgr2=0x7fb4a006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:08.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.023+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 shutdown_connections 2023-11-26T07:23:08.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.023+0000 7fb49f59e640 1 -- 172.21.15.70:0/3046989374 wait complete. 2023-11-26T07:23:08.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-26T07:23:08.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47e5c32640 1 Processor -- start 2023-11-26T07:23:08.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47e5c32640 1 -- start start 2023-11-26T07:23:08.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47e5c32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f47e00cf280 0x7f47e00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47e5c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e00cd1b0 0x7f47e00cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47e5c32640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00cc730 con 0x7f47e0143ac0 2023-11-26T07:23:08.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47e5c32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e0143ea0 con 0x7f47e00cf280 2023-11-26T07:23:08.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47e5c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00cfc50 con 0x7f47e00cd1b0 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47deffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f47e00cf280 0x7f47e00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47deffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f47e00cf280 0x7f47e00cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50654/0 (socket says 172.21.15.70:50654) 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47deffd640 1 -- 172.21.15.70:0/1068581169 learned_addr learned my addr 172.21.15.70:0/1068581169 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47dffff640 1 --2- 172.21.15.70:0/1068581169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e00cd1b0 0x7f47e00cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47deffd640 1 -- 172.21.15.70:0/1068581169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e00cd1b0 msgr2=0x7f47e00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47deffd640 1 --2- 172.21.15.70:0/1068581169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e00cd1b0 0x7f47e00cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47deffd640 1 -- 172.21.15.70:0/1068581169 >> v1:172.21.15.120:6789/0 conn(0x7f47e0143ac0 legacy=0x7f47e0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47deffd640 1 -- 172.21.15.70:0/1068581169 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0070ee0 con 0x7f47e00cf280 2023-11-26T07:23:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.199+0000 7f47de7fc640 1 -- 172.21.15.70:0/1068581169 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691993401 0 0) 0x7f47e00cc730 con 0x7f47e0143ac0 2023-11-26T07:23:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47deffd640 1 --2- 172.21.15.70:0/1068581169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cf280 0x7f47e00cf710 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009870 tx=0x7f47d401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db75d35a3b39d943 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47de7fc640 1 -- 172.21.15.70:0/1068581169 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40a9400 con 0x7f47e00cf280 2023-11-26T07:23:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47de7fc640 1 -- 172.21.15.70:0/1068581169 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d40a9560 con 0x7f47e00cf280 2023-11-26T07:23:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47de7fc640 1 -- 172.21.15.70:0/1068581169 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40a98f0 con 0x7f47e00cf280 2023-11-26T07:23:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 -- 172.21.15.70:0/1068581169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cf280 msgr2=0x7f47e00cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1068581169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cf280 0x7f47e00cf710 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009870 tx=0x7f47d401c540 comp rx=0 tx=0).stop 2023-11-26T07:23:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 -- 172.21.15.70:0/1068581169 shutdown_connections 2023-11-26T07:23:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1068581169 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e00cd1b0 0x7f47e00cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1068581169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cf280 0x7f47e00cf710 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 -- 172.21.15.70:0/1068581169 >> 172.21.15.70:0/1068581169 conn(0x7f47e006a890 msgr2=0x7f47e006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 -- 172.21.15.70:0/1068581169 shutdown_connections 2023-11-26T07:23:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 -- 172.21.15.70:0/1068581169 wait complete. 2023-11-26T07:23:08.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 Processor -- start 2023-11-26T07:23:08.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.203+0000 7f47e5c32640 1 -- start start 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cd1b0 0x7f47e013bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47e00cf280 0x7f47e01416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e0143ac0 0x7f47e0141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e013eee0 con 0x7f47e00cd1b0 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0159d60 con 0x7f47e00cf280 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e013e2d0 con 0x7f47e0143ac0 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cd1b0 0x7f47e013bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cd1b0 0x7f47e013bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50666/0 (socket says 172.21.15.70:50666) 2023-11-26T07:23:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 -- 172.21.15.70:0/1585240072 learned_addr learned my addr 172.21.15.70:0/1585240072 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47dffff640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e0143ac0 0x7f47e0141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47deffd640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47e00cf280 0x7f47e01416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 -- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e0143ac0 msgr2=0x7f47e0141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e0143ac0 0x7f47e0141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 -- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47e00cf280 msgr2=0x7f47e01416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47e00cf280 0x7f47e01416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 -- 172.21.15.70:0/1585240072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40094d0 con 0x7f47e00cd1b0 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47dffff640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e0143ac0 0x7f47e0141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47df7fe640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cd1b0 0x7f47e013bd20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c520 tx=0x7f47d000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47c7fff640 1 -- 172.21.15.70:0/1585240072 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00052d0 con 0x7f47e00cd1b0 2023-11-26T07:23:08.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47c7fff640 1 -- 172.21.15.70:0/1585240072 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0005430 con 0x7f47e00cd1b0 2023-11-26T07:23:08.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e013e5b0 con 0x7f47e00cd1b0 2023-11-26T07:23:08.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47c7fff640 1 -- 172.21.15.70:0/1585240072 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0012870 con 0x7f47e00cd1b0 2023-11-26T07:23:08.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e013eb70 con 0x7f47e00cd1b0 2023-11-26T07:23:08.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.207+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e0067680 con 0x7f47e00cd1b0 2023-11-26T07:23:08.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.215+0000 7f47c7fff640 1 -- 172.21.15.70:0/1585240072 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f47d0003620 con 0x7f47e00cd1b0 2023-11-26T07:23:08.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.215+0000 7f47c7fff640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47cc066db0 0x7f47cc069270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:08.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.215+0000 7f47c7fff640 1 -- 172.21.15.70:0/1585240072 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f47d0082020 con 0x7f47e00cd1b0 2023-11-26T07:23:08.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.215+0000 7f47deffd640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47cc066db0 0x7f47cc069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:08.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.215+0000 7f47deffd640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47cc066db0 0x7f47cc069270 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f47d40ae000 tx=0x7f47d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:08.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.215+0000 7f47c7fff640 1 -- 172.21.15.70:0/1585240072 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47d0050dd0 con 0x7f47e00cd1b0 2023-11-26T07:23:08.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:08.399+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f47e00719c0 con 0x7f47e00cd1b0 2023-11-26T07:23:09.041 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.039+0000 7f47c7fff640 1 -- 172.21.15.70:0/1585240072 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f47d00170c0 con 0x7f47e00cd1b0 2023-11-26T07:23:09.041 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 10 and data pool 11 2023-11-26T07:23:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47cc066db0 msgr2=0x7f47cc069270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47cc066db0 0x7f47cc069270 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f47d40ae000 tx=0x7f47d4008040 comp rx=0 tx=0).stop 2023-11-26T07:23:09.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cd1b0 msgr2=0x7f47e013bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cd1b0 0x7f47e013bd20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c520 tx=0x7f47d000c9e0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 shutdown_connections 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f47e0143ac0 0x7f47e0141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47e00cf280 0x7f47e01416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f47cc066db0 0x7f47cc069270 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 --2- 172.21.15.70:0/1585240072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47e00cd1b0 0x7f47e013bd20 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 >> 172.21.15.70:0/1585240072 conn(0x7f47e006a890 msgr2=0x7f47e00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 shutdown_connections 2023-11-26T07:23:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.043+0000 7f47e5c32640 1 -- 172.21.15.70:0/1585240072 wait complete. 2023-11-26T07:23:09.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:09.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.203+0000 7fb18c9df640 1 Processor -- start 2023-11-26T07:23:09.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.203+0000 7fb18c9df640 1 -- start start 2023-11-26T07:23:09.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.203+0000 7fb18c9df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb188143ac0 0x7fb188070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.203+0000 7fb18c9df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1880cc730 con 0x7fb1880cf990 2023-11-26T07:23:09.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.203+0000 7fb18c9df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb188070ee0 con 0x7fb1880708b0 2023-11-26T07:23:09.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.203+0000 7fb18c9df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb188143ea0 con 0x7fb188143ac0 2023-11-26T07:23:09.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb186d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb1880cf990 0x7fb1880cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42926/0 (socket says 172.21.15.70:42926) 2023-11-26T07:23:09.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb186d9d640 1 -- 172.21.15.70:0/889539435 learned_addr learned my addr 172.21.15.70:0/889539435 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:09.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb18659c640 1 --2- 172.21.15.70:0/889539435 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb188143ac0 0x7fb188070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb185d9b640 1 -- 172.21.15.70:0/889539435 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765901163 0 0) 0x7fb1880cc730 con 0x7fb1880cf990 2023-11-26T07:23:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb185d9b640 1 -- 172.21.15.70:0/889539435 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb174003530 con 0x7fb1880cf990 2023-11-26T07:23:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb18659c640 1 -- 172.21.15.70:0/889539435 >> v1:172.21.15.120:6789/0 conn(0x7fb1880708b0 legacy=0x7fb1880cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb185d9b640 1 -- 172.21.15.70:0/889539435 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354142615 0 0) 0x7fb188070ee0 con 0x7fb1880708b0 2023-11-26T07:23:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb18659c640 1 -- 172.21.15.70:0/889539435 >> v1:172.21.15.70:6789/0 conn(0x7fb1880cf990 legacy=0x7fb1880cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb18659c640 1 -- 172.21.15.70:0/889539435 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880711c0 con 0x7fb188143ac0 2023-11-26T07:23:09.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.207+0000 7fb18659c640 1 --2- 172.21.15.70:0/889539435 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb188143ac0 0x7fb188070370 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1780097f0 tx=0x7fb17801e6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78607ba42b2b322 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb185d9b640 1 -- 172.21.15.70:0/889539435 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780aa610 con 0x7fb188143ac0 2023-11-26T07:23:09.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb185d9b640 1 -- 172.21.15.70:0/889539435 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1780aa770 con 0x7fb188143ac0 2023-11-26T07:23:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb185d9b640 1 -- 172.21.15.70:0/889539435 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780aab00 con 0x7fb188143ac0 2023-11-26T07:23:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- 172.21.15.70:0/889539435 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb188143ac0 msgr2=0x7fb188070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 --2- 172.21.15.70:0/889539435 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb188143ac0 0x7fb188070370 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1780097f0 tx=0x7fb17801e6d0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- 172.21.15.70:0/889539435 shutdown_connections 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 --2- 172.21.15.70:0/889539435 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb188143ac0 0x7fb188070370 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- 172.21.15.70:0/889539435 >> 172.21.15.70:0/889539435 conn(0x7fb18806a890 msgr2=0x7fb18806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- 172.21.15.70:0/889539435 shutdown_connections 2023-11-26T07:23:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- 172.21.15.70:0/889539435 wait complete. 2023-11-26T07:23:09.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 Processor -- start 2023-11-26T07:23:09.212 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- start start 2023-11-26T07:23:09.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1880708b0 0x7fb188143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1880cf990 0x7fb188145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb188143ac0 0x7fb1880c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb188144530 con 0x7fb188143ac0 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb188146770 con 0x7fb1880cf990 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.211+0000 7fb18c9df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb188146a50 con 0x7fb1880708b0 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb188143ac0 0x7fb1880c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb18659c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1880708b0 0x7fb188143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb188143ac0 0x7fb1880c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50672/0 (socket says 172.21.15.70:50672) 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 -- 172.21.15.70:0/1739221904 learned_addr learned my addr 172.21.15.70:0/1739221904 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb17dd9b640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1880cf990 0x7fb188145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 -- 172.21.15.70:0/1739221904 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1880708b0 msgr2=0x7fb188143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1880708b0 0x7fb188143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 -- 172.21.15.70:0/1739221904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1880cf990 msgr2=0x7fb188145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1880cf990 0x7fb188145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 -- 172.21.15.70:0/1739221904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178009420 con 0x7fb188143ac0 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb186d9d640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb188143ac0 0x7fb1880c3e60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c400 tx=0x7fb18000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb17f7fe640 1 -- 172.21.15.70:0/1739221904 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180005cf0 con 0x7fb188143ac0 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb17f7fe640 1 -- 172.21.15.70:0/1739221904 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb180005e50 con 0x7fb188143ac0 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb17f7fe640 1 -- 172.21.15.70:0/1739221904 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800072d0 con 0x7fb188143ac0 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb188146d30 con 0x7fb188143ac0 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1881472f0 con 0x7fb188143ac0 2023-11-26T07:23:09.216 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb188067680 con 0x7fb188143ac0 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.215+0000 7fb17f7fe640 1 -- 172.21.15.70:0/1739221904 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fb180007430 con 0x7fb188143ac0 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.219+0000 7fb17f7fe640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb168066ce0 0x7fb1680691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.219+0000 7fb17f7fe640 1 -- 172.21.15.70:0/1739221904 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1800846a0 con 0x7fb188143ac0 2023-11-26T07:23:09.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.219+0000 7fb18659c640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb168066ce0 0x7fb1680691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.218 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.219+0000 7fb18659c640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb168066ce0 0x7fb1680691a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b1000 tx=0x7fb178008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.223+0000 7fb17f7fe640 1 -- 172.21.15.70:0/1739221904 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb180050b90 con 0x7fb188143ac0 2023-11-26T07:23:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.371+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb188067fd0 con 0x7fb188143ac0 2023-11-26T07:23:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb17f7fe640 1 -- 172.21.15.70:0/1739221904 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16581 (secure 0 0 0) 0x7fb180017020 con 0x7fb188143ac0 2023-11-26T07:23:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:09.374 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":77,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:08.402987+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb168066ce0 msgr2=0x7fb1680691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb168066ce0 0x7fb1680691a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b1000 tx=0x7fb178008040 comp rx=0 tx=0).stop 2023-11-26T07:23:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb188143ac0 msgr2=0x7fb1880c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb188143ac0 0x7fb1880c3e60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c400 tx=0x7fb18000c8c0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 shutdown_connections 2023-11-26T07:23:09.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb168066ce0 0x7fb1680691a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb188143ac0 0x7fb1880c3e60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1880cf990 0x7fb188145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 --2- 172.21.15.70:0/1739221904 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb1880708b0 0x7fb188143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 >> 172.21.15.70:0/1739221904 conn(0x7fb18806a890 msgr2=0x7fb18806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 shutdown_connections 2023-11-26T07:23:09.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.375+0000 7fb18c9df640 1 -- 172.21.15.70:0/1739221904 wait complete. 2023-11-26T07:23:09.396 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:09.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.531+0000 7f710c2e3640 1 Processor -- start 2023-11-26T07:23:09.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.531+0000 7f710c2e3640 1 -- start start 2023-11-26T07:23:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710c2e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71040cf280 0x7f71040cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.535 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710c2e3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71040cd1b0 0x7f71040cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710c2e3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040cc730 con 0x7f7104143ac0 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710c2e3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7104143ea0 con 0x7f71040cf280 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710c2e3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040cfc50 con 0x7f71040cd1b0 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710987e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71040cf280 0x7f71040cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710a07f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f7104143ac0 0x7f7104070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42940/0 (socket says 172.21.15.70:42940) 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710a07f640 1 -- 172.21.15.70:0/1465332038 learned_addr learned my addr 172.21.15.70:0/1465332038 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710987e640 1 -- 172.21.15.70:0/1465332038 >> v2:172.21.15.120:3300/0 conn(0x7f71040cd1b0 msgr2=0x7f71040cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:09.536 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710987e640 1 --2- 172.21.15.70:0/1465332038 >> v2:172.21.15.120:3300/0 conn(0x7f71040cd1b0 0x7f71040cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710987e640 1 -- 172.21.15.70:0/1465332038 >> v1:172.21.15.70:6789/0 conn(0x7f7104143ac0 legacy=0x7f7104070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.537 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.535+0000 7f710987e640 1 -- 172.21.15.70:0/1465332038 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104070ee0 con 0x7f71040cf280 2023-11-26T07:23:09.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710987e640 1 --2- 172.21.15.70:0/1465332038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cf280 0x7f71040cf710 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f710406e570 tx=0x7f70f401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966a82d97bc18534 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710907d640 1 -- 172.21.15.70:0/1465332038 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40ab660 con 0x7f71040cf280 2023-11-26T07:23:09.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710907d640 1 -- 172.21.15.70:0/1465332038 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f40ab7c0 con 0x7f71040cf280 2023-11-26T07:23:09.538 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710907d640 1 -- 172.21.15.70:0/1465332038 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40abb50 con 0x7f71040cf280 2023-11-26T07:23:09.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- 172.21.15.70:0/1465332038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cf280 msgr2=0x7f71040cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 --2- 172.21.15.70:0/1465332038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cf280 0x7f71040cf710 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f710406e570 tx=0x7f70f401c460 comp rx=0 tx=0).stop 2023-11-26T07:23:09.539 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- 172.21.15.70:0/1465332038 shutdown_connections 2023-11-26T07:23:09.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 --2- 172.21.15.70:0/1465332038 >> v2:172.21.15.120:3300/0 conn(0x7f71040cd1b0 0x7f71040cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 --2- 172.21.15.70:0/1465332038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cf280 0x7f71040cf710 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- 172.21.15.70:0/1465332038 >> 172.21.15.70:0/1465332038 conn(0x7f710406a890 msgr2=0x7f710406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- 172.21.15.70:0/1465332038 shutdown_connections 2023-11-26T07:23:09.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- 172.21.15.70:0/1465332038 wait complete. 2023-11-26T07:23:09.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 Processor -- start 2023-11-26T07:23:09.540 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- start start 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cd1b0 0x7f710415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71040cf280 0x7f7104159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104143ac0 0x7f710413bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710413c760 con 0x7f71040cd1b0 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040ac8e0 con 0x7f7104143ac0 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.539+0000 7f710c2e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71041334d0 con 0x7f71040cf280 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cd1b0 0x7f710415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cd1b0 0x7f710415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50690/0 (socket says 172.21.15.70:50690) 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 -- 172.21.15.70:0/921010013 learned_addr learned my addr 172.21.15.70:0/921010013 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:09.542 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a880640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104143ac0 0x7f710413bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710987e640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71040cf280 0x7f7104159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.543 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 -- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71040cf280 msgr2=0x7f7104159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71040cf280 0x7f7104159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 -- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104143ac0 msgr2=0x7f710413bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104143ac0 0x7f710413bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 -- 172.21.15.70:0/921010013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4009420 con 0x7f71040cd1b0 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710a07f640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cd1b0 0x7f710415b3c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f710000c500 tx=0x7f710000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f70faffd640 1 -- 172.21.15.70:0/921010013 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100005cf0 con 0x7f71040cd1b0 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f70faffd640 1 -- 172.21.15.70:0/921010013 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100005e50 con 0x7f71040cd1b0 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f70faffd640 1 -- 172.21.15.70:0/921010013 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71000072f0 con 0x7f71040cd1b0 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71041337b0 con 0x7f71040cd1b0 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71040b1480 con 0x7f71040cd1b0 2023-11-26T07:23:09.544 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710415a380 con 0x7f71040cd1b0 2023-11-26T07:23:09.545 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.543+0000 7f70faffd640 1 -- 172.21.15.70:0/921010013 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f7100007450 con 0x7f71040cd1b0 2023-11-26T07:23:09.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.547+0000 7f70faffd640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f70e8066ce0 0x7f70e80691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.547+0000 7f70faffd640 1 -- 172.21.15.70:0/921010013 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7100081da0 con 0x7f71040cd1b0 2023-11-26T07:23:09.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.547+0000 7f710987e640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f70e8066ce0 0x7f70e80691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.546 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.547+0000 7f710987e640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f70e8066ce0 0x7f70e80691a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f70f40af000 tx=0x7f70f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.551+0000 7f70faffd640 1 -- 172.21.15.70:0/921010013 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7100050b50 con 0x7f71040cd1b0 2023-11-26T07:23:09.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.699+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7104067680 con 0x7f71040cd1b0 2023-11-26T07:23:09.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f70faffd640 1 -- 172.21.15.70:0/921010013 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f7100054170 con 0x7f71040cd1b0 2023-11-26T07:23:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:09.703 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":77,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:08.402987+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:09.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f70e8066ce0 msgr2=0x7f70e80691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f70e8066ce0 0x7f70e80691a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f70f40af000 tx=0x7f70f40a7000 comp rx=0 tx=0).stop 2023-11-26T07:23:09.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cd1b0 msgr2=0x7f710415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.704 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cd1b0 0x7f710415b3c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f710000c500 tx=0x7f710000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 shutdown_connections 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7104143ac0 0x7f710413bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71040cf280 0x7f7104159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f70e8066ce0 0x7f70e80691a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 --2- 172.21.15.70:0/921010013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71040cd1b0 0x7f710415b3c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 >> 172.21.15.70:0/921010013 conn(0x7f710406a890 msgr2=0x7f71040cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 shutdown_connections 2023-11-26T07:23:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.703+0000 7f710c2e3640 1 -- 172.21.15.70:0/921010013 wait complete. 2023-11-26T07:23:09.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-26T07:23:09.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782eb57640 1 Processor -- start 2023-11-26T07:23:09.866 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782eb57640 1 -- start start 2023-11-26T07:23:09.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782eb57640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f78280cd610 0x7f7828071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782eb57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782eb57640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7828071530 con 0x7f78281614b0 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782eb57640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7828071eb0 con 0x7f78280cd610 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782eb57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782815d970 con 0x7f7828070ba0 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f781ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f78280cd610 0x7f7828071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782c8f3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f78281614b0 0x7f7828161890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42942/0 (socket says 172.21.15.70:42942) 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782c8f3640 1 -- 172.21.15.70:0/3215658794 learned_addr learned my addr 172.21.15.70:0/3215658794 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f781ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f78280cd610 0x7f7828071970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50702/0 (socket says 172.21.15.70:50702) 2023-11-26T07:23:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f782d0f4640 1 --2- 172.21.15.70:0/3215658794 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f781ffff640 1 -- 172.21.15.70:0/3215658794 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 msgr2=0x7f7828070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f781ffff640 1 --2- 172.21.15.70:0/3215658794 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f781ffff640 1 -- 172.21.15.70:0/3215658794 >> v1:172.21.15.70:6789/0 conn(0x7f78281614b0 legacy=0x7f7828161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f781ffff640 1 -- 172.21.15.70:0/3215658794 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782815dc30 con 0x7f78280cd610 2023-11-26T07:23:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.867+0000 7f781f7fe640 1 -- 172.21.15.70:0/3215658794 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613057627 0 0) 0x7f7824001120 con 0x7f78281614b0 2023-11-26T07:23:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f781ffff640 1 --2- 172.21.15.70:0/3215658794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f7828071970 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f78180097c0 tx=0x7f781801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86956c9fddc95a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f781f7fe640 1 -- 172.21.15.70:0/3215658794 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180ab650 con 0x7f78280cd610 2023-11-26T07:23:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f781f7fe640 1 -- 172.21.15.70:0/3215658794 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78180ab7b0 con 0x7f78280cd610 2023-11-26T07:23:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f781f7fe640 1 -- 172.21.15.70:0/3215658794 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180abb40 con 0x7f78280cd610 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 -- 172.21.15.70:0/3215658794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 msgr2=0x7f7828071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 --2- 172.21.15.70:0/3215658794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f7828071970 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f78180097c0 tx=0x7f781801c450 comp rx=0 tx=0).stop 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 -- 172.21.15.70:0/3215658794 shutdown_connections 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 --2- 172.21.15.70:0/3215658794 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 --2- 172.21.15.70:0/3215658794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f7828071970 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 -- 172.21.15.70:0/3215658794 >> 172.21.15.70:0/3215658794 conn(0x7f78280cf710 msgr2=0x7f78280cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 -- 172.21.15.70:0/3215658794 shutdown_connections 2023-11-26T07:23:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 -- 172.21.15.70:0/3215658794 wait complete. 2023-11-26T07:23:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 Processor -- start 2023-11-26T07:23:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.871+0000 7f782eb57640 1 -- start start 2023-11-26T07:23:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f78280cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78281614b0 0x7f782815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7828156c20 con 0x7f78280cd610 2023-11-26T07:23:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7828156010 con 0x7f78281614b0 2023-11-26T07:23:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78281562f0 con 0x7f7828070ba0 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f78280cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f78280cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50710/0 (socket says 172.21.15.70:50710) 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 -- 172.21.15.70:0/3288200054 learned_addr learned my addr 172.21.15.70:0/3288200054 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782c8f3640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782d0f4640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78281614b0 0x7f782815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 -- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 msgr2=0x7f7828155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 -- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78281614b0 msgr2=0x7f782815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78281614b0 0x7f782815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 -- 172.21.15.70:0/3288200054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818009420 con 0x7f78280cd610 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782d0f4640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78281614b0 0x7f782815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781ffff640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f78280cba70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f781801ab00 tx=0x7f781801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781d7fa640 1 -- 172.21.15.70:0/3288200054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818004220 con 0x7f78280cd610 2023-11-26T07:23:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781d7fa640 1 -- 172.21.15.70:0/3288200054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78180b9070 con 0x7f78280cd610 2023-11-26T07:23:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f781d7fa640 1 -- 172.21.15.70:0/3288200054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818003620 con 0x7f78280cd610 2023-11-26T07:23:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78281565d0 con 0x7f78280cd610 2023-11-26T07:23:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782815ccf0 con 0x7f78280cd610 2023-11-26T07:23:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.875+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782815cee0 con 0x7f78280cd610 2023-11-26T07:23:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.879+0000 7f781d7fa640 1 -- 172.21.15.70:0/3288200054 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f7818003780 con 0x7f78280cd610 2023-11-26T07:23:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.879+0000 7f781d7fa640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7814066d10 0x7f78140691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.879+0000 7f781d7fa640 1 -- 172.21.15.70:0/3288200054 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78180bb070 con 0x7f78280cd610 2023-11-26T07:23:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.879+0000 7f782c8f3640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7814066d10 0x7f78140691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.879+0000 7f782c8f3640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7814066d10 0x7f78140691d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7824001380 tx=0x7f7824007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:09.883+0000 7f781d7fa640 1 -- 172.21.15.70:0/3288200054 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f782815cee0 con 0x7f78280cd610 2023-11-26T07:23:10.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:10.071+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f782815cee0 con 0x7f78280cd610 2023-11-26T07:23:11.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.063+0000 7f781d7fa640 1 -- 172.21.15.70:0/3288200054 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f782815cee0 con 0x7f78280cd610 2023-11-26T07:23:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7814066d10 msgr2=0x7f78140691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7814066d10 0x7f78140691d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7824001380 tx=0x7f7824007be0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 msgr2=0x7f78280cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f78280cba70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f781801ab00 tx=0x7f781801ac90 comp rx=0 tx=0).stop 2023-11-26T07:23:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 shutdown_connections 2023-11-26T07:23:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7814066d10 0x7f78140691d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78280cd610 0x7f78280cba70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78281614b0 0x7f782815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 --2- 172.21.15.70:0/3288200054 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7828070ba0 0x7f7828155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 >> 172.21.15.70:0/3288200054 conn(0x7f78280cf710 msgr2=0x7f782815eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 shutdown_connections 2023-11-26T07:23:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.067+0000 7f782eb57640 1 -- 172.21.15.70:0/3288200054 wait complete. 2023-11-26T07:23:11.091 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-26T07:23:11.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-26T07:23:11.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9e04a68640 1 Processor -- start 2023-11-26T07:23:11.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9e04a68640 1 -- start start 2023-11-26T07:23:11.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9e04a68640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e00143ac0 0x7f9e00070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9e04a68640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9e000708b0 0x7f9e000cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9e04a68640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e000cc730 con 0x7f9e000cf7c0 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9e04a68640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e00143ea0 con 0x7f9e00143ac0 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9e04a68640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e000cfbd0 con 0x7f9e000708b0 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9dfe59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e00143ac0 0x7f9e00070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9dfe59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9e00143ac0 0x7f9e00070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50712/0 (socket says 172.21.15.70:50712) 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9dfe59c640 1 -- 172.21.15.70:0/1755653069 learned_addr learned my addr 172.21.15.70:0/1755653069 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9dfe59c640 1 -- 172.21.15.70:0/1755653069 >> v2:172.21.15.120:3300/0 conn(0x7f9e000708b0 msgr2=0x7f9e000cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9dfe59c640 1 --2- 172.21.15.70:0/1755653069 >> v2:172.21.15.120:3300/0 conn(0x7f9e000708b0 0x7f9e000cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9dfe59c640 1 -- 172.21.15.70:0/1755653069 >> v1:172.21.15.120:6789/0 conn(0x7f9e000cf7c0 legacy=0x7f9e000b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:11.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.235+0000 7f9dfe59c640 1 -- 172.21.15.70:0/1755653069 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00070ee0 con 0x7f9e00143ac0 2023-11-26T07:23:11.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9dfe59c640 1 --2- 172.21.15.70:0/1755653069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00143ac0 0x7f9e00070370 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9e000aeb10 tx=0x7f9df001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd20a2105e601975 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9dfdd9b640 1 -- 172.21.15.70:0/1755653069 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00aa640 con 0x7f9e00143ac0 2023-11-26T07:23:11.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9dfdd9b640 1 -- 172.21.15.70:0/1755653069 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df00aa7a0 con 0x7f9e00143ac0 2023-11-26T07:23:11.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9dfdd9b640 1 -- 172.21.15.70:0/1755653069 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00aab30 con 0x7f9e00143ac0 2023-11-26T07:23:11.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 -- 172.21.15.70:0/1755653069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00143ac0 msgr2=0x7f9e00070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 --2- 172.21.15.70:0/1755653069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00143ac0 0x7f9e00070370 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9e000aeb10 tx=0x7f9df001c4c0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 -- 172.21.15.70:0/1755653069 shutdown_connections 2023-11-26T07:23:11.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 --2- 172.21.15.70:0/1755653069 >> v2:172.21.15.120:3300/0 conn(0x7f9e000708b0 0x7f9e000cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 --2- 172.21.15.70:0/1755653069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00143ac0 0x7f9e00070370 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 -- 172.21.15.70:0/1755653069 >> 172.21.15.70:0/1755653069 conn(0x7f9e0006a890 msgr2=0x7f9e0006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:11.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 -- 172.21.15.70:0/1755653069 shutdown_connections 2023-11-26T07:23:11.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.239+0000 7f9e04a68640 1 -- 172.21.15.70:0/1755653069 wait complete. 2023-11-26T07:23:11.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 Processor -- start 2023-11-26T07:23:11.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 -- start start 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e000708b0 0x7f9e00157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e000cf7c0 0x7f9e000adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00143ac0 0x7f9e0013c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0013ed80 con 0x7f9e000cf7c0 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0013ef10 con 0x7f9e00143ac0 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001582c0 con 0x7f9e000708b0 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e000cf7c0 0x7f9e000adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e000cf7c0 0x7f9e000adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50722/0 (socket says 172.21.15.70:50722) 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 -- 172.21.15.70:0/662263943 learned_addr learned my addr 172.21.15.70:0/662263943 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9dfed9d640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00143ac0 0x7f9e0013c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9dfe59c640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e000708b0 0x7f9e00157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 -- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e000708b0 msgr2=0x7f9e00157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e000708b0 0x7f9e00157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 -- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00143ac0 msgr2=0x7f9e0013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00143ac0 0x7f9e0013c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 -- 172.21.15.70:0/662263943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00094d0 con 0x7f9e000cf7c0 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9dfed9d640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00143ac0 0x7f9e0013c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9dfe59c640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e000708b0 0x7f9e00157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df5d9b640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e000cf7c0 0x7f9e000adbd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9de800b410 tx=0x7f9de800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df77fe640 1 -- 172.21.15.70:0/662263943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8011830 con 0x7f9e000cf7c0 2023-11-26T07:23:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df77fe640 1 -- 172.21.15.70:0/662263943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de8011990 con 0x7f9e000cf7c0 2023-11-26T07:23:11.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0015a6a0 con 0x7f9e000cf7c0 2023-11-26T07:23:11.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9df77fe640 1 -- 172.21.15.70:0/662263943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8011d40 con 0x7f9e000cf7c0 2023-11-26T07:23:11.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.243+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e00158840 con 0x7f9e000cf7c0 2023-11-26T07:23:11.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.247+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e000b1b20 con 0x7f9e000cf7c0 2023-11-26T07:23:11.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.247+0000 7f9df77fe640 1 -- 172.21.15.70:0/662263943 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f9de801a400 con 0x7f9e000cf7c0 2023-11-26T07:23:11.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.247+0000 7f9df77fe640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9de0066ce0 0x7f9de00691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:11.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.247+0000 7f9df77fe640 1 -- 172.21.15.70:0/662263943 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9de8082a30 con 0x7f9e000cf7c0 2023-11-26T07:23:11.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.247+0000 7f9dfe59c640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9de0066ce0 0x7f9de00691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:11.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.247+0000 7f9dfe59c640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9de0066ce0 0x7f9de00691a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9df00ae000 tx=0x7f9df0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:11.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.251+0000 7f9df77fe640 1 -- 172.21.15.70:0/662263943 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9de8051840 con 0x7f9e000cf7c0 2023-11-26T07:23:11.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:11.431+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9e0013f080 con 0x7f9e000cf7c0 2023-11-26T07:23:12.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9df77fe640 1 -- 172.21.15.70:0/662263943 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9e0013f080 con 0x7f9e000cf7c0 2023-11-26T07:23:12.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9de0066ce0 msgr2=0x7f9de00691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9de0066ce0 0x7f9de00691a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9df00ae000 tx=0x7f9df0008040 comp rx=0 tx=0).stop 2023-11-26T07:23:12.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e000cf7c0 msgr2=0x7f9e000adbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e000cf7c0 0x7f9e000adbd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9de800b410 tx=0x7f9de800b8d0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 shutdown_connections 2023-11-26T07:23:12.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9de0066ce0 0x7f9de00691a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e000cf7c0 0x7f9e000adbd0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e00143ac0 0x7f9e0013c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 --2- 172.21.15.70:0/662263943 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9e000708b0 0x7f9e00157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 >> 172.21.15.70:0/662263943 conn(0x7f9e0006a890 msgr2=0x7f9e000b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:12.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 shutdown_connections 2023-11-26T07:23:12.070 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.067+0000 7f9e04a68640 1 -- 172.21.15.70:0/662263943 wait complete. 2023-11-26T07:23:12.089 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-26T07:23:12.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:23:12.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb471d640 1 Processor -- start 2023-11-26T07:23:12.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb471d640 1 -- start start 2023-11-26T07:23:12.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb471d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb471d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3bac0d1bc0 0x7f3bac0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb471d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0cf0e0 con 0x7f3bac0b2160 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb471d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac15dac0 con 0x7f3bac0d1bc0 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb471d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0ceb20 con 0x7f3bac15d6e0 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb2cba640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3bac0d1bc0 0x7f3bac0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb2cba640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3bac0d1bc0 0x7f3bac0b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50728/0 (socket says 172.21.15.70:50728) 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb2cba640 1 -- 172.21.15.70:0/3132242713 learned_addr learned my addr 172.21.15.70:0/3132242713 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb24b9640 1 --2- 172.21.15.70:0/3132242713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb2cba640 1 -- 172.21.15.70:0/3132242713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 msgr2=0x7f3bac0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb2cba640 1 --2- 172.21.15.70:0/3132242713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb2cba640 1 -- 172.21.15.70:0/3132242713 >> v1:172.21.15.120:6789/0 conn(0x7f3bac0b2160 legacy=0x7f3bac0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb2cba640 1 -- 172.21.15.70:0/3132242713 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0cee00 con 0x7f3bac0d1bc0 2023-11-26T07:23:12.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.227+0000 7f3bb24b9640 1 --2- 172.21.15.70:0/3132242713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:12.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb2cba640 1 --2- 172.21.15.70:0/3132242713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0d1bc0 0x7f3bac0b0750 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009e50 tx=0x7f3ba401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db680a97298207d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb14b7640 1 -- 172.21.15.70:0/3132242713 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40a57d0 con 0x7f3bac0d1bc0 2023-11-26T07:23:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb14b7640 1 -- 172.21.15.70:0/3132242713 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba40a5930 con 0x7f3bac0d1bc0 2023-11-26T07:23:12.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb14b7640 1 -- 172.21.15.70:0/3132242713 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40a5cc0 con 0x7f3bac0d1bc0 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 -- 172.21.15.70:0/3132242713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0d1bc0 msgr2=0x7f3bac0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 --2- 172.21.15.70:0/3132242713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0d1bc0 0x7f3bac0b0750 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009e50 tx=0x7f3ba401ca10 comp rx=0 tx=0).stop 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 -- 172.21.15.70:0/3132242713 shutdown_connections 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 --2- 172.21.15.70:0/3132242713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0d1bc0 0x7f3bac0b0750 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 --2- 172.21.15.70:0/3132242713 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 -- 172.21.15.70:0/3132242713 >> 172.21.15.70:0/3132242713 conn(0x7f3bac09c550 msgr2=0x7f3bac0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 -- 172.21.15.70:0/3132242713 shutdown_connections 2023-11-26T07:23:12.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.231+0000 7f3bb471d640 1 -- 172.21.15.70:0/3132242713 wait complete. 2023-11-26T07:23:12.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 Processor -- start 2023-11-26T07:23:12.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 -- start start 2023-11-26T07:23:12.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0b2160 0x7f3bac155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac0d1bc0 0x7f3bac0cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac15eb60 con 0x7f3bac0b2160 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac155ca0 con 0x7f3bac0d1bc0 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac15dc00 con 0x7f3bac15d6e0 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0b2160 0x7f3bac155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0b2160 0x7f3bac155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50736/0 (socket says 172.21.15.70:50736) 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 -- 172.21.15.70:0/2228554272 learned_addr learned my addr 172.21.15.70:0/2228554272 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb2cba640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb1cb8640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac0d1bc0 0x7f3bac0cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 -- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 msgr2=0x7f3bac0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 -- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac0d1bc0 msgr2=0x7f3bac0cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac0d1bc0 0x7f3bac0cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 -- 172.21.15.70:0/2228554272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4009b30 con 0x7f3bac0b2160 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb24b9640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0b2160 0x7f3bac155760 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800d800 tx=0x7f3ba800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3ba2ffd640 1 -- 172.21.15.70:0/2228554272 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80096c0 con 0x7f3bac0b2160 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3ba2ffd640 1 -- 172.21.15.70:0/2228554272 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8009820 con 0x7f3bac0b2160 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3ba2ffd640 1 -- 172.21.15.70:0/2228554272 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8009bd0 con 0x7f3bac0b2160 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac15dee0 con 0x7f3bac0b2160 2023-11-26T07:23:12.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.235+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac15e4a0 con 0x7f3bac0b2160 2023-11-26T07:23:12.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.239+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac0d0d50 con 0x7f3bac0b2160 2023-11-26T07:23:12.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.239+0000 7f3ba2ffd640 1 -- 172.21.15.70:0/2228554272 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f3ba8009d30 con 0x7f3bac0b2160 2023-11-26T07:23:12.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.239+0000 7f3ba2ffd640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b90066ce0 0x7f3b900691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.239 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.239+0000 7f3ba2ffd640 1 -- 172.21.15.70:0/2228554272 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ba8083090 con 0x7f3bac0b2160 2023-11-26T07:23:12.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.239+0000 7f3bb1cb8640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b90066ce0 0x7f3b900691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.239+0000 7f3bb1cb8640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b90066ce0 0x7f3b900691a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3bac159450 tx=0x7f3b9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.243+0000 7f3ba2ffd640 1 -- 172.21.15.70:0/2228554272 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ba8051d90 con 0x7f3bac0b2160 2023-11-26T07:23:12.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bac15edd0 con 0x7f3bac0b2160 2023-11-26T07:23:12.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3ba2ffd640 1 -- 172.21.15.70:0/2228554272 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f3ba80553b0 con 0x7f3bac0b2160 2023-11-26T07:23:12.423 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:12.423 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/162502503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":162502503},{"type":"v1","addr":"172.21.15.120:6835","nonce":162502503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3659422844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3659422844},{"type":"v1","addr":"172.21.15.70:6835","nonce":3659422844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2807806185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2807806185},{"type":"v1","addr":"172.21.15.70:6837","nonce":2807806185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:08.403306+0000","modified":"2023-11-26T07:23:11.434465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6834/2083039818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2083039818},{"type":"v1","addr":"172.21.15.120:6834","nonce":2083039818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:23:12.424 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 47 2023-11-26T07:23:12.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b90066ce0 msgr2=0x7f3b900691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b90066ce0 0x7f3b900691a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3bac159450 tx=0x7f3b9c009040 comp rx=0 tx=0).stop 2023-11-26T07:23:12.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0b2160 msgr2=0x7f3bac155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0b2160 0x7f3bac155760 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800d800 tx=0x7f3ba800dcc0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 shutdown_connections 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3bac15d6e0 0x7f3bac0cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3bac0d1bc0 0x7f3bac0cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3b90066ce0 0x7f3b900691a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 --2- 172.21.15.70:0/2228554272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bac0b2160 0x7f3bac155760 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 >> 172.21.15.70:0/2228554272 conn(0x7f3bac09c550 msgr2=0x7f3bac0b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 shutdown_connections 2023-11-26T07:23:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.423+0000 7f3bb471d640 1 -- 172.21.15.70:0/2228554272 wait complete. 2023-11-26T07:23:12.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:12.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaeb59e640 1 Processor -- start 2023-11-26T07:23:12.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaeb59e640 1 -- start start 2023-11-26T07:23:12.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaeb59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbaec144720 0x7fbaec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaeb59e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec06e3f0 con 0x7fbaec06d840 2023-11-26T07:23:12.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaeb59e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec0722f0 con 0x7fbaec071bf0 2023-11-26T07:23:12.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaeb59e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec06de30 con 0x7fbaec144720 2023-11-26T07:23:12.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbaec06d840 0x7fbaec0714e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42952/0 (socket says 172.21.15.70:42952) 2023-11-26T07:23:12.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 -- 172.21.15.70:0/446933587 learned_addr learned my addr 172.21.15.70:0/446933587 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:12.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaea59c640 1 --2- 172.21.15.70:0/446933587 >> v2:172.21.15.120:3300/0 conn(0x7fbaec144720 0x7fbaec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828680222 0 0) 0x7fbaec06e3f0 con 0x7fbaec06d840 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad4003530 con 0x7fbaec06d840 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076792707 0 0) 0x7fbad4003530 con 0x7fbaec06d840 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 >> v2:172.21.15.120:3300/0 conn(0x7fbaec144720 msgr2=0x7fbaec06d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 --2- 172.21.15.70:0/446933587 >> v2:172.21.15.120:3300/0 conn(0x7fbaec144720 0x7fbaec06d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 >> v1:172.21.15.120:6789/0 conn(0x7fbaec071bf0 legacy=0x7fbaec15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec06e110 con 0x7fbaec06d840 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fbae0001680 con 0x7fbaec06d840 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 >> v1:172.21.15.70:6789/0 conn(0x7fbaec06d840 legacy=0x7fbaec0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbad4003980 0x7fbad4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbad40047d0 0x7fbad4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad4005190 0x7fbad400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec06de30 con 0x7fbad40047d0 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad400c030 con 0x7fbad4003980 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad400c1f0 con 0x7fbad4005190 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbad40047d0 0x7fbad4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaea59c640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbad4003980 0x7fbad4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaead9d640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad4005190 0x7fbad400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 -- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad4005190 msgr2=0x7fbad400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad4005190 0x7fbad400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 -- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbad4003980 msgr2=0x7fbad4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbad4003980 0x7fbad4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbae9d9b640 1 -- 172.21.15.70:0/446933587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4003530 con 0x7fbad40047d0 2023-11-26T07:23:12.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaead9d640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad4005190 0x7fbad400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:12.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.583+0000 7fbaead9d640 1 -- 172.21.15.70:0/446933587 reap_dead start 2023-11-26T07:23:12.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbae9d9b640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbad40047d0 0x7fbad4004c50 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c240 tx=0x7fbae001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00a4fa189be6121 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0005ae0 con 0x7fbad40047d0 2023-11-26T07:23:12.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae00ab070 con 0x7fbad40047d0 2023-11-26T07:23:12.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbae959a640 1 -- 172.21.15.70:0/446933587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0007070 con 0x7fbad40047d0 2023-11-26T07:23:12.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbaeb59e640 1 -- 172.21.15.70:0/446933587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbad40047d0 msgr2=0x7fbad4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbad40047d0 0x7fbad4004c50 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c240 tx=0x7fbae001f3b0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbaeb59e640 1 -- 172.21.15.70:0/446933587 shutdown_connections 2023-11-26T07:23:12.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/446933587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbad40047d0 0x7fbad4004c50 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbaeb59e640 1 -- 172.21.15.70:0/446933587 >> 172.21.15.70:0/446933587 conn(0x7fbaec06a890 msgr2=0x7fbaec06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:12.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbaeb59e640 1 -- 172.21.15.70:0/446933587 shutdown_connections 2023-11-26T07:23:12.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.587+0000 7fbaeb59e640 1 -- 172.21.15.70:0/446933587 wait complete. 2023-11-26T07:23:12.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 Processor -- start 2023-11-26T07:23:12.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 -- start start 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad40047d0 0x7fbaec14b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbaec0a85f0 0x7fbaec138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbaec14cad0 0x7fbaec14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec14b800 con 0x7fbaec14cad0 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec14c640 con 0x7fbaec0a85f0 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec1386c0 con 0x7fbad40047d0 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbaec14cad0 0x7fbaec14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbaec14cad0 0x7fbaec14d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50760/0 (socket says 172.21.15.70:50760) 2023-11-26T07:23:12.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 -- 172.21.15.70:0/1012076799 learned_addr learned my addr 172.21.15.70:0/1012076799 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:12.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 -- 172.21.15.70:0/1012076799 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad40047d0 msgr2=0x7fbaec14b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad40047d0 0x7fbaec14b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 -- 172.21.15.70:0/1012076799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbaec0a85f0 msgr2=0x7fbaec138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbaec0a85f0 0x7fbaec138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 -- 172.21.15.70:0/1012076799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec13b660 con 0x7fbaec14cad0 2023-11-26T07:23:12.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaead9d640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbaec14cad0 0x7fbaec14d350 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0701c0 tx=0x7fbae400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbadaffd640 1 -- 172.21.15.70:0/1012076799 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400eed0 con 0x7fbaec14cad0 2023-11-26T07:23:12.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbadaffd640 1 -- 172.21.15.70:0/1012076799 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4003980 con 0x7fbaec14cad0 2023-11-26T07:23:12.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec14ba30 con 0x7fbaec14cad0 2023-11-26T07:23:12.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbadaffd640 1 -- 172.21.15.70:0/1012076799 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4003d30 con 0x7fbaec14cad0 2023-11-26T07:23:12.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.591+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec14bff0 con 0x7fbaec14cad0 2023-11-26T07:23:12.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.595+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec067500 con 0x7fbaec14cad0 2023-11-26T07:23:12.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.595+0000 7fbadaffd640 1 -- 172.21.15.70:0/1012076799 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fbae40050d0 con 0x7fbaec14cad0 2023-11-26T07:23:12.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.595+0000 7fbadaffd640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbacc066ce0 0x7fbacc0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.595+0000 7fbadaffd640 1 -- 172.21.15.70:0/1012076799 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbae4082400 con 0x7fbaec14cad0 2023-11-26T07:23:12.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.595+0000 7fbaea59c640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbacc066ce0 0x7fbacc0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.595+0000 7fbaea59c640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbacc066ce0 0x7fbacc0691a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbadc006e90 tx=0x7fbadc006e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.599 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.599+0000 7fbadaffd640 1 -- 172.21.15.70:0/1012076799 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbae40510d0 con 0x7fbaec14cad0 2023-11-26T07:23:12.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.751+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaec06cdc0 con 0x7fbaec14cad0 2023-11-26T07:23:12.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.751+0000 7fbadaffd640 1 -- 172.21.15.70:0/1012076799 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16568 (secure 0 0 0) 0x7fbae40546f0 con 0x7fbaec14cad0 2023-11-26T07:23:12.752 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:12.753 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":78,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:09.840932+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:12.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbacc066ce0 msgr2=0x7fbacc0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbacc066ce0 0x7fbacc0691a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbadc006e90 tx=0x7fbadc006e00 comp rx=0 tx=0).stop 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbaec14cad0 msgr2=0x7fbaec14d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbaec14cad0 0x7fbaec14d350 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0701c0 tx=0x7fbae400eb90 comp rx=0 tx=0).stop 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 shutdown_connections 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbacc066ce0 0x7fbacc0691a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbaec14cad0 0x7fbaec14d350 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbaec0a85f0 0x7fbaec138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 --2- 172.21.15.70:0/1012076799 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbad40047d0 0x7fbaec14b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 >> 172.21.15.70:0/1012076799 conn(0x7fbaec06a890 msgr2=0x7fbaec1439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:12.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 shutdown_connections 2023-11-26T07:23:12.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.755+0000 7fbaeb59e640 1 -- 172.21.15.70:0/1012076799 wait complete. 2023-11-26T07:23:12.773 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-26T07:23:12.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:23:12.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd42aa68640 1 Processor -- start 2023-11-26T07:23:12.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd42aa68640 1 -- start start 2023-11-26T07:23:12.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd42aa68640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd4240cf280 0x7fd4240cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd42aa68640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4240cc730 con 0x7fd4240cd1b0 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd42aa68640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd424070ee0 con 0x7fd424143ac0 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd42aa68640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd424143ea0 con 0x7fd4240cf280 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd41bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd4240cf280 0x7fd4240cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd429005640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd4240cd1b0 0x7fd4240cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42968/0 (socket says 172.21.15.70:42968) 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd41bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd4240cf280 0x7fd4240cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50778/0 (socket says 172.21.15.70:50778) 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd429005640 1 -- 172.21.15.70:0/2580112354 learned_addr learned my addr 172.21.15.70:0/2580112354 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd41bfff640 1 -- 172.21.15.70:0/2580112354 >> v1:172.21.15.120:6789/0 conn(0x7fd424143ac0 legacy=0x7fd424070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd41bfff640 1 -- 172.21.15.70:0/2580112354 >> v1:172.21.15.70:6789/0 conn(0x7fd4240cd1b0 legacy=0x7fd4240cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.911+0000 7fd41bfff640 1 -- 172.21.15.70:0/2580112354 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240711c0 con 0x7fd4240cf280 2023-11-26T07:23:12.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd41bfff640 1 --2- 172.21.15.70:0/2580112354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cf280 0x7fd4240cf710 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd41400ba60 tx=0x7fd41401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80da436bef99cf49 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd41b7fe640 1 -- 172.21.15.70:0/2580112354 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a7b30 con 0x7fd4240cf280 2023-11-26T07:23:12.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd41b7fe640 1 -- 172.21.15.70:0/2580112354 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140a7c90 con 0x7fd4240cf280 2023-11-26T07:23:12.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd41b7fe640 1 -- 172.21.15.70:0/2580112354 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140af440 con 0x7fd4240cf280 2023-11-26T07:23:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd42aa68640 1 -- 172.21.15.70:0/2580112354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cf280 msgr2=0x7fd4240cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd42aa68640 1 --2- 172.21.15.70:0/2580112354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cf280 0x7fd4240cf710 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd41400ba60 tx=0x7fd41401eb50 comp rx=0 tx=0).stop 2023-11-26T07:23:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd42aa68640 1 -- 172.21.15.70:0/2580112354 shutdown_connections 2023-11-26T07:23:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd42aa68640 1 --2- 172.21.15.70:0/2580112354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cf280 0x7fd4240cf710 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd42aa68640 1 -- 172.21.15.70:0/2580112354 >> 172.21.15.70:0/2580112354 conn(0x7fd42406a890 msgr2=0x7fd42406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd42aa68640 1 -- 172.21.15.70:0/2580112354 shutdown_connections 2023-11-26T07:23:12.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.915+0000 7fd42aa68640 1 -- 172.21.15.70:0/2580112354 wait complete. 2023-11-26T07:23:12.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 Processor -- start 2023-11-26T07:23:12.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 -- start start 2023-11-26T07:23:12.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cd1b0 0x7fd42413ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4240cf280 0x7fd42415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd424143ac0 0x7fd42415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42415b410 con 0x7fd4240cd1b0 2023-11-26T07:23:12.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42415b130 con 0x7fd424143ac0 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240af600 con 0x7fd4240cf280 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cd1b0 0x7fd42413ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cd1b0 0x7fd42413ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50780/0 (socket says 172.21.15.70:50780) 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 -- 172.21.15.70:0/546144553 learned_addr learned my addr 172.21.15.70:0/546144553 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd429005640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd424143ac0 0x7fd42415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd41bfff640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4240cf280 0x7fd42415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 -- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4240cf280 msgr2=0x7fd42415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4240cf280 0x7fd42415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 -- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd424143ac0 msgr2=0x7fd42415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd424143ac0 0x7fd42415ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:12.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 -- 172.21.15.70:0/546144553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41400b6c0 con 0x7fd4240cd1b0 2023-11-26T07:23:12.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd428804640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cd1b0 0x7fd42413ff50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c3c0 tx=0x7fd42000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd4197fa640 1 -- 172.21.15.70:0/546144553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200052d0 con 0x7fd4240cd1b0 2023-11-26T07:23:12.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd4197fa640 1 -- 172.21.15.70:0/546144553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420005430 con 0x7fd4240cd1b0 2023-11-26T07:23:12.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd4197fa640 1 -- 172.21.15.70:0/546144553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420003840 con 0x7fd4240cd1b0 2023-11-26T07:23:12.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4240af8e0 con 0x7fd4240cd1b0 2023-11-26T07:23:12.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.919+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42413cfa0 con 0x7fd4240cd1b0 2023-11-26T07:23:12.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.923+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42406c4a0 con 0x7fd4240cd1b0 2023-11-26T07:23:12.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.923+0000 7fd4197fa640 1 -- 172.21.15.70:0/546144553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd4200039a0 con 0x7fd4240cd1b0 2023-11-26T07:23:12.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.923+0000 7fd4197fa640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd410066ce0 0x7fd4100691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:12.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.923+0000 7fd4197fa640 1 -- 172.21.15.70:0/546144553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd420081da0 con 0x7fd4240cd1b0 2023-11-26T07:23:12.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.923+0000 7fd41bfff640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd410066ce0 0x7fd4100691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:12.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.923+0000 7fd41bfff640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd410066ce0 0x7fd4100691a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd4140b1000 tx=0x7fd4140a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:12.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:12.927+0000 7fd4197fa640 1 -- 172.21.15.70:0/546144553 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd420050b50 con 0x7fd4240cd1b0 2023-11-26T07:23:13.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.075+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd424067680 con 0x7fd410066ce0 2023-11-26T07:23:13.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.083+0000 7fd4197fa640 1 -- 172.21.15.70:0/546144553 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289536 (secure 0 0 0) 0x7fd424067680 con 0x7fd410066ce0 2023-11-26T07:23:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd410066ce0 msgr2=0x7fd4100691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd410066ce0 0x7fd4100691a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd4140b1000 tx=0x7fd4140a9070 comp rx=0 tx=0).stop 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cd1b0 msgr2=0x7fd42413ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cd1b0 0x7fd42413ff50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd42000c3c0 tx=0x7fd42000c880 comp rx=0 tx=0).stop 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 shutdown_connections 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd424143ac0 0x7fd42415ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd4240cf280 0x7fd42415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd410066ce0 0x7fd4100691a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 --2- 172.21.15.70:0/546144553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4240cd1b0 0x7fd42413ff50 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 >> 172.21.15.70:0/546144553 conn(0x7fd42406a890 msgr2=0x7fd4240b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 shutdown_connections 2023-11-26T07:23:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.087+0000 7fd42aa68640 1 -- 172.21.15.70:0/546144553 wait complete. 2023-11-26T07:23:13.107 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-11-26T07:23:12.056826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270568,"kb_used_data":8612,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754704152,"statfs":{"total":773094113280,"available":772817051648,"internally_reserved":0,"allocated":8818688,"data_stored":4415496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":268095025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.036815"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336254+0000","last_change":"2023-11-26T07:23:08.874625+0000","last_active":"2023-11-26T07:23:10.336254+0000","last_peered":"2023-11-26T07:23:10.336254+0000","last_clean":"2023-11-26T07:23:10.336254+0000","last_became_active":"2023-11-26T07:23:08.874274+0000","last_became_peered":"2023-11-26T07:23:08.874274+0000","last_unstale":"2023-11-26T07:23:10.336254+0000","last_undegraded":"2023-11-26T07:23:10.336254+0000","last_fullsized":"2023-11-26T07:23:10.336254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:15:22.389018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337929+0000","last_change":"2023-11-26T07:23:08.865811+0000","last_active":"2023-11-26T07:23:10.337929+0000","last_peered":"2023-11-26T07:23:10.337929+0000","last_clean":"2023-11-26T07:23:10.337929+0000","last_became_active":"2023-11-26T07:23:08.865538+0000","last_became_peered":"2023-11-26T07:23:08.865538+0000","last_unstale":"2023-11-26T07:23:10.337929+0000","last_undegraded":"2023-11-26T07:23:10.337929+0000","last_fullsized":"2023-11-26T07:23:10.337929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:41.385660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336439+0000","last_change":"2023-11-26T07:23:08.856264+0000","last_active":"2023-11-26T07:23:10.336439+0000","last_peered":"2023-11-26T07:23:10.336439+0000","last_clean":"2023-11-26T07:23:10.336439+0000","last_became_active":"2023-11-26T07:23:08.855995+0000","last_became_peered":"2023-11-26T07:23:08.855995+0000","last_unstale":"2023-11-26T07:23:10.336439+0000","last_undegraded":"2023-11-26T07:23:10.336439+0000","last_fullsized":"2023-11-26T07:23:10.336439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:00:24.194012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847064+0000","last_change":"2023-11-26T07:23:08.863117+0000","last_active":"2023-11-26T07:23:09.847064+0000","last_peered":"2023-11-26T07:23:09.847064+0000","last_clean":"2023-11-26T07:23:09.847064+0000","last_became_active":"2023-11-26T07:23:08.862853+0000","last_became_peered":"2023-11-26T07:23:08.862853+0000","last_unstale":"2023-11-26T07:23:09.847064+0000","last_undegraded":"2023-11-26T07:23:09.847064+0000","last_fullsized":"2023-11-26T07:23:09.847064+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:07:36.771875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845847+0000","last_change":"2023-11-26T07:23:08.872963+0000","last_active":"2023-11-26T07:23:09.845847+0000","last_peered":"2023-11-26T07:23:09.845847+0000","last_clean":"2023-11-26T07:23:09.845847+0000","last_became_active":"2023-11-26T07:23:08.872468+0000","last_became_peered":"2023-11-26T07:23:08.872468+0000","last_unstale":"2023-11-26T07:23:09.845847+0000","last_undegraded":"2023-11-26T07:23:09.845847+0000","last_fullsized":"2023-11-26T07:23:09.845847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:24:22.198121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337183+0000","last_change":"2023-11-26T07:23:08.855728+0000","last_active":"2023-11-26T07:23:10.337183+0000","last_peered":"2023-11-26T07:23:10.337183+0000","last_clean":"2023-11-26T07:23:10.337183+0000","last_became_active":"2023-11-26T07:23:08.855415+0000","last_became_peered":"2023-11-26T07:23:08.855415+0000","last_unstale":"2023-11-26T07:23:10.337183+0000","last_undegraded":"2023-11-26T07:23:10.337183+0000","last_fullsized":"2023-11-26T07:23:10.337183+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:57:47.963617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846225+0000","last_change":"2023-11-26T07:23:08.860515+0000","last_active":"2023-11-26T07:23:09.846225+0000","last_peered":"2023-11-26T07:23:09.846225+0000","last_clean":"2023-11-26T07:23:09.846225+0000","last_became_active":"2023-11-26T07:23:08.859286+0000","last_became_peered":"2023-11-26T07:23:08.859286+0000","last_unstale":"2023-11-26T07:23:09.846225+0000","last_undegraded":"2023-11-26T07:23:09.846225+0000","last_fullsized":"2023-11-26T07:23:09.846225+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:29.774356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336345+0000","last_change":"2023-11-26T07:23:08.860341+0000","last_active":"2023-11-26T07:23:10.336345+0000","last_peered":"2023-11-26T07:23:10.336345+0000","last_clean":"2023-11-26T07:23:10.336345+0000","last_became_active":"2023-11-26T07:23:08.860044+0000","last_became_peered":"2023-11-26T07:23:08.860044+0000","last_unstale":"2023-11-26T07:23:10.336345+0000","last_undegraded":"2023-11-26T07:23:10.336345+0000","last_fullsized":"2023-11-26T07:23:10.336345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:34:04.528252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846314+0000","last_change":"2023-11-26T07:23:08.863108+0000","last_active":"2023-11-26T07:23:09.846314+0000","last_peered":"2023-11-26T07:23:09.846314+0000","last_clean":"2023-11-26T07:23:09.846314+0000","last_became_active":"2023-11-26T07:23:08.862579+0000","last_became_peered":"2023-11-26T07:23:08.862579+0000","last_unstale":"2023-11-26T07:23:09.846314+0000","last_undegraded":"2023-11-26T07:23:09.846314+0000","last_fullsized":"2023-11-26T07:23:09.846314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:17:50.051981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337033+0000","last_change":"2023-11-26T07:23:08.868342+0000","last_active":"2023-11-26T07:23:10.337033+0000","last_peered":"2023-11-26T07:23:10.337033+0000","last_clean":"2023-11-26T07:23:10.337033+0000","last_became_active":"2023-11-26T07:23:08.868072+0000","last_became_peered":"2023-11-26T07:23:08.868072+0000","last_unstale":"2023-11-26T07:23:10.337033+0000","last_undegraded":"2023-11-26T07:23:10.337033+0000","last_fullsized":"2023-11-26T07:23:10.337033+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:23:19.259798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336172+0000","last_change":"2023-11-26T07:23:08.874146+0000","last_active":"2023-11-26T07:23:10.336172+0000","last_peered":"2023-11-26T07:23:10.336172+0000","last_clean":"2023-11-26T07:23:10.336172+0000","last_became_active":"2023-11-26T07:23:08.873807+0000","last_became_peered":"2023-11-26T07:23:08.873807+0000","last_unstale":"2023-11-26T07:23:10.336172+0000","last_undegraded":"2023-11-26T07:23:10.336172+0000","last_fullsized":"2023-11-26T07:23:10.336172+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:15:01.879474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847089+0000","last_change":"2023-11-26T07:23:08.868391+0000","last_active":"2023-11-26T07:23:09.847089+0000","last_peered":"2023-11-26T07:23:09.847089+0000","last_clean":"2023-11-26T07:23:09.847089+0000","last_became_active":"2023-11-26T07:23:08.868104+0000","last_became_peered":"2023-11-26T07:23:08.868104+0000","last_unstale":"2023-11-26T07:23:09.847089+0000","last_undegraded":"2023-11-26T07:23:09.847089+0000","last_fullsized":"2023-11-26T07:23:09.847089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:20.134759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336307+0000","last_change":"2023-11-26T07:23:08.859937+0000","last_active":"2023-11-26T07:23:10.336307+0000","last_peered":"2023-11-26T07:23:10.336307+0000","last_clean":"2023-11-26T07:23:10.336307+0000","last_became_active":"2023-11-26T07:23:08.859557+0000","last_became_peered":"2023-11-26T07:23:08.859557+0000","last_unstale":"2023-11-26T07:23:10.336307+0000","last_undegraded":"2023-11-26T07:23:10.336307+0000","last_fullsized":"2023-11-26T07:23:10.336307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:59.899852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845853+0000","last_change":"2023-11-26T07:23:08.854537+0000","last_active":"2023-11-26T07:23:09.845853+0000","last_peered":"2023-11-26T07:23:09.845853+0000","last_clean":"2023-11-26T07:23:09.845853+0000","last_became_active":"2023-11-26T07:23:08.853883+0000","last_became_peered":"2023-11-26T07:23:08.853883+0000","last_unstale":"2023-11-26T07:23:09.845853+0000","last_undegraded":"2023-11-26T07:23:09.845853+0000","last_fullsized":"2023-11-26T07:23:09.845853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:45:02.701493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335979+0000","last_change":"2023-11-26T07:23:08.858988+0000","last_active":"2023-11-26T07:23:10.335979+0000","last_peered":"2023-11-26T07:23:10.335979+0000","last_clean":"2023-11-26T07:23:10.335979+0000","last_became_active":"2023-11-26T07:23:08.858675+0000","last_became_peered":"2023-11-26T07:23:08.858675+0000","last_unstale":"2023-11-26T07:23:10.335979+0000","last_undegraded":"2023-11-26T07:23:10.335979+0000","last_fullsized":"2023-11-26T07:23:10.335979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:57:22.295755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335964+0000","last_change":"2023-11-26T07:23:08.866077+0000","last_active":"2023-11-26T07:23:10.335964+0000","last_peered":"2023-11-26T07:23:10.335964+0000","last_clean":"2023-11-26T07:23:10.335964+0000","last_became_active":"2023-11-26T07:23:08.865797+0000","last_became_peered":"2023-11-26T07:23:08.865797+0000","last_unstale":"2023-11-26T07:23:10.335964+0000","last_undegraded":"2023-11-26T07:23:10.335964+0000","last_fullsized":"2023-11-26T07:23:10.335964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:57:47.963617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846311+0000","last_change":"2023-11-26T07:23:08.862890+0000","last_active":"2023-11-26T07:23:09.846311+0000","last_peered":"2023-11-26T07:23:09.846311+0000","last_clean":"2023-11-26T07:23:09.846311+0000","last_became_active":"2023-11-26T07:23:08.862104+0000","last_became_peered":"2023-11-26T07:23:08.862104+0000","last_unstale":"2023-11-26T07:23:09.846311+0000","last_undegraded":"2023-11-26T07:23:09.846311+0000","last_fullsized":"2023-11-26T07:23:09.846311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:49:00.812263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847139+0000","last_change":"2023-11-26T07:23:08.865981+0000","last_active":"2023-11-26T07:23:09.847139+0000","last_peered":"2023-11-26T07:23:09.847139+0000","last_clean":"2023-11-26T07:23:09.847139+0000","last_became_active":"2023-11-26T07:23:08.865527+0000","last_became_peered":"2023-11-26T07:23:08.865527+0000","last_unstale":"2023-11-26T07:23:09.847139+0000","last_undegraded":"2023-11-26T07:23:09.847139+0000","last_fullsized":"2023-11-26T07:23:09.847139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:17:09.003109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337753+0000","last_change":"2023-11-26T07:23:08.860195+0000","last_active":"2023-11-26T07:23:10.337753+0000","last_peered":"2023-11-26T07:23:10.337753+0000","last_clean":"2023-11-26T07:23:10.337753+0000","last_became_active":"2023-11-26T07:23:08.859819+0000","last_became_peered":"2023-11-26T07:23:08.859819+0000","last_unstale":"2023-11-26T07:23:10.337753+0000","last_undegraded":"2023-11-26T07:23:10.337753+0000","last_fullsized":"2023-11-26T07:23:10.337753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:40.756665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336636+0000","last_change":"2023-11-26T07:23:08.857619+0000","last_active":"2023-11-26T07:23:10.336636+0000","last_peered":"2023-11-26T07:23:10.336636+0000","last_clean":"2023-11-26T07:23:10.336636+0000","last_became_active":"2023-11-26T07:23:08.857366+0000","last_became_peered":"2023-11-26T07:23:08.857366+0000","last_unstale":"2023-11-26T07:23:10.336636+0000","last_undegraded":"2023-11-26T07:23:10.336636+0000","last_fullsized":"2023-11-26T07:23:10.336636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:14.839371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336600+0000","last_change":"2023-11-26T07:23:08.863644+0000","last_active":"2023-11-26T07:23:10.336600+0000","last_peered":"2023-11-26T07:23:10.336600+0000","last_clean":"2023-11-26T07:23:10.336600+0000","last_became_active":"2023-11-26T07:23:08.863111+0000","last_became_peered":"2023-11-26T07:23:08.863111+0000","last_unstale":"2023-11-26T07:23:10.336600+0000","last_undegraded":"2023-11-26T07:23:10.336600+0000","last_fullsized":"2023-11-26T07:23:10.336600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:50.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336495+0000","last_change":"2023-11-26T07:23:08.863793+0000","last_active":"2023-11-26T07:23:10.336495+0000","last_peered":"2023-11-26T07:23:10.336495+0000","last_clean":"2023-11-26T07:23:10.336495+0000","last_became_active":"2023-11-26T07:23:08.863483+0000","last_became_peered":"2023-11-26T07:23:08.863483+0000","last_unstale":"2023-11-26T07:23:10.336495+0000","last_undegraded":"2023-11-26T07:23:10.336495+0000","last_fullsized":"2023-11-26T07:23:10.336495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:46.670976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335674+0000","last_change":"2023-11-26T07:23:08.873969+0000","last_active":"2023-11-26T07:23:10.335674+0000","last_peered":"2023-11-26T07:23:10.335674+0000","last_clean":"2023-11-26T07:23:10.335674+0000","last_became_active":"2023-11-26T07:23:08.873637+0000","last_became_peered":"2023-11-26T07:23:08.873637+0000","last_unstale":"2023-11-26T07:23:10.335674+0000","last_undegraded":"2023-11-26T07:23:10.335674+0000","last_fullsized":"2023-11-26T07:23:10.335674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:14.839371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335548+0000","last_change":"2023-11-26T07:23:08.874246+0000","last_active":"2023-11-26T07:23:10.335548+0000","last_peered":"2023-11-26T07:23:10.335548+0000","last_clean":"2023-11-26T07:23:10.335548+0000","last_became_active":"2023-11-26T07:23:08.873452+0000","last_became_peered":"2023-11-26T07:23:08.873452+0000","last_unstale":"2023-11-26T07:23:10.335548+0000","last_undegraded":"2023-11-26T07:23:10.335548+0000","last_fullsized":"2023-11-26T07:23:10.335548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:35:34.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336659+0000","last_change":"2023-11-26T07:23:08.872477+0000","last_active":"2023-11-26T07:23:10.336659+0000","last_peered":"2023-11-26T07:23:10.336659+0000","last_clean":"2023-11-26T07:23:10.336659+0000","last_became_active":"2023-11-26T07:23:08.872159+0000","last_became_peered":"2023-11-26T07:23:08.872159+0000","last_unstale":"2023-11-26T07:23:10.336659+0000","last_undegraded":"2023-11-26T07:23:10.336659+0000","last_fullsized":"2023-11-26T07:23:10.336659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:40.756665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846816+0000","last_change":"2023-11-26T07:23:08.861412+0000","last_active":"2023-11-26T07:23:09.846816+0000","last_peered":"2023-11-26T07:23:09.846816+0000","last_clean":"2023-11-26T07:23:09.846816+0000","last_became_active":"2023-11-26T07:23:08.860985+0000","last_became_peered":"2023-11-26T07:23:08.860985+0000","last_unstale":"2023-11-26T07:23:09.846816+0000","last_undegraded":"2023-11-26T07:23:09.846816+0000","last_fullsized":"2023-11-26T07:23:09.846816+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:31.147191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336507+0000","last_change":"2023-11-26T07:23:08.872619+0000","last_active":"2023-11-26T07:23:10.336507+0000","last_peered":"2023-11-26T07:23:10.336507+0000","last_clean":"2023-11-26T07:23:10.336507+0000","last_became_active":"2023-11-26T07:23:08.872275+0000","last_became_peered":"2023-11-26T07:23:08.872275+0000","last_unstale":"2023-11-26T07:23:10.336507+0000","last_undegraded":"2023-11-26T07:23:10.336507+0000","last_fullsized":"2023-11-26T07:23:10.336507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:52:38.534307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337030+0000","last_change":"2023-11-26T07:23:08.867962+0000","last_active":"2023-11-26T07:23:10.337030+0000","last_peered":"2023-11-26T07:23:10.337030+0000","last_clean":"2023-11-26T07:23:10.337030+0000","last_became_active":"2023-11-26T07:23:08.867664+0000","last_became_peered":"2023-11-26T07:23:08.867664+0000","last_unstale":"2023-11-26T07:23:10.337030+0000","last_undegraded":"2023-11-26T07:23:10.337030+0000","last_fullsized":"2023-11-26T07:23:10.337030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:41.385660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336429+0000","last_change":"2023-11-26T07:23:08.862911+0000","last_active":"2023-11-26T07:23:10.336429+0000","last_peered":"2023-11-26T07:23:10.336429+0000","last_clean":"2023-11-26T07:23:10.336429+0000","last_became_active":"2023-11-26T07:23:08.859353+0000","last_became_peered":"2023-11-26T07:23:08.859353+0000","last_unstale":"2023-11-26T07:23:10.336429+0000","last_undegraded":"2023-11-26T07:23:10.336429+0000","last_fullsized":"2023-11-26T07:23:10.336429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:36.109534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846285+0000","last_change":"2023-11-26T07:23:08.861318+0000","last_active":"2023-11-26T07:23:09.846285+0000","last_peered":"2023-11-26T07:23:09.846285+0000","last_clean":"2023-11-26T07:23:09.846285+0000","last_became_active":"2023-11-26T07:23:08.861011+0000","last_became_peered":"2023-11-26T07:23:08.861011+0000","last_unstale":"2023-11-26T07:23:09.846285+0000","last_undegraded":"2023-11-26T07:23:09.846285+0000","last_fullsized":"2023-11-26T07:23:09.846285+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:40:21.215492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846419+0000","last_change":"2023-11-26T07:23:08.850768+0000","last_active":"2023-11-26T07:23:09.846419+0000","last_peered":"2023-11-26T07:23:09.846419+0000","last_clean":"2023-11-26T07:23:09.846419+0000","last_became_active":"2023-11-26T07:23:08.850467+0000","last_became_peered":"2023-11-26T07:23:08.850467+0000","last_unstale":"2023-11-26T07:23:09.846419+0000","last_undegraded":"2023-11-26T07:23:09.846419+0000","last_fullsized":"2023-11-26T07:23:09.846419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:37.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336475+0000","last_change":"2023-11-26T07:23:08.855440+0000","last_active":"2023-11-26T07:23:10.336475+0000","last_peered":"2023-11-26T07:23:10.336475+0000","last_clean":"2023-11-26T07:23:10.336475+0000","last_became_active":"2023-11-26T07:23:08.855068+0000","last_became_peered":"2023-11-26T07:23:08.855068+0000","last_unstale":"2023-11-26T07:23:10.336475+0000","last_undegraded":"2023-11-26T07:23:10.336475+0000","last_fullsized":"2023-11-26T07:23:10.336475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:47:11.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336127+0000","last_change":"2023-11-26T07:23:08.877141+0000","last_active":"2023-11-26T07:23:10.336127+0000","last_peered":"2023-11-26T07:23:10.336127+0000","last_clean":"2023-11-26T07:23:10.336127+0000","last_became_active":"2023-11-26T07:23:08.876865+0000","last_became_peered":"2023-11-26T07:23:08.876865+0000","last_unstale":"2023-11-26T07:23:10.336127+0000","last_undegraded":"2023-11-26T07:23:10.336127+0000","last_fullsized":"2023-11-26T07:23:10.336127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:46.429112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"77'4","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336635+0000","last_change":"2023-11-26T07:23:08.059422+0000","last_active":"2023-11-26T07:23:10.336635+0000","last_peered":"2023-11-26T07:23:10.336635+0000","last_clean":"2023-11-26T07:23:10.336635+0000","last_became_active":"2023-11-26T07:23:08.059154+0000","last_became_peered":"2023-11-26T07:23:08.059154+0000","last_unstale":"2023-11-26T07:23:10.336635+0000","last_undegraded":"2023-11-26T07:23:10.336635+0000","last_fullsized":"2023-11-26T07:23:10.336635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:30.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846417+0000","last_change":"2023-11-26T07:23:08.854281+0000","last_active":"2023-11-26T07:23:09.846417+0000","last_peered":"2023-11-26T07:23:09.846417+0000","last_clean":"2023-11-26T07:23:09.846417+0000","last_became_active":"2023-11-26T07:23:08.853994+0000","last_became_peered":"2023-11-26T07:23:08.853994+0000","last_unstale":"2023-11-26T07:23:09.846417+0000","last_undegraded":"2023-11-26T07:23:09.846417+0000","last_fullsized":"2023-11-26T07:23:09.846417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:02:58.806885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336708+0000","last_change":"2023-11-26T07:23:08.046492+0000","last_active":"2023-11-26T07:23:10.336708+0000","last_peered":"2023-11-26T07:23:10.336708+0000","last_clean":"2023-11-26T07:23:10.336708+0000","last_became_active":"2023-11-26T07:23:08.046230+0000","last_became_peered":"2023-11-26T07:23:08.046230+0000","last_unstale":"2023-11-26T07:23:10.336708+0000","last_undegraded":"2023-11-26T07:23:10.336708+0000","last_fullsized":"2023-11-26T07:23:10.336708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:35.999678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337623+0000","last_change":"2023-11-26T07:23:08.871562+0000","last_active":"2023-11-26T07:23:10.337623+0000","last_peered":"2023-11-26T07:23:10.337623+0000","last_clean":"2023-11-26T07:23:10.337623+0000","last_became_active":"2023-11-26T07:23:08.871289+0000","last_became_peered":"2023-11-26T07:23:08.871289+0000","last_unstale":"2023-11-26T07:23:10.337623+0000","last_undegraded":"2023-11-26T07:23:10.337623+0000","last_fullsized":"2023-11-26T07:23:10.337623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:50.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336885+0000","last_change":"2023-11-26T07:23:08.055229+0000","last_active":"2023-11-26T07:23:10.336885+0000","last_peered":"2023-11-26T07:23:10.336885+0000","last_clean":"2023-11-26T07:23:10.336885+0000","last_became_active":"2023-11-26T07:23:08.054927+0000","last_became_peered":"2023-11-26T07:23:08.054927+0000","last_unstale":"2023-11-26T07:23:10.336885+0000","last_undegraded":"2023-11-26T07:23:10.336885+0000","last_fullsized":"2023-11-26T07:23:10.336885+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:34:03.521921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336473+0000","last_change":"2023-11-26T07:23:08.875331+0000","last_active":"2023-11-26T07:23:10.336473+0000","last_peered":"2023-11-26T07:23:10.336473+0000","last_clean":"2023-11-26T07:23:10.336473+0000","last_became_active":"2023-11-26T07:23:08.874678+0000","last_became_peered":"2023-11-26T07:23:08.874678+0000","last_unstale":"2023-11-26T07:23:10.336473+0000","last_undegraded":"2023-11-26T07:23:10.336473+0000","last_fullsized":"2023-11-26T07:23:10.336473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:38:11.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337818+0000","last_change":"2023-11-26T07:23:08.046485+0000","last_active":"2023-11-26T07:23:10.337818+0000","last_peered":"2023-11-26T07:23:10.337818+0000","last_clean":"2023-11-26T07:23:10.337818+0000","last_became_active":"2023-11-26T07:23:08.041549+0000","last_became_peered":"2023-11-26T07:23:08.041549+0000","last_unstale":"2023-11-26T07:23:10.337818+0000","last_undegraded":"2023-11-26T07:23:10.337818+0000","last_fullsized":"2023-11-26T07:23:10.337818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:35:42.972810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846408+0000","last_change":"2023-11-26T07:23:08.863982+0000","last_active":"2023-11-26T07:23:09.846408+0000","last_peered":"2023-11-26T07:23:09.846408+0000","last_clean":"2023-11-26T07:23:09.846408+0000","last_became_active":"2023-11-26T07:23:08.863700+0000","last_became_peered":"2023-11-26T07:23:08.863700+0000","last_unstale":"2023-11-26T07:23:09.846408+0000","last_undegraded":"2023-11-26T07:23:09.846408+0000","last_fullsized":"2023-11-26T07:23:09.846408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:39:37.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336545+0000","last_change":"2023-11-26T07:23:08.053639+0000","last_active":"2023-11-26T07:23:10.336545+0000","last_peered":"2023-11-26T07:23:10.336545+0000","last_clean":"2023-11-26T07:23:10.336545+0000","last_became_active":"2023-11-26T07:23:08.053259+0000","last_became_peered":"2023-11-26T07:23:08.053259+0000","last_unstale":"2023-11-26T07:23:10.336545+0000","last_undegraded":"2023-11-26T07:23:10.336545+0000","last_fullsized":"2023-11-26T07:23:10.336545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:38:54.264621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336750+0000","last_change":"2023-11-26T07:23:08.872355+0000","last_active":"2023-11-26T07:23:10.336750+0000","last_peered":"2023-11-26T07:23:10.336750+0000","last_clean":"2023-11-26T07:23:10.336750+0000","last_became_active":"2023-11-26T07:23:08.872050+0000","last_became_peered":"2023-11-26T07:23:08.872050+0000","last_unstale":"2023-11-26T07:23:10.336750+0000","last_undegraded":"2023-11-26T07:23:10.336750+0000","last_fullsized":"2023-11-26T07:23:10.336750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:28:28.703762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337332+0000","last_change":"2023-11-26T07:23:08.046477+0000","last_active":"2023-11-26T07:23:10.337332+0000","last_peered":"2023-11-26T07:23:10.337332+0000","last_clean":"2023-11-26T07:23:10.337332+0000","last_became_active":"2023-11-26T07:23:08.046171+0000","last_became_peered":"2023-11-26T07:23:08.046171+0000","last_unstale":"2023-11-26T07:23:10.337332+0000","last_undegraded":"2023-11-26T07:23:10.337332+0000","last_fullsized":"2023-11-26T07:23:10.337332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:50:19.030697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845456+0000","last_change":"2023-11-26T07:23:08.861738+0000","last_active":"2023-11-26T07:23:09.845456+0000","last_peered":"2023-11-26T07:23:09.845456+0000","last_clean":"2023-11-26T07:23:09.845456+0000","last_became_active":"2023-11-26T07:23:08.861442+0000","last_became_peered":"2023-11-26T07:23:08.861442+0000","last_unstale":"2023-11-26T07:23:09.845456+0000","last_undegraded":"2023-11-26T07:23:09.845456+0000","last_fullsized":"2023-11-26T07:23:09.845456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:57:24.236722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846916+0000","last_change":"2023-11-26T07:23:08.050800+0000","last_active":"2023-11-26T07:23:09.846916+0000","last_peered":"2023-11-26T07:23:09.846916+0000","last_clean":"2023-11-26T07:23:09.846916+0000","last_became_active":"2023-11-26T07:23:08.050200+0000","last_became_peered":"2023-11-26T07:23:08.050200+0000","last_unstale":"2023-11-26T07:23:09.846916+0000","last_undegraded":"2023-11-26T07:23:09.846916+0000","last_fullsized":"2023-11-26T07:23:09.846916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:43:14.829064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336098+0000","last_change":"2023-11-26T07:23:08.872385+0000","last_active":"2023-11-26T07:23:10.336098+0000","last_peered":"2023-11-26T07:23:10.336098+0000","last_clean":"2023-11-26T07:23:10.336098+0000","last_became_active":"2023-11-26T07:23:08.872110+0000","last_became_peered":"2023-11-26T07:23:08.872110+0000","last_unstale":"2023-11-26T07:23:10.336098+0000","last_undegraded":"2023-11-26T07:23:10.336098+0000","last_fullsized":"2023-11-26T07:23:10.336098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:04:13.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845443+0000","last_change":"2023-11-26T07:23:08.039896+0000","last_active":"2023-11-26T07:23:09.845443+0000","last_peered":"2023-11-26T07:23:09.845443+0000","last_clean":"2023-11-26T07:23:09.845443+0000","last_became_active":"2023-11-26T07:23:08.039643+0000","last_became_peered":"2023-11-26T07:23:08.039643+0000","last_unstale":"2023-11-26T07:23:09.845443+0000","last_undegraded":"2023-11-26T07:23:09.845443+0000","last_fullsized":"2023-11-26T07:23:09.845443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:58:45.070997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846924+0000","last_change":"2023-11-26T07:23:08.871656+0000","last_active":"2023-11-26T07:23:09.846924+0000","last_peered":"2023-11-26T07:23:09.846924+0000","last_clean":"2023-11-26T07:23:09.846924+0000","last_became_active":"2023-11-26T07:23:08.871360+0000","last_became_peered":"2023-11-26T07:23:08.871360+0000","last_unstale":"2023-11-26T07:23:09.846924+0000","last_undegraded":"2023-11-26T07:23:09.846924+0000","last_fullsized":"2023-11-26T07:23:09.846924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:04:13.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336759+0000","last_change":"2023-11-26T07:23:08.050809+0000","last_active":"2023-11-26T07:23:10.336759+0000","last_peered":"2023-11-26T07:23:10.336759+0000","last_clean":"2023-11-26T07:23:10.336759+0000","last_became_active":"2023-11-26T07:23:08.050200+0000","last_became_peered":"2023-11-26T07:23:08.050200+0000","last_unstale":"2023-11-26T07:23:10.336759+0000","last_undegraded":"2023-11-26T07:23:10.336759+0000","last_fullsized":"2023-11-26T07:23:10.336759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:54.103963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336398+0000","last_change":"2023-11-26T07:23:08.877709+0000","last_active":"2023-11-26T07:23:10.336398+0000","last_peered":"2023-11-26T07:23:10.336398+0000","last_clean":"2023-11-26T07:23:10.336398+0000","last_became_active":"2023-11-26T07:23:08.877415+0000","last_became_peered":"2023-11-26T07:23:08.877415+0000","last_unstale":"2023-11-26T07:23:10.336398+0000","last_undegraded":"2023-11-26T07:23:10.336398+0000","last_fullsized":"2023-11-26T07:23:10.336398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:22:41.469325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337945+0000","last_change":"2023-11-26T07:23:08.051992+0000","last_active":"2023-11-26T07:23:10.337945+0000","last_peered":"2023-11-26T07:23:10.337945+0000","last_clean":"2023-11-26T07:23:10.337945+0000","last_became_active":"2023-11-26T07:23:08.051712+0000","last_became_peered":"2023-11-26T07:23:08.051712+0000","last_unstale":"2023-11-26T07:23:10.337945+0000","last_undegraded":"2023-11-26T07:23:10.337945+0000","last_fullsized":"2023-11-26T07:23:10.337945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:59.421665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337823+0000","last_change":"2023-11-26T07:23:08.865463+0000","last_active":"2023-11-26T07:23:10.337823+0000","last_peered":"2023-11-26T07:23:10.337823+0000","last_clean":"2023-11-26T07:23:10.337823+0000","last_became_active":"2023-11-26T07:23:08.865172+0000","last_became_peered":"2023-11-26T07:23:08.865172+0000","last_unstale":"2023-11-26T07:23:10.337823+0000","last_undegraded":"2023-11-26T07:23:10.337823+0000","last_fullsized":"2023-11-26T07:23:10.337823+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:28:28.703762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336675+0000","last_change":"2023-11-26T07:23:08.040807+0000","last_active":"2023-11-26T07:23:10.336675+0000","last_peered":"2023-11-26T07:23:10.336675+0000","last_clean":"2023-11-26T07:23:10.336675+0000","last_became_active":"2023-11-26T07:23:08.040546+0000","last_became_peered":"2023-11-26T07:23:08.040546+0000","last_unstale":"2023-11-26T07:23:10.336675+0000","last_undegraded":"2023-11-26T07:23:10.336675+0000","last_fullsized":"2023-11-26T07:23:10.336675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:30.172804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846029+0000","last_change":"2023-11-26T07:23:08.858599+0000","last_active":"2023-11-26T07:23:09.846029+0000","last_peered":"2023-11-26T07:23:09.846029+0000","last_clean":"2023-11-26T07:23:09.846029+0000","last_became_active":"2023-11-26T07:23:08.858278+0000","last_became_peered":"2023-11-26T07:23:08.858278+0000","last_unstale":"2023-11-26T07:23:09.846029+0000","last_undegraded":"2023-11-26T07:23:09.846029+0000","last_fullsized":"2023-11-26T07:23:09.846029+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:43.630432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847175+0000","last_change":"2023-11-26T07:23:08.037373+0000","last_active":"2023-11-26T07:23:09.847175+0000","last_peered":"2023-11-26T07:23:09.847175+0000","last_clean":"2023-11-26T07:23:09.847175+0000","last_became_active":"2023-11-26T07:23:08.037097+0000","last_became_peered":"2023-11-26T07:23:08.037097+0000","last_unstale":"2023-11-26T07:23:09.847175+0000","last_undegraded":"2023-11-26T07:23:09.847175+0000","last_fullsized":"2023-11-26T07:23:09.847175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:53:00.253920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336196+0000","last_change":"2023-11-26T07:23:08.874091+0000","last_active":"2023-11-26T07:23:10.336196+0000","last_peered":"2023-11-26T07:23:10.336196+0000","last_clean":"2023-11-26T07:23:10.336196+0000","last_became_active":"2023-11-26T07:23:08.873753+0000","last_became_peered":"2023-11-26T07:23:08.873753+0000","last_unstale":"2023-11-26T07:23:10.336196+0000","last_undegraded":"2023-11-26T07:23:10.336196+0000","last_fullsized":"2023-11-26T07:23:10.336196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:46.023144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846945+0000","last_change":"2023-11-26T07:23:08.052231+0000","last_active":"2023-11-26T07:23:09.846945+0000","last_peered":"2023-11-26T07:23:09.846945+0000","last_clean":"2023-11-26T07:23:09.846945+0000","last_became_active":"2023-11-26T07:23:08.051916+0000","last_became_peered":"2023-11-26T07:23:08.051916+0000","last_unstale":"2023-11-26T07:23:09.846945+0000","last_undegraded":"2023-11-26T07:23:09.846945+0000","last_fullsized":"2023-11-26T07:23:09.846945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:42:14.244536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846555+0000","last_change":"2023-11-26T07:23:08.865552+0000","last_active":"2023-11-26T07:23:09.846555+0000","last_peered":"2023-11-26T07:23:09.846555+0000","last_clean":"2023-11-26T07:23:09.846555+0000","last_became_active":"2023-11-26T07:23:08.865220+0000","last_became_peered":"2023-11-26T07:23:08.865220+0000","last_unstale":"2023-11-26T07:23:09.846555+0000","last_undegraded":"2023-11-26T07:23:09.846555+0000","last_fullsized":"2023-11-26T07:23:09.846555+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:29.031673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337333+0000","last_change":"2023-11-26T07:23:08.039578+0000","last_active":"2023-11-26T07:23:10.337333+0000","last_peered":"2023-11-26T07:23:10.337333+0000","last_clean":"2023-11-26T07:23:10.337333+0000","last_became_active":"2023-11-26T07:23:08.039269+0000","last_became_peered":"2023-11-26T07:23:08.039269+0000","last_unstale":"2023-11-26T07:23:10.337333+0000","last_undegraded":"2023-11-26T07:23:10.337333+0000","last_fullsized":"2023-11-26T07:23:10.337333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:39:54.052986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335932+0000","last_change":"2023-11-26T07:23:08.865450+0000","last_active":"2023-11-26T07:23:10.335932+0000","last_peered":"2023-11-26T07:23:10.335932+0000","last_clean":"2023-11-26T07:23:10.335932+0000","last_became_active":"2023-11-26T07:23:08.864087+0000","last_became_peered":"2023-11-26T07:23:08.864087+0000","last_unstale":"2023-11-26T07:23:10.335932+0000","last_undegraded":"2023-11-26T07:23:10.335932+0000","last_fullsized":"2023-11-26T07:23:10.335932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:31.147191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846225+0000","last_change":"2023-11-26T07:23:08.044998+0000","last_active":"2023-11-26T07:23:09.846225+0000","last_peered":"2023-11-26T07:23:09.846225+0000","last_clean":"2023-11-26T07:23:09.846225+0000","last_became_active":"2023-11-26T07:23:08.044764+0000","last_became_peered":"2023-11-26T07:23:08.044764+0000","last_unstale":"2023-11-26T07:23:09.846225+0000","last_undegraded":"2023-11-26T07:23:09.846225+0000","last_fullsized":"2023-11-26T07:23:09.846225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:40.379329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845583+0000","last_change":"2023-11-26T07:23:08.864220+0000","last_active":"2023-11-26T07:23:09.845583+0000","last_peered":"2023-11-26T07:23:09.845583+0000","last_clean":"2023-11-26T07:23:09.845583+0000","last_became_active":"2023-11-26T07:23:08.863966+0000","last_became_peered":"2023-11-26T07:23:08.863966+0000","last_unstale":"2023-11-26T07:23:09.845583+0000","last_undegraded":"2023-11-26T07:23:09.845583+0000","last_fullsized":"2023-11-26T07:23:09.845583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:11:09.082051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336150+0000","last_change":"2023-11-26T07:23:08.059519+0000","last_active":"2023-11-26T07:23:10.336150+0000","last_peered":"2023-11-26T07:23:10.336150+0000","last_clean":"2023-11-26T07:23:10.336150+0000","last_became_active":"2023-11-26T07:23:08.058826+0000","last_became_peered":"2023-11-26T07:23:08.058826+0000","last_unstale":"2023-11-26T07:23:10.336150+0000","last_undegraded":"2023-11-26T07:23:10.336150+0000","last_fullsized":"2023-11-26T07:23:10.336150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:59.421665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337164+0000","last_change":"2023-11-26T07:23:08.859990+0000","last_active":"2023-11-26T07:23:10.337164+0000","last_peered":"2023-11-26T07:23:10.337164+0000","last_clean":"2023-11-26T07:23:10.337164+0000","last_became_active":"2023-11-26T07:23:08.859462+0000","last_became_peered":"2023-11-26T07:23:08.859462+0000","last_unstale":"2023-11-26T07:23:10.337164+0000","last_undegraded":"2023-11-26T07:23:10.337164+0000","last_fullsized":"2023-11-26T07:23:10.337164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:02:25.570820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337865+0000","last_change":"2023-11-26T07:23:08.043752+0000","last_active":"2023-11-26T07:23:10.337865+0000","last_peered":"2023-11-26T07:23:10.337865+0000","last_clean":"2023-11-26T07:23:10.337865+0000","last_became_active":"2023-11-26T07:23:08.043454+0000","last_became_peered":"2023-11-26T07:23:08.043454+0000","last_unstale":"2023-11-26T07:23:10.337865+0000","last_undegraded":"2023-11-26T07:23:10.337865+0000","last_fullsized":"2023-11-26T07:23:10.337865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:43.204178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336539+0000","last_change":"2023-11-26T07:23:08.875214+0000","last_active":"2023-11-26T07:23:10.336539+0000","last_peered":"2023-11-26T07:23:10.336539+0000","last_clean":"2023-11-26T07:23:10.336539+0000","last_became_active":"2023-11-26T07:23:08.874945+0000","last_became_peered":"2023-11-26T07:23:08.874945+0000","last_unstale":"2023-11-26T07:23:10.336539+0000","last_undegraded":"2023-11-26T07:23:10.336539+0000","last_fullsized":"2023-11-26T07:23:10.336539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:42:30.479550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337204+0000","last_change":"2023-11-26T07:23:08.056498+0000","last_active":"2023-11-26T07:23:10.337204+0000","last_peered":"2023-11-26T07:23:10.337204+0000","last_clean":"2023-11-26T07:23:10.337204+0000","last_became_active":"2023-11-26T07:23:08.054719+0000","last_became_peered":"2023-11-26T07:23:08.054719+0000","last_unstale":"2023-11-26T07:23:10.337204+0000","last_undegraded":"2023-11-26T07:23:10.337204+0000","last_fullsized":"2023-11-26T07:23:10.337204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:47:10.053447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847142+0000","last_change":"2023-11-26T07:23:08.869420+0000","last_active":"2023-11-26T07:23:09.847142+0000","last_peered":"2023-11-26T07:23:09.847142+0000","last_clean":"2023-11-26T07:23:09.847142+0000","last_became_active":"2023-11-26T07:23:08.868396+0000","last_became_peered":"2023-11-26T07:23:08.868396+0000","last_unstale":"2023-11-26T07:23:09.847142+0000","last_undegraded":"2023-11-26T07:23:09.847142+0000","last_fullsized":"2023-11-26T07:23:09.847142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:02:02.504585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337782+0000","last_change":"2023-11-26T07:23:08.056486+0000","last_active":"2023-11-26T07:23:10.337782+0000","last_peered":"2023-11-26T07:23:10.337782+0000","last_clean":"2023-11-26T07:23:10.337782+0000","last_became_active":"2023-11-26T07:23:08.056142+0000","last_became_peered":"2023-11-26T07:23:08.056142+0000","last_unstale":"2023-11-26T07:23:10.337782+0000","last_undegraded":"2023-11-26T07:23:10.337782+0000","last_fullsized":"2023-11-26T07:23:10.337782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:46:02.459085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846137+0000","last_change":"2023-11-26T07:23:08.861708+0000","last_active":"2023-11-26T07:23:09.846137+0000","last_peered":"2023-11-26T07:23:09.846137+0000","last_clean":"2023-11-26T07:23:09.846137+0000","last_became_active":"2023-11-26T07:23:08.861311+0000","last_became_peered":"2023-11-26T07:23:08.861311+0000","last_unstale":"2023-11-26T07:23:09.846137+0000","last_undegraded":"2023-11-26T07:23:09.846137+0000","last_fullsized":"2023-11-26T07:23:09.846137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:03.506930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336661+0000","last_change":"2023-11-26T07:23:08.059780+0000","last_active":"2023-11-26T07:23:10.336661+0000","last_peered":"2023-11-26T07:23:10.336661+0000","last_clean":"2023-11-26T07:23:10.336661+0000","last_became_active":"2023-11-26T07:23:08.059336+0000","last_became_peered":"2023-11-26T07:23:08.059336+0000","last_unstale":"2023-11-26T07:23:10.336661+0000","last_undegraded":"2023-11-26T07:23:10.336661+0000","last_fullsized":"2023-11-26T07:23:10.336661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:28.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336565+0000","last_change":"2023-11-26T07:23:08.861329+0000","last_active":"2023-11-26T07:23:10.336565+0000","last_peered":"2023-11-26T07:23:10.336565+0000","last_clean":"2023-11-26T07:23:10.336565+0000","last_became_active":"2023-11-26T07:23:08.859994+0000","last_became_peered":"2023-11-26T07:23:08.859994+0000","last_unstale":"2023-11-26T07:23:10.336565+0000","last_undegraded":"2023-11-26T07:23:10.336565+0000","last_fullsized":"2023-11-26T07:23:10.336565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:44:41.945797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337453+0000","last_change":"2023-11-26T07:23:08.046098+0000","last_active":"2023-11-26T07:23:10.337453+0000","last_peered":"2023-11-26T07:23:10.337453+0000","last_clean":"2023-11-26T07:23:10.337453+0000","last_became_active":"2023-11-26T07:23:08.042657+0000","last_became_peered":"2023-11-26T07:23:08.042657+0000","last_unstale":"2023-11-26T07:23:10.337453+0000","last_undegraded":"2023-11-26T07:23:10.337453+0000","last_fullsized":"2023-11-26T07:23:10.337453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:58.650825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336110+0000","last_change":"2023-11-26T07:23:08.864127+0000","last_active":"2023-11-26T07:23:10.336110+0000","last_peered":"2023-11-26T07:23:10.336110+0000","last_clean":"2023-11-26T07:23:10.336110+0000","last_became_active":"2023-11-26T07:23:08.863857+0000","last_became_peered":"2023-11-26T07:23:08.863857+0000","last_unstale":"2023-11-26T07:23:10.336110+0000","last_undegraded":"2023-11-26T07:23:10.336110+0000","last_fullsized":"2023-11-26T07:23:10.336110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:15.097076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846353+0000","last_change":"2023-11-26T07:23:08.038118+0000","last_active":"2023-11-26T07:23:09.846353+0000","last_peered":"2023-11-26T07:23:09.846353+0000","last_clean":"2023-11-26T07:23:09.846353+0000","last_became_active":"2023-11-26T07:23:08.037752+0000","last_became_peered":"2023-11-26T07:23:08.037752+0000","last_unstale":"2023-11-26T07:23:09.846353+0000","last_undegraded":"2023-11-26T07:23:09.846353+0000","last_fullsized":"2023-11-26T07:23:09.846353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:23:18.253466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336194+0000","last_change":"2023-11-26T07:23:08.861763+0000","last_active":"2023-11-26T07:23:10.336194+0000","last_peered":"2023-11-26T07:23:10.336194+0000","last_clean":"2023-11-26T07:23:10.336194+0000","last_became_active":"2023-11-26T07:23:08.861479+0000","last_became_peered":"2023-11-26T07:23:08.861479+0000","last_unstale":"2023-11-26T07:23:10.336194+0000","last_undegraded":"2023-11-26T07:23:10.336194+0000","last_fullsized":"2023-11-26T07:23:10.336194+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:14:01.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335884+0000","last_change":"2023-11-26T07:23:08.048923+0000","last_active":"2023-11-26T07:23:10.335884+0000","last_peered":"2023-11-26T07:23:10.335884+0000","last_clean":"2023-11-26T07:23:10.335884+0000","last_became_active":"2023-11-26T07:23:08.048659+0000","last_became_peered":"2023-11-26T07:23:08.048659+0000","last_unstale":"2023-11-26T07:23:10.335884+0000","last_undegraded":"2023-11-26T07:23:10.335884+0000","last_fullsized":"2023-11-26T07:23:10.335884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:02:24.564489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336621+0000","last_change":"2023-11-26T07:23:08.859236+0000","last_active":"2023-11-26T07:23:10.336621+0000","last_peered":"2023-11-26T07:23:10.336621+0000","last_clean":"2023-11-26T07:23:10.336621+0000","last_became_active":"2023-11-26T07:23:08.858862+0000","last_became_peered":"2023-11-26T07:23:08.858862+0000","last_unstale":"2023-11-26T07:23:10.336621+0000","last_undegraded":"2023-11-26T07:23:10.336621+0000","last_fullsized":"2023-11-26T07:23:10.336621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:35:34.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337880+0000","last_change":"2023-11-26T07:23:08.044513+0000","last_active":"2023-11-26T07:23:10.337880+0000","last_peered":"2023-11-26T07:23:10.337880+0000","last_clean":"2023-11-26T07:23:10.337880+0000","last_became_active":"2023-11-26T07:23:08.044244+0000","last_became_peered":"2023-11-26T07:23:08.044244+0000","last_unstale":"2023-11-26T07:23:10.337880+0000","last_undegraded":"2023-11-26T07:23:10.337880+0000","last_fullsized":"2023-11-26T07:23:10.337880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:45:55.874541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846918+0000","last_change":"2023-11-26T07:23:08.859717+0000","last_active":"2023-11-26T07:23:09.846918+0000","last_peered":"2023-11-26T07:23:09.846918+0000","last_clean":"2023-11-26T07:23:09.846918+0000","last_became_active":"2023-11-26T07:23:08.859400+0000","last_became_peered":"2023-11-26T07:23:08.859400+0000","last_unstale":"2023-11-26T07:23:09.846918+0000","last_undegraded":"2023-11-26T07:23:09.846918+0000","last_fullsized":"2023-11-26T07:23:09.846918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:57:22.295755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846925+0000","last_change":"2023-11-26T07:23:08.043377+0000","last_active":"2023-11-26T07:23:09.846925+0000","last_peered":"2023-11-26T07:23:09.846925+0000","last_clean":"2023-11-26T07:23:09.846925+0000","last_became_active":"2023-11-26T07:23:08.043067+0000","last_became_peered":"2023-11-26T07:23:08.043067+0000","last_unstale":"2023-11-26T07:23:09.846925+0000","last_undegraded":"2023-11-26T07:23:09.846925+0000","last_fullsized":"2023-11-26T07:23:09.846925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:28:27.697431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335854+0000","last_change":"2023-11-26T07:23:08.873879+0000","last_active":"2023-11-26T07:23:10.335854+0000","last_peered":"2023-11-26T07:23:10.335854+0000","last_clean":"2023-11-26T07:23:10.335854+0000","last_became_active":"2023-11-26T07:23:08.873468+0000","last_became_peered":"2023-11-26T07:23:08.873468+0000","last_unstale":"2023-11-26T07:23:10.335854+0000","last_undegraded":"2023-11-26T07:23:10.335854+0000","last_fullsized":"2023-11-26T07:23:10.335854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:54.385222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846115+0000","last_change":"2023-11-26T07:23:08.040895+0000","last_active":"2023-11-26T07:23:09.846115+0000","last_peered":"2023-11-26T07:23:09.846115+0000","last_clean":"2023-11-26T07:23:09.846115+0000","last_became_active":"2023-11-26T07:23:08.040440+0000","last_became_peered":"2023-11-26T07:23:08.040440+0000","last_unstale":"2023-11-26T07:23:09.846115+0000","last_undegraded":"2023-11-26T07:23:09.846115+0000","last_fullsized":"2023-11-26T07:23:09.846115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:19:10.821163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336321+0000","last_change":"2023-11-26T07:23:08.875534+0000","last_active":"2023-11-26T07:23:10.336321+0000","last_peered":"2023-11-26T07:23:10.336321+0000","last_clean":"2023-11-26T07:23:10.336321+0000","last_became_active":"2023-11-26T07:23:08.875047+0000","last_became_peered":"2023-11-26T07:23:08.875047+0000","last_unstale":"2023-11-26T07:23:10.336321+0000","last_undegraded":"2023-11-26T07:23:10.336321+0000","last_fullsized":"2023-11-26T07:23:10.336321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:41:38.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336425+0000","last_change":"2023-11-26T07:23:08.050909+0000","last_active":"2023-11-26T07:23:10.336425+0000","last_peered":"2023-11-26T07:23:10.336425+0000","last_clean":"2023-11-26T07:23:10.336425+0000","last_became_active":"2023-11-26T07:23:08.050618+0000","last_became_peered":"2023-11-26T07:23:08.050618+0000","last_unstale":"2023-11-26T07:23:10.336425+0000","last_undegraded":"2023-11-26T07:23:10.336425+0000","last_fullsized":"2023-11-26T07:23:10.336425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:28.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845981+0000","last_change":"2023-11-26T07:23:08.854715+0000","last_active":"2023-11-26T07:23:09.845981+0000","last_peered":"2023-11-26T07:23:09.845981+0000","last_clean":"2023-11-26T07:23:09.845981+0000","last_became_active":"2023-11-26T07:23:08.854271+0000","last_became_peered":"2023-11-26T07:23:08.854271+0000","last_unstale":"2023-11-26T07:23:09.845981+0000","last_undegraded":"2023-11-26T07:23:09.845981+0000","last_fullsized":"2023-11-26T07:23:09.845981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:46:51.454599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845842+0000","last_change":"2023-11-26T07:23:08.035124+0000","last_active":"2023-11-26T07:23:09.845842+0000","last_peered":"2023-11-26T07:23:09.845842+0000","last_clean":"2023-11-26T07:23:09.845842+0000","last_became_active":"2023-11-26T07:23:08.034876+0000","last_became_peered":"2023-11-26T07:23:08.034876+0000","last_unstale":"2023-11-26T07:23:09.845842+0000","last_undegraded":"2023-11-26T07:23:09.845842+0000","last_fullsized":"2023-11-26T07:23:09.845842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:12:06.915152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337513+0000","last_change":"2023-11-26T07:23:08.877329+0000","last_active":"2023-11-26T07:23:10.337513+0000","last_peered":"2023-11-26T07:23:10.337513+0000","last_clean":"2023-11-26T07:23:10.337513+0000","last_became_active":"2023-11-26T07:23:08.876722+0000","last_became_peered":"2023-11-26T07:23:08.876722+0000","last_unstale":"2023-11-26T07:23:10.337513+0000","last_undegraded":"2023-11-26T07:23:10.337513+0000","last_fullsized":"2023-11-26T07:23:10.337513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:46.670976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846820+0000","last_change":"2023-11-26T07:23:08.052732+0000","last_active":"2023-11-26T07:23:09.846820+0000","last_peered":"2023-11-26T07:23:09.846820+0000","last_clean":"2023-11-26T07:23:09.846820+0000","last_became_active":"2023-11-26T07:23:08.052476+0000","last_became_peered":"2023-11-26T07:23:08.052476+0000","last_unstale":"2023-11-26T07:23:09.846820+0000","last_undegraded":"2023-11-26T07:23:09.846820+0000","last_fullsized":"2023-11-26T07:23:09.846820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:00:19.348218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846917+0000","last_change":"2023-11-26T07:23:08.856954+0000","last_active":"2023-11-26T07:23:09.846917+0000","last_peered":"2023-11-26T07:23:09.846917+0000","last_clean":"2023-11-26T07:23:09.846917+0000","last_became_active":"2023-11-26T07:23:08.856663+0000","last_became_peered":"2023-11-26T07:23:08.856663+0000","last_unstale":"2023-11-26T07:23:09.846917+0000","last_undegraded":"2023-11-26T07:23:09.846917+0000","last_fullsized":"2023-11-26T07:23:09.846917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:52.843039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336338+0000","last_change":"2023-11-26T07:23:08.055764+0000","last_active":"2023-11-26T07:23:10.336338+0000","last_peered":"2023-11-26T07:23:10.336338+0000","last_clean":"2023-11-26T07:23:10.336338+0000","last_became_active":"2023-11-26T07:23:08.055490+0000","last_became_peered":"2023-11-26T07:23:08.055490+0000","last_unstale":"2023-11-26T07:23:10.336338+0000","last_undegraded":"2023-11-26T07:23:10.336338+0000","last_fullsized":"2023-11-26T07:23:10.336338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:45:55.874541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336842+0000","last_change":"2023-11-26T07:23:08.855469+0000","last_active":"2023-11-26T07:23:10.336842+0000","last_peered":"2023-11-26T07:23:10.336842+0000","last_clean":"2023-11-26T07:23:10.336842+0000","last_became_active":"2023-11-26T07:23:08.855176+0000","last_became_peered":"2023-11-26T07:23:08.855176+0000","last_unstale":"2023-11-26T07:23:10.336842+0000","last_undegraded":"2023-11-26T07:23:10.336842+0000","last_fullsized":"2023-11-26T07:23:10.336842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:55.110295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336561+0000","last_change":"2023-11-26T07:23:08.042948+0000","last_active":"2023-11-26T07:23:10.336561+0000","last_peered":"2023-11-26T07:23:10.336561+0000","last_clean":"2023-11-26T07:23:10.336561+0000","last_became_active":"2023-11-26T07:23:08.042577+0000","last_became_peered":"2023-11-26T07:23:08.042577+0000","last_unstale":"2023-11-26T07:23:10.336561+0000","last_undegraded":"2023-11-26T07:23:10.336561+0000","last_fullsized":"2023-11-26T07:23:10.336561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:17:07.996777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336363+0000","last_change":"2023-11-26T07:23:08.860548+0000","last_active":"2023-11-26T07:23:10.336363+0000","last_peered":"2023-11-26T07:23:10.336363+0000","last_clean":"2023-11-26T07:23:10.336363+0000","last_became_active":"2023-11-26T07:23:08.860284+0000","last_became_peered":"2023-11-26T07:23:08.860284+0000","last_unstale":"2023-11-26T07:23:10.336363+0000","last_undegraded":"2023-11-26T07:23:10.336363+0000","last_fullsized":"2023-11-26T07:23:10.336363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:24.257746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337574+0000","last_change":"2023-11-26T07:23:08.042612+0000","last_active":"2023-11-26T07:23:10.337574+0000","last_peered":"2023-11-26T07:23:10.337574+0000","last_clean":"2023-11-26T07:23:10.337574+0000","last_became_active":"2023-11-26T07:23:08.042060+0000","last_became_peered":"2023-11-26T07:23:08.042060+0000","last_unstale":"2023-11-26T07:23:10.337574+0000","last_undegraded":"2023-11-26T07:23:10.337574+0000","last_fullsized":"2023-11-26T07:23:10.337574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:02:01.498254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-26T07:23:08.859115+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:23:08.859115+0000","last_peered":"2023-11-26T07:23:08.859115+0000","last_clean":"2023-11-26T07:23:08.859115+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:23:08.859115+0000","last_undegraded":"2023-11-26T07:23:08.859115+0000","last_fullsized":"2023-11-26T07:23:08.859115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1540096,"data_stored":990789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.88300000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.629},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.51000000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.755},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.53400000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86499999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63600000000000001,"15min":0.70499999999999996},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84199999999999997,"5min":1.923,"15min":1.923},"last":0.47499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.66400000000000003},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86099999999999999,"5min":1,"15min":1},"last":0.73399999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.49099999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93300000000000005,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":0.76700000000000002},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1839999999999999,"5min":1.863,"15min":1.863},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":399897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91500000000000004,"5min":1.171,"15min":1.171},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67600000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":1.093,"15min":1.093},"last":0.61699999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.50800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84799999999999998,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67100000000000004,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.69499999999999995},"min":{"1min":0.51200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.76600000000000001},"min":{"1min":0.55300000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":1.089,"15min":1.089},"last":0.75800000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.749,"15min":0.76700000000000002},"min":{"1min":0.61399999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88500000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.504},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.68300000000000005},"min":{"1min":0.46500000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":1.018,"15min":1.018},"last":0.442}]},{"osd":5,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.72499999999999998},"min":{"1min":0.45900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92900000000000005,"5min":1.133,"15min":1.133},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":1.042,"15min":1.042},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73699999999999999,"15min":0.77800000000000002},"min":{"1min":0.504,"5min":0.38,"15min":0.38},"max":{"1min":0.99399999999999999,"5min":1.196,"15min":1.196},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.74199999999999999,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.56100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":954368,"data_stored":406195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.72999999999999998,"15min":0.96199999999999997},"min":{"1min":0.505,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83499999999999996,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.99099999999999999},"min":{"1min":0.60499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.879,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.76500000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.80600000000000005,"15min":1.056},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.90400000000000003,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.82999999999999996,"15min":0.94699999999999995},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90800000000000003,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.88800000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.81299999999999994,"15min":0.81899999999999995},"min":{"1min":0.52900000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89100000000000001,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.96199999999999997},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77400000000000002,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.80600000000000005,"15min":1.0880000000000001},"min":{"1min":0.45700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.871,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.90800000000000003,"15min":1.1259999999999999},"min":{"1min":0.53700000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86399999999999999,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.66500000000000004,"15min":0.92100000000000004},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78800000000000003,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.75800000000000001,"15min":1.0289999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93300000000000005,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81599999999999995,"15min":0.87},"min":{"1min":0.47899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.024,"15min":1.8720000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84399999999999997,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.83999999999999997,"15min":1.1479999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.873,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.91500000000000004,"15min":1.1499999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91700000000000004,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":954368,"data_stored":406175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.032,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.438,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92900000000000005,"5min":1.218,"15min":1.218},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89700000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98499999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92000000000000004,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.66500000000000004,"15min":0.70899999999999996},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80000000000000004,"5min":1.238,"15min":1.238},"last":0.497}]},{"osd":6,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69499999999999995,"15min":0.755},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.88900000000000001,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.80600000000000005},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.876,"5min":1.095,"15min":1.095},"last":0.96999999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.78200000000000003},"min":{"1min":0.53800000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.873,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.82199999999999995},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93300000000000005,"5min":1.302,"15min":1.302},"last":0.47199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":946176,"data_stored":399917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.46100000000000002},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51400000000000001,"15min":0.628},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64300000000000002,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.51400000000000001},"min":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70899999999999996,"15min":0.85399999999999998},"min":{"1min":0.48899999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.01,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.503,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.88},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.03,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.76800000000000002},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71099999999999997,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97499999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.89700000000000002},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.99199999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.753,"15min":0.91500000000000004},"min":{"1min":0.54100000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.032,"5min":3.476,"15min":3.476},"last":0.747},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73099999999999998,"15min":0.77500000000000002},"min":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":407717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.41099999999999998},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.31},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.44},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60299999999999998,"5min":2.056,"15min":2.056},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.308,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69099999999999995,"5min":1.175,"15min":1.175},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.46300000000000002,"15min":0.48499999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84599999999999997,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.92600000000000005,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.45700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.266,"5min":1.351,"15min":1.351},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.50600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.752,"15min":1.752},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":1.214,"15min":1.214},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76600000000000001,"15min":0.79800000000000004},"min":{"1min":0.48799999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89700000000000002,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97999999999999998,"5min":1.421,"15min":1.421},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.746,"15min":0.752},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93999999999999995,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92400000000000004,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335544,"statfs":{"total":96636764160,"available":96599597056,"internally_reserved":0,"allocated":970752,"data_stored":408333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41899999999999998,"15min":0.48699999999999999},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45600000000000002,"15min":0.47799999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59699999999999998,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56899999999999995,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.376},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.49199999999999999,"15min":0.55500000000000005},"min":{"1min":0.35099999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53200000000000003,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.434}]},{"osd":3,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53200000000000003,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51100000000000001,"15min":0.55700000000000005},"min":{"1min":0.35699999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.752,"15min":0.81499999999999995},"min":{"1min":0.51800000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72699999999999998,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.999,"5min":1.329,"15min":1.329},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.83899999999999997},"min":{"1min":0.54500000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0529999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76800000000000002,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.036,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.754,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0940000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1279999999999999,"5min":1.173,"15min":1.173},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36848,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":1544192,"data_stored":996473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47299999999999998,"15min":0.60499999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47899999999999998,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61599999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.40699999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.503,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63100000000000001,"5min":2.415,"15min":2.415},"last":0.435},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.54200000000000004,"15min":0.70199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63200000000000001,"5min":5.234,"15min":5.234},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.505,"15min":0.58899999999999997},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56999999999999995,"5min":3.726,"15min":3.726},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.59099999999999997,"15min":0.75800000000000001},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68700000000000006,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.495}]},{"osd":4,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.754,"15min":0.92100000000000004},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.105,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73399999999999999,"15min":0.81599999999999995},"min":{"1min":0.54100000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1659999999999999,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.754}]},{"osd":5,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.82099999999999995},"min":{"1min":0.54300000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.238,"5min":2.835,"15min":2.835},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.86499999999999999},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.86599999999999999},"min":{"1min":0.52300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76000000000000001,"15min":0.83799999999999997},"min":{"1min":0.49299999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.034,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.874}]},{"osd":7,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.86899999999999999},"min":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90600000000000003,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.84599999999999997},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.071,"5min":2.798,"15min":2.798},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:23:13.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:23:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e8e46640 1 Processor -- start 2023-11-26T07:23:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e8e46640 1 -- start start 2023-11-26T07:23:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e8e46640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd6e415d6e0 0x7fd6e40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e8e46640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40cf0e0 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e8e46640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40ceb20 con 0x7fd6e40b2160 2023-11-26T07:23:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e8e46640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e415dac0 con 0x7fd6e415d6e0 2023-11-26T07:23:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd6e415d6e0 0x7fd6e40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e2d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd6e40d1bc0 0x7fd6e40b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:42980/0 (socket says 172.21.15.70:42980) 2023-11-26T07:23:13.292 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e2d9d640 1 -- 172.21.15.70:0/2520526723 learned_addr learned my addr 172.21.15.70:0/2520526723 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:13.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e259c640 1 -- 172.21.15.70:0/2520526723 >> v1:172.21.15.120:6789/0 conn(0x7fd6e40b2160 legacy=0x7fd6e40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:13.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e259c640 1 -- 172.21.15.70:0/2520526723 >> v1:172.21.15.70:6789/0 conn(0x7fd6e40d1bc0 legacy=0x7fd6e40b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.291+0000 7fd6e259c640 1 -- 172.21.15.70:0/2520526723 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40cee00 con 0x7fd6e415d6e0 2023-11-26T07:23:13.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e259c640 1 --2- 172.21.15.70:0/2520526723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e415d6e0 0x7fd6e40d0df0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40097c0 tx=0x7fd6d401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba08da404e73ec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e1d9b640 1 -- 172.21.15.70:0/2520526723 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40ab600 con 0x7fd6e415d6e0 2023-11-26T07:23:13.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e1d9b640 1 -- 172.21.15.70:0/2520526723 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d40a7050 con 0x7fd6e415d6e0 2023-11-26T07:23:13.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e1d9b640 1 -- 172.21.15.70:0/2520526723 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40ab980 con 0x7fd6e415d6e0 2023-11-26T07:23:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e8e46640 1 -- 172.21.15.70:0/2520526723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e415d6e0 msgr2=0x7fd6e40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/2520526723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e415d6e0 0x7fd6e40d0df0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40097c0 tx=0x7fd6d401c440 comp rx=0 tx=0).stop 2023-11-26T07:23:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e8e46640 1 -- 172.21.15.70:0/2520526723 shutdown_connections 2023-11-26T07:23:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/2520526723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e415d6e0 0x7fd6e40d0df0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e8e46640 1 -- 172.21.15.70:0/2520526723 >> 172.21.15.70:0/2520526723 conn(0x7fd6e409c550 msgr2=0x7fd6e40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e8e46640 1 -- 172.21.15.70:0/2520526723 shutdown_connections 2023-11-26T07:23:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.295+0000 7fd6e8e46640 1 -- 172.21.15.70:0/2520526723 wait complete. 2023-11-26T07:23:13.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 Processor -- start 2023-11-26T07:23:13.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 -- start start 2023-11-26T07:23:13.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6e40b2160 0x7fd6e415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e40d1bc0 0x7fd6e4150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6e415d6e0 0x7fd6e4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4159930 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4154890 con 0x7fd6e40b2160 2023-11-26T07:23:13.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4154280 con 0x7fd6e415d6e0 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e40d1bc0 0x7fd6e4150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6e40b2160 0x7fd6e415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e40d1bc0 0x7fd6e4150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50786/0 (socket says 172.21.15.70:50786) 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 -- 172.21.15.70:0/739526835 learned_addr learned my addr 172.21.15.70:0/739526835 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e2d9d640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6e415d6e0 0x7fd6e4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 -- 172.21.15.70:0/739526835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6e415d6e0 msgr2=0x7fd6e4154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6e415d6e0 0x7fd6e4154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 -- 172.21.15.70:0/739526835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6e40b2160 msgr2=0x7fd6e415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6e40b2160 0x7fd6e415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 -- 172.21.15.70:0/739526835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4009420 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6d9d9b640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e40d1bc0 0x7fd6e4150810 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c7c0 tx=0x7fd6cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6db7fe640 1 -- 172.21.15.70:0/739526835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00aa50 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6db7fe640 1 -- 172.21.15.70:0/739526835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00abb0 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6db7fe640 1 -- 172.21.15.70:0/739526835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc012420 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e4159650 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e4159300 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.299+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e41540e0 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.303+0000 7fd6db7fe640 1 -- 172.21.15.70:0/739526835 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fd6cc012580 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.303+0000 7fd6db7fe640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6c4066d10 0x7fd6c40691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.303+0000 7fd6db7fe640 1 -- 172.21.15.70:0/739526835 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6cc082a00 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.303+0000 7fd6e259c640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6c4066d10 0x7fd6c40691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.303+0000 7fd6e259c640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6c4066d10 0x7fd6c40691d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ad000 tx=0x7fd6d40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.307+0000 7fd6db7fe640 1 -- 172.21.15.70:0/739526835 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6e41540e0 con 0x7fd6e40d1bc0 2023-11-26T07:23:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.455+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6e41540e0 con 0x7fd6c4066d10 2023-11-26T07:23:13.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6db7fe640 1 -- 172.21.15.70:0/739526835 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289536 (secure 0 0 0) 0x7fd6e41540e0 con 0x7fd6c4066d10 2023-11-26T07:23:13.464 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:13.466 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6c4066d10 msgr2=0x7fd6c40691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6c4066d10 0x7fd6c40691d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ad000 tx=0x7fd6d40a6000 comp rx=0 tx=0).stop 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e40d1bc0 msgr2=0x7fd6e4150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e40d1bc0 0x7fd6e4150810 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c7c0 tx=0x7fd6cc00cc80 comp rx=0 tx=0).stop 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 shutdown_connections 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd6c4066d10 0x7fd6c40691d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6e40d1bc0 0x7fd6e4150810 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.467 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6e415d6e0 0x7fd6e4154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 --2- 172.21.15.70:0/739526835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6e40b2160 0x7fd6e415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 >> 172.21.15.70:0/739526835 conn(0x7fd6e409c550 msgr2=0x7fd6e40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:13.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 shutdown_connections 2023-11-26T07:23:13.468 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.463+0000 7fd6e8e46640 1 -- 172.21.15.70:0/739526835 wait complete. 2023-11-26T07:23:13.485 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-11-26T07:23:12.056826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270568,"kb_used_data":8612,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754704152,"statfs":{"total":773094113280,"available":772817051648,"internally_reserved":0,"allocated":8818688,"data_stored":4415496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":268095025},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.036815"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336254+0000","last_change":"2023-11-26T07:23:08.874625+0000","last_active":"2023-11-26T07:23:10.336254+0000","last_peered":"2023-11-26T07:23:10.336254+0000","last_clean":"2023-11-26T07:23:10.336254+0000","last_became_active":"2023-11-26T07:23:08.874274+0000","last_became_peered":"2023-11-26T07:23:08.874274+0000","last_unstale":"2023-11-26T07:23:10.336254+0000","last_undegraded":"2023-11-26T07:23:10.336254+0000","last_fullsized":"2023-11-26T07:23:10.336254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:15:22.389018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337929+0000","last_change":"2023-11-26T07:23:08.865811+0000","last_active":"2023-11-26T07:23:10.337929+0000","last_peered":"2023-11-26T07:23:10.337929+0000","last_clean":"2023-11-26T07:23:10.337929+0000","last_became_active":"2023-11-26T07:23:08.865538+0000","last_became_peered":"2023-11-26T07:23:08.865538+0000","last_unstale":"2023-11-26T07:23:10.337929+0000","last_undegraded":"2023-11-26T07:23:10.337929+0000","last_fullsized":"2023-11-26T07:23:10.337929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:41.385660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336439+0000","last_change":"2023-11-26T07:23:08.856264+0000","last_active":"2023-11-26T07:23:10.336439+0000","last_peered":"2023-11-26T07:23:10.336439+0000","last_clean":"2023-11-26T07:23:10.336439+0000","last_became_active":"2023-11-26T07:23:08.855995+0000","last_became_peered":"2023-11-26T07:23:08.855995+0000","last_unstale":"2023-11-26T07:23:10.336439+0000","last_undegraded":"2023-11-26T07:23:10.336439+0000","last_fullsized":"2023-11-26T07:23:10.336439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:00:24.194012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847064+0000","last_change":"2023-11-26T07:23:08.863117+0000","last_active":"2023-11-26T07:23:09.847064+0000","last_peered":"2023-11-26T07:23:09.847064+0000","last_clean":"2023-11-26T07:23:09.847064+0000","last_became_active":"2023-11-26T07:23:08.862853+0000","last_became_peered":"2023-11-26T07:23:08.862853+0000","last_unstale":"2023-11-26T07:23:09.847064+0000","last_undegraded":"2023-11-26T07:23:09.847064+0000","last_fullsized":"2023-11-26T07:23:09.847064+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:07:36.771875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845847+0000","last_change":"2023-11-26T07:23:08.872963+0000","last_active":"2023-11-26T07:23:09.845847+0000","last_peered":"2023-11-26T07:23:09.845847+0000","last_clean":"2023-11-26T07:23:09.845847+0000","last_became_active":"2023-11-26T07:23:08.872468+0000","last_became_peered":"2023-11-26T07:23:08.872468+0000","last_unstale":"2023-11-26T07:23:09.845847+0000","last_undegraded":"2023-11-26T07:23:09.845847+0000","last_fullsized":"2023-11-26T07:23:09.845847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:24:22.198121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337183+0000","last_change":"2023-11-26T07:23:08.855728+0000","last_active":"2023-11-26T07:23:10.337183+0000","last_peered":"2023-11-26T07:23:10.337183+0000","last_clean":"2023-11-26T07:23:10.337183+0000","last_became_active":"2023-11-26T07:23:08.855415+0000","last_became_peered":"2023-11-26T07:23:08.855415+0000","last_unstale":"2023-11-26T07:23:10.337183+0000","last_undegraded":"2023-11-26T07:23:10.337183+0000","last_fullsized":"2023-11-26T07:23:10.337183+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:57:47.963617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846225+0000","last_change":"2023-11-26T07:23:08.860515+0000","last_active":"2023-11-26T07:23:09.846225+0000","last_peered":"2023-11-26T07:23:09.846225+0000","last_clean":"2023-11-26T07:23:09.846225+0000","last_became_active":"2023-11-26T07:23:08.859286+0000","last_became_peered":"2023-11-26T07:23:08.859286+0000","last_unstale":"2023-11-26T07:23:09.846225+0000","last_undegraded":"2023-11-26T07:23:09.846225+0000","last_fullsized":"2023-11-26T07:23:09.846225+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:29.774356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336345+0000","last_change":"2023-11-26T07:23:08.860341+0000","last_active":"2023-11-26T07:23:10.336345+0000","last_peered":"2023-11-26T07:23:10.336345+0000","last_clean":"2023-11-26T07:23:10.336345+0000","last_became_active":"2023-11-26T07:23:08.860044+0000","last_became_peered":"2023-11-26T07:23:08.860044+0000","last_unstale":"2023-11-26T07:23:10.336345+0000","last_undegraded":"2023-11-26T07:23:10.336345+0000","last_fullsized":"2023-11-26T07:23:10.336345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:34:04.528252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846314+0000","last_change":"2023-11-26T07:23:08.863108+0000","last_active":"2023-11-26T07:23:09.846314+0000","last_peered":"2023-11-26T07:23:09.846314+0000","last_clean":"2023-11-26T07:23:09.846314+0000","last_became_active":"2023-11-26T07:23:08.862579+0000","last_became_peered":"2023-11-26T07:23:08.862579+0000","last_unstale":"2023-11-26T07:23:09.846314+0000","last_undegraded":"2023-11-26T07:23:09.846314+0000","last_fullsized":"2023-11-26T07:23:09.846314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:17:50.051981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337033+0000","last_change":"2023-11-26T07:23:08.868342+0000","last_active":"2023-11-26T07:23:10.337033+0000","last_peered":"2023-11-26T07:23:10.337033+0000","last_clean":"2023-11-26T07:23:10.337033+0000","last_became_active":"2023-11-26T07:23:08.868072+0000","last_became_peered":"2023-11-26T07:23:08.868072+0000","last_unstale":"2023-11-26T07:23:10.337033+0000","last_undegraded":"2023-11-26T07:23:10.337033+0000","last_fullsized":"2023-11-26T07:23:10.337033+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:23:19.259798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336172+0000","last_change":"2023-11-26T07:23:08.874146+0000","last_active":"2023-11-26T07:23:10.336172+0000","last_peered":"2023-11-26T07:23:10.336172+0000","last_clean":"2023-11-26T07:23:10.336172+0000","last_became_active":"2023-11-26T07:23:08.873807+0000","last_became_peered":"2023-11-26T07:23:08.873807+0000","last_unstale":"2023-11-26T07:23:10.336172+0000","last_undegraded":"2023-11-26T07:23:10.336172+0000","last_fullsized":"2023-11-26T07:23:10.336172+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:15:01.879474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847089+0000","last_change":"2023-11-26T07:23:08.868391+0000","last_active":"2023-11-26T07:23:09.847089+0000","last_peered":"2023-11-26T07:23:09.847089+0000","last_clean":"2023-11-26T07:23:09.847089+0000","last_became_active":"2023-11-26T07:23:08.868104+0000","last_became_peered":"2023-11-26T07:23:08.868104+0000","last_unstale":"2023-11-26T07:23:09.847089+0000","last_undegraded":"2023-11-26T07:23:09.847089+0000","last_fullsized":"2023-11-26T07:23:09.847089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:01:20.134759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336307+0000","last_change":"2023-11-26T07:23:08.859937+0000","last_active":"2023-11-26T07:23:10.336307+0000","last_peered":"2023-11-26T07:23:10.336307+0000","last_clean":"2023-11-26T07:23:10.336307+0000","last_became_active":"2023-11-26T07:23:08.859557+0000","last_became_peered":"2023-11-26T07:23:08.859557+0000","last_unstale":"2023-11-26T07:23:10.336307+0000","last_undegraded":"2023-11-26T07:23:10.336307+0000","last_fullsized":"2023-11-26T07:23:10.336307+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:53:59.899852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845853+0000","last_change":"2023-11-26T07:23:08.854537+0000","last_active":"2023-11-26T07:23:09.845853+0000","last_peered":"2023-11-26T07:23:09.845853+0000","last_clean":"2023-11-26T07:23:09.845853+0000","last_became_active":"2023-11-26T07:23:08.853883+0000","last_became_peered":"2023-11-26T07:23:08.853883+0000","last_unstale":"2023-11-26T07:23:09.845853+0000","last_undegraded":"2023-11-26T07:23:09.845853+0000","last_fullsized":"2023-11-26T07:23:09.845853+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:45:02.701493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335979+0000","last_change":"2023-11-26T07:23:08.858988+0000","last_active":"2023-11-26T07:23:10.335979+0000","last_peered":"2023-11-26T07:23:10.335979+0000","last_clean":"2023-11-26T07:23:10.335979+0000","last_became_active":"2023-11-26T07:23:08.858675+0000","last_became_peered":"2023-11-26T07:23:08.858675+0000","last_unstale":"2023-11-26T07:23:10.335979+0000","last_undegraded":"2023-11-26T07:23:10.335979+0000","last_fullsized":"2023-11-26T07:23:10.335979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:57:22.295755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335964+0000","last_change":"2023-11-26T07:23:08.866077+0000","last_active":"2023-11-26T07:23:10.335964+0000","last_peered":"2023-11-26T07:23:10.335964+0000","last_clean":"2023-11-26T07:23:10.335964+0000","last_became_active":"2023-11-26T07:23:08.865797+0000","last_became_peered":"2023-11-26T07:23:08.865797+0000","last_unstale":"2023-11-26T07:23:10.335964+0000","last_undegraded":"2023-11-26T07:23:10.335964+0000","last_fullsized":"2023-11-26T07:23:10.335964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:57:47.963617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846311+0000","last_change":"2023-11-26T07:23:08.862890+0000","last_active":"2023-11-26T07:23:09.846311+0000","last_peered":"2023-11-26T07:23:09.846311+0000","last_clean":"2023-11-26T07:23:09.846311+0000","last_became_active":"2023-11-26T07:23:08.862104+0000","last_became_peered":"2023-11-26T07:23:08.862104+0000","last_unstale":"2023-11-26T07:23:09.846311+0000","last_undegraded":"2023-11-26T07:23:09.846311+0000","last_fullsized":"2023-11-26T07:23:09.846311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:49:00.812263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847139+0000","last_change":"2023-11-26T07:23:08.865981+0000","last_active":"2023-11-26T07:23:09.847139+0000","last_peered":"2023-11-26T07:23:09.847139+0000","last_clean":"2023-11-26T07:23:09.847139+0000","last_became_active":"2023-11-26T07:23:08.865527+0000","last_became_peered":"2023-11-26T07:23:08.865527+0000","last_unstale":"2023-11-26T07:23:09.847139+0000","last_undegraded":"2023-11-26T07:23:09.847139+0000","last_fullsized":"2023-11-26T07:23:09.847139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:17:09.003109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337753+0000","last_change":"2023-11-26T07:23:08.860195+0000","last_active":"2023-11-26T07:23:10.337753+0000","last_peered":"2023-11-26T07:23:10.337753+0000","last_clean":"2023-11-26T07:23:10.337753+0000","last_became_active":"2023-11-26T07:23:08.859819+0000","last_became_peered":"2023-11-26T07:23:08.859819+0000","last_unstale":"2023-11-26T07:23:10.337753+0000","last_undegraded":"2023-11-26T07:23:10.337753+0000","last_fullsized":"2023-11-26T07:23:10.337753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:40.756665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336636+0000","last_change":"2023-11-26T07:23:08.857619+0000","last_active":"2023-11-26T07:23:10.336636+0000","last_peered":"2023-11-26T07:23:10.336636+0000","last_clean":"2023-11-26T07:23:10.336636+0000","last_became_active":"2023-11-26T07:23:08.857366+0000","last_became_peered":"2023-11-26T07:23:08.857366+0000","last_unstale":"2023-11-26T07:23:10.336636+0000","last_undegraded":"2023-11-26T07:23:10.336636+0000","last_fullsized":"2023-11-26T07:23:10.336636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:14.839371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336600+0000","last_change":"2023-11-26T07:23:08.863644+0000","last_active":"2023-11-26T07:23:10.336600+0000","last_peered":"2023-11-26T07:23:10.336600+0000","last_clean":"2023-11-26T07:23:10.336600+0000","last_became_active":"2023-11-26T07:23:08.863111+0000","last_became_peered":"2023-11-26T07:23:08.863111+0000","last_unstale":"2023-11-26T07:23:10.336600+0000","last_undegraded":"2023-11-26T07:23:10.336600+0000","last_fullsized":"2023-11-26T07:23:10.336600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:50.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336495+0000","last_change":"2023-11-26T07:23:08.863793+0000","last_active":"2023-11-26T07:23:10.336495+0000","last_peered":"2023-11-26T07:23:10.336495+0000","last_clean":"2023-11-26T07:23:10.336495+0000","last_became_active":"2023-11-26T07:23:08.863483+0000","last_became_peered":"2023-11-26T07:23:08.863483+0000","last_unstale":"2023-11-26T07:23:10.336495+0000","last_undegraded":"2023-11-26T07:23:10.336495+0000","last_fullsized":"2023-11-26T07:23:10.336495+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:46.670976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335674+0000","last_change":"2023-11-26T07:23:08.873969+0000","last_active":"2023-11-26T07:23:10.335674+0000","last_peered":"2023-11-26T07:23:10.335674+0000","last_clean":"2023-11-26T07:23:10.335674+0000","last_became_active":"2023-11-26T07:23:08.873637+0000","last_became_peered":"2023-11-26T07:23:08.873637+0000","last_unstale":"2023-11-26T07:23:10.335674+0000","last_undegraded":"2023-11-26T07:23:10.335674+0000","last_fullsized":"2023-11-26T07:23:10.335674+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:58:14.839371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335548+0000","last_change":"2023-11-26T07:23:08.874246+0000","last_active":"2023-11-26T07:23:10.335548+0000","last_peered":"2023-11-26T07:23:10.335548+0000","last_clean":"2023-11-26T07:23:10.335548+0000","last_became_active":"2023-11-26T07:23:08.873452+0000","last_became_peered":"2023-11-26T07:23:08.873452+0000","last_unstale":"2023-11-26T07:23:10.335548+0000","last_undegraded":"2023-11-26T07:23:10.335548+0000","last_fullsized":"2023-11-26T07:23:10.335548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:35:34.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336659+0000","last_change":"2023-11-26T07:23:08.872477+0000","last_active":"2023-11-26T07:23:10.336659+0000","last_peered":"2023-11-26T07:23:10.336659+0000","last_clean":"2023-11-26T07:23:10.336659+0000","last_became_active":"2023-11-26T07:23:08.872159+0000","last_became_peered":"2023-11-26T07:23:08.872159+0000","last_unstale":"2023-11-26T07:23:10.336659+0000","last_undegraded":"2023-11-26T07:23:10.336659+0000","last_fullsized":"2023-11-26T07:23:10.336659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:23:40.756665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846816+0000","last_change":"2023-11-26T07:23:08.861412+0000","last_active":"2023-11-26T07:23:09.846816+0000","last_peered":"2023-11-26T07:23:09.846816+0000","last_clean":"2023-11-26T07:23:09.846816+0000","last_became_active":"2023-11-26T07:23:08.860985+0000","last_became_peered":"2023-11-26T07:23:08.860985+0000","last_unstale":"2023-11-26T07:23:09.846816+0000","last_undegraded":"2023-11-26T07:23:09.846816+0000","last_fullsized":"2023-11-26T07:23:09.846816+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:31.147191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336507+0000","last_change":"2023-11-26T07:23:08.872619+0000","last_active":"2023-11-26T07:23:10.336507+0000","last_peered":"2023-11-26T07:23:10.336507+0000","last_clean":"2023-11-26T07:23:10.336507+0000","last_became_active":"2023-11-26T07:23:08.872275+0000","last_became_peered":"2023-11-26T07:23:08.872275+0000","last_unstale":"2023-11-26T07:23:10.336507+0000","last_undegraded":"2023-11-26T07:23:10.336507+0000","last_fullsized":"2023-11-26T07:23:10.336507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:52:38.534307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337030+0000","last_change":"2023-11-26T07:23:08.867962+0000","last_active":"2023-11-26T07:23:10.337030+0000","last_peered":"2023-11-26T07:23:10.337030+0000","last_clean":"2023-11-26T07:23:10.337030+0000","last_became_active":"2023-11-26T07:23:08.867664+0000","last_became_peered":"2023-11-26T07:23:08.867664+0000","last_unstale":"2023-11-26T07:23:10.337030+0000","last_undegraded":"2023-11-26T07:23:10.337030+0000","last_fullsized":"2023-11-26T07:23:10.337030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:41.385660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336429+0000","last_change":"2023-11-26T07:23:08.862911+0000","last_active":"2023-11-26T07:23:10.336429+0000","last_peered":"2023-11-26T07:23:10.336429+0000","last_clean":"2023-11-26T07:23:10.336429+0000","last_became_active":"2023-11-26T07:23:08.859353+0000","last_became_peered":"2023-11-26T07:23:08.859353+0000","last_unstale":"2023-11-26T07:23:10.336429+0000","last_undegraded":"2023-11-26T07:23:10.336429+0000","last_fullsized":"2023-11-26T07:23:10.336429+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:03:36.109534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846285+0000","last_change":"2023-11-26T07:23:08.861318+0000","last_active":"2023-11-26T07:23:09.846285+0000","last_peered":"2023-11-26T07:23:09.846285+0000","last_clean":"2023-11-26T07:23:09.846285+0000","last_became_active":"2023-11-26T07:23:08.861011+0000","last_became_peered":"2023-11-26T07:23:08.861011+0000","last_unstale":"2023-11-26T07:23:09.846285+0000","last_undegraded":"2023-11-26T07:23:09.846285+0000","last_fullsized":"2023-11-26T07:23:09.846285+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:40:21.215492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846419+0000","last_change":"2023-11-26T07:23:08.850768+0000","last_active":"2023-11-26T07:23:09.846419+0000","last_peered":"2023-11-26T07:23:09.846419+0000","last_clean":"2023-11-26T07:23:09.846419+0000","last_became_active":"2023-11-26T07:23:08.850467+0000","last_became_peered":"2023-11-26T07:23:08.850467+0000","last_unstale":"2023-11-26T07:23:09.846419+0000","last_undegraded":"2023-11-26T07:23:09.846419+0000","last_fullsized":"2023-11-26T07:23:09.846419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:37.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336475+0000","last_change":"2023-11-26T07:23:08.855440+0000","last_active":"2023-11-26T07:23:10.336475+0000","last_peered":"2023-11-26T07:23:10.336475+0000","last_clean":"2023-11-26T07:23:10.336475+0000","last_became_active":"2023-11-26T07:23:08.855068+0000","last_became_peered":"2023-11-26T07:23:08.855068+0000","last_unstale":"2023-11-26T07:23:10.336475+0000","last_undegraded":"2023-11-26T07:23:10.336475+0000","last_fullsized":"2023-11-26T07:23:10.336475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:47:11.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336127+0000","last_change":"2023-11-26T07:23:08.877141+0000","last_active":"2023-11-26T07:23:10.336127+0000","last_peered":"2023-11-26T07:23:10.336127+0000","last_clean":"2023-11-26T07:23:10.336127+0000","last_became_active":"2023-11-26T07:23:08.876865+0000","last_became_peered":"2023-11-26T07:23:08.876865+0000","last_unstale":"2023-11-26T07:23:10.336127+0000","last_undegraded":"2023-11-26T07:23:10.336127+0000","last_fullsized":"2023-11-26T07:23:10.336127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:46.429112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"77'4","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336635+0000","last_change":"2023-11-26T07:23:08.059422+0000","last_active":"2023-11-26T07:23:10.336635+0000","last_peered":"2023-11-26T07:23:10.336635+0000","last_clean":"2023-11-26T07:23:10.336635+0000","last_became_active":"2023-11-26T07:23:08.059154+0000","last_became_peered":"2023-11-26T07:23:08.059154+0000","last_unstale":"2023-11-26T07:23:10.336635+0000","last_undegraded":"2023-11-26T07:23:10.336635+0000","last_fullsized":"2023-11-26T07:23:10.336635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:30.140860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846417+0000","last_change":"2023-11-26T07:23:08.854281+0000","last_active":"2023-11-26T07:23:09.846417+0000","last_peered":"2023-11-26T07:23:09.846417+0000","last_clean":"2023-11-26T07:23:09.846417+0000","last_became_active":"2023-11-26T07:23:08.853994+0000","last_became_peered":"2023-11-26T07:23:08.853994+0000","last_unstale":"2023-11-26T07:23:09.846417+0000","last_undegraded":"2023-11-26T07:23:09.846417+0000","last_fullsized":"2023-11-26T07:23:09.846417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:02:58.806885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336708+0000","last_change":"2023-11-26T07:23:08.046492+0000","last_active":"2023-11-26T07:23:10.336708+0000","last_peered":"2023-11-26T07:23:10.336708+0000","last_clean":"2023-11-26T07:23:10.336708+0000","last_became_active":"2023-11-26T07:23:08.046230+0000","last_became_peered":"2023-11-26T07:23:08.046230+0000","last_unstale":"2023-11-26T07:23:10.336708+0000","last_undegraded":"2023-11-26T07:23:10.336708+0000","last_fullsized":"2023-11-26T07:23:10.336708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:02:35.999678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337623+0000","last_change":"2023-11-26T07:23:08.871562+0000","last_active":"2023-11-26T07:23:10.337623+0000","last_peered":"2023-11-26T07:23:10.337623+0000","last_clean":"2023-11-26T07:23:10.337623+0000","last_became_active":"2023-11-26T07:23:08.871289+0000","last_became_peered":"2023-11-26T07:23:08.871289+0000","last_unstale":"2023-11-26T07:23:10.337623+0000","last_undegraded":"2023-11-26T07:23:10.337623+0000","last_fullsized":"2023-11-26T07:23:10.337623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:09:50.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336885+0000","last_change":"2023-11-26T07:23:08.055229+0000","last_active":"2023-11-26T07:23:10.336885+0000","last_peered":"2023-11-26T07:23:10.336885+0000","last_clean":"2023-11-26T07:23:10.336885+0000","last_became_active":"2023-11-26T07:23:08.054927+0000","last_became_peered":"2023-11-26T07:23:08.054927+0000","last_unstale":"2023-11-26T07:23:10.336885+0000","last_undegraded":"2023-11-26T07:23:10.336885+0000","last_fullsized":"2023-11-26T07:23:10.336885+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:34:03.521921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336473+0000","last_change":"2023-11-26T07:23:08.875331+0000","last_active":"2023-11-26T07:23:10.336473+0000","last_peered":"2023-11-26T07:23:10.336473+0000","last_clean":"2023-11-26T07:23:10.336473+0000","last_became_active":"2023-11-26T07:23:08.874678+0000","last_became_peered":"2023-11-26T07:23:08.874678+0000","last_unstale":"2023-11-26T07:23:10.336473+0000","last_undegraded":"2023-11-26T07:23:10.336473+0000","last_fullsized":"2023-11-26T07:23:10.336473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:38:11.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337818+0000","last_change":"2023-11-26T07:23:08.046485+0000","last_active":"2023-11-26T07:23:10.337818+0000","last_peered":"2023-11-26T07:23:10.337818+0000","last_clean":"2023-11-26T07:23:10.337818+0000","last_became_active":"2023-11-26T07:23:08.041549+0000","last_became_peered":"2023-11-26T07:23:08.041549+0000","last_unstale":"2023-11-26T07:23:10.337818+0000","last_undegraded":"2023-11-26T07:23:10.337818+0000","last_fullsized":"2023-11-26T07:23:10.337818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:35:42.972810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846408+0000","last_change":"2023-11-26T07:23:08.863982+0000","last_active":"2023-11-26T07:23:09.846408+0000","last_peered":"2023-11-26T07:23:09.846408+0000","last_clean":"2023-11-26T07:23:09.846408+0000","last_became_active":"2023-11-26T07:23:08.863700+0000","last_became_peered":"2023-11-26T07:23:08.863700+0000","last_unstale":"2023-11-26T07:23:09.846408+0000","last_undegraded":"2023-11-26T07:23:09.846408+0000","last_fullsized":"2023-11-26T07:23:09.846408+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:39:37.906134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336545+0000","last_change":"2023-11-26T07:23:08.053639+0000","last_active":"2023-11-26T07:23:10.336545+0000","last_peered":"2023-11-26T07:23:10.336545+0000","last_clean":"2023-11-26T07:23:10.336545+0000","last_became_active":"2023-11-26T07:23:08.053259+0000","last_became_peered":"2023-11-26T07:23:08.053259+0000","last_unstale":"2023-11-26T07:23:10.336545+0000","last_undegraded":"2023-11-26T07:23:10.336545+0000","last_fullsized":"2023-11-26T07:23:10.336545+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:38:54.264621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336750+0000","last_change":"2023-11-26T07:23:08.872355+0000","last_active":"2023-11-26T07:23:10.336750+0000","last_peered":"2023-11-26T07:23:10.336750+0000","last_clean":"2023-11-26T07:23:10.336750+0000","last_became_active":"2023-11-26T07:23:08.872050+0000","last_became_peered":"2023-11-26T07:23:08.872050+0000","last_unstale":"2023-11-26T07:23:10.336750+0000","last_undegraded":"2023-11-26T07:23:10.336750+0000","last_fullsized":"2023-11-26T07:23:10.336750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:28:28.703762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337332+0000","last_change":"2023-11-26T07:23:08.046477+0000","last_active":"2023-11-26T07:23:10.337332+0000","last_peered":"2023-11-26T07:23:10.337332+0000","last_clean":"2023-11-26T07:23:10.337332+0000","last_became_active":"2023-11-26T07:23:08.046171+0000","last_became_peered":"2023-11-26T07:23:08.046171+0000","last_unstale":"2023-11-26T07:23:10.337332+0000","last_undegraded":"2023-11-26T07:23:10.337332+0000","last_fullsized":"2023-11-26T07:23:10.337332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:50:19.030697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845456+0000","last_change":"2023-11-26T07:23:08.861738+0000","last_active":"2023-11-26T07:23:09.845456+0000","last_peered":"2023-11-26T07:23:09.845456+0000","last_clean":"2023-11-26T07:23:09.845456+0000","last_became_active":"2023-11-26T07:23:08.861442+0000","last_became_peered":"2023-11-26T07:23:08.861442+0000","last_unstale":"2023-11-26T07:23:09.845456+0000","last_undegraded":"2023-11-26T07:23:09.845456+0000","last_fullsized":"2023-11-26T07:23:09.845456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:57:24.236722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846916+0000","last_change":"2023-11-26T07:23:08.050800+0000","last_active":"2023-11-26T07:23:09.846916+0000","last_peered":"2023-11-26T07:23:09.846916+0000","last_clean":"2023-11-26T07:23:09.846916+0000","last_became_active":"2023-11-26T07:23:08.050200+0000","last_became_peered":"2023-11-26T07:23:08.050200+0000","last_unstale":"2023-11-26T07:23:09.846916+0000","last_undegraded":"2023-11-26T07:23:09.846916+0000","last_fullsized":"2023-11-26T07:23:09.846916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:43:14.829064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336098+0000","last_change":"2023-11-26T07:23:08.872385+0000","last_active":"2023-11-26T07:23:10.336098+0000","last_peered":"2023-11-26T07:23:10.336098+0000","last_clean":"2023-11-26T07:23:10.336098+0000","last_became_active":"2023-11-26T07:23:08.872110+0000","last_became_peered":"2023-11-26T07:23:08.872110+0000","last_unstale":"2023-11-26T07:23:10.336098+0000","last_undegraded":"2023-11-26T07:23:10.336098+0000","last_fullsized":"2023-11-26T07:23:10.336098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:04:13.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845443+0000","last_change":"2023-11-26T07:23:08.039896+0000","last_active":"2023-11-26T07:23:09.845443+0000","last_peered":"2023-11-26T07:23:09.845443+0000","last_clean":"2023-11-26T07:23:09.845443+0000","last_became_active":"2023-11-26T07:23:08.039643+0000","last_became_peered":"2023-11-26T07:23:08.039643+0000","last_unstale":"2023-11-26T07:23:09.845443+0000","last_undegraded":"2023-11-26T07:23:09.845443+0000","last_fullsized":"2023-11-26T07:23:09.845443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:58:45.070997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846924+0000","last_change":"2023-11-26T07:23:08.871656+0000","last_active":"2023-11-26T07:23:09.846924+0000","last_peered":"2023-11-26T07:23:09.846924+0000","last_clean":"2023-11-26T07:23:09.846924+0000","last_became_active":"2023-11-26T07:23:08.871360+0000","last_became_peered":"2023-11-26T07:23:08.871360+0000","last_unstale":"2023-11-26T07:23:09.846924+0000","last_undegraded":"2023-11-26T07:23:09.846924+0000","last_fullsized":"2023-11-26T07:23:09.846924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:04:13.855477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336759+0000","last_change":"2023-11-26T07:23:08.050809+0000","last_active":"2023-11-26T07:23:10.336759+0000","last_peered":"2023-11-26T07:23:10.336759+0000","last_clean":"2023-11-26T07:23:10.336759+0000","last_became_active":"2023-11-26T07:23:08.050200+0000","last_became_peered":"2023-11-26T07:23:08.050200+0000","last_unstale":"2023-11-26T07:23:10.336759+0000","last_undegraded":"2023-11-26T07:23:10.336759+0000","last_fullsized":"2023-11-26T07:23:10.336759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:54.103963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336398+0000","last_change":"2023-11-26T07:23:08.877709+0000","last_active":"2023-11-26T07:23:10.336398+0000","last_peered":"2023-11-26T07:23:10.336398+0000","last_clean":"2023-11-26T07:23:10.336398+0000","last_became_active":"2023-11-26T07:23:08.877415+0000","last_became_peered":"2023-11-26T07:23:08.877415+0000","last_unstale":"2023-11-26T07:23:10.336398+0000","last_undegraded":"2023-11-26T07:23:10.336398+0000","last_fullsized":"2023-11-26T07:23:10.336398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:22:41.469325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337945+0000","last_change":"2023-11-26T07:23:08.051992+0000","last_active":"2023-11-26T07:23:10.337945+0000","last_peered":"2023-11-26T07:23:10.337945+0000","last_clean":"2023-11-26T07:23:10.337945+0000","last_became_active":"2023-11-26T07:23:08.051712+0000","last_became_peered":"2023-11-26T07:23:08.051712+0000","last_unstale":"2023-11-26T07:23:10.337945+0000","last_undegraded":"2023-11-26T07:23:10.337945+0000","last_fullsized":"2023-11-26T07:23:10.337945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:59.421665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337823+0000","last_change":"2023-11-26T07:23:08.865463+0000","last_active":"2023-11-26T07:23:10.337823+0000","last_peered":"2023-11-26T07:23:10.337823+0000","last_clean":"2023-11-26T07:23:10.337823+0000","last_became_active":"2023-11-26T07:23:08.865172+0000","last_became_peered":"2023-11-26T07:23:08.865172+0000","last_unstale":"2023-11-26T07:23:10.337823+0000","last_undegraded":"2023-11-26T07:23:10.337823+0000","last_fullsized":"2023-11-26T07:23:10.337823+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:28:28.703762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336675+0000","last_change":"2023-11-26T07:23:08.040807+0000","last_active":"2023-11-26T07:23:10.336675+0000","last_peered":"2023-11-26T07:23:10.336675+0000","last_clean":"2023-11-26T07:23:10.336675+0000","last_became_active":"2023-11-26T07:23:08.040546+0000","last_became_peered":"2023-11-26T07:23:08.040546+0000","last_unstale":"2023-11-26T07:23:10.336675+0000","last_undegraded":"2023-11-26T07:23:10.336675+0000","last_fullsized":"2023-11-26T07:23:10.336675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:57:30.172804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846029+0000","last_change":"2023-11-26T07:23:08.858599+0000","last_active":"2023-11-26T07:23:09.846029+0000","last_peered":"2023-11-26T07:23:09.846029+0000","last_clean":"2023-11-26T07:23:09.846029+0000","last_became_active":"2023-11-26T07:23:08.858278+0000","last_became_peered":"2023-11-26T07:23:08.858278+0000","last_unstale":"2023-11-26T07:23:09.846029+0000","last_undegraded":"2023-11-26T07:23:09.846029+0000","last_fullsized":"2023-11-26T07:23:09.846029+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:09:43.630432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847175+0000","last_change":"2023-11-26T07:23:08.037373+0000","last_active":"2023-11-26T07:23:09.847175+0000","last_peered":"2023-11-26T07:23:09.847175+0000","last_clean":"2023-11-26T07:23:09.847175+0000","last_became_active":"2023-11-26T07:23:08.037097+0000","last_became_peered":"2023-11-26T07:23:08.037097+0000","last_unstale":"2023-11-26T07:23:09.847175+0000","last_undegraded":"2023-11-26T07:23:09.847175+0000","last_fullsized":"2023-11-26T07:23:09.847175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:53:00.253920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336196+0000","last_change":"2023-11-26T07:23:08.874091+0000","last_active":"2023-11-26T07:23:10.336196+0000","last_peered":"2023-11-26T07:23:10.336196+0000","last_clean":"2023-11-26T07:23:10.336196+0000","last_became_active":"2023-11-26T07:23:08.873753+0000","last_became_peered":"2023-11-26T07:23:08.873753+0000","last_unstale":"2023-11-26T07:23:10.336196+0000","last_undegraded":"2023-11-26T07:23:10.336196+0000","last_fullsized":"2023-11-26T07:23:10.336196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:59:46.023144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846945+0000","last_change":"2023-11-26T07:23:08.052231+0000","last_active":"2023-11-26T07:23:09.846945+0000","last_peered":"2023-11-26T07:23:09.846945+0000","last_clean":"2023-11-26T07:23:09.846945+0000","last_became_active":"2023-11-26T07:23:08.051916+0000","last_became_peered":"2023-11-26T07:23:08.051916+0000","last_unstale":"2023-11-26T07:23:09.846945+0000","last_undegraded":"2023-11-26T07:23:09.846945+0000","last_fullsized":"2023-11-26T07:23:09.846945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:42:14.244536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846555+0000","last_change":"2023-11-26T07:23:08.865552+0000","last_active":"2023-11-26T07:23:09.846555+0000","last_peered":"2023-11-26T07:23:09.846555+0000","last_clean":"2023-11-26T07:23:09.846555+0000","last_became_active":"2023-11-26T07:23:08.865220+0000","last_became_peered":"2023-11-26T07:23:08.865220+0000","last_unstale":"2023-11-26T07:23:09.846555+0000","last_undegraded":"2023-11-26T07:23:09.846555+0000","last_fullsized":"2023-11-26T07:23:09.846555+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:00:29.031673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337333+0000","last_change":"2023-11-26T07:23:08.039578+0000","last_active":"2023-11-26T07:23:10.337333+0000","last_peered":"2023-11-26T07:23:10.337333+0000","last_clean":"2023-11-26T07:23:10.337333+0000","last_became_active":"2023-11-26T07:23:08.039269+0000","last_became_peered":"2023-11-26T07:23:08.039269+0000","last_unstale":"2023-11-26T07:23:10.337333+0000","last_undegraded":"2023-11-26T07:23:10.337333+0000","last_fullsized":"2023-11-26T07:23:10.337333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:39:54.052986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335932+0000","last_change":"2023-11-26T07:23:08.865450+0000","last_active":"2023-11-26T07:23:10.335932+0000","last_peered":"2023-11-26T07:23:10.335932+0000","last_clean":"2023-11-26T07:23:10.335932+0000","last_became_active":"2023-11-26T07:23:08.864087+0000","last_became_peered":"2023-11-26T07:23:08.864087+0000","last_unstale":"2023-11-26T07:23:10.335932+0000","last_undegraded":"2023-11-26T07:23:10.335932+0000","last_fullsized":"2023-11-26T07:23:10.335932+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:09:31.147191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846225+0000","last_change":"2023-11-26T07:23:08.044998+0000","last_active":"2023-11-26T07:23:09.846225+0000","last_peered":"2023-11-26T07:23:09.846225+0000","last_clean":"2023-11-26T07:23:09.846225+0000","last_became_active":"2023-11-26T07:23:08.044764+0000","last_became_peered":"2023-11-26T07:23:08.044764+0000","last_unstale":"2023-11-26T07:23:09.846225+0000","last_undegraded":"2023-11-26T07:23:09.846225+0000","last_fullsized":"2023-11-26T07:23:09.846225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:40.379329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845583+0000","last_change":"2023-11-26T07:23:08.864220+0000","last_active":"2023-11-26T07:23:09.845583+0000","last_peered":"2023-11-26T07:23:09.845583+0000","last_clean":"2023-11-26T07:23:09.845583+0000","last_became_active":"2023-11-26T07:23:08.863966+0000","last_became_peered":"2023-11-26T07:23:08.863966+0000","last_unstale":"2023-11-26T07:23:09.845583+0000","last_undegraded":"2023-11-26T07:23:09.845583+0000","last_fullsized":"2023-11-26T07:23:09.845583+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:11:09.082051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336150+0000","last_change":"2023-11-26T07:23:08.059519+0000","last_active":"2023-11-26T07:23:10.336150+0000","last_peered":"2023-11-26T07:23:10.336150+0000","last_clean":"2023-11-26T07:23:10.336150+0000","last_became_active":"2023-11-26T07:23:08.058826+0000","last_became_peered":"2023-11-26T07:23:08.058826+0000","last_unstale":"2023-11-26T07:23:10.336150+0000","last_undegraded":"2023-11-26T07:23:10.336150+0000","last_fullsized":"2023-11-26T07:23:10.336150+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:23:59.421665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337164+0000","last_change":"2023-11-26T07:23:08.859990+0000","last_active":"2023-11-26T07:23:10.337164+0000","last_peered":"2023-11-26T07:23:10.337164+0000","last_clean":"2023-11-26T07:23:10.337164+0000","last_became_active":"2023-11-26T07:23:08.859462+0000","last_became_peered":"2023-11-26T07:23:08.859462+0000","last_unstale":"2023-11-26T07:23:10.337164+0000","last_undegraded":"2023-11-26T07:23:10.337164+0000","last_fullsized":"2023-11-26T07:23:10.337164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:02:25.570820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337865+0000","last_change":"2023-11-26T07:23:08.043752+0000","last_active":"2023-11-26T07:23:10.337865+0000","last_peered":"2023-11-26T07:23:10.337865+0000","last_clean":"2023-11-26T07:23:10.337865+0000","last_became_active":"2023-11-26T07:23:08.043454+0000","last_became_peered":"2023-11-26T07:23:08.043454+0000","last_unstale":"2023-11-26T07:23:10.337865+0000","last_undegraded":"2023-11-26T07:23:10.337865+0000","last_fullsized":"2023-11-26T07:23:10.337865+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:43.204178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336539+0000","last_change":"2023-11-26T07:23:08.875214+0000","last_active":"2023-11-26T07:23:10.336539+0000","last_peered":"2023-11-26T07:23:10.336539+0000","last_clean":"2023-11-26T07:23:10.336539+0000","last_became_active":"2023-11-26T07:23:08.874945+0000","last_became_peered":"2023-11-26T07:23:08.874945+0000","last_unstale":"2023-11-26T07:23:10.336539+0000","last_undegraded":"2023-11-26T07:23:10.336539+0000","last_fullsized":"2023-11-26T07:23:10.336539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:42:30.479550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337204+0000","last_change":"2023-11-26T07:23:08.056498+0000","last_active":"2023-11-26T07:23:10.337204+0000","last_peered":"2023-11-26T07:23:10.337204+0000","last_clean":"2023-11-26T07:23:10.337204+0000","last_became_active":"2023-11-26T07:23:08.054719+0000","last_became_peered":"2023-11-26T07:23:08.054719+0000","last_unstale":"2023-11-26T07:23:10.337204+0000","last_undegraded":"2023-11-26T07:23:10.337204+0000","last_fullsized":"2023-11-26T07:23:10.337204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:47:10.053447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.847142+0000","last_change":"2023-11-26T07:23:08.869420+0000","last_active":"2023-11-26T07:23:09.847142+0000","last_peered":"2023-11-26T07:23:09.847142+0000","last_clean":"2023-11-26T07:23:09.847142+0000","last_became_active":"2023-11-26T07:23:08.868396+0000","last_became_peered":"2023-11-26T07:23:08.868396+0000","last_unstale":"2023-11-26T07:23:09.847142+0000","last_undegraded":"2023-11-26T07:23:09.847142+0000","last_fullsized":"2023-11-26T07:23:09.847142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:02:02.504585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337782+0000","last_change":"2023-11-26T07:23:08.056486+0000","last_active":"2023-11-26T07:23:10.337782+0000","last_peered":"2023-11-26T07:23:10.337782+0000","last_clean":"2023-11-26T07:23:10.337782+0000","last_became_active":"2023-11-26T07:23:08.056142+0000","last_became_peered":"2023-11-26T07:23:08.056142+0000","last_unstale":"2023-11-26T07:23:10.337782+0000","last_undegraded":"2023-11-26T07:23:10.337782+0000","last_fullsized":"2023-11-26T07:23:10.337782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:46:02.459085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846137+0000","last_change":"2023-11-26T07:23:08.861708+0000","last_active":"2023-11-26T07:23:09.846137+0000","last_peered":"2023-11-26T07:23:09.846137+0000","last_clean":"2023-11-26T07:23:09.846137+0000","last_became_active":"2023-11-26T07:23:08.861311+0000","last_became_peered":"2023-11-26T07:23:08.861311+0000","last_unstale":"2023-11-26T07:23:09.846137+0000","last_undegraded":"2023-11-26T07:23:09.846137+0000","last_fullsized":"2023-11-26T07:23:09.846137+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:47:03.506930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336661+0000","last_change":"2023-11-26T07:23:08.059780+0000","last_active":"2023-11-26T07:23:10.336661+0000","last_peered":"2023-11-26T07:23:10.336661+0000","last_clean":"2023-11-26T07:23:10.336661+0000","last_became_active":"2023-11-26T07:23:08.059336+0000","last_became_peered":"2023-11-26T07:23:08.059336+0000","last_unstale":"2023-11-26T07:23:10.336661+0000","last_undegraded":"2023-11-26T07:23:10.336661+0000","last_fullsized":"2023-11-26T07:23:10.336661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:28.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336565+0000","last_change":"2023-11-26T07:23:08.861329+0000","last_active":"2023-11-26T07:23:10.336565+0000","last_peered":"2023-11-26T07:23:10.336565+0000","last_clean":"2023-11-26T07:23:10.336565+0000","last_became_active":"2023-11-26T07:23:08.859994+0000","last_became_peered":"2023-11-26T07:23:08.859994+0000","last_unstale":"2023-11-26T07:23:10.336565+0000","last_undegraded":"2023-11-26T07:23:10.336565+0000","last_fullsized":"2023-11-26T07:23:10.336565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:44:41.945797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337453+0000","last_change":"2023-11-26T07:23:08.046098+0000","last_active":"2023-11-26T07:23:10.337453+0000","last_peered":"2023-11-26T07:23:10.337453+0000","last_clean":"2023-11-26T07:23:10.337453+0000","last_became_active":"2023-11-26T07:23:08.042657+0000","last_became_peered":"2023-11-26T07:23:08.042657+0000","last_unstale":"2023-11-26T07:23:10.337453+0000","last_undegraded":"2023-11-26T07:23:10.337453+0000","last_fullsized":"2023-11-26T07:23:10.337453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:49:58.650825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336110+0000","last_change":"2023-11-26T07:23:08.864127+0000","last_active":"2023-11-26T07:23:10.336110+0000","last_peered":"2023-11-26T07:23:10.336110+0000","last_clean":"2023-11-26T07:23:10.336110+0000","last_became_active":"2023-11-26T07:23:08.863857+0000","last_became_peered":"2023-11-26T07:23:08.863857+0000","last_unstale":"2023-11-26T07:23:10.336110+0000","last_undegraded":"2023-11-26T07:23:10.336110+0000","last_fullsized":"2023-11-26T07:23:10.336110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:15.097076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846353+0000","last_change":"2023-11-26T07:23:08.038118+0000","last_active":"2023-11-26T07:23:09.846353+0000","last_peered":"2023-11-26T07:23:09.846353+0000","last_clean":"2023-11-26T07:23:09.846353+0000","last_became_active":"2023-11-26T07:23:08.037752+0000","last_became_peered":"2023-11-26T07:23:08.037752+0000","last_unstale":"2023-11-26T07:23:09.846353+0000","last_undegraded":"2023-11-26T07:23:09.846353+0000","last_fullsized":"2023-11-26T07:23:09.846353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T08:23:18.253466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336194+0000","last_change":"2023-11-26T07:23:08.861763+0000","last_active":"2023-11-26T07:23:10.336194+0000","last_peered":"2023-11-26T07:23:10.336194+0000","last_clean":"2023-11-26T07:23:10.336194+0000","last_became_active":"2023-11-26T07:23:08.861479+0000","last_became_peered":"2023-11-26T07:23:08.861479+0000","last_unstale":"2023-11-26T07:23:10.336194+0000","last_undegraded":"2023-11-26T07:23:10.336194+0000","last_fullsized":"2023-11-26T07:23:10.336194+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T19:14:01.066055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335884+0000","last_change":"2023-11-26T07:23:08.048923+0000","last_active":"2023-11-26T07:23:10.335884+0000","last_peered":"2023-11-26T07:23:10.335884+0000","last_clean":"2023-11-26T07:23:10.335884+0000","last_became_active":"2023-11-26T07:23:08.048659+0000","last_became_peered":"2023-11-26T07:23:08.048659+0000","last_unstale":"2023-11-26T07:23:10.335884+0000","last_undegraded":"2023-11-26T07:23:10.335884+0000","last_fullsized":"2023-11-26T07:23:10.335884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:02:24.564489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336621+0000","last_change":"2023-11-26T07:23:08.859236+0000","last_active":"2023-11-26T07:23:10.336621+0000","last_peered":"2023-11-26T07:23:10.336621+0000","last_clean":"2023-11-26T07:23:10.336621+0000","last_became_active":"2023-11-26T07:23:08.858862+0000","last_became_peered":"2023-11-26T07:23:08.858862+0000","last_unstale":"2023-11-26T07:23:10.336621+0000","last_undegraded":"2023-11-26T07:23:10.336621+0000","last_fullsized":"2023-11-26T07:23:10.336621+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:35:34.411319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337880+0000","last_change":"2023-11-26T07:23:08.044513+0000","last_active":"2023-11-26T07:23:10.337880+0000","last_peered":"2023-11-26T07:23:10.337880+0000","last_clean":"2023-11-26T07:23:10.337880+0000","last_became_active":"2023-11-26T07:23:08.044244+0000","last_became_peered":"2023-11-26T07:23:08.044244+0000","last_unstale":"2023-11-26T07:23:10.337880+0000","last_undegraded":"2023-11-26T07:23:10.337880+0000","last_fullsized":"2023-11-26T07:23:10.337880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:45:55.874541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846918+0000","last_change":"2023-11-26T07:23:08.859717+0000","last_active":"2023-11-26T07:23:09.846918+0000","last_peered":"2023-11-26T07:23:09.846918+0000","last_clean":"2023-11-26T07:23:09.846918+0000","last_became_active":"2023-11-26T07:23:08.859400+0000","last_became_peered":"2023-11-26T07:23:08.859400+0000","last_unstale":"2023-11-26T07:23:09.846918+0000","last_undegraded":"2023-11-26T07:23:09.846918+0000","last_fullsized":"2023-11-26T07:23:09.846918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T11:57:22.295755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846925+0000","last_change":"2023-11-26T07:23:08.043377+0000","last_active":"2023-11-26T07:23:09.846925+0000","last_peered":"2023-11-26T07:23:09.846925+0000","last_clean":"2023-11-26T07:23:09.846925+0000","last_became_active":"2023-11-26T07:23:08.043067+0000","last_became_peered":"2023-11-26T07:23:08.043067+0000","last_unstale":"2023-11-26T07:23:09.846925+0000","last_undegraded":"2023-11-26T07:23:09.846925+0000","last_fullsized":"2023-11-26T07:23:09.846925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:28:27.697431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.335854+0000","last_change":"2023-11-26T07:23:08.873879+0000","last_active":"2023-11-26T07:23:10.335854+0000","last_peered":"2023-11-26T07:23:10.335854+0000","last_clean":"2023-11-26T07:23:10.335854+0000","last_became_active":"2023-11-26T07:23:08.873468+0000","last_became_peered":"2023-11-26T07:23:08.873468+0000","last_unstale":"2023-11-26T07:23:10.335854+0000","last_undegraded":"2023-11-26T07:23:10.335854+0000","last_fullsized":"2023-11-26T07:23:10.335854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T15:32:54.385222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846115+0000","last_change":"2023-11-26T07:23:08.040895+0000","last_active":"2023-11-26T07:23:09.846115+0000","last_peered":"2023-11-26T07:23:09.846115+0000","last_clean":"2023-11-26T07:23:09.846115+0000","last_became_active":"2023-11-26T07:23:08.040440+0000","last_became_peered":"2023-11-26T07:23:08.040440+0000","last_unstale":"2023-11-26T07:23:09.846115+0000","last_undegraded":"2023-11-26T07:23:09.846115+0000","last_fullsized":"2023-11-26T07:23:09.846115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:19:10.821163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336321+0000","last_change":"2023-11-26T07:23:08.875534+0000","last_active":"2023-11-26T07:23:10.336321+0000","last_peered":"2023-11-26T07:23:10.336321+0000","last_clean":"2023-11-26T07:23:10.336321+0000","last_became_active":"2023-11-26T07:23:08.875047+0000","last_became_peered":"2023-11-26T07:23:08.875047+0000","last_unstale":"2023-11-26T07:23:10.336321+0000","last_undegraded":"2023-11-26T07:23:10.336321+0000","last_fullsized":"2023-11-26T07:23:10.336321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T07:41:38.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336425+0000","last_change":"2023-11-26T07:23:08.050909+0000","last_active":"2023-11-26T07:23:10.336425+0000","last_peered":"2023-11-26T07:23:10.336425+0000","last_clean":"2023-11-26T07:23:10.336425+0000","last_became_active":"2023-11-26T07:23:08.050618+0000","last_became_peered":"2023-11-26T07:23:08.050618+0000","last_unstale":"2023-11-26T07:23:10.336425+0000","last_undegraded":"2023-11-26T07:23:10.336425+0000","last_fullsized":"2023-11-26T07:23:10.336425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T13:43:28.768025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845981+0000","last_change":"2023-11-26T07:23:08.854715+0000","last_active":"2023-11-26T07:23:09.845981+0000","last_peered":"2023-11-26T07:23:09.845981+0000","last_clean":"2023-11-26T07:23:09.845981+0000","last_became_active":"2023-11-26T07:23:08.854271+0000","last_became_peered":"2023-11-26T07:23:08.854271+0000","last_unstale":"2023-11-26T07:23:09.845981+0000","last_undegraded":"2023-11-26T07:23:09.845981+0000","last_fullsized":"2023-11-26T07:23:09.845981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:46:51.454599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.845842+0000","last_change":"2023-11-26T07:23:08.035124+0000","last_active":"2023-11-26T07:23:09.845842+0000","last_peered":"2023-11-26T07:23:09.845842+0000","last_clean":"2023-11-26T07:23:09.845842+0000","last_became_active":"2023-11-26T07:23:08.034876+0000","last_became_peered":"2023-11-26T07:23:08.034876+0000","last_unstale":"2023-11-26T07:23:09.845842+0000","last_undegraded":"2023-11-26T07:23:09.845842+0000","last_fullsized":"2023-11-26T07:23:09.845842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:12:06.915152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337513+0000","last_change":"2023-11-26T07:23:08.877329+0000","last_active":"2023-11-26T07:23:10.337513+0000","last_peered":"2023-11-26T07:23:10.337513+0000","last_clean":"2023-11-26T07:23:10.337513+0000","last_became_active":"2023-11-26T07:23:08.876722+0000","last_became_peered":"2023-11-26T07:23:08.876722+0000","last_unstale":"2023-11-26T07:23:10.337513+0000","last_undegraded":"2023-11-26T07:23:10.337513+0000","last_fullsized":"2023-11-26T07:23:10.337513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T10:33:46.670976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846820+0000","last_change":"2023-11-26T07:23:08.052732+0000","last_active":"2023-11-26T07:23:09.846820+0000","last_peered":"2023-11-26T07:23:09.846820+0000","last_clean":"2023-11-26T07:23:09.846820+0000","last_became_active":"2023-11-26T07:23:08.052476+0000","last_became_peered":"2023-11-26T07:23:08.052476+0000","last_unstale":"2023-11-26T07:23:09.846820+0000","last_undegraded":"2023-11-26T07:23:09.846820+0000","last_fullsized":"2023-11-26T07:23:09.846820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T16:00:19.348218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:09.846917+0000","last_change":"2023-11-26T07:23:08.856954+0000","last_active":"2023-11-26T07:23:09.846917+0000","last_peered":"2023-11-26T07:23:09.846917+0000","last_clean":"2023-11-26T07:23:09.846917+0000","last_became_active":"2023-11-26T07:23:08.856663+0000","last_became_peered":"2023-11-26T07:23:08.856663+0000","last_unstale":"2023-11-26T07:23:09.846917+0000","last_undegraded":"2023-11-26T07:23:09.846917+0000","last_fullsized":"2023-11-26T07:23:09.846917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:26:52.843039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336338+0000","last_change":"2023-11-26T07:23:08.055764+0000","last_active":"2023-11-26T07:23:10.336338+0000","last_peered":"2023-11-26T07:23:10.336338+0000","last_clean":"2023-11-26T07:23:10.336338+0000","last_became_active":"2023-11-26T07:23:08.055490+0000","last_became_peered":"2023-11-26T07:23:08.055490+0000","last_unstale":"2023-11-26T07:23:10.336338+0000","last_undegraded":"2023-11-26T07:23:10.336338+0000","last_fullsized":"2023-11-26T07:23:10.336338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T12:45:55.874541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336842+0000","last_change":"2023-11-26T07:23:08.855469+0000","last_active":"2023-11-26T07:23:10.336842+0000","last_peered":"2023-11-26T07:23:10.336842+0000","last_clean":"2023-11-26T07:23:10.336842+0000","last_became_active":"2023-11-26T07:23:08.855176+0000","last_became_peered":"2023-11-26T07:23:08.855176+0000","last_unstale":"2023-11-26T07:23:10.336842+0000","last_undegraded":"2023-11-26T07:23:10.336842+0000","last_fullsized":"2023-11-26T07:23:10.336842+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T17:45:55.110295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336561+0000","last_change":"2023-11-26T07:23:08.042948+0000","last_active":"2023-11-26T07:23:10.336561+0000","last_peered":"2023-11-26T07:23:10.336561+0000","last_clean":"2023-11-26T07:23:10.336561+0000","last_became_active":"2023-11-26T07:23:08.042577+0000","last_became_peered":"2023-11-26T07:23:08.042577+0000","last_unstale":"2023-11-26T07:23:10.336561+0000","last_undegraded":"2023-11-26T07:23:10.336561+0000","last_fullsized":"2023-11-26T07:23:10.336561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:17:07.996777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.336363+0000","last_change":"2023-11-26T07:23:08.860548+0000","last_active":"2023-11-26T07:23:10.336363+0000","last_peered":"2023-11-26T07:23:10.336363+0000","last_clean":"2023-11-26T07:23:10.336363+0000","last_became_active":"2023-11-26T07:23:08.860284+0000","last_became_peered":"2023-11-26T07:23:08.860284+0000","last_unstale":"2023-11-26T07:23:10.336363+0000","last_undegraded":"2023-11-26T07:23:10.336363+0000","last_fullsized":"2023-11-26T07:23:10.336363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:08.019215+0000","last_clean_scrub_stamp":"2023-11-26T07:23:08.019215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T14:18:24.257746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-26T07:23:10.337574+0000","last_change":"2023-11-26T07:23:08.042612+0000","last_active":"2023-11-26T07:23:10.337574+0000","last_peered":"2023-11-26T07:23:10.337574+0000","last_clean":"2023-11-26T07:23:10.337574+0000","last_became_active":"2023-11-26T07:23:08.042060+0000","last_became_peered":"2023-11-26T07:23:08.042060+0000","last_unstale":"2023-11-26T07:23:10.337574+0000","last_undegraded":"2023-11-26T07:23:10.337574+0000","last_fullsized":"2023-11-26T07:23:10.337574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:23:07.012883+0000","last_clean_scrub_stamp":"2023-11-26T07:23:07.012883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:02:01.498254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":213,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-11-26T07:23:08.859115+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:23:08.859115+0000","last_peered":"2023-11-26T07:23:08.859115+0000","last_clean":"2023-11-26T07:23:08.859115+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:23:08.859115+0000","last_undegraded":"2023-11-26T07:23:08.859115+0000","last_fullsized":"2023-11-26T07:23:08.859115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1540096,"data_stored":990789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.88300000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.64700000000000002,"15min":0.629},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.51000000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.44800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.755},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.53400000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86499999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.57499999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63600000000000001,"15min":0.70499999999999996},"min":{"1min":0.40300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84199999999999997,"5min":1.923,"15min":1.923},"last":0.47499999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63700000000000001,"15min":0.66400000000000003},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86099999999999999,"5min":1,"15min":1},"last":0.73399999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.49099999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93300000000000005,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.71099999999999997,"15min":0.76700000000000002},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1839999999999999,"5min":1.863,"15min":1.863},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":399897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91500000000000004,"5min":1.171,"15min":1.171},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67600000000000005,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":1.093,"15min":1.093},"last":0.61699999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.50800000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84799999999999998,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67100000000000004,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.69499999999999995},"min":{"1min":0.51200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.76600000000000001},"min":{"1min":0.55300000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":1.089,"15min":1.089},"last":0.75800000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83899999999999997,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.749,"15min":0.76700000000000002},"min":{"1min":0.61399999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.88500000000000001,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.504},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.68300000000000005},"min":{"1min":0.46500000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83099999999999996,"5min":1.018,"15min":1.018},"last":0.442}]},{"osd":5,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.72499999999999998},"min":{"1min":0.45900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92900000000000005,"5min":1.133,"15min":1.133},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.72999999999999998},"min":{"1min":0.51800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":1.042,"15min":1.042},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Nov 26 07:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73699999999999999,"15min":0.77800000000000002},"min":{"1min":0.504,"5min":0.38,"15min":0.38},"max":{"1min":0.99399999999999999,"5min":1.196,"15min":1.196},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.74199999999999999,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95999999999999996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.56100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":954368,"data_stored":406195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.72999999999999998,"15min":0.96199999999999997},"min":{"1min":0.505,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83499999999999996,"5min":6.8019999999999996,"15min":6.8019999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.99099999999999999},"min":{"1min":0.60499999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.879,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":0.76500000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.80600000000000005,"15min":1.056},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.90400000000000003,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.82999999999999996,"15min":0.94699999999999995},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90800000000000003,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.88800000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.81299999999999994,"15min":0.81899999999999995},"min":{"1min":0.52900000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89100000000000001,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.96199999999999997},"min":{"1min":0.53500000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77400000000000002,"5min":6.7530000000000001,"15min":6.7530000000000001},"last":0.86299999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.80600000000000005,"15min":1.0880000000000001},"min":{"1min":0.45700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.871,"5min":7.7789999999999999,"15min":7.7789999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.90800000000000003,"15min":1.1259999999999999},"min":{"1min":0.53700000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86399999999999999,"5min":8.7530000000000001,"15min":8.7530000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.66500000000000004,"15min":0.92100000000000004},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78800000000000003,"5min":6.6879999999999997,"15min":6.6879999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.75800000000000001,"15min":1.0289999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93300000000000005,"5min":7.1680000000000001,"15min":7.1680000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81599999999999995,"15min":0.87},"min":{"1min":0.47899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84999999999999998,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.024,"15min":1.8720000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84399999999999997,"5min":24.623000000000001,"15min":24.623000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.83999999999999997,"15min":1.1479999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.873,"5min":7.6390000000000002,"15min":7.6390000000000002},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.91500000000000004,"15min":1.1499999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91700000000000004,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":954368,"data_stored":406175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88100000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.032,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.71099999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95899999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.438,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92900000000000005,"5min":1.218,"15min":1.218},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.91200000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.89700000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.74199999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98499999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.38600000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92000000000000004,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.66500000000000004,"15min":0.70899999999999996},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80000000000000004,"5min":1.238,"15min":1.238},"last":0.497}]},{"osd":6,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69499999999999995,"15min":0.755},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.88900000000000001,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73799999999999999,"15min":0.80600000000000005},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.876,"5min":1.095,"15min":1.095},"last":0.96999999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.78200000000000003},"min":{"1min":0.53800000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.873,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.82199999999999995},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93300000000000005,"5min":1.302,"15min":1.302},"last":0.47199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":946176,"data_stored":399917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.42699999999999999},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"min":{"1min":0.29299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.54900000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.46100000000000002},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51400000000000001,"15min":0.628},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.64300000000000002,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.51400000000000001},"min":{"1min":0.35799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70899999999999996,"15min":0.85399999999999998},"min":{"1min":0.48899999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.01,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69099999999999995,"15min":0.73899999999999999},"min":{"1min":0.503,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.88},"min":{"1min":0.47599999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.03,"5min":3.3210000000000002,"15min":3.3210000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.76800000000000002},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71099999999999997,"15min":0.749},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97499999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.89700000000000002},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.99199999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.753,"15min":0.91500000000000004},"min":{"1min":0.54100000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.032,"5min":3.476,"15min":3.476},"last":0.747},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73099999999999998,"15min":0.77500000000000002},"min":{"1min":0.55500000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":962560,"data_stored":407717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.41099999999999998},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.31},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.44},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60299999999999998,"5min":2.056,"15min":2.056},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.433,"15min":0.432},"min":{"1min":0.308,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69099999999999995,"5min":1.175,"15min":1.175},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.46300000000000002,"15min":0.48499999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68799999999999994,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84599999999999997,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.92600000000000005,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.71499999999999997},"min":{"1min":0.45700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.266,"5min":1.351,"15min":1.351},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.50600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90300000000000002,"5min":1.752,"15min":1.752},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71199999999999997,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95199999999999996,"5min":1.214,"15min":1.214},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72599999999999998,"15min":0.74199999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76600000000000001,"15min":0.79800000000000004},"min":{"1min":0.48799999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89700000000000002,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97999999999999998,"5min":1.421,"15min":1.421},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.746,"15min":0.752},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93999999999999995,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.78800000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92400000000000004,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.61699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335544,"statfs":{"total":96636764160,"available":96599597056,"internally_reserved":0,"allocated":970752,"data_stored":408333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41899999999999998,"15min":0.48699999999999999},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.505,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45600000000000002,"15min":0.47799999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59699999999999998,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56899999999999995,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.376},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.49199999999999999,"15min":0.55500000000000005},"min":{"1min":0.35099999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53200000000000003,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.434}]},{"osd":3,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53200000000000003,"15min":0.60999999999999999},"min":{"1min":0.377,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.628,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51100000000000001,"15min":0.55700000000000005},"min":{"1min":0.35699999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.623,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.752,"15min":0.81499999999999995},"min":{"1min":0.51800000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.085,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.72699999999999998,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.999,"5min":1.329,"15min":1.329},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.83899999999999997},"min":{"1min":0.54500000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0529999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76800000000000002,"15min":0.81999999999999995},"min":{"1min":0.56699999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.036,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:22:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.754,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0940000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76800000000000002,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1279999999999999,"5min":1.173,"15min":1.173},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36848,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":1544192,"data_stored":996473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47299999999999998,"15min":0.60499999999999998},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.439,"5min":0.47899999999999998,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61599999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.40699999999999997}]},{"osd":2,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.503,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63100000000000001,"5min":2.415,"15min":2.415},"last":0.435},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.54200000000000004,"15min":0.70199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63200000000000001,"5min":5.234,"15min":5.234},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.505,"15min":0.58899999999999997},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.56999999999999995,"5min":3.726,"15min":3.726},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.59099999999999997,"15min":0.75800000000000001},"min":{"1min":0.40999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.68700000000000006,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.495}]},{"osd":4,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.754,"15min":0.92100000000000004},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.105,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73399999999999999,"15min":0.81599999999999995},"min":{"1min":0.54100000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1659999999999999,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":0.754}]},{"osd":5,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.82099999999999995},"min":{"1min":0.54300000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.238,"5min":2.835,"15min":2.835},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75800000000000001,"15min":0.86499999999999999},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":3.3679999999999999,"15min":3.3679999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76800000000000002,"15min":0.86599999999999999},"min":{"1min":0.52300000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76000000000000001,"15min":0.83799999999999997},"min":{"1min":0.49299999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.034,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":0.874}]},{"osd":7,"last update":"Sun Nov 26 07:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.86899999999999999},"min":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90600000000000003,"5min":3.3300000000000001,"15min":3.3300000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.84599999999999997},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.071,"5min":2.798,"15min":2.798},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:23:13.489 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-26T07:23:13.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-26T07:23:13.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.671+0000 7f0ba0180640 1 Processor -- start 2023-11-26T07:23:13.672 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.671+0000 7f0ba0180640 1 -- start start 2023-11-26T07:23:13.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.671+0000 7f0ba0180640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0b981449f0 0x7f0b9806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.671+0000 7f0ba0180640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b9806dc70 0x7f0b980ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.671+0000 7f0ba0180640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9806d7e0 con 0x7f0b980cb8d0 2023-11-26T07:23:13.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.671+0000 7f0ba0180640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b980cebf0 con 0x7f0b981449f0 2023-11-26T07:23:13.674 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.671+0000 7f0ba0180640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9806cbd0 con 0x7f0b9806dc70 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0b981449f0 0x7f0b9806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0b981449f0 0x7f0b9806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51840/0 (socket says 172.21.15.70:51840) 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 -- 172.21.15.70:0/920884921 learned_addr learned my addr 172.21.15.70:0/920884921 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9d71b640 1 --2- 172.21.15.70:0/920884921 >> v2:172.21.15.120:3300/0 conn(0x7f0b9806dc70 0x7f0b980ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 -- 172.21.15.70:0/920884921 >> v2:172.21.15.120:3300/0 conn(0x7f0b9806dc70 msgr2=0x7f0b980ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 --2- 172.21.15.70:0/920884921 >> v2:172.21.15.120:3300/0 conn(0x7f0b9806dc70 0x7f0b980ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 -- 172.21.15.70:0/920884921 >> v1:172.21.15.120:6789/0 conn(0x7f0b980cb8d0 legacy=0x7f0b980705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:13.675 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 -- 172.21.15.70:0/920884921 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9806ceb0 con 0x7f0b981449f0 2023-11-26T07:23:13.676 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9df1c640 1 --2- 172.21.15.70:0/920884921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b981449f0 0x7f0b9806c540 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0b980723e0 tx=0x7f0b980714c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddff6affdf996234 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9cf1a640 1 -- 172.21.15.70:0/920884921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940aa5f0 con 0x7f0b981449f0 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9cf1a640 1 -- 172.21.15.70:0/920884921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b940aa750 con 0x7f0b981449f0 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.675+0000 7f0b9cf1a640 1 -- 172.21.15.70:0/920884921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940aaae0 con 0x7f0b981449f0 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- 172.21.15.70:0/920884921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b981449f0 msgr2=0x7f0b9806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 --2- 172.21.15.70:0/920884921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b981449f0 0x7f0b9806c540 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0b980723e0 tx=0x7f0b980714c0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- 172.21.15.70:0/920884921 shutdown_connections 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 --2- 172.21.15.70:0/920884921 >> v2:172.21.15.120:3300/0 conn(0x7f0b9806dc70 0x7f0b980ce6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.678 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 --2- 172.21.15.70:0/920884921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b981449f0 0x7f0b9806c540 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- 172.21.15.70:0/920884921 >> 172.21.15.70:0/920884921 conn(0x7f0b980b0bf0 msgr2=0x7f0b980b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:13.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- 172.21.15.70:0/920884921 shutdown_connections 2023-11-26T07:23:13.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- 172.21.15.70:0/920884921 wait complete. 2023-11-26T07:23:13.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 Processor -- start 2023-11-26T07:23:13.679 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- start start 2023-11-26T07:23:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b9806dc70 0x7f0b9813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b980cb8d0 0x7f0b980aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b981449f0 0x7f0b980abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b981403b0 con 0x7f0b9806dc70 2023-11-26T07:23:13.681 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98145170 con 0x7f0b981449f0 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0ba0180640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9815acc0 con 0x7f0b980cb8d0 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b9806dc70 0x7f0b9813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b9806dc70 0x7f0b9813fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51856/0 (socket says 172.21.15.70:51856) 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 -- 172.21.15.70:0/316787053 learned_addr learned my addr 172.21.15.70:0/316787053 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 -- 172.21.15.70:0/316787053 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b980cb8d0 msgr2=0x7f0b980aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b980cb8d0 0x7f0b980aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 -- 172.21.15.70:0/316787053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b981449f0 msgr2=0x7f0b980abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b981449f0 0x7f0b980abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.679+0000 7f0b9df1c640 1 -- 172.21.15.70:0/316787053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940094d0 con 0x7f0b9806dc70 2023-11-26T07:23:13.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b9df1c640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b9806dc70 0x7f0b9813fe70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0b9401a0c0 tx=0x7f0b9401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b8e7fc640 1 -- 172.21.15.70:0/316787053 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b3800 con 0x7f0b9806dc70 2023-11-26T07:23:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b8e7fc640 1 -- 172.21.15.70:0/316787053 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b940b3960 con 0x7f0b9806dc70 2023-11-26T07:23:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b8e7fc640 1 -- 172.21.15.70:0/316787053 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940b3cd0 con 0x7f0b9806dc70 2023-11-26T07:23:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9815afa0 con 0x7f0b9806dc70 2023-11-26T07:23:13.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b981453c0 con 0x7f0b9806dc70 2023-11-26T07:23:13.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b98067720 con 0x7f0b9806dc70 2023-11-26T07:23:13.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b8e7fc640 1 -- 172.21.15.70:0/316787053 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f0b940b2380 con 0x7f0b9806dc70 2023-11-26T07:23:13.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b8e7fc640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b7c066ce0 0x7f0b7c0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:13.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b8e7fc640 1 -- 172.21.15.70:0/316787053 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b940a7070 con 0x7f0b9806dc70 2023-11-26T07:23:13.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.683+0000 7f0b9d71b640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b7c066ce0 0x7f0b7c0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:13.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.687+0000 7f0b9d71b640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b7c066ce0 0x7f0b7c0691a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0b98143c10 tx=0x7f0b88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:13.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.687+0000 7f0b8e7fc640 1 -- 172.21.15.70:0/316787053 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b940ebc30 con 0x7f0b9806dc70 2023-11-26T07:23:13.892 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.891+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0b9806e210 con 0x7f0b9806dc70 2023-11-26T07:23:13.895 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0b8e7fc640 1 -- 172.21.15.70:0/316787053 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0b940c3020 con 0x7f0b9806dc70 2023-11-26T07:23:13.895 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-11-26T07:23:13.895 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDt8GJlnnBvKxAAmFcTzEmYwU+HPInnIsuZgA== 2023-11-26T07:23:13.896 INFO:teuthology.orchestra.run.smithi070.stdout: caps mds = "allow" 2023-11-26T07:23:13.896 INFO:teuthology.orchestra.run.smithi070.stdout: caps mon = "allow r" 2023-11-26T07:23:13.896 INFO:teuthology.orchestra.run.smithi070.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-26T07:23:13.896 INFO:teuthology.orchestra.run.smithi070.stderr:updated caps for client.0 2023-11-26T07:23:13.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b7c066ce0 msgr2=0x7f0b7c0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b7c066ce0 0x7f0b7c0691a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0b98143c10 tx=0x7f0b88008040 comp rx=0 tx=0).stop 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b9806dc70 msgr2=0x7f0b9813fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b9806dc70 0x7f0b9813fe70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0b9401a0c0 tx=0x7f0b9401acd0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 shutdown_connections 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b981449f0 0x7f0b980abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0b980cb8d0 0x7f0b980aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0b7c066ce0 0x7f0b7c0691a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 --2- 172.21.15.70:0/316787053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b9806dc70 0x7f0b9813fe70 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:13.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 >> 172.21.15.70:0/316787053 conn(0x7f0b980b0bf0 msgr2=0x7f0b980afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:13.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 shutdown_connections 2023-11-26T07:23:13.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:13.895+0000 7f0ba0180640 1 -- 172.21.15.70:0/316787053 wait complete. 2023-11-26T07:23:13.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:23:14.008 INFO:tasks.ceph.mds.d.smithi120.stderr:2023-11-26T07:23:14.004+0000 7fed73777640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-26T07:23:14.055 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe6534fe640 1 Processor -- start 2023-11-26T07:23:14.056 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe6534fe640 1 -- start start 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe6534fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe64c1575c0 0x7fe64c06bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe6534fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe64c06aba0 0x7fe64c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe6534fe640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c0cd610 con 0x7fe64c159e10 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe6534fe640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c15a6d0 con 0x7fe64c06aba0 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe6534fe640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c15a9b0 con 0x7fe64c1575c0 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe651a9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe64c06aba0 0x7fe64c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe651a9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe64c06aba0 0x7fe64c0cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51868/0 (socket says 172.21.15.70:51868) 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.055+0000 7fe651a9b640 1 -- 172.21.15.70:0/1196630381 learned_addr learned my addr 172.21.15.70:0/1196630381 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe65129a640 1 --2- 172.21.15.70:0/1196630381 >> v2:172.21.15.120:3300/0 conn(0x7fe64c1575c0 0x7fe64c06bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe651a9b640 1 -- 172.21.15.70:0/1196630381 >> v2:172.21.15.120:3300/0 conn(0x7fe64c1575c0 msgr2=0x7fe64c06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.058 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe651a9b640 1 --2- 172.21.15.70:0/1196630381 >> v2:172.21.15.120:3300/0 conn(0x7fe64c1575c0 0x7fe64c06bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe651a9b640 1 -- 172.21.15.70:0/1196630381 >> v1:172.21.15.120:6789/0 conn(0x7fe64c159e10 legacy=0x7fe64c06a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe651a9b640 1 -- 172.21.15.70:0/1196630381 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c15ac90 con 0x7fe64c06aba0 2023-11-26T07:23:14.059 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe65129a640 1 --2- 172.21.15.70:0/1196630381 >> v2:172.21.15.120:3300/0 conn(0x7fe64c1575c0 0x7fe64c06bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:14.060 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe651a9b640 1 --2- 172.21.15.70:0/1196630381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c06aba0 0x7fe64c0cddd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe64c066cd0 tx=0x7fe64401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f83f0c7807f30d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe643fff640 1 -- 172.21.15.70:0/1196630381 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440a5620 con 0x7fe64c06aba0 2023-11-26T07:23:14.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe643fff640 1 -- 172.21.15.70:0/1196630381 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440a5780 con 0x7fe64c06aba0 2023-11-26T07:23:14.061 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe643fff640 1 -- 172.21.15.70:0/1196630381 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440a5b10 con 0x7fe64c06aba0 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe6534fe640 1 -- 172.21.15.70:0/1196630381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c06aba0 msgr2=0x7fe64c0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.059+0000 7fe6534fe640 1 --2- 172.21.15.70:0/1196630381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c06aba0 0x7fe64c0cddd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe64c066cd0 tx=0x7fe64401c8d0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- 172.21.15.70:0/1196630381 shutdown_connections 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 --2- 172.21.15.70:0/1196630381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c06aba0 0x7fe64c0cddd0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 --2- 172.21.15.70:0/1196630381 >> v2:172.21.15.120:3300/0 conn(0x7fe64c1575c0 0x7fe64c06bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- 172.21.15.70:0/1196630381 >> 172.21.15.70:0/1196630381 conn(0x7fe64c0cf710 msgr2=0x7fe64c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- 172.21.15.70:0/1196630381 shutdown_connections 2023-11-26T07:23:14.062 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- 172.21.15.70:0/1196630381 wait complete. 2023-11-26T07:23:14.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 Processor -- start 2023-11-26T07:23:14.063 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- start start 2023-11-26T07:23:14.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe64c06aba0 0x7fe64c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe64c1575c0 0x7fe64c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c159e10 0x7fe64c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c1599f0 con 0x7fe64c159e10 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0ae710 con 0x7fe64c1575c0 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe6534fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c158410 con 0x7fe64c06aba0 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c159e10 0x7fe64c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c159e10 0x7fe64c157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51880/0 (socket says 172.21.15.70:51880) 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 -- 172.21.15.70:0/107886225 learned_addr learned my addr 172.21.15.70:0/107886225 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe65129a640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe64c06aba0 0x7fe64c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe650a99640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe64c1575c0 0x7fe64c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 -- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe64c06aba0 msgr2=0x7fe64c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe64c06aba0 0x7fe64c1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 -- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe64c1575c0 msgr2=0x7fe64c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe64c1575c0 0x7fe64c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.066 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.063+0000 7fe651a9b640 1 -- 172.21.15.70:0/107886225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644009b30 con 0x7fe64c159e10 2023-11-26T07:23:14.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe651a9b640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c159e10 0x7fe64c157a30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe64401af80 tx=0x7fe644019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe641ffb640 1 -- 172.21.15.70:0/107886225 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440b8670 con 0x7fe64c159e10 2023-11-26T07:23:14.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe641ffb640 1 -- 172.21.15.70:0/107886225 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440b87d0 con 0x7fe64c159e10 2023-11-26T07:23:14.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe641ffb640 1 -- 172.21.15.70:0/107886225 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440b8b80 con 0x7fe64c159e10 2023-11-26T07:23:14.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c1586f0 con 0x7fe64c159e10 2023-11-26T07:23:14.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c158cb0 con 0x7fe64c159e10 2023-11-26T07:23:14.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c067680 con 0x7fe64c159e10 2023-11-26T07:23:14.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe641ffb640 1 -- 172.21.15.70:0/107886225 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fe6440b8ce0 con 0x7fe64c159e10 2023-11-26T07:23:14.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe641ffb640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe630066ce0 0x7fe6300691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe641ffb640 1 -- 172.21.15.70:0/107886225 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe64411dd10 con 0x7fe64c159e10 2023-11-26T07:23:14.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.067+0000 7fe65129a640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe630066ce0 0x7fe6300691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.069 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.071+0000 7fe65129a640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe630066ce0 0x7fe6300691a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe64800ab60 tx=0x7fe648008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.073 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.071+0000 7fe641ffb640 1 -- 172.21.15.70:0/107886225 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6440ecca0 con 0x7fe64c159e10 2023-11-26T07:23:14.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe64c14de70 con 0x7fe64c159e10 2023-11-26T07:23:14.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe641ffb640 1 -- 172.21.15.70:0/107886225 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fe6440f02c0 con 0x7fe64c159e10 2023-11-26T07:23:14.255 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:14.256 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/162502503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":162502503},{"type":"v1","addr":"172.21.15.120:6835","nonce":162502503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3659422844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3659422844},{"type":"v1","addr":"172.21.15.70:6835","nonce":3659422844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2807806185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2807806185},{"type":"v1","addr":"172.21.15.70:6837","nonce":2807806185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:08.403306+0000","modified":"2023-11-26T07:23:11.434465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6834/2083039818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2083039818},{"type":"v1","addr":"172.21.15.120:6834","nonce":2083039818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:23:14.256 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 47 2023-11-26T07:23:14.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe630066ce0 msgr2=0x7fe6300691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe630066ce0 0x7fe6300691a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe64800ab60 tx=0x7fe648008040 comp rx=0 tx=0).stop 2023-11-26T07:23:14.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c159e10 msgr2=0x7fe64c157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c159e10 0x7fe64c157a30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fe64401af80 tx=0x7fe644019670 comp rx=0 tx=0).stop 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 shutdown_connections 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe630066ce0 0x7fe6300691a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe64c159e10 0x7fe64c157a30 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe64c1575c0 0x7fe64c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 --2- 172.21.15.70:0/107886225 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe64c06aba0 0x7fe64c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 >> 172.21.15.70:0/107886225 conn(0x7fe64c0cf710 msgr2=0x7fe64c1562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 shutdown_connections 2023-11-26T07:23:14.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.255+0000 7fe6534fe640 1 -- 172.21.15.70:0/107886225 wait complete. 2023-11-26T07:23:14.678 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-26T07:23:08.403306+0000', 'modified': '2023-11-26T07:23:11.434465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6870}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6870': {'gid': 6870, 'name': 'd', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6834/2083039818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 2083039818}, {'type': 'v1', 'addr': '172.21.15.120:6834', 'nonce': 2083039818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-26T07:23:14.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-26T07:23:14.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-26T07:23:14.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.815+0000 7f1a1fb2a640 1 Processor -- start 2023-11-26T07:23:14.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1fb2a640 1 -- start start 2023-11-26T07:23:14.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1fb2a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a180cf990 0x7f1a1815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1fb2a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1806c520 con 0x7f1a1815f4e0 2023-11-26T07:23:14.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1fb2a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1806c800 con 0x7f1a1813e290 2023-11-26T07:23:14.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1fb2a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1806cae0 con 0x7f1a180cf990 2023-11-26T07:23:14.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1e0c7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1a1815f4e0 0x7f1a180cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46924/0 (socket says 172.21.15.70:46924) 2023-11-26T07:23:14.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/3366106887 learned_addr learned my addr 172.21.15.70:0/3366106887 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:14.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3366106887 >> v2:172.21.15.120:3300/0 conn(0x7f1a180cf990 0x7f1a1815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1c8c4640 1 -- 172.21.15.70:0/3366106887 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287272784 0 0) 0x7f1a1806c520 con 0x7f1a1815f4e0 2023-11-26T07:23:14.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1c8c4640 1 -- 172.21.15.70:0/3366106887 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a04003530 con 0x7f1a1815f4e0 2023-11-26T07:23:14.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1d0c5640 1 -- 172.21.15.70:0/3366106887 >> v1:172.21.15.120:6789/0 conn(0x7f1a1813e290 legacy=0x7f1a180cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1d0c5640 1 -- 172.21.15.70:0/3366106887 >> v1:172.21.15.70:6789/0 conn(0x7f1a1815f4e0 legacy=0x7f1a180cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.819+0000 7f1a1d0c5640 1 -- 172.21.15.70:0/3366106887 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1806cdc0 con 0x7f1a180cf990 2023-11-26T07:23:14.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3366106887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 0x7f1a1815efa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097c0 tx=0x7f1a0801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285f62e07b2c231b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1c8c4640 1 -- 172.21.15.70:0/3366106887 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080ab670 con 0x7f1a180cf990 2023-11-26T07:23:14.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1c8c4640 1 -- 172.21.15.70:0/3366106887 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a080ab7d0 con 0x7f1a180cf990 2023-11-26T07:23:14.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1c8c4640 1 -- 172.21.15.70:0/3366106887 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080abb60 con 0x7f1a180cf990 2023-11-26T07:23:14.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/3366106887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 msgr2=0x7f1a1815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/3366106887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 0x7f1a1815efa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097c0 tx=0x7f1a0801c450 comp rx=0 tx=0).stop 2023-11-26T07:23:14.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/3366106887 shutdown_connections 2023-11-26T07:23:14.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/3366106887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 0x7f1a1815efa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/3366106887 >> 172.21.15.70:0/3366106887 conn(0x7f1a1806a890 msgr2=0x7f1a1806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/3366106887 shutdown_connections 2023-11-26T07:23:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.823+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/3366106887 wait complete. 2023-11-26T07:23:14.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 Processor -- start 2023-11-26T07:23:14.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 -- start start 2023-11-26T07:23:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 0x7f1a180afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a1813e290 0x7f1a1815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a1815f4e0 0x7f1a18137870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1815cae0 con 0x7f1a1815f4e0 2023-11-26T07:23:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180b0da0 con 0x7f1a180cf990 2023-11-26T07:23:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1815e300 con 0x7f1a1813e290 2023-11-26T07:23:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a1815f4e0 0x7f1a18137870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a1815f4e0 0x7f1a18137870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51890/0 (socket says 172.21.15.70:51890) 2023-11-26T07:23:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/344944418 learned_addr learned my addr 172.21.15.70:0/344944418 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a1813e290 0x7f1a1815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 0x7f1a180afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a1813e290 msgr2=0x7f1a1815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a1813e290 0x7f1a1815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 msgr2=0x7f1a180afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 0x7f1a180afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/344944418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08009420 con 0x7f1a1815f4e0 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a1815f4e0 0x7f1a18137870 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000cad0 tx=0x7f1a1000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a0e7fc640 1 -- 172.21.15.70:0/344944418 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1000ac30 con 0x7f1a1815f4e0 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a0e7fc640 1 -- 172.21.15.70:0/344944418 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000ad90 con 0x7f1a1815f4e0 2023-11-26T07:23:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a0e7fc640 1 -- 172.21.15.70:0/344944418 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10012620 con 0x7f1a1815f4e0 2023-11-26T07:23:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a180b0190 con 0x7f1a1815f4e0 2023-11-26T07:23:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.827+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a180b0750 con 0x7f1a1815f4e0 2023-11-26T07:23:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.831+0000 7f1a0e7fc640 1 -- 172.21.15.70:0/344944418 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f1a10007070 con 0x7f1a1815f4e0 2023-11-26T07:23:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.831+0000 7f1a0e7fc640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19fc066ce0 0x7f19fc0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.831+0000 7f1a0e7fc640 1 -- 172.21.15.70:0/344944418 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a10082870 con 0x7f1a1815f4e0 2023-11-26T07:23:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.831+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19fc066ce0 0x7f19fc0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.831+0000 7f1a22e9f000 1 Processor -- start 2023-11-26T07:23:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.831+0000 7f1a22e9f000 1 -- start start 2023-11-26T07:23:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.831+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19fc066ce0 0x7f19fc0691a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a14000f70 tx=0x7f1a14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bfc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8bb1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bb2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8a1c130 con 0x55e3f8bb2320 2023-11-26T07:23:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8a099a0 con 0x55e3f8bfbc90 2023-11-26T07:23:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8a06ed0 con 0x55e3f8bfc5b0 2023-11-26T07:23:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bb2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bb2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51896/0 (socket says 172.21.15.70:51896) 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/3423747074 learned_addr learned my addr 172.21.15.70:0/3423747074 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bfc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8bb1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 msgr2=0x55e3f8bb1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8bb1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 msgr2=0x55e3f8bfc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bfc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 -- 172.21.15.70:0/3423747074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f86fa890 con 0x55e3f8bb2320 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bfc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bb2700 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000caa0 tx=0x7f1a10085110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641d7eef887ceeab server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f19fb7fe640 1 -- 172.21.15.70:0/3423747074 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100593e0 con 0x55e3f8bb2320 2023-11-26T07:23:14.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f19fb7fe640 1 -- 172.21.15.70:0/3423747074 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1005d590 con 0x55e3f8bb2320 2023-11-26T07:23:14.837 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f19fb7fe640 1 -- 172.21.15.70:0/3423747074 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100519a0 con 0x55e3f8bb2320 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3423747074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 msgr2=0x55e3f8bb2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bb2700 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000caa0 tx=0x7f1a10085110 comp rx=0 tx=0).stop 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3423747074 shutdown_connections 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bb2700 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8bb1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3423747074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bfc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3423747074 >> 172.21.15.70:0/3423747074 conn(0x55e3f8bae2d0 msgr2=0x55e3f8bb06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3423747074 shutdown_connections 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3423747074 wait complete. 2023-11-26T07:23:14.839 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 -- start start 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.835+0000 7f1a22e9f000 1 Processor -- start 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bb2320 0x55e3f8bb6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bb7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8a027c0 con 0x55e3f8bfbc90 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f89babf0 con 0x55e3f8bfc5b0 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3f89c0a90 con 0x55e3f8bb2320 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 10 client.0 _ll_register_callbacks cb 0x55e3f8b9d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bb7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bb7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51912/0 (socket says 172.21.15.70:51912) 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 -- 172.21.15.70:0/3071847240 learned_addr learned my addr 172.21.15.70:0/3071847240 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:14.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bb2320 0x55e3f8bb6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 -- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bb2320 msgr2=0x55e3f8bb6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bb2320 0x55e3f8bb6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 -- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 msgr2=0x55e3f8bca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 -- 172.21.15.70:0/3071847240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a180b0750 con 0x55e3f8bfbc90 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bb7250 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097c0 tx=0x7f1a0801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d94e4541df4044 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f19f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3071847240 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080bb070 con 0x55e3f8bfbc90 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3f89c4470 con 0x55e3f8bfbc90 2023-11-26T07:23:14.841 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3071847240 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a1815fb00 con 0x55e3f8bfbc90 2023-11-26T07:23:14.843 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3071847240 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a08004370 con 0x55e3f8bfbc90 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 10 client.7005 fetch_fsmap learned FSMap version 47 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55e3f89c3190 con 0x55e3f8bfbc90 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3071847240 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3f89c4470 con 0x55e3f8bfbc90 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3071847240 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1a080ab940 con 0x55e3f8bfbc90 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 10 client.7005 fetch_fsmap finished waiting for FSMap version 47 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 10 client.7005 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 20 client.7005 populate_metadata read hostname 'smithi070' 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8bcb320 0x55e3f8c0df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 4 client.7005 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 --> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3f89c7b50 con 0x55e3f8bcb320 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8bcb320 0x55e3f8c0df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f19f8ff9640 10 client.7005 ms_handle_connect on v2:172.21.15.120:6832/2083039818 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.839+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8bcb320 0x55e3f8c0df50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee3ee9588f9b8399 server_cookie=2adb2f1a0c769ac6 in_seq=0 out_seq=0 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3071847240 <== mds.0 v2:172.21.15.120:6832/2083039818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e3f89c7b50 con 0x55e3f8bcb320 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f19f8ff9640 10 client.7005 handle_command_reply: tid=0 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 client.7005 shutdown 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bfbc90 msgr2=0x55e3f8bb7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bb7250 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1a080097c0 tx=0x7f1a0801ac90 comp rx=0 tx=0).stop 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 shutdown_connections 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8bcb320 0x55e3f8c0df50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bb7250 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3071847240 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bb2320 0x55e3f8bb6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.845 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f19f8ff9640 0 client.7005 ms_handle_reset on v2:172.21.15.120:6832/2083039818 2023-11-26T07:23:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 >> 172.21.15.70:0/3071847240 conn(0x55e3f8bae2d0 msgr2=0x55e3f8bb06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 shutdown_connections 2023-11-26T07:23:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3071847240 wait complete. 2023-11-26T07:23:14.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.843+0000 7f1a22e9f000 20 client.7005 trim_cache size 0 max 16384 2023-11-26T07:23:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 Processor -- start 2023-11-26T07:23:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 -- start start 2023-11-26T07:23:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bfaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfbc90 0x55e3f8bf9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bfa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f86bb940 con 0x55e3f8bb2320 2023-11-26T07:23:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f89c18f0 con 0x55e3f8bfc5b0 2023-11-26T07:23:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3f89bbd60 con 0x55e3f8bfbc90 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bfaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bfaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51924/0 (socket says 172.21.15.70:51924) 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/2582273969 learned_addr learned my addr 172.21.15.70:0/2582273969 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfbc90 0x55e3f8bf9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bfa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfbc90 msgr2=0x55e3f8bf9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfbc90 0x55e3f8bf9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 msgr2=0x55e3f8bfa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bfa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/2582273969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f89a9490 con 0x55e3f8bb2320 2023-11-26T07:23:14.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfbc90 0x55e3f8bf9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:14.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bfaa80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x55e3f899c650 tx=0x7f1a14012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683ee2a450292294 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f19fbfff640 1 -- 172.21.15.70:0/2582273969 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14026810 con 0x55e3f8bb2320 2023-11-26T07:23:14.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f19fbfff640 1 -- 172.21.15.70:0/2582273969 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1402a070 con 0x55e3f8bb2320 2023-11-26T07:23:14.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.859+0000 7f19fbfff640 1 -- 172.21.15.70:0/2582273969 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400ebd0 con 0x55e3f8bb2320 2023-11-26T07:23:14.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/2582273969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 msgr2=0x55e3f8bfaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bfaa80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x55e3f899c650 tx=0x7f1a14012000 comp rx=0 tx=0).stop 2023-11-26T07:23:14.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/2582273969 shutdown_connections 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfc5b0 0x55e3f8bfa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfbc90 0x55e3f8bf9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/2582273969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bfaa80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/2582273969 >> 172.21.15.70:0/2582273969 conn(0x55e3f8bae2d0 msgr2=0x55e3f8bb06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/2582273969 shutdown_connections 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/2582273969 wait complete. 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- start start 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 Processor -- start 2023-11-26T07:23:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bde7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bded20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8c0df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f89be6f0 con 0x55e3f8bb2320 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f89ad3b0 con 0x55e3f8bfbc90 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3f89c0420 con 0x55e3f8bfc5b0 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 10 client.0 _ll_register_callbacks cb 0x55e3f8a50c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bde7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bde7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51934/0 (socket says 172.21.15.70:51934) 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/3835489604 learned_addr learned my addr 172.21.15.70:0/3835489604 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1e0c7640 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8c0df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 msgr2=0x55e3f8c0df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8c0df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 msgr2=0x55e3f8bded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bded20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 -- 172.21.15.70:0/3835489604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1401d040 con 0x55e3f8bb2320 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a1d8c6640 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bde7e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f1a14005360 tx=0x7f1a14000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d912049977935005 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f19f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3835489604 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400ebd0 con 0x55e3f8bb2320 2023-11-26T07:23:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3835489604 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a1400ed30 con 0x55e3f8bb2320 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3f8a01110 con 0x55e3f8bb2320 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3835489604 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a14003600 con 0x55e3f8bb2320 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 10 client.7011 fetch_fsmap learned FSMap version 47 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55e3f86facc0 con 0x55e3f8bb2320 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3835489604 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3f8a01110 con 0x55e3f8bb2320 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3835489604 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 47) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1a14003760 con 0x55e3f8bb2320 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 10 client.7011 fetch_fsmap finished waiting for FSMap version 47 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 10 client.7011 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 20 client.7011 populate_metadata read hostname 'smithi070' 2023-11-26T07:23:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8c0e490 0x55e3f8c0e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 4 client.7011 mds_command: new command op to 6870 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.863+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 --> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e3f8a309a0 con 0x55e3f8c0e490 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8c0e490 0x55e3f8c0e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f19f8ff9640 10 client.7011 ms_handle_connect on v2:172.21.15.120:6832/2083039818 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1d0c5640 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8c0e490 0x55e3f8c0e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=792906fd047140a8 server_cookie=441ff4718b5409c9 in_seq=0 out_seq=0 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f19f8ff9640 1 -- 172.21.15.70:0/3835489604 <== mds.0 v2:172.21.15.120:6832/2083039818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e3f8a309a0 con 0x55e3f8c0e490 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f19f8ff9640 10 client.7011 handle_command_reply: tid=0 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 client.7011 shutdown 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 msgr2=0x55e3f8bde7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bde7e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f1a14005360 tx=0x7f1a14000ee0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 shutdown_connections 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:6832/2083039818,v1:172.21.15.120:6834/2083039818] conn(0x55e3f8c0e490 0x55e3f8c0e870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x55e3f8bfc5b0 0x55e3f8c0df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3f8bfbc90 0x55e3f8bded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 --2- 172.21.15.70:0/3835489604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3f8bb2320 0x55e3f8bde7e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f19f8ff9640 0 client.7011 ms_handle_reset on v2:172.21.15.120:6832/2083039818 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 >> 172.21.15.70:0/3835489604 conn(0x55e3f8bae2d0 msgr2=0x55e3f8c090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 shutdown_connections 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 1 -- 172.21.15.70:0/3835489604 wait complete. 2023-11-26T07:23:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a22e9f000 20 client.7011 trim_cache size 0 max 16384 2023-11-26T07:23:14.874 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:14.874 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "35961970-1319-4bbb-b3aa-e783ca1e0d4a", 2023-11-26T07:23:14.874 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2023-11-26T07:23:14.874 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 6870, 2023-11-26T07:23:14.874 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2023-11-26T07:23:14.874 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2023-11-26T07:23:14.874 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2023-11-26T07:23:14.875 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 5.824889024, 2023-11-26T07:23:14.875 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 47, 2023-11-26T07:23:14.875 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 78, 2023-11-26T07:23:14.875 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 78, 2023-11-26T07:23:14.875 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 11.662145754999999 2023-11-26T07:23:14.875 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19fc066ce0 msgr2=0x7f19fc0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19fc066ce0 0x7f19fc0691a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1a14000f70 tx=0x7f1a14009040 comp rx=0 tx=0).stop 2023-11-26T07:23:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a1815f4e0 msgr2=0x7f1a18137870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a1815f4e0 0x7f1a18137870 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000cad0 tx=0x7f1a1000cf90 comp rx=0 tx=0).stop 2023-11-26T07:23:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 shutdown_connections 2023-11-26T07:23:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f19fc066ce0 0x7f19fc0691a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a1815f4e0 0x7f1a18137870 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a1813e290 0x7f1a1815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 --2- 172.21.15.70:0/344944418 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a180cf990 0x7f1a180afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 >> 172.21.15.70:0/344944418 conn(0x7f1a1806a890 msgr2=0x7f1a1813c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 shutdown_connections 2023-11-26T07:23:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:14.867+0000 7f1a1fb2a640 1 -- 172.21.15.70:0/344944418 wait complete. 2023-11-26T07:23:14.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:23:15.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 Processor -- start 2023-11-26T07:23:15.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 -- start start 2023-11-26T07:23:15.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4234143ac0 0x7f4234070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f42340cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f42340cf7c0 0x7f42340b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4234143ea0 con 0x7f42340cf7c0 2023-11-26T07:23:15.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42340cfbf0 con 0x7f4234143ac0 2023-11-26T07:23:15.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f423ba5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340cc730 con 0x7f42340708b0 2023-11-26T07:23:15.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f42340cf7c0 0x7f42340b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f42340cf7c0 0x7f42340b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51944/0 (socket says 172.21.15.70:51944) 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 -- 172.21.15.70:0/2715922281 learned_addr learned my addr 172.21.15.70:0/2715922281 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f42397f6640 1 --2- 172.21.15.70:0/2715922281 >> v2:172.21.15.120:3300/0 conn(0x7f4234143ac0 0x7f4234070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4238ff5640 1 --2- 172.21.15.70:0/2715922281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f42340cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 -- 172.21.15.70:0/2715922281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 msgr2=0x7f42340cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 --2- 172.21.15.70:0/2715922281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f42340cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 -- 172.21.15.70:0/2715922281 >> v2:172.21.15.120:3300/0 conn(0x7f4234143ac0 msgr2=0x7f4234070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 --2- 172.21.15.70:0/2715922281 >> v2:172.21.15.120:3300/0 conn(0x7f4234143ac0 0x7f4234070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4239ff7640 1 -- 172.21.15.70:0/2715922281 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234070ee0 con 0x7f42340cf7c0 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f42397f6640 1 --2- 172.21.15.70:0/2715922281 >> v2:172.21.15.120:3300/0 conn(0x7f4234143ac0 0x7f4234070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:15.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.027+0000 7f4238ff5640 1 --2- 172.21.15.70:0/2715922281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f42340cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:15.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f4239ff7640 1 --2- 172.21.15.70:0/2715922281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f42340b1ef0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f423406dca0 tx=0x7f422c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ad8912f14fa690 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f422bfff640 1 -- 172.21.15.70:0/2715922281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0a64b0 con 0x7f42340cf7c0 2023-11-26T07:23:15.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f422bfff640 1 -- 172.21.15.70:0/2715922281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0a6610 con 0x7f42340cf7c0 2023-11-26T07:23:15.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f422bfff640 1 -- 172.21.15.70:0/2715922281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0a69a0 con 0x7f42340cf7c0 2023-11-26T07:23:15.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 -- 172.21.15.70:0/2715922281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 msgr2=0x7f42340b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 --2- 172.21.15.70:0/2715922281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f42340b1ef0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f423406dca0 tx=0x7f422c01c710 comp rx=0 tx=0).stop 2023-11-26T07:23:15.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 -- 172.21.15.70:0/2715922281 shutdown_connections 2023-11-26T07:23:15.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 --2- 172.21.15.70:0/2715922281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f42340b1ef0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 --2- 172.21.15.70:0/2715922281 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f42340cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 --2- 172.21.15.70:0/2715922281 >> v2:172.21.15.120:3300/0 conn(0x7f4234143ac0 0x7f4234070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 -- 172.21.15.70:0/2715922281 >> 172.21.15.70:0/2715922281 conn(0x7f423406a890 msgr2=0x7f423406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:15.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 -- 172.21.15.70:0/2715922281 shutdown_connections 2023-11-26T07:23:15.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.031+0000 7f423ba5a640 1 -- 172.21.15.70:0/2715922281 wait complete. 2023-11-26T07:23:15.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 Processor -- start 2023-11-26T07:23:15.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 -- start start 2023-11-26T07:23:15.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f423413ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f4234157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4234143ac0 0x7f42341382d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.035 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4234157660 con 0x7f42340cf7c0 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4234141f00 con 0x7f4234143ac0 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4234141c20 con 0x7f42340708b0 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f4234157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f4234157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51952/0 (socket says 172.21.15.70:51952) 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 -- 172.21.15.70:0/363468654 learned_addr learned my addr 172.21.15.70:0/363468654 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f42397f6640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f423413ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4239ff7640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4234143ac0 0x7f42341382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 -- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 msgr2=0x7f423413ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f423413ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 -- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4234143ac0 msgr2=0x7f42341382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4234143ac0 0x7f42341382d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 -- 172.21.15.70:0/363468654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009b30 con 0x7f42340cf7c0 2023-11-26T07:23:15.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4238ff5640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f4234157120 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f422400c7c0 tx=0x7f422400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4229ffb640 1 -- 172.21.15.70:0/363468654 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224007a30 con 0x7f42340cf7c0 2023-11-26T07:23:15.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4229ffb640 1 -- 172.21.15.70:0/363468654 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224007b90 con 0x7f42340cf7c0 2023-11-26T07:23:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f4229ffb640 1 -- 172.21.15.70:0/363468654 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400ce70 con 0x7f42340cf7c0 2023-11-26T07:23:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4234157930 con 0x7f42340cf7c0 2023-11-26T07:23:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4234157ef0 con 0x7f42340cf7c0 2023-11-26T07:23:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.035+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4234067680 con 0x7f42340cf7c0 2023-11-26T07:23:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.039+0000 7f4229ffb640 1 -- 172.21.15.70:0/363468654 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f42240113f0 con 0x7f42340cf7c0 2023-11-26T07:23:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.039+0000 7f4229ffb640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4218066ce0 0x7f42180691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.039+0000 7f4229ffb640 1 -- 172.21.15.70:0/363468654 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42240828f0 con 0x7f42340cf7c0 2023-11-26T07:23:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.039+0000 7f42397f6640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4218066ce0 0x7f42180691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:15.040 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.039+0000 7f42397f6640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4218066ce0 0x7f42180691a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f423413a2c0 tx=0x7f4230008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:15.043 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.043+0000 7f4229ffb640 1 -- 172.21.15.70:0/363468654 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4224051700 con 0x7f42340cf7c0 2023-11-26T07:23:15.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.223+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42341420c0 con 0x7f42340cf7c0 2023-11-26T07:23:15.225 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f4229ffb640 1 -- 172.21.15.70:0/363468654 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4224054d20 con 0x7f42340cf7c0 2023-11-26T07:23:15.226 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:23:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4218066ce0 msgr2=0x7f42180691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4218066ce0 0x7f42180691a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f423413a2c0 tx=0x7f4230008040 comp rx=0 tx=0).stop 2023-11-26T07:23:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 msgr2=0x7f4234157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f4234157120 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f422400c7c0 tx=0x7f422400cc80 comp rx=0 tx=0).stop 2023-11-26T07:23:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 shutdown_connections 2023-11-26T07:23:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4218066ce0 0x7f42180691a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42340cf7c0 0x7f4234157120 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4234143ac0 0x7f42341382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 --2- 172.21.15.70:0/363468654 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f42340708b0 0x7f423413ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 >> 172.21.15.70:0/363468654 conn(0x7f423406a890 msgr2=0x7f4234142420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 shutdown_connections 2023-11-26T07:23:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:15.227+0000 7f423ba5a640 1 -- 172.21.15.70:0/363468654 wait complete. 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:23:15.247 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:23:15.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.248 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2023-11-26T07:23:15.257 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:23:15.257 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2023-11-26T07:23:15.258 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42097sec preferred_lft 42097sec 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 02:42:99:81:d5:52 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.259 INFO:teuthology.orchestra.run.smithi070.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:23:15.260 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:23:15.261 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:15.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.261 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:23:15.323 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-11-26T07:23:15.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.325 DEBUG:teuthology.orchestra.run.smithi070:> route 2023-11-26T07:23:15.379 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2023-11-26T07:23:15.379 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:23:15.379 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:23:15.379 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:23:15.380 INFO:teuthology.orchestra.run.smithi070.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:23:15.380 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:23:15.380 INFO:teuthology.orchestra.run.smithi070.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:23:15.380 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:23:15.380 INFO:teuthology.orchestra.run.smithi070.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:23:15.380 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:23:15.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.380 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec bash -c ' 2023-11-26T07:23:15.380 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2023-11-26T07:23:15.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:23:15.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:23:15.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:23:15.381 DEBUG:teuthology.orchestra.run.smithi070:> ') 2023-11-26T07:23:15.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.471 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:23:15.480 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:23:15.480 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:23:15.481 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:23:15.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.481 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2023-11-26T07:23:15.549 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-26T07:23:15.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:15.549 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:15.601 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-26T07:23:15.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:15.602 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:15.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:23:15.717 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:23:15.771 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:23:15.772 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:23:15.773 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:23:15.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.774 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:23:15.825 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:23:15.826 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-26T07:23:15.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2023-11-26T07:23:15.893 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:23:15.947 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2023-11-26T07:23:15.947 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2023-11-26T07:23:15.947 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2023-11-26T07:23:15.947 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2023-11-26T07:23:15.947 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2023-11-26T07:23:15.947 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2023-11-26T07:23:15.947 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/run/lock 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/fs/nfsd 2023-11-26T07:23:15.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/run/rpc_pipefs 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-0 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-1 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-2 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph/osd/ceph-3 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:23:15.949 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:23:15.950 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:23:15.950 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:23:15.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:15.951 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2023-11-26T07:23:15.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2023-11-26T07:23:15.967+0000 7f2da382a580 -1 init, newargv = 0x55d4907335e0 newargc=15 2023-11-26T07:23:15.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[55435]: starting ceph client 2023-11-26T07:23:15.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[55435]: starting fuse 2023-11-26T07:23:15.976 INFO:teuthology.orchestra.run.smithi070.stdout:43 2023-11-26T07:23:15.976 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:23:15.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:23:15.976 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2023-11-26T07:23:15.976 DEBUG:teuthology.orchestra.run.smithi070:> import re 2023-11-26T07:23:15.976 DEBUG:teuthology.orchestra.run.smithi070:> import os 2023-11-26T07:23:15.976 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2023-11-26T07:23:15.977 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> return f 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2023-11-26T07:23:15.978 DEBUG:teuthology.orchestra.run.smithi070:> ' 2023-11-26T07:23:16.105 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.55435.asok 2023-11-26T07:23:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:23:16.116 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55435.asok 2023-11-26T07:23:16.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:16.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55435.asok status 2023-11-26T07:23:16.285 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:16.285 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2023-11-26T07:23:16.285 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:23:16.285 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "55435", 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 7023, 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2023-11-26T07:23:16.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 7023 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3605762109 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2023-11-26T07:23:16.287 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3605762109 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.7023 192.168.0.1:0/3605762109", 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/3605762109", 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 47, 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 78, 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2023-11-26T07:23:16.288 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:16.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:16.300 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2023-11-26T07:23:16.300 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:16.310 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2023-11-26T07:23:16.310 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:16.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:16.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-26T07:23:16.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-26T07:23:16.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d82372640 1 Processor -- start 2023-11-26T07:23:16.555 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d82372640 1 -- start start 2023-11-26T07:23:16.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d82372640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1d7c0d1bc0 0x7f1d7c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d82372640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1d7c0b2160 0x7f1d7c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.556 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d82372640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0cf0e0 con 0x7f1d7c15d6e0 2023-11-26T07:23:16.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d82372640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c15dac0 con 0x7f1d7c0b2160 2023-11-26T07:23:16.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d82372640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0ceb20 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d8090f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1d7c0b2160 0x7f1d7c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d8090f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1d7c0b2160 0x7f1d7c0b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51968/0 (socket says 172.21.15.70:51968) 2023-11-26T07:23:16.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d8090f640 1 -- 172.21.15.70:0/2989968737 learned_addr learned my addr 172.21.15.70:0/2989968737 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:16.557 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d7b7fe640 1 --2- 172.21.15.70:0/2989968737 >> v2:172.21.15.120:3300/0 conn(0x7f1d7c0d1bc0 0x7f1d7c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d8090f640 1 -- 172.21.15.70:0/2989968737 >> v2:172.21.15.120:3300/0 conn(0x7f1d7c0d1bc0 msgr2=0x7f1d7c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:16.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d8090f640 1 --2- 172.21.15.70:0/2989968737 >> v2:172.21.15.120:3300/0 conn(0x7f1d7c0d1bc0 0x7f1d7c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d8090f640 1 -- 172.21.15.70:0/2989968737 >> v1:172.21.15.120:6789/0 conn(0x7f1d7c15d6e0 legacy=0x7f1d7c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.558 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.555+0000 7f1d8090f640 1 -- 172.21.15.70:0/2989968737 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0cee00 con 0x7f1d7c0b2160 2023-11-26T07:23:16.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d8090f640 1 --2- 172.21.15.70:0/2989968737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0b0750 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0ca2a0 tx=0x7f1d7401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3423b9bada5f19d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d7affd640 1 -- 172.21.15.70:0/2989968737 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740a5780 con 0x7f1d7c0b2160 2023-11-26T07:23:16.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d7affd640 1 -- 172.21.15.70:0/2989968737 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d740a58e0 con 0x7f1d7c0b2160 2023-11-26T07:23:16.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d7affd640 1 -- 172.21.15.70:0/2989968737 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740a5c70 con 0x7f1d7c0b2160 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 -- 172.21.15.70:0/2989968737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0b2160 msgr2=0x7f1d7c0b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 --2- 172.21.15.70:0/2989968737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0b0750 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0ca2a0 tx=0x7f1d7401c9d0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 -- 172.21.15.70:0/2989968737 shutdown_connections 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 --2- 172.21.15.70:0/2989968737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0b0750 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 --2- 172.21.15.70:0/2989968737 >> v2:172.21.15.120:3300/0 conn(0x7f1d7c0d1bc0 0x7f1d7c0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 -- 172.21.15.70:0/2989968737 >> 172.21.15.70:0/2989968737 conn(0x7f1d7c09c550 msgr2=0x7f1d7c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 -- 172.21.15.70:0/2989968737 shutdown_connections 2023-11-26T07:23:16.561 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.559+0000 7f1d82372640 1 -- 172.21.15.70:0/2989968737 wait complete. 2023-11-26T07:23:16.562 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 Processor -- start 2023-11-26T07:23:16.563 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 -- start start 2023-11-26T07:23:16.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0d1bc0 0x7f1d7c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1d7c15d6e0 0x7f1d7c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c1590a0 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0c7330 con 0x7f1d7c0b2160 2023-11-26T07:23:16.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0cbfa0 con 0x7f1d7c15d6e0 2023-11-26T07:23:16.564 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0d1bc0 0x7f1d7c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0d1bc0 0x7f1d7c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51976/0 (socket says 172.21.15.70:51976) 2023-11-26T07:23:16.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 -- 172.21.15.70:0/3451318908 learned_addr learned my addr 172.21.15.70:0/3451318908 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:16.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7bfff640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.565 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d8090f640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1d7c15d6e0 0x7f1d7c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 -- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1d7c15d6e0 msgr2=0x7f1d7c0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1d7c15d6e0 0x7f1d7c0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 -- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0b2160 msgr2=0x7f1d7c0c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 -- 172.21.15.70:0/3451318908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74009b30 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d8090f640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1d7c15d6e0 0x7f1d7c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:16.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7bfff640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:16.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d7b7fe640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0d1bc0 0x7f1d7c1585c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000d800 tx=0x7f1d7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d78ff9640 1 -- 172.21.15.70:0/3451318908 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000b6c0 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d78ff9640 1 -- 172.21.15.70:0/3451318908 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000b820 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c0cc280 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d78ff9640 1 -- 172.21.15.70:0/3451318908 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000bb90 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.563+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c158b00 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.567 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.567+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c067680 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.567+0000 7f1d78ff9640 1 -- 172.21.15.70:0/3451318908 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f1d7000bcf0 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.567+0000 7f1d78ff9640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1d68066d10 0x7f1d680691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:16.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.567+0000 7f1d78ff9640 1 -- 172.21.15.70:0/3451318908 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d70085640 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.567+0000 7f1d7bfff640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1d68066d10 0x7f1d680691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:16.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.567+0000 7f1d7bfff640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1d68066d10 0x7f1d680691d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c073860 tx=0x7f1d6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:16.572 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.571+0000 7f1d78ff9640 1 -- 172.21.15.70:0/3451318908 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d70051b20 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d7c073b10 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d78ff9640 1 -- 172.21.15.70:0/3451318908 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1d70055140 con 0x7f1d7c0d1bc0 2023-11-26T07:23:16.754 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-26T07:23:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1d68066d10 msgr2=0x7f1d680691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1d68066d10 0x7f1d680691d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c073860 tx=0x7f1d6c009040 comp rx=0 tx=0).stop 2023-11-26T07:23:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0d1bc0 msgr2=0x7f1d7c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0d1bc0 0x7f1d7c1585c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000d800 tx=0x7f1d7000dcc0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 shutdown_connections 2023-11-26T07:23:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1d68066d10 0x7f1d680691d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0d1bc0 0x7f1d7c1585c0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1d7c15d6e0 0x7f1d7c0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 --2- 172.21.15.70:0/3451318908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d7c0b2160 0x7f1d7c0c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 >> 172.21.15.70:0/3451318908 conn(0x7f1d7c09c550 msgr2=0x7f1d7c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 shutdown_connections 2023-11-26T07:23:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:16.755+0000 7f1d82372640 1 -- 172.21.15.70:0/3451318908 wait complete. 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-26T07:23:16.775 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:23:16.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:16.776 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2023-11-26T07:23:16.786 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-26T07:23:16.786 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-26T07:23:16.786 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2023-11-26T07:23:16.786 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.786 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2023-11-26T07:23:16.786 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.786 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42092sec preferred_lft 42092sec 2023-11-26T07:23:16.787 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:42:29:fb:62:88 brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.788 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:16.789 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:23:16.789 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-26T07:23:16.789 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.789 INFO:teuthology.orchestra.run.smithi120.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-26T07:23:16.789 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:23:16.789 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-26T07:23:16.789 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2023-11-26T07:23:16.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:16.790 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-26T07:23:16.859 INFO:teuthology.orchestra.run.smithi120.stdout:1 2023-11-26T07:23:16.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:16.861 DEBUG:teuthology.orchestra.run.smithi120:> route 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:23:16.921 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:23:16.922 INFO:teuthology.orchestra.run.smithi120.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-26T07:23:16.922 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-26T07:23:16.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:16.922 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec bash -c ' 2023-11-26T07:23:16.922 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2023-11-26T07:23:16.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-26T07:23:16.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-26T07:23:16.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-26T07:23:16.922 DEBUG:teuthology.orchestra.run.smithi120:> ') 2023-11-26T07:23:17.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.020 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:23:17.029 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:23:17.029 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:23:17.029 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:23:17.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2023-11-26T07:23:17.098 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-26T07:23:17.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:17.098 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:17.153 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-26T07:23:17.154 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-26T07:23:17.154 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:17.209 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:23:17.275 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:23:17.331 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:23:17.331 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:23:17.331 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:23:17.331 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:23:17.331 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:23:17.332 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:23:17.333 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:23:17.334 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:23:17.334 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:23:17.334 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:23:17.334 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:23:17.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.335 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:23:17.385 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-26T07:23:17.385 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-26T07:23:17.432 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2023-11-26T07:23:17.453 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2023-11-26T07:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/run/lock 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/fs/nfsd 2023-11-26T07:23:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysusers.service 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/run/rpc_pipefs 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-4 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-5 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-6 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph/osd/ceph-7 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:23:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:23:17.510 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:23:17.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.510 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2023-11-26T07:23:17.528 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:2023-11-26T07:23:17.524+0000 7fd48532a580 -1 init, newargv = 0x55779840a120 newargc=15 2023-11-26T07:23:17.528 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44641]: starting ceph client 2023-11-26T07:23:17.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44641]: starting fuse 2023-11-26T07:23:17.536 INFO:teuthology.orchestra.run.smithi120.stdout:43 2023-11-26T07:23:17.536 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-26T07:23:17.536 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2023-11-26T07:23:17.536 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2023-11-26T07:23:17.536 DEBUG:teuthology.orchestra.run.smithi120:> import re 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> import os 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2023-11-26T07:23:17.537 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> return f 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.1")) 2023-11-26T07:23:17.538 DEBUG:teuthology.orchestra.run.smithi120:> ' 2023-11-26T07:23:17.661 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.1.44641.asok 2023-11-26T07:23:17.664 INFO:teuthology.orchestra.run.smithi120.stderr:2023-11-26T07:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-26T07:23:17.672 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44641.asok 2023-11-26T07:23:17.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44641.asok status 2023-11-26T07:23:17.841 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "44c2237fe77713214148c1fd622c872f346f1b99", 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 18.0.0-7484-g44c2237f (44c2237fe77713214148c1fd622c872f346f1b99) reef (dev)", 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "1", 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "44641", 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/" 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:23:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 6697, 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 6697 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2110699258 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-11-26T07:23:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2110699258 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.6697 172.21.15.120:0/2110699258", 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "172.21.15.120:0/2110699258", 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 1, 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 47, 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 78, 2023-11-26T07:23:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2023-11-26T07:23:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2023-11-26T07:23:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2023-11-26T07:23:17.845 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-11-26T07:23:17.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.856 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2023-11-26T07:23:17.856 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:17.866 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2023-11-26T07:23:17.866 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:17.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:17.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-26T07:23:17.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-26T07:23:18.074 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bc22d6640 1 Processor -- start 2023-11-26T07:23:18.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bc22d6640 1 -- start start 2023-11-26T07:23:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bc22d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4bbc143ac0 0x7f4bbc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:18.076 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bc22d6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc0cc730 con 0x7f4bbc0708b0 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bc22d6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc070ee0 con 0x7f4bbc0cf990 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bc22d6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc143ea0 con 0x7f4bbc143ac0 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bbbfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4bbc143ac0 0x7f4bbc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bb3fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4bbc0708b0 0x7f4bbc0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46936/0 (socket says 172.21.15.70:46936) 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bb3fff640 1 -- 172.21.15.70:0/1248139737 learned_addr learned my addr 172.21.15.70:0/1248139737 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bbbfff640 1 -- 172.21.15.70:0/1248139737 >> v1:172.21.15.120:6789/0 conn(0x7f4bbc0cf990 legacy=0x7f4bbc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bbbfff640 1 -- 172.21.15.70:0/1248139737 >> v1:172.21.15.70:6789/0 conn(0x7f4bbc0708b0 legacy=0x7f4bbc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bbbfff640 1 -- 172.21.15.70:0/1248139737 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc0711c0 con 0x7f4bbc143ac0 2023-11-26T07:23:18.077 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.075+0000 7f4bbb7fe640 1 -- 172.21.15.70:0/1248139737 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797571816 0 0) 0x7f4bbc0cc730 con 0x7f4bbc0708b0 2023-11-26T07:23:18.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bbbfff640 1 --2- 172.21.15.70:0/1248139737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc070370 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0097c0 tx=0x7f4bac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155c88aa86af1859 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bbb7fe640 1 -- 172.21.15.70:0/1248139737 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0a8050 con 0x7f4bbc143ac0 2023-11-26T07:23:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bbb7fe640 1 -- 172.21.15.70:0/1248139737 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0ac5f0 con 0x7f4bbc143ac0 2023-11-26T07:23:18.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bbb7fe640 1 -- 172.21.15.70:0/1248139737 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0ac980 con 0x7f4bbc143ac0 2023-11-26T07:23:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bc22d6640 1 -- 172.21.15.70:0/1248139737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 msgr2=0x7f4bbc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/1248139737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc070370 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0097c0 tx=0x7f4bac01c480 comp rx=0 tx=0).stop 2023-11-26T07:23:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bc22d6640 1 -- 172.21.15.70:0/1248139737 shutdown_connections 2023-11-26T07:23:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/1248139737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc070370 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bc22d6640 1 -- 172.21.15.70:0/1248139737 >> 172.21.15.70:0/1248139737 conn(0x7f4bbc06a890 msgr2=0x7f4bbc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bc22d6640 1 -- 172.21.15.70:0/1248139737 shutdown_connections 2023-11-26T07:23:18.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.079+0000 7f4bc22d6640 1 -- 172.21.15.70:0/1248139737 wait complete. 2023-11-26T07:23:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 Processor -- start 2023-11-26T07:23:18.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 -- start start 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4bbc0708b0 0x7f4bbc13d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bbc0cf990 0x7f4bbc156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc13b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc13cc30 con 0x7f4bbc143ac0 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc159b40 con 0x7f4bbc0cf990 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc13bfb0 con 0x7f4bbc0708b0 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc13b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc13b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52000/0 (socket says 172.21.15.70:52000) 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 -- 172.21.15.70:0/735045911 learned_addr learned my addr 172.21.15.70:0/735045911 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:18.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bb3fff640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bbc0cf990 0x7f4bbc156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bbbfff640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4bbc0708b0 0x7f4bbc13d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 -- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4bbc0708b0 msgr2=0x7f4bbc13d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4bbc0708b0 0x7f4bbc13d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 -- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bbc0cf990 msgr2=0x7f4bbc156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bbc0cf990 0x7f4bbc156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 -- 172.21.15.70:0/735045911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac009420 con 0x7f4bbc143ac0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc0873640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc13b440 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400c770 tx=0x7f4bb400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bb97fa640 1 -- 172.21.15.70:0/735045911 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4003b80 con 0x7f4bbc143ac0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bb97fa640 1 -- 172.21.15.70:0/735045911 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4003ce0 con 0x7f4bbc143ac0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc13c290 con 0x7f4bbc143ac0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bb97fa640 1 -- 172.21.15.70:0/735045911 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400aa90 con 0x7f4bbc143ac0 2023-11-26T07:23:18.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.083+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc13c850 con 0x7f4bbc143ac0 2023-11-26T07:23:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.087+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc13cd70 con 0x7f4bbc143ac0 2023-11-26T07:23:18.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.087+0000 7f4bb97fa640 1 -- 172.21.15.70:0/735045911 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f4bb400abf0 con 0x7f4bbc143ac0 2023-11-26T07:23:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.087+0000 7f4bb97fa640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b9c066ce0 0x7f4b9c0691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.087+0000 7f4bb97fa640 1 -- 172.21.15.70:0/735045911 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bb4082610 con 0x7f4bbc143ac0 2023-11-26T07:23:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.087+0000 7f4bbbfff640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b9c066ce0 0x7f4b9c0691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:18.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.087+0000 7f4bbbfff640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b9c066ce0 0x7f4b9c0691a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0ae000 tx=0x7f4bac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:18.091 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.091+0000 7f4bb97fa640 1 -- 172.21.15.70:0/735045911 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4bbc13cd70 con 0x7f4bbc143ac0 2023-11-26T07:23:18.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:18.275+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4bbc13cd70 con 0x7f4bbc143ac0 2023-11-26T07:23:19.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.131+0000 7f4bb97fa640 1 -- 172.21.15.70:0/735045911 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4bbc13cd70 con 0x7f4bbc143ac0 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.131+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b9c066ce0 msgr2=0x7f4b9c0691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.131+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b9c066ce0 0x7f4b9c0691a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0ae000 tx=0x7f4bac0a7000 comp rx=0 tx=0).stop 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.131+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 msgr2=0x7f4bbc13b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.131+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc13b440 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400c770 tx=0x7f4bb400cc30 comp rx=0 tx=0).stop 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 shutdown_connections 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4b9c066ce0 0x7f4b9c0691a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bbc143ac0 0x7f4bbc13b440 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bbc0cf990 0x7f4bbc156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 --2- 172.21.15.70:0/735045911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4bbc0708b0 0x7f4bbc13d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 >> 172.21.15.70:0/735045911 conn(0x7f4bbc06a890 msgr2=0x7f4bbc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:19.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 shutdown_connections 2023-11-26T07:23:19.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.135+0000 7f4bc22d6640 1 -- 172.21.15.70:0/735045911 wait complete. 2023-11-26T07:23:19.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-26T07:23:19.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb9311d640 1 Processor -- start 2023-11-26T07:23:19.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb9311d640 1 -- start start 2023-11-26T07:23:19.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb9311d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb8c0cf280 0x7feb8c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb9311d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb8c0cd1b0 0x7feb8c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb9311d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0cc730 con 0x7feb8c143ac0 2023-11-26T07:23:19.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb9311d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c143ea0 con 0x7feb8c0cf280 2023-11-26T07:23:19.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb9311d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c0cfc50 con 0x7feb8c0cd1b0 2023-11-26T07:23:19.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb8bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7feb8c0cf280 0x7feb8c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb90eb9640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7feb8c143ac0 0x7feb8c070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46948/0 (socket says 172.21.15.70:46948) 2023-11-26T07:23:19.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb90eb9640 1 -- 172.21.15.70:0/2375735570 learned_addr learned my addr 172.21.15.70:0/2375735570 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:19.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb916ba640 1 --2- 172.21.15.70:0/2375735570 >> v2:172.21.15.120:3300/0 conn(0x7feb8c0cd1b0 0x7feb8c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb8bfff640 1 -- 172.21.15.70:0/2375735570 >> v2:172.21.15.120:3300/0 conn(0x7feb8c0cd1b0 msgr2=0x7feb8c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:19.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb8bfff640 1 --2- 172.21.15.70:0/2375735570 >> v2:172.21.15.120:3300/0 conn(0x7feb8c0cd1b0 0x7feb8c0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb8bfff640 1 -- 172.21.15.70:0/2375735570 >> v1:172.21.15.70:6789/0 conn(0x7feb8c143ac0 legacy=0x7feb8c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb8bfff640 1 -- 172.21.15.70:0/2375735570 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c070ee0 con 0x7feb8c0cf280 2023-11-26T07:23:19.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb8b7fe640 1 -- 172.21.15.70:0/2375735570 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552341336 0 0) 0x7feb8c0cc730 con 0x7feb8c143ac0 2023-11-26T07:23:19.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.295+0000 7feb916ba640 1 --2- 172.21.15.70:0/2375735570 >> v2:172.21.15.120:3300/0 conn(0x7feb8c0cd1b0 0x7feb8c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:19.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb8bfff640 1 --2- 172.21.15.70:0/2375735570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c0cf280 0x7feb8c0cf710 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7feb8c06e570 tx=0x7feb7801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5364e758bdc8bb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb8b7fe640 1 -- 172.21.15.70:0/2375735570 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780ab660 con 0x7feb8c0cf280 2023-11-26T07:23:19.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb8b7fe640 1 -- 172.21.15.70:0/2375735570 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780ab7c0 con 0x7feb8c0cf280 2023-11-26T07:23:19.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb8b7fe640 1 -- 172.21.15.70:0/2375735570 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780abb50 con 0x7feb8c0cf280 2023-11-26T07:23:19.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 -- 172.21.15.70:0/2375735570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c0cf280 msgr2=0x7feb8c0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 --2- 172.21.15.70:0/2375735570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c0cf280 0x7feb8c0cf710 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7feb8c06e570 tx=0x7feb7801c460 comp rx=0 tx=0).stop 2023-11-26T07:23:19.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 -- 172.21.15.70:0/2375735570 shutdown_connections 2023-11-26T07:23:19.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 --2- 172.21.15.70:0/2375735570 >> v2:172.21.15.120:3300/0 conn(0x7feb8c0cd1b0 0x7feb8c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 --2- 172.21.15.70:0/2375735570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c0cf280 0x7feb8c0cf710 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 -- 172.21.15.70:0/2375735570 >> 172.21.15.70:0/2375735570 conn(0x7feb8c06a890 msgr2=0x7feb8c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:19.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 -- 172.21.15.70:0/2375735570 shutdown_connections 2023-11-26T07:23:19.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.299+0000 7feb9311d640 1 -- 172.21.15.70:0/2375735570 wait complete. 2023-11-26T07:23:19.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 Processor -- start 2023-11-26T07:23:19.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 -- start start 2023-11-26T07:23:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8c0cd1b0 0x7feb8c137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb8c0cf280 0x7feb8c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c143ac0 0x7feb8c0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0b0280 con 0x7feb8c143ac0 2023-11-26T07:23:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0b0840 con 0x7feb8c0cf280 2023-11-26T07:23:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0af520 con 0x7feb8c0cd1b0 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c143ac0 0x7feb8c0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c143ac0 0x7feb8c0b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52012/0 (socket says 172.21.15.70:52012) 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 -- 172.21.15.70:0/3812230885 learned_addr learned my addr 172.21.15.70:0/3812230885 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 -- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8c0cd1b0 msgr2=0x7feb8c137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb8bfff640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb8c0cf280 0x7feb8c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8c0cd1b0 0x7feb8c137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 -- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb8c0cf280 msgr2=0x7feb8c0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb8c0cf280 0x7feb8c0aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 -- 172.21.15.70:0/3812230885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78009420 con 0x7feb8c143ac0 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb8bfff640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb8c0cf280 0x7feb8c0aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb916ba640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c143ac0 0x7feb8c0b0cd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7feb8400cd50 tx=0x7feb8400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb897fa640 1 -- 172.21.15.70:0/3812230885 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400f680 con 0x7feb8c143ac0 2023-11-26T07:23:19.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb897fa640 1 -- 172.21.15.70:0/3812230885 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8400f800 con 0x7feb8c143ac0 2023-11-26T07:23:19.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c0af800 con 0x7feb8c143ac0 2023-11-26T07:23:19.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb897fa640 1 -- 172.21.15.70:0/3812230885 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400fbb0 con 0x7feb8c143ac0 2023-11-26T07:23:19.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c137cd0 con 0x7feb8c143ac0 2023-11-26T07:23:19.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.303+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c067680 con 0x7feb8c143ac0 2023-11-26T07:23:19.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.307+0000 7feb897fa640 1 -- 172.21.15.70:0/3812230885 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7feb8400b040 con 0x7feb8c143ac0 2023-11-26T07:23:19.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.307+0000 7feb897fa640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb70066d10 0x7feb700691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.307+0000 7feb897fa640 1 -- 172.21.15.70:0/3812230885 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb840832f0 con 0x7feb8c143ac0 2023-11-26T07:23:19.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.307+0000 7feb90eb9640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb70066d10 0x7feb700691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.307+0000 7feb90eb9640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb70066d10 0x7feb700691d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7feb800011f0 tx=0x7feb80007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.311+0000 7feb897fa640 1 -- 172.21.15.70:0/3812230885 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb84051ff0 con 0x7feb8c143ac0 2023-11-26T07:23:19.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.479+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7feb8c0b09b0 con 0x7feb70066d10 2023-11-26T07:23:19.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb897fa640 1 -- 172.21.15.70:0/3812230885 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7feb8c0b09b0 con 0x7feb70066d10 2023-11-26T07:23:19.482 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2023-11-26T07:23:19.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2023-11-26T07:23:19.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephfs" 2023-11-26T07:23:19.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:19.482 INFO:teuthology.orchestra.run.smithi070.stdout:] 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb70066d10 msgr2=0x7feb700691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb70066d10 0x7feb700691d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7feb800011f0 tx=0x7feb80007930 comp rx=0 tx=0).stop 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c143ac0 msgr2=0x7feb8c0b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c143ac0 0x7feb8c0b0cd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7feb8400cd50 tx=0x7feb8400a650 comp rx=0 tx=0).stop 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 shutdown_connections 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7feb70066d10 0x7feb700691d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb8c143ac0 0x7feb8c0b0cd0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb8c0cf280 0x7feb8c0aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 --2- 172.21.15.70:0/3812230885 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7feb8c0cd1b0 0x7feb8c137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 >> 172.21.15.70:0/3812230885 conn(0x7feb8c06a890 msgr2=0x7feb8c15b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:19.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 shutdown_connections 2023-11-26T07:23:19.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.483+0000 7feb9311d640 1 -- 172.21.15.70:0/3812230885 wait complete. 2023-11-26T07:23:19.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-26T07:23:19.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe309ff8640 1 Processor -- start 2023-11-26T07:23:19.642 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe309ff8640 1 -- start start 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe309ff8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3040cf280 0x7fe3040cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe309ff8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cd1b0 0x7fe3040cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe309ff8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040cc730 con 0x7fe304143ac0 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe309ff8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe304143ea0 con 0x7fe3040cf280 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe309ff8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040cfc50 con 0x7fe3040cd1b0 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe302ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3040cf280 0x7fe3040cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe3037fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe304143ac0 0x7fe304070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:36916/0 (socket says 172.21.15.70:36916) 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe302ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3040cf280 0x7fe3040cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52014/0 (socket says 172.21.15.70:52014) 2023-11-26T07:23:19.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe3037fe640 1 -- 172.21.15.70:0/2260195849 learned_addr learned my addr 172.21.15.70:0/2260195849 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:19.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe303fff640 1 --2- 172.21.15.70:0/2260195849 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cd1b0 0x7fe3040cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe302ffd640 1 -- 172.21.15.70:0/2260195849 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cd1b0 msgr2=0x7fe3040cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:19.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe302ffd640 1 --2- 172.21.15.70:0/2260195849 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cd1b0 0x7fe3040cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe302ffd640 1 -- 172.21.15.70:0/2260195849 >> v1:172.21.15.120:6789/0 conn(0x7fe304143ac0 legacy=0x7fe304070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.643+0000 7fe302ffd640 1 -- 172.21.15.70:0/2260195849 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304070ee0 con 0x7fe3040cf280 2023-11-26T07:23:19.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe302ffd640 1 --2- 172.21.15.70:0/2260195849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cf280 0x7fe3040cf710 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80097c0 tx=0x7fe2f801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dfeec60beb714 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe3027fc640 1 -- 172.21.15.70:0/2260195849 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80ab680 con 0x7fe3040cf280 2023-11-26T07:23:19.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe3027fc640 1 -- 172.21.15.70:0/2260195849 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f80ab7e0 con 0x7fe3040cf280 2023-11-26T07:23:19.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe3027fc640 1 -- 172.21.15.70:0/2260195849 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80abb70 con 0x7fe3040cf280 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 -- 172.21.15.70:0/2260195849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cf280 msgr2=0x7fe3040cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 --2- 172.21.15.70:0/2260195849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cf280 0x7fe3040cf710 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80097c0 tx=0x7fe2f801c480 comp rx=0 tx=0).stop 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 -- 172.21.15.70:0/2260195849 shutdown_connections 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 --2- 172.21.15.70:0/2260195849 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cd1b0 0x7fe3040cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 --2- 172.21.15.70:0/2260195849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cf280 0x7fe3040cf710 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 -- 172.21.15.70:0/2260195849 >> 172.21.15.70:0/2260195849 conn(0x7fe30406a890 msgr2=0x7fe30406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 -- 172.21.15.70:0/2260195849 shutdown_connections 2023-11-26T07:23:19.648 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 -- 172.21.15.70:0/2260195849 wait complete. 2023-11-26T07:23:19.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.647+0000 7fe309ff8640 1 Processor -- start 2023-11-26T07:23:19.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 -- start start 2023-11-26T07:23:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cd1b0 0x7fe3041f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cf280 0x7fe3041f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe304143ac0 0x7fe30413a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304140ed0 con 0x7fe3040cd1b0 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3041f53b0 con 0x7fe304143ac0 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe304140250 con 0x7fe3040cf280 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cd1b0 0x7fe3041f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cd1b0 0x7fe3041f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52016/0 (socket says 172.21.15.70:52016) 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 -- 172.21.15.70:0/7541831 learned_addr learned my addr 172.21.15.70:0/7541831 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe302ffd640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cf280 0x7fe3041f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe303fff640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe304143ac0 0x7fe30413a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 -- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cf280 msgr2=0x7fe3041f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cf280 0x7fe3041f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 -- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe304143ac0 msgr2=0x7fe30413a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe304143ac0 0x7fe30413a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 -- 172.21.15.70:0/7541831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f8009420 con 0x7fe3040cd1b0 2023-11-26T07:23:19.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe3037fe640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cd1b0 0x7fe3041f4e70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4005890 tx=0x7fe2f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe2ebfff640 1 -- 172.21.15.70:0/7541831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4005cf0 con 0x7fe3040cd1b0 2023-11-26T07:23:19.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe2ebfff640 1 -- 172.21.15.70:0/7541831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f4005e50 con 0x7fe3040cd1b0 2023-11-26T07:23:19.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe2ebfff640 1 -- 172.21.15.70:0/7541831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40072b0 con 0x7fe3040cd1b0 2023-11-26T07:23:19.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe304140530 con 0x7fe3040cd1b0 2023-11-26T07:23:19.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe304140af0 con 0x7fe3040cd1b0 2023-11-26T07:23:19.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.651+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe304067680 con 0x7fe3040cd1b0 2023-11-26T07:23:19.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.655+0000 7fe2ebfff640 1 -- 172.21.15.70:0/7541831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7fe2f4007410 con 0x7fe3040cd1b0 2023-11-26T07:23:19.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.655+0000 7fe2ebfff640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2f0066ce0 0x7fe2f00691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.655+0000 7fe2ebfff640 1 -- 172.21.15.70:0/7541831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2f4084660 con 0x7fe3040cd1b0 2023-11-26T07:23:19.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.655+0000 7fe302ffd640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2f0066ce0 0x7fe2f00691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.655 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.655+0000 7fe302ffd640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2f0066ce0 0x7fe2f00691a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80af000 tx=0x7fe2f80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.658 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.659+0000 7fe2ebfff640 1 -- 172.21.15.70:0/7541831 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2f4050b40 con 0x7fe3040cd1b0 2023-11-26T07:23:19.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.807+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe30406af10 con 0x7fe3040cd1b0 2023-11-26T07:23:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.807+0000 7fe2ebfff640 1 -- 172.21.15.70:0/7541831 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe2f4017020 con 0x7fe3040cd1b0 2023-11-26T07:23:19.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2f0066ce0 msgr2=0x7fe2f00691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2f0066ce0 0x7fe2f00691a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80af000 tx=0x7fe2f80a7000 comp rx=0 tx=0).stop 2023-11-26T07:23:19.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cd1b0 msgr2=0x7fe3041f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cd1b0 0x7fe3041f4e70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4005890 tx=0x7fe2f400c960 comp rx=0 tx=0).stop 2023-11-26T07:23:19.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 shutdown_connections 2023-11-26T07:23:19.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe304143ac0 0x7fe30413a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe3040cf280 0x7fe3041f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2f0066ce0 0x7fe2f00691a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 --2- 172.21.15.70:0/7541831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3040cd1b0 0x7fe3041f4e70 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 >> 172.21.15.70:0/7541831 conn(0x7fe30406a890 msgr2=0x7fe304070370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 shutdown_connections 2023-11-26T07:23:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.811+0000 7fe309ff8640 1 -- 172.21.15.70:0/7541831 wait complete. 2023-11-26T07:23:19.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol84210 --mode=777 2023-11-26T07:23:19.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51ff59e640 1 Processor -- start 2023-11-26T07:23:19.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51ff59e640 1 -- start start 2023-11-26T07:23:19.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51ff59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52000b47a0 0x7f52000cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51ff59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 0x7f520015e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51ff59e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000ce900 con 0x7f52000b43c0 2023-11-26T07:23:19.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51ff59e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520015e540 con 0x7f52000b47a0 2023-11-26T07:23:19.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51ff59e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000ce710 con 0x7f520015db50 2023-11-26T07:23:19.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fe59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f52000b43c0 0x7f520006e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:46954/0 (socket says 172.21.15.70:46954) 2023-11-26T07:23:19.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fe59c640 1 -- 172.21.15.70:0/2969418050 learned_addr learned my addr 172.21.15.70:0/2969418050 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:19.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51f7fff640 1 --2- 172.21.15.70:0/2969418050 >> v2:172.21.15.120:3300/0 conn(0x7f52000b47a0 0x7f52000cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fed9d640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 0x7f520015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770534199 0 0) 0x7f52000ce900 con 0x7f52000b43c0 2023-11-26T07:23:19.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec003530 con 0x7f52000b43c0 2023-11-26T07:23:19.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2143139319 0 0) 0x7f51ec003530 con 0x7f52000b43c0 2023-11-26T07:23:19.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 msgr2=0x7f520015e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:19.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 0x7f520015e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 >> v2:172.21.15.120:3300/0 conn(0x7f52000b47a0 msgr2=0x7f52000cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 --2- 172.21.15.70:0/2969418050 >> v2:172.21.15.120:3300/0 conn(0x7f52000b47a0 0x7f52000cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52000cebe0 con 0x7f52000b43c0 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f51f0001680 con 0x7f52000b43c0 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fed9d640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 0x7f520015e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 >> v1:172.21.15.70:6789/0 conn(0x7f52000b43c0 legacy=0x7f520006e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51ec003980 0x7f51ec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ec0047d0 0x7f51ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 0x7f51ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520015e540 con 0x7f51ec003980 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec00b990 con 0x7f51ec0047d0 2023-11-26T07:23:19.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec00bad0 con 0x7f520015db50 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51ec003980 0x7f51ec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51f7fff640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ec0047d0 0x7f51ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.971+0000 7f51fed9d640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 0x7f51ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fe59c640 1 -- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 msgr2=0x7f51ec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f520015db50 0x7f51ec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fe59c640 1 -- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ec0047d0 msgr2=0x7f51ec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ec0047d0 0x7f51ec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fe59c640 1 -- 172.21.15.70:0/2969418050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009a70 con 0x7f51ec003980 2023-11-26T07:23:19.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51f7fff640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ec0047d0 0x7f51ec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:19.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51ec003980 0x7f51ec003da0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f51f000c190 tx=0x7f51f001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fc088d5d3b9d1a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00058e0 con 0x7f51ec003980 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f0005a60 con 0x7f51ec003980 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fdd9b640 1 -- 172.21.15.70:0/2969418050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0005e10 con 0x7f51ec003980 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51ff59e640 1 -- 172.21.15.70:0/2969418050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51ec003980 msgr2=0x7f51ec003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51ff59e640 1 --2- 172.21.15.70:0/2969418050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51ec003980 0x7f51ec003da0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f51f000c190 tx=0x7f51f001cc20 comp rx=0 tx=0).stop 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51fed9d640 1 -- 172.21.15.70:0/2969418050 reap_dead start 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51ff59e640 1 -- 172.21.15.70:0/2969418050 shutdown_connections 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.975+0000 7f51ff59e640 1 -- 172.21.15.70:0/2969418050 >> 172.21.15.70:0/2969418050 conn(0x7f52000b1ce0 msgr2=0x7f52000b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 -- 172.21.15.70:0/2969418050 shutdown_connections 2023-11-26T07:23:19.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 -- 172.21.15.70:0/2969418050 wait complete. 2023-11-26T07:23:19.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 Processor -- start 2023-11-26T07:23:19.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 -- start start 2023-11-26T07:23:19.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51ec003980 0x7f520014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520015a940 0x7f52000ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52000ae790 0x7f520013f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520014fbc0 con 0x7f520015a940 2023-11-26T07:23:19.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520014d290 con 0x7f52000ae790 2023-11-26T07:23:19.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51ff59e640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000ad490 con 0x7f51ec003980 2023-11-26T07:23:19.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520015a940 0x7f52000ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520015a940 0x7f52000ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52038/0 (socket says 172.21.15.70:52038) 2023-11-26T07:23:19.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 -- 172.21.15.70:0/2389633982 learned_addr learned my addr 172.21.15.70:0/2389633982 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:19.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 -- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51ec003980 msgr2=0x7f520014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51ec003980 0x7f520014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51ec003980 0x7f520014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 -- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52000ae790 msgr2=0x7f520013f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:19.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52000ae790 0x7f520013f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 -- 172.21.15.70:0/2389633982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52000ad770 con 0x7f520015a940 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51ec003980 0x7f520014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.979+0000 7f51f7fff640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520015a940 0x7f52000ae250 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009160 tx=0x7f51e8011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51f6ffd640 1 -- 172.21.15.70:0/2389633982 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8004220 con 0x7f520015a940 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51f6ffd640 1 -- 172.21.15.70:0/2389633982 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8004380 con 0x7f520015a940 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52000ada50 con 0x7f520015a940 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51f6ffd640 1 -- 172.21.15.70:0/2389633982 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8015890 con 0x7f520015a940 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520015adc0 con 0x7f520015a940 2023-11-26T07:23:19.983 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5200067500 con 0x7f520015a940 2023-11-26T07:23:19.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51f6ffd640 1 -- 172.21.15.70:0/2389633982 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f51e80159f0 con 0x7f520015a940 2023-11-26T07:23:19.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51f6ffd640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f51e0066ce0 0x7f51e00691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:19.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51f6ffd640 1 -- 172.21.15.70:0/2389633982 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51e8082cf0 con 0x7f520015a940 2023-11-26T07:23:19.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.983+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f51e0066ce0 0x7f51e00691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:19.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.987+0000 7f51fe59c640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f51e0066ce0 0x7f51e00691a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f51f00aa000 tx=0x7f51f0001940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:19.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:19.987+0000 7f51f6ffd640 1 -- 172.21.15.70:0/2389633982 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51e80519f0 con 0x7f520015a940 2023-11-26T07:23:20.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.167+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol84210", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f520015b0a0 con 0x7f51e0066ce0 2023-11-26T07:23:20.174 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:20.175+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:20.174 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:20.175+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:20.174 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:20.175+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:20.174 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:20.175+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:20.174 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:20.175+0000 7ff29010f640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:20.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51f6ffd640 1 -- 172.21.15.70:0/2389633982 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f520015b0a0 con 0x7f51e0066ce0 2023-11-26T07:23:20.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f51e0066ce0 msgr2=0x7f51e00691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f51e0066ce0 0x7f51e00691a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f51f00aa000 tx=0x7f51f0001940 comp rx=0 tx=0).stop 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520015a940 msgr2=0x7f52000ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520015a940 0x7f52000ae250 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009160 tx=0x7f51e8011a60 comp rx=0 tx=0).stop 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 shutdown_connections 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f51e0066ce0 0x7f51e00691a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520015a940 0x7f52000ae250 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52000ae790 0x7f520013f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 --2- 172.21.15.70:0/2389633982 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f51ec003980 0x7f520014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.207+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 >> 172.21.15.70:0/2389633982 conn(0x7f52000b1ce0 msgr2=0x7f52000b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.211+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 shutdown_connections 2023-11-26T07:23:20.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.211+0000 7f51ff59e640 1 -- 172.21.15.70:0/2389633982 wait complete. 2023-11-26T07:23:20.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol84210 2023-11-26T07:23:20.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.367+0000 7f108b31c640 1 Processor -- start 2023-11-26T07:23:20.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.367+0000 7f108b31c640 1 -- start start 2023-11-26T07:23:20.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f108b31c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1084143ac0 0x7f1084070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:20.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f108b31c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f10840708b0 0x7f10840cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:20.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f108b31c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10840cfbf0 con 0x7f10840cf7c0 2023-11-26T07:23:20.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f108b31c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1084143ea0 con 0x7f10840708b0 2023-11-26T07:23:20.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f108b31c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10840cc730 con 0x7f1084143ac0 2023-11-26T07:23:20.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10890b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1084143ac0 0x7f1084070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:20.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10890b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1084143ac0 0x7f1084070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:52358/0 (socket says 172.21.15.70:52358) 2023-11-26T07:23:20.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10890b8640 1 -- 172.21.15.70:0/1257145766 learned_addr learned my addr 172.21.15.70:0/1257145766 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:20.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10888b7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f10840708b0 0x7f10840cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:20.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10890b8640 1 -- 172.21.15.70:0/1257145766 >> v2:172.21.15.120:3300/0 conn(0x7f10840708b0 msgr2=0x7f10840cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:20.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10890b8640 1 --2- 172.21.15.70:0/1257145766 >> v2:172.21.15.120:3300/0 conn(0x7f10840708b0 0x7f10840cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10890b8640 1 -- 172.21.15.70:0/1257145766 >> v1:172.21.15.120:6789/0 conn(0x7f10840cf7c0 legacy=0x7f10840b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10890b8640 1 -- 172.21.15.70:0/1257145766 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084070ee0 con 0x7f1084143ac0 2023-11-26T07:23:20.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.371+0000 7f10888b7640 1 --2- 172.21.15.70:0/1257145766 >> v2:172.21.15.120:3300/0 conn(0x7f10840708b0 0x7f10840cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:23:20.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f10890b8640 1 --2- 172.21.15.70:0/1257145766 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1084143ac0 0x7f1084070370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1080009870 tx=0x7f108001e750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0d68a1aa6b2e1dd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:20.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f107bfff640 1 -- 172.21.15.70:0/1257145766 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800a8630 con 0x7f1084143ac0 2023-11-26T07:23:20.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f107bfff640 1 -- 172.21.15.70:0/1257145766 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800a8790 con 0x7f1084143ac0 2023-11-26T07:23:20.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f107bfff640 1 -- 172.21.15.70:0/1257145766 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800a8b20 con 0x7f1084143ac0 2023-11-26T07:23:20.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 -- 172.21.15.70:0/1257145766 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1084143ac0 msgr2=0x7f1084070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 --2- 172.21.15.70:0/1257145766 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1084143ac0 0x7f1084070370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1080009870 tx=0x7f108001e750 comp rx=0 tx=0).stop 2023-11-26T07:23:20.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 -- 172.21.15.70:0/1257145766 shutdown_connections 2023-11-26T07:23:20.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 --2- 172.21.15.70:0/1257145766 >> v2:172.21.15.120:3300/0 conn(0x7f10840708b0 0x7f10840cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 --2- 172.21.15.70:0/1257145766 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1084143ac0 0x7f1084070370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 -- 172.21.15.70:0/1257145766 >> 172.21.15.70:0/1257145766 conn(0x7f108406a890 msgr2=0x7f108406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:20.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 -- 172.21.15.70:0/1257145766 shutdown_connections 2023-11-26T07:23:20.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 -- 172.21.15.70:0/1257145766 wait complete. 2023-11-26T07:23:20.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 Processor -- start 2023-11-26T07:23:20.377 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.375+0000 7f108b31c640 1 -- start start 2023-11-26T07:23:20.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10840708b0 0x7f1084159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:20.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10840cf7c0 0x7f1084139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:20.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1084143ac0 0x7f10841fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:20.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10841f9990 con 0x7f10840708b0 2023-11-26T07:23:20.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108413b160 con 0x7f1084143ac0 2023-11-26T07:23:20.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108413b440 con 0x7f10840cf7c0 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10890b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10840708b0 0x7f1084159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10888b7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10840cf7c0 0x7f1084139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10888b7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10840cf7c0 0x7f1084139e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:52362/0 (socket says 172.21.15.70:52362) 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10888b7640 1 -- 172.21.15.70:0/18250669 learned_addr learned my addr 172.21.15.70:0/18250669 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10898b9640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1084143ac0 0x7f10841fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10890b8640 1 -- 172.21.15.70:0/18250669 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10840cf7c0 msgr2=0x7f1084139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10890b8640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10840cf7c0 0x7f1084139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10890b8640 1 -- 172.21.15.70:0/18250669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1084143ac0 msgr2=0x7f10841fa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10890b8640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1084143ac0 0x7f10841fa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10890b8640 1 -- 172.21.15.70:0/18250669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074009420 con 0x7f10840708b0 2023-11-26T07:23:20.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f10890b8640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10840708b0 0x7f1084159660 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f10800ad000 tx=0x7f108001b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:20.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f1079ffb640 1 -- 172.21.15.70:0/18250669 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800b3650 con 0x7f10840708b0 2023-11-26T07:23:20.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f1079ffb640 1 -- 172.21.15.70:0/18250669 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800b37d0 con 0x7f10840708b0 2023-11-26T07:23:20.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f1079ffb640 1 -- 172.21.15.70:0/18250669 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800b3b80 con 0x7f10840708b0 2023-11-26T07:23:20.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10800094d0 con 0x7f10840708b0 2023-11-26T07:23:20.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10841f9ba0 con 0x7f10840708b0 2023-11-26T07:23:20.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.379+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10841f9d90 con 0x7f10840708b0 2023-11-26T07:23:20.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.383+0000 7f1079ffb640 1 -- 172.21.15.70:0/18250669 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 14) v1 ==== 86617+0+0 (secure 0 0 0) 0x7f10800b3ce0 con 0x7f10840708b0 2023-11-26T07:23:20.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.383+0000 7f1079ffb640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1068066ce0 0x7f10680691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:20.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.383+0000 7f1079ffb640 1 -- 172.21.15.70:0/18250669 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f108011ba10 con 0x7f10840708b0 2023-11-26T07:23:20.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.383+0000 7f10888b7640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1068066ce0 0x7f10680691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:20.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.383+0000 7f10888b7640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1068066ce0 0x7f10680691a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f10840b3200 tx=0x7f1074009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:20.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.387+0000 7f1079ffb640 1 -- 172.21.15.70:0/18250669 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10800ea8e0 con 0x7f10840708b0 2023-11-26T07:23:20.559 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.559+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol84210", "target": ["mon-mgr", ""]}) v1 -- 0x7f108413b960 con 0x7f1068066ce0 2023-11-26T07:23:20.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.563+0000 7f1079ffb640 1 -- 172.21.15.70:0/18250669 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+67 (secure 0 0 0) 0x7f1074009a40 con 0x7f1068066ce0 2023-11-26T07:23:20.789 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.563+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1068066ce0 msgr2=0x7f10680691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.563+0000 7f108b31c640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1068066ce0 0x7f10680691a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f10840b3200 tx=0x7f1074009190 comp rx=0 tx=0).stop 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10840708b0 msgr2=0x7f1084159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10840708b0 0x7f1084159660 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f10800ad000 tx=0x7f108001b4f0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 shutdown_connections 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1084143ac0 0x7f10841fa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f10840cf7c0 0x7f1084139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.790 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1068066ce0 0x7f10680691a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 --2- 172.21.15.70:0/18250669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10840708b0 0x7f1084159660 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 >> 172.21.15.70:0/18250669 conn(0x7f108406a890 msgr2=0x7f108415c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 shutdown_connections 2023-11-26T07:23:20.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:20.567+0000 7f108b31c640 1 -- 172.21.15.70:0/18250669 wait complete. 2023-11-26T07:23:20.791 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol84210 with 200 files each 1MB size under directory volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2 2023-11-26T07:23:20.791 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:20.791 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.801 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:20.884 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:20.885 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:20.885 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169313 s, 61.9 MB/s 2023-11-26T07:23:20.886 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:20.886 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:20.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:20.942 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.021 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.021 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.021 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181008 s, 57.9 MB/s 2023-11-26T07:23:21.022 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.022 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.074 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.151 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.151 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.151 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150215 s, 69.8 MB/s 2023-11-26T07:23:21.152 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.152 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.205 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.281 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.281 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.281 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164187 s, 63.9 MB/s 2023-11-26T07:23:21.282 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.282 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.334 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.411 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.411 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.411 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146082 s, 71.8 MB/s 2023-11-26T07:23:21.412 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.412 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.466 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.546 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173351 s, 60.5 MB/s 2023-11-26T07:23:21.547 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.547 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.598 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145577 s, 72.0 MB/s 2023-11-26T07:23:21.671 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.671 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.725 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.801 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.801 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.801 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126069 s, 83.2 MB/s 2023-11-26T07:23:21.802 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.802 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.858 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182801 s, 57.4 MB/s 2023-11-26T07:23:21.935 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:21.935 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:21.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:21.985 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.059 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.059 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.059 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153037 s, 68.5 MB/s 2023-11-26T07:23:22.060 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.060 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.110 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.183 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.183 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.183 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154134 s, 68.0 MB/s 2023-11-26T07:23:22.184 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.184 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.234 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139973 s, 74.9 MB/s 2023-11-26T07:23:22.308 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.308 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.357 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.432 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.432 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.432 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158353 s, 66.2 MB/s 2023-11-26T07:23:22.433 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.433 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.486 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016375 s, 64.0 MB/s 2023-11-26T07:23:22.562 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.562 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.614 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.690 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.690 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.690 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137385 s, 76.3 MB/s 2023-11-26T07:23:22.691 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.691 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.741 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.815 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.815 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.815 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154973 s, 67.7 MB/s 2023-11-26T07:23:22.816 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.816 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.866 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:22.939 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:22.939 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:22.939 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148988 s, 70.4 MB/s 2023-11-26T07:23:22.940 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:22.940 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:22.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:22.990 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.062 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.062 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.063 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141968 s, 73.9 MB/s 2023-11-26T07:23:23.063 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.063 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.113 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151408 s, 69.3 MB/s 2023-11-26T07:23:23.188 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.188 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.237 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.315 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.316 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167506 s, 62.6 MB/s 2023-11-26T07:23:23.316 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.317 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.365 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.438 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.438 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.439 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143129 s, 73.3 MB/s 2023-11-26T07:23:23.439 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.440 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.490 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.567 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148939 s, 70.4 MB/s 2023-11-26T07:23:23.568 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.568 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.617 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143144 s, 73.3 MB/s 2023-11-26T07:23:23.695 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.695 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.745 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.818 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.819 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.819 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135697 s, 77.3 MB/s 2023-11-26T07:23:23.820 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.820 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.869 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:23.947 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143945 s, 72.8 MB/s 2023-11-26T07:23:23.948 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:23.948 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:23.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:23.998 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.071 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.071 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.071 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147443 s, 71.1 MB/s 2023-11-26T07:23:24.072 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.072 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.121 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.193 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.193 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.193 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133155 s, 78.7 MB/s 2023-11-26T07:23:24.194 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.195 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.245 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.319 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.319 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.319 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01571 s, 66.7 MB/s 2023-11-26T07:23:24.320 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.320 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.369 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.444 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.445 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167014 s, 62.8 MB/s 2023-11-26T07:23:24.446 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.446 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.497 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156341 s, 67.1 MB/s 2023-11-26T07:23:24.573 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.573 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.625 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150782 s, 69.5 MB/s 2023-11-26T07:23:24.700 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.700 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.750 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.821 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.822 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.822 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132907 s, 78.9 MB/s 2023-11-26T07:23:24.822 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.823 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:24.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:24.874 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:24.946 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148831 s, 70.5 MB/s 2023-11-26T07:23:24.948 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:24.948 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.001 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.076 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.077 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149122 s, 70.3 MB/s 2023-11-26T07:23:25.077 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.078 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.134 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.206 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.206 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.206 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144557 s, 72.5 MB/s 2023-11-26T07:23:25.207 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.207 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.258 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.330 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.330 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.330 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141596 s, 74.1 MB/s 2023-11-26T07:23:25.331 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.331 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.382 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.459 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154853 s, 67.7 MB/s 2023-11-26T07:23:25.460 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.460 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.510 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.583 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.583 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.584 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149985 s, 69.9 MB/s 2023-11-26T07:23:25.585 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.585 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.634 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.707 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.707 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.707 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152171 s, 68.9 MB/s 2023-11-26T07:23:25.708 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.708 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.766 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.848 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.848 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.848 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149465 s, 70.2 MB/s 2023-11-26T07:23:25.849 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.849 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:25.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:25.907 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:25.985 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:25.985 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:25.985 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152049 s, 69.0 MB/s 2023-11-26T07:23:25.986 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:25.986 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.038 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.115 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:26.115 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:26.115 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130931 s, 80.1 MB/s 2023-11-26T07:23:26.116 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:26.116 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.171 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.250 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:26.251 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:26.251 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157125 s, 66.7 MB/s 2023-11-26T07:23:26.251 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:26.252 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.304 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.380 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:26.380 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:26.380 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162959 s, 64.3 MB/s 2023-11-26T07:23:26.381 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:26.381 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.434 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.514 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:26.514 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:26.514 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015815 s, 66.3 MB/s 2023-11-26T07:23:26.515 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:26.515 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.571 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.643 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:26.644 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:26.644 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147555 s, 71.1 MB/s 2023-11-26T07:23:26.645 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:26.645 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.698 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.772 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:26.772 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:26.772 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147786 s, 71.0 MB/s 2023-11-26T07:23:26.773 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:26.773 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.826 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:26.901 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:26.901 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:26.902 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131207 s, 79.9 MB/s 2023-11-26T07:23:26.902 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:26.903 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:26.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:26.954 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.027 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.027 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.027 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146853 s, 71.4 MB/s 2023-11-26T07:23:27.028 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.028 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.078 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.153 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.153 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.153 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167474 s, 62.6 MB/s 2023-11-26T07:23:27.154 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.154 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.210 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.284 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.284 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.284 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157509 s, 66.6 MB/s 2023-11-26T07:23:27.285 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.285 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.338 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.411 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.412 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.412 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148405 s, 70.7 MB/s 2023-11-26T07:23:27.413 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.413 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.470 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139241 s, 75.3 MB/s 2023-11-26T07:23:27.547 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.548 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.598 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014847 s, 70.6 MB/s 2023-11-26T07:23:27.671 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.671 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.725 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.802 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.802 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.802 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142315 s, 73.7 MB/s 2023-11-26T07:23:27.803 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.803 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.853 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:27.925 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:27.925 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:27.925 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131243 s, 79.9 MB/s 2023-11-26T07:23:27.926 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:27.926 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:27.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:27.978 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.051 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.051 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.051 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140141 s, 74.8 MB/s 2023-11-26T07:23:28.052 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.052 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.102 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.174 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.175 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.175 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139631 s, 75.1 MB/s 2023-11-26T07:23:28.176 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.176 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.230 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.300 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.300 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.300 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138405 s, 75.8 MB/s 2023-11-26T07:23:28.301 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.301 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.358 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.431 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.431 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.431 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149343 s, 70.2 MB/s 2023-11-26T07:23:28.432 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.432 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.481 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015493 s, 67.7 MB/s 2023-11-26T07:23:28.562 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.562 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.617 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.695 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.695 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144278 s, 72.7 MB/s 2023-11-26T07:23:28.696 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.696 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.745 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.819 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.819 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.819 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151151 s, 69.4 MB/s 2023-11-26T07:23:28.820 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.820 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.870 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:28.943 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:28.943 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:28.943 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014681 s, 71.4 MB/s 2023-11-26T07:23:28.944 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:28.944 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:28.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:28.993 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.068 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151801 s, 69.1 MB/s 2023-11-26T07:23:29.069 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.069 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.125 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.203 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.203 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.203 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140083 s, 74.9 MB/s 2023-11-26T07:23:29.204 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.204 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.254 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.329 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149991 s, 69.9 MB/s 2023-11-26T07:23:29.330 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.330 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.381 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160157 s, 65.5 MB/s 2023-11-26T07:23:29.463 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.463 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.517 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.592 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.592 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.593 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160688 s, 65.3 MB/s 2023-11-26T07:23:29.593 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.593 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.649 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.725 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163977 s, 63.9 MB/s 2023-11-26T07:23:29.726 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.726 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.777 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.853 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160734 s, 65.2 MB/s 2023-11-26T07:23:29.854 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.854 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:29.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:29.906 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:29.979 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:29.979 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:29.979 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146865 s, 71.4 MB/s 2023-11-26T07:23:29.980 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:29.980 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.034 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.107 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:30.107 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:30.107 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139449 s, 75.2 MB/s 2023-11-26T07:23:30.108 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:30.108 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.157 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.230 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:30.230 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:30.231 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137578 s, 76.2 MB/s 2023-11-26T07:23:30.231 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:30.232 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:30.278 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:23:30.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.282 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.361 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:30.361 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:30.361 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153972 s, 68.1 MB/s 2023-11-26T07:23:30.362 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:30.362 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.417 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144976 s, 72.3 MB/s 2023-11-26T07:23:30.492 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:30.492 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.541 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159484 s, 65.7 MB/s 2023-11-26T07:23:30.618 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:30.618 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.673 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164743 s, 63.6 MB/s 2023-11-26T07:23:30.750 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:30.750 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.805 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:30.883 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:30.883 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:30.883 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134959 s, 77.7 MB/s 2023-11-26T07:23:30.884 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:30.884 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:30.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:30.933 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.011 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138637 s, 75.6 MB/s 2023-11-26T07:23:31.012 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.012 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.061 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.136 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.137 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166167 s, 63.1 MB/s 2023-11-26T07:23:31.138 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.138 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.194 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.272 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.272 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.272 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01509 s, 69.5 MB/s 2023-11-26T07:23:31.273 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.273 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.325 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.404 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.405 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.405 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165975 s, 63.2 MB/s 2023-11-26T07:23:31.406 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.406 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.462 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.540 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.540 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.540 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166519 s, 63.0 MB/s 2023-11-26T07:23:31.541 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.541 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.594 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014544 s, 72.1 MB/s 2023-11-26T07:23:31.668 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.668 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.717 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149193 s, 70.3 MB/s 2023-11-26T07:23:31.792 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.792 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.841 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:31.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:31.916 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:31.916 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158178 s, 66.3 MB/s 2023-11-26T07:23:31.917 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:31.917 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:31.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:31.969 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.042 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.042 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.042 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139197 s, 75.3 MB/s 2023-11-26T07:23:32.043 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.043 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.097 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.171 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.171 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.171 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154409 s, 67.9 MB/s 2023-11-26T07:23:32.172 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.172 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.221 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.295 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.295 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.295 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146433 s, 71.6 MB/s 2023-11-26T07:23:32.296 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.296 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.345 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.418 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.418 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.418 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139105 s, 75.4 MB/s 2023-11-26T07:23:32.419 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.419 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.469 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.541 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.541 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.541 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122901 s, 85.3 MB/s 2023-11-26T07:23:32.542 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.542 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.597 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.671 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.671 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.671 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147565 s, 71.1 MB/s 2023-11-26T07:23:32.672 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.672 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.722 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.796 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.796 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.796 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156377 s, 67.1 MB/s 2023-11-26T07:23:32.797 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.797 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.849 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:32.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158091 s, 66.3 MB/s 2023-11-26T07:23:32.929 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:32.929 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:32.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:32.981 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.056 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015396 s, 68.1 MB/s 2023-11-26T07:23:33.057 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.057 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.110 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.182 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.182 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.182 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014066 s, 74.5 MB/s 2023-11-26T07:23:33.183 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.183 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.233 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.304 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.304 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.304 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138877 s, 75.5 MB/s 2023-11-26T07:23:33.305 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.305 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.361 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.440 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.440 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.440 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157175 s, 66.7 MB/s 2023-11-26T07:23:33.441 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.441 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.497 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.574 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.574 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131346 s, 79.8 MB/s 2023-11-26T07:23:33.575 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.575 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.628 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.703 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.703 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.703 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154435 s, 67.9 MB/s 2023-11-26T07:23:33.704 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.704 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.757 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.832 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.832 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.832 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161163 s, 65.1 MB/s 2023-11-26T07:23:33.833 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.833 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:33.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:33.885 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131046 s, 80.0 MB/s 2023-11-26T07:23:33.958 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:33.958 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.010 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.083 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.083 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.083 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146809 s, 71.4 MB/s 2023-11-26T07:23:34.084 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.084 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.133 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.206 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.206 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.206 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136414 s, 76.9 MB/s 2023-11-26T07:23:34.207 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.207 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.257 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.331 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162272 s, 64.6 MB/s 2023-11-26T07:23:34.333 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.333 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.385 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.460 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.460 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.460 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154222 s, 68.0 MB/s 2023-11-26T07:23:34.461 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.461 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.513 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153423 s, 68.3 MB/s 2023-11-26T07:23:34.588 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.589 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.641 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.717 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.717 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.717 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013454 s, 77.9 MB/s 2023-11-26T07:23:34.718 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.718 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.770 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.844 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.844 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.844 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164994 s, 63.6 MB/s 2023-11-26T07:23:34.845 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.845 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:34.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:34.897 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:34.971 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:34.972 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:34.972 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157918 s, 66.4 MB/s 2023-11-26T07:23:34.973 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:34.973 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.029 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.103 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.103 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153816 s, 68.2 MB/s 2023-11-26T07:23:35.104 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:35.105 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.162 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.237 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.237 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.238 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140967 s, 74.4 MB/s 2023-11-26T07:23:35.238 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:35.239 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.293 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.367 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.367 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.367 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144014 s, 72.8 MB/s 2023-11-26T07:23:35.368 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:35.368 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.417 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.497 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.497 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.497 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169337 s, 61.9 MB/s 2023-11-26T07:23:35.498 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:35.498 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.554 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.627 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.627 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.627 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147668 s, 71.0 MB/s 2023-11-26T07:23:35.628 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:35.628 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.677 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.749 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.749 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.749 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135941 s, 77.1 MB/s 2023-11-26T07:23:35.750 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:35.750 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.801 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153861 s, 68.2 MB/s 2023-11-26T07:23:35.876 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:35.876 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:35.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:35.925 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:35.999 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:35.999 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:35.999 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124091 s, 84.5 MB/s 2023-11-26T07:23:36.000 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.000 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.049 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.123 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:36.123 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:36.123 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147906 s, 70.9 MB/s 2023-11-26T07:23:36.124 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.124 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.173 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.245 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:36.246 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:36.246 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143076 s, 73.3 MB/s 2023-11-26T07:23:36.247 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.247 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.297 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155728 s, 67.3 MB/s 2023-11-26T07:23:36.376 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.376 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.429 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144536 s, 72.5 MB/s 2023-11-26T07:23:36.503 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.504 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.553 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:36.631 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015426 s, 68.0 MB/s 2023-11-26T07:23:36.632 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.632 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.681 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:36.754 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150324 s, 69.8 MB/s 2023-11-26T07:23:36.755 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.755 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.805 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135052 s, 77.6 MB/s 2023-11-26T07:23:36.878 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:36.878 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:36.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:36.929 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.003 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.003 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.003 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146112 s, 71.8 MB/s 2023-11-26T07:23:37.004 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.004 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.058 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.135 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.135 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.135 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155475 s, 67.4 MB/s 2023-11-26T07:23:37.136 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.136 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.185 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.257 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142808 s, 73.4 MB/s 2023-11-26T07:23:37.259 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.259 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.309 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.382 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.382 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.382 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146807 s, 71.4 MB/s 2023-11-26T07:23:37.383 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.383 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.437 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.512 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.512 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.512 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155555 s, 67.4 MB/s 2023-11-26T07:23:37.513 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.513 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.565 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138374 s, 75.8 MB/s 2023-11-26T07:23:37.639 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.639 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.693 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.770 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.770 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.770 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137617 s, 76.2 MB/s 2023-11-26T07:23:37.771 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.771 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.821 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133963 s, 78.3 MB/s 2023-11-26T07:23:37.894 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:37.894 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:37.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:37.945 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.017 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.017 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.017 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126492 s, 82.9 MB/s 2023-11-26T07:23:38.018 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.018 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.073 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.150 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.150 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.150 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148889 s, 70.4 MB/s 2023-11-26T07:23:38.151 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.151 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.201 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.275 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.275 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.275 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155497 s, 67.4 MB/s 2023-11-26T07:23:38.276 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.276 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.325 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.399 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.399 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.400 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149969 s, 69.9 MB/s 2023-11-26T07:23:38.400 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.401 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.457 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136043 s, 77.1 MB/s 2023-11-26T07:23:38.531 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.531 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.586 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143153 s, 73.2 MB/s 2023-11-26T07:23:38.660 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.660 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.709 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.783 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147785 s, 71.0 MB/s 2023-11-26T07:23:38.784 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.785 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.837 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158425 s, 66.2 MB/s 2023-11-26T07:23:38.913 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:38.913 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:38.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:38.965 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.039 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.039 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.039 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141872 s, 73.9 MB/s 2023-11-26T07:23:39.040 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.040 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.093 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135433 s, 77.4 MB/s 2023-11-26T07:23:39.166 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.166 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.217 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.290 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.290 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.290 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144085 s, 72.8 MB/s 2023-11-26T07:23:39.291 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.291 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.345 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.419 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.419 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.419 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154606 s, 67.8 MB/s 2023-11-26T07:23:39.420 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.420 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.473 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.546 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.546 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142199 s, 73.7 MB/s 2023-11-26T07:23:39.547 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.547 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.597 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.674 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.674 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.675 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145611 s, 72.0 MB/s 2023-11-26T07:23:39.675 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.676 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.729 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.799 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.800 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.800 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012166 s, 86.2 MB/s 2023-11-26T07:23:39.801 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.801 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.857 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:39.935 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:39.935 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:39.935 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153362 s, 68.4 MB/s 2023-11-26T07:23:39.936 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:39.936 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:39.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:39.985 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.060 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144352 s, 72.6 MB/s 2023-11-26T07:23:40.060 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.061 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.114 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.189 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.189 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.189 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137289 s, 76.4 MB/s 2023-11-26T07:23:40.190 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.190 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.241 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.314 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.314 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.314 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137082 s, 76.5 MB/s 2023-11-26T07:23:40.315 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.315 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.365 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.440 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.440 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.440 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165797 s, 63.2 MB/s 2023-11-26T07:23:40.441 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.441 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.493 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.566 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.567 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.567 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145054 s, 72.3 MB/s 2023-11-26T07:23:40.568 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.568 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.617 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.689 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.689 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.689 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123394 s, 85.0 MB/s 2023-11-26T07:23:40.690 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.690 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.741 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.819 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.819 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.819 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155421 s, 67.5 MB/s 2023-11-26T07:23:40.820 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.820 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.870 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:40.941 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136008 s, 77.1 MB/s 2023-11-26T07:23:40.943 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:40.943 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:40.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:40.993 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.068 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.069 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151401 s, 69.3 MB/s 2023-11-26T07:23:41.069 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.070 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.121 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.193 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.193 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.193 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135558 s, 77.4 MB/s 2023-11-26T07:23:41.194 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.194 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.250 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.327 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.327 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151539 s, 69.2 MB/s 2023-11-26T07:23:41.328 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.328 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.377 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153477 s, 68.3 MB/s 2023-11-26T07:23:41.457 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.457 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.509 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.583 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146091 s, 71.8 MB/s 2023-11-26T07:23:41.584 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.584 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.633 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.706 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.706 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.707 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147136 s, 71.3 MB/s 2023-11-26T07:23:41.707 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.707 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.757 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.831 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.831 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.831 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150798 s, 69.5 MB/s 2023-11-26T07:23:41.832 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.832 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:41.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:41.881 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:41.952 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:41.953 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:41.953 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013302 s, 78.8 MB/s 2023-11-26T07:23:41.953 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:41.954 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.005 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014724 s, 71.2 MB/s 2023-11-26T07:23:42.084 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.084 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.137 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151661 s, 69.1 MB/s 2023-11-26T07:23:42.212 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.212 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.265 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.338 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.338 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.338 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144565 s, 72.5 MB/s 2023-11-26T07:23:42.339 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.339 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.393 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.469 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143973 s, 72.8 MB/s 2023-11-26T07:23:42.470 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.470 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.521 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140762 s, 74.5 MB/s 2023-11-26T07:23:42.594 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.595 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.645 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01402 s, 74.8 MB/s 2023-11-26T07:23:42.719 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.719 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.773 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155206 s, 67.6 MB/s 2023-11-26T07:23:42.848 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.848 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:42.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:42.897 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:42.971 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:42.971 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:42.971 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155151 s, 67.6 MB/s 2023-11-26T07:23:42.972 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:42.972 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.021 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.097 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.097 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.098 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137434 s, 76.3 MB/s 2023-11-26T07:23:43.099 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.099 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.149 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.226 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.226 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.226 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145336 s, 72.1 MB/s 2023-11-26T07:23:43.227 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.227 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.277 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.349 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.349 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.349 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139183 s, 75.3 MB/s 2023-11-26T07:23:43.350 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.350 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.401 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.476 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.476 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.476 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160383 s, 65.4 MB/s 2023-11-26T07:23:43.477 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.477 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.533 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.608 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014946 s, 70.2 MB/s 2023-11-26T07:23:43.609 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.609 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.661 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.737 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.737 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.737 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156054 s, 67.2 MB/s 2023-11-26T07:23:43.738 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.738 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.789 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.862 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.862 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.862 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147225 s, 71.2 MB/s 2023-11-26T07:23:43.863 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.863 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:43.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:43.913 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:43.990 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:43.990 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:43.991 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149445 s, 70.2 MB/s 2023-11-26T07:23:43.991 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:43.992 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.041 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.117 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:44.117 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:44.117 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012162 s, 86.2 MB/s 2023-11-26T07:23:44.118 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:44.118 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.173 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.250 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:44.250 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:44.250 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147993 s, 70.9 MB/s 2023-11-26T07:23:44.251 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:44.251 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.307 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:44.382 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013478 s, 77.8 MB/s 2023-11-26T07:23:44.383 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:44.383 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.433 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:44.510 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164263 s, 63.8 MB/s 2023-11-26T07:23:44.510 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:44.510 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.561 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.635 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:44.636 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:44.636 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149362 s, 70.2 MB/s 2023-11-26T07:23:44.637 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:44.637 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.689 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.762 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:44.762 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:44.762 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142649 s, 73.5 MB/s 2023-11-26T07:23:44.763 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:44.763 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.813 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:44.886 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148887 s, 70.4 MB/s 2023-11-26T07:23:44.887 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:44.887 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:44.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:44.937 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142587 s, 73.5 MB/s 2023-11-26T07:23:45.012 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.012 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.066 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.136 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126111 s, 83.1 MB/s 2023-11-26T07:23:45.137 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.137 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.193 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.266 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.266 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.266 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147151 s, 71.3 MB/s 2023-11-26T07:23:45.267 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.267 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.321 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145428 s, 72.1 MB/s 2023-11-26T07:23:45.395 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.396 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.445 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.519 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.519 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154762 s, 67.8 MB/s 2023-11-26T07:23:45.520 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.520 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.569 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146421 s, 71.6 MB/s 2023-11-26T07:23:45.644 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.644 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.697 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.771 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.772 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.772 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014944 s, 70.2 MB/s 2023-11-26T07:23:45.773 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.773 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.830 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:45.903 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:45.903 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:45.903 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146047 s, 71.8 MB/s 2023-11-26T07:23:45.904 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:45.904 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:45.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:45.953 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:46.030 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:46.030 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:46.031 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139457 s, 75.2 MB/s 2023-11-26T07:23:46.031 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:46.032 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:46.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:46.081 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140711 s, 74.5 MB/s 2023-11-26T07:23:46.158 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:46.158 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:46.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:23:46.209 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol84210/850eb740-103b-4162-b3b5-4449a7815de2/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2023-11-26T07:23:46.284 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-26T07:23:46.284 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-26T07:23:46.284 INFO:teuthology.orchestra.run.smithi070.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163733 s, 64.0 MB/s 2023-11-26T07:23:46.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol84210 subvol_snap78150 2023-11-26T07:23:46.474 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 Processor -- start 2023-11-26T07:23:46.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 -- start start 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb2e415d6e0 0x7fb2e40d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb2e40b2160 0x7fb2e40d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e40d19f0 0x7fb2e40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e415dac0 con 0x7fb2e415d6e0 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40d1e80 con 0x7fb2e40b2160 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2eb50f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40cf0e0 con 0x7fb2e40d19f0 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb2e415d6e0 0x7fb2e40d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb2e415d6e0 0x7fb2e40d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55378/0 (socket says 172.21.15.70:55378) 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3531915623 learned_addr learned my addr 172.21.15.70:0/3531915623 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:46.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e9aac640 1 --2- 172.21.15.70:0/3531915623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e40d19f0 0x7fb2e40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e8aaa640 1 --2- 172.21.15.70:0/3531915623 >> v2:172.21.15.120:3300/0 conn(0x7fb2e40b2160 0x7fb2e40d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3531915623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e40d19f0 msgr2=0x7fb2e40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 --2- 172.21.15.70:0/3531915623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e40d19f0 0x7fb2e40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3531915623 >> v2:172.21.15.120:3300/0 conn(0x7fb2e40b2160 msgr2=0x7fb2e40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 --2- 172.21.15.70:0/3531915623 >> v2:172.21.15.120:3300/0 conn(0x7fb2e40b2160 0x7fb2e40d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.475+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3531915623 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e40ceb20 con 0x7fb2e415d6e0 2023-11-26T07:23:46.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2e92ab640 1 --2- 172.21.15.70:0/3531915623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e415d6e0 0x7fb2e40d0df0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ca2a0 tx=0x7fb2e001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a257ca19d9f046e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2dbfff640 1 -- 172.21.15.70:0/3531915623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00ab600 con 0x7fb2e415d6e0 2023-11-26T07:23:46.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2dbfff640 1 -- 172.21.15.70:0/3531915623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e00a7050 con 0x7fb2e415d6e0 2023-11-26T07:23:46.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2dbfff640 1 -- 172.21.15.70:0/3531915623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00ab980 con 0x7fb2e415d6e0 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3531915623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e415d6e0 msgr2=0x7fb2e40d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3531915623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e415d6e0 0x7fb2e40d0df0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ca2a0 tx=0x7fb2e001c240 comp rx=0 tx=0).stop 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3531915623 shutdown_connections 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3531915623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e40d19f0 0x7fb2e40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3531915623 >> v2:172.21.15.120:3300/0 conn(0x7fb2e40b2160 0x7fb2e40d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3531915623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e415d6e0 0x7fb2e40d0df0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3531915623 >> 172.21.15.70:0/3531915623 conn(0x7fb2e409c550 msgr2=0x7fb2e40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3531915623 shutdown_connections 2023-11-26T07:23:46.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.479+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3531915623 wait complete. 2023-11-26T07:23:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 Processor -- start 2023-11-26T07:23:46.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 -- start start 2023-11-26T07:23:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40b2160 0x7fb2e40b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e40d19f0 0x7fb2e41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e415d6e0 0x7fb2e414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4150940 con 0x7fb2e40b2160 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4155460 con 0x7fb2e40d19f0 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4150b50 con 0x7fb2e415d6e0 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40b2160 0x7fb2e40b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40b2160 0x7fb2e40b89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55380/0 (socket says 172.21.15.70:55380) 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3522493481 learned_addr learned my addr 172.21.15.70:0/3522493481 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e8aaa640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e40d19f0 0x7fb2e41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e9aac640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e415d6e0 0x7fb2e414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e415d6e0 msgr2=0x7fb2e414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e415d6e0 0x7fb2e414f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e40d19f0 msgr2=0x7fb2e41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e40d19f0 0x7fb2e41513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 -- 172.21.15.70:0/3522493481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00094d0 con 0x7fb2e40b2160 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e8aaa640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e40d19f0 0x7fb2e41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2e92ab640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40b2160 0x7fb2e40b89a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb2e001a8f0 tx=0x7fb2e0018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2d9ffb640 1 -- 172.21.15.70:0/3522493481 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00b4420 con 0x7fb2e40b2160 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2d9ffb640 1 -- 172.21.15.70:0/3522493481 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e00b4580 con 0x7fb2e40b2160 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2d9ffb640 1 -- 172.21.15.70:0/3522493481 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00b4930 con 0x7fb2e40b2160 2023-11-26T07:23:46.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.483+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4150e30 con 0x7fb2e40b2160 2023-11-26T07:23:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.487+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e41556b0 con 0x7fb2e40b2160 2023-11-26T07:23:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.487+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e4067680 con 0x7fb2e40b2160 2023-11-26T07:23:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.487+0000 7fb2d9ffb640 1 -- 172.21.15.70:0/3522493481 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) v1 ==== 86668+0+0 (secure 0 0 0) 0x7fb2e00b2070 con 0x7fb2e40b2160 2023-11-26T07:23:46.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.487+0000 7fb2d9ffb640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2c8066d70 0x7fb2c8069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.487+0000 7fb2d9ffb640 1 -- 172.21.15.70:0/3522493481 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb2e011b7c0 con 0x7fb2e40b2160 2023-11-26T07:23:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.487+0000 7fb2e8aaa640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2c8066d70 0x7fb2c8069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.491+0000 7fb2e8aaa640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2c8066d70 0x7fb2c8069230 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40d2b00 tx=0x7fb2d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.491+0000 7fb2d9ffb640 1 -- 172.21.15.70:0/3522493481 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2e00ea690 con 0x7fb2e40b2160 2023-11-26T07:23:46.668 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.667+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol84210", "snap_name": "subvol_snap78150", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e40ce810 con 0x7fb2c8066d70 2023-11-26T07:23:46.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2d9ffb640 1 -- 172.21.15.70:0/3522493481 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb2d4009860 con 0x7fb2c8066d70 2023-11-26T07:23:46.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2c8066d70 msgr2=0x7fb2c8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2c8066d70 0x7fb2c8069230 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40d2b00 tx=0x7fb2d4008040 comp rx=0 tx=0).stop 2023-11-26T07:23:46.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40b2160 msgr2=0x7fb2e40b89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40b2160 0x7fb2e40b89a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb2e001a8f0 tx=0x7fb2e0018fe0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 shutdown_connections 2023-11-26T07:23:46.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb2e415d6e0 0x7fb2e414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2e40d19f0 0x7fb2e41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb2c8066d70 0x7fb2c8069230 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 --2- 172.21.15.70:0/3522493481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2e40b2160 0x7fb2e40b89a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 >> 172.21.15.70:0/3522493481 conn(0x7fb2e409c550 msgr2=0x7fb2e40734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:46.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 shutdown_connections 2023-11-26T07:23:46.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.687+0000 7fb2eb50f640 1 -- 172.21.15.70:0/3522493481 wait complete. 2023-11-26T07:23:46.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2023-11-26T07:23:46.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f459bd35640 1 Processor -- start 2023-11-26T07:23:46.846 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f459bd35640 1 -- start start 2023-11-26T07:23:46.847 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f459bd35640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f45940b2160 0x7f45940d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f459bd35640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45940cf0e0 con 0x7f45940d1bc0 2023-11-26T07:23:46.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f459bd35640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45940ceb20 con 0x7f459415d6e0 2023-11-26T07:23:46.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f459bd35640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459415dac0 con 0x7f45940b2160 2023-11-26T07:23:46.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f45992d0640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f45940d1bc0 0x7f45940b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:32914/0 (socket says 172.21.15.70:32914) 2023-11-26T07:23:46.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f45992d0640 1 -- 172.21.15.70:0/1448586179 learned_addr learned my addr 172.21.15.70:0/1448586179 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702207932 0 0) 0x7f45940cf0e0 con 0x7f45940d1bc0 2023-11-26T07:23:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f459a2d2640 1 --2- 172.21.15.70:0/1448586179 >> v2:172.21.15.120:3300/0 conn(0x7f45940b2160 0x7f45940d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4580003530 con 0x7f45940d1bc0 2023-11-26T07:23:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426686780 0 0) 0x7f4580003530 con 0x7f45940d1bc0 2023-11-26T07:23:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 >> v2:172.21.15.120:3300/0 conn(0x7f45940b2160 msgr2=0x7f45940d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 --2- 172.21.15.70:0/1448586179 >> v2:172.21.15.120:3300/0 conn(0x7f45940b2160 0x7f45940d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 >> v1:172.21.15.120:6789/0 conn(0x7f459415d6e0 legacy=0x7f45940d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940cee00 con 0x7f45940d1bc0 2023-11-26T07:23:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f4584001680 con 0x7f45940d1bc0 2023-11-26T07:23:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 >> v1:172.21.15.70:6789/0 conn(0x7f45940d1bc0 legacy=0x7f45940b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45800039d0 0x7f4580003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45800047d0 0x7f4580004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.847+0000 7f4598acf640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580005190 0x7f458000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459415dac0 con 0x7f4580005190 2023-11-26T07:23:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458000c090 con 0x7f45800039d0 2023-11-26T07:23:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458000c250 con 0x7f45800047d0 2023-11-26T07:23:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580005190 0x7f458000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f4599ad1640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45800039d0 0x7f4580003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f45992d0640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45800047d0 0x7f4580004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 -- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45800047d0 msgr2=0x7f4580004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45800047d0 0x7f4580004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 -- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45800039d0 msgr2=0x7f4580003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45800039d0 0x7f4580003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 -- 172.21.15.70:0/1448586179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580003530 con 0x7f4580005190 2023-11-26T07:23:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 -- 172.21.15.70:0/1448586179 reap_dead start 2023-11-26T07:23:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f459a2d2640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580005190 0x7f458000b990 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f458c009f90 tx=0x7f458c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64528cfa3e025d6a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0a5c70 con 0x7f4580005190 2023-11-26T07:23:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c00f040 con 0x7f4580005190 2023-11-26T07:23:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.851+0000 7f4598acf640 1 -- 172.21.15.70:0/1448586179 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0ad440 con 0x7f4580005190 2023-11-26T07:23:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- 172.21.15.70:0/1448586179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580005190 msgr2=0x7f458000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580005190 0x7f458000b990 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f458c009f90 tx=0x7f458c01cc60 comp rx=0 tx=0).stop 2023-11-26T07:23:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- 172.21.15.70:0/1448586179 shutdown_connections 2023-11-26T07:23:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 --2- 172.21.15.70:0/1448586179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580005190 0x7f458000b990 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- 172.21.15.70:0/1448586179 >> 172.21.15.70:0/1448586179 conn(0x7f459409c550 msgr2=0x7f45940d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- 172.21.15.70:0/1448586179 shutdown_connections 2023-11-26T07:23:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- 172.21.15.70:0/1448586179 wait complete. 2023-11-26T07:23:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 Processor -- start 2023-11-26T07:23:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- start start 2023-11-26T07:23:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4580005190 0x7f4594160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45940b6cd0 0x7f459415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45940b8340 0x7f45941f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940b7150 con 0x7f45940b8340 2023-11-26T07:23:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940b6840 con 0x7f4580005190 2023-11-26T07:23:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459bd35640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940b5f50 con 0x7f45940b6cd0 2023-11-26T07:23:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45940b8340 0x7f45941f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45940b8340 0x7f45941f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55396/0 (socket says 172.21.15.70:55396) 2023-11-26T07:23:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 -- 172.21.15.70:0/4245435901 learned_addr learned my addr 172.21.15.70:0/4245435901 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f4599ad1640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4580005190 0x7f4594160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f45992d0640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45940b6cd0 0x7f459415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 -- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45940b6cd0 msgr2=0x7f459415f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45940b6cd0 0x7f459415f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 -- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4580005190 msgr2=0x7f4594160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4580005190 0x7f4594160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f459a2d2640 1 -- 172.21.15.70:0/4245435901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940ce990 con 0x7f45940b8340 2023-11-26T07:23:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f45992d0640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45940b6cd0 0x7f459415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.855+0000 7f4599ad1640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4580005190 0x7f4594160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f459a2d2640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45940b8340 0x7f45941f6040 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f458c01ca90 tx=0x7f458c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f458a7fc640 1 -- 172.21.15.70:0/4245435901 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0bd070 con 0x7f45940b8340 2023-11-26T07:23:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f458a7fc640 1 -- 172.21.15.70:0/4245435901 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c0ada00 con 0x7f45940b8340 2023-11-26T07:23:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45940b8ab0 con 0x7f45940b8340 2023-11-26T07:23:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f458a7fc640 1 -- 172.21.15.70:0/4245435901 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0addb0 con 0x7f45940b8340 2023-11-26T07:23:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45940b64d0 con 0x7f45940b8340 2023-11-26T07:23:46.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459415f610 con 0x7f45940b8340 2023-11-26T07:23:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f458a7fc640 1 -- 172.21.15.70:0/4245435901 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) v1 ==== 86668+0+0 (secure 0 0 0) 0x7f458c0b4040 con 0x7f45940b8340 2023-11-26T07:23:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f458a7fc640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4578066d70 0x7f4578069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f458a7fc640 1 -- 172.21.15.70:0/4245435901 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f458c11d030 con 0x7f45940b8340 2023-11-26T07:23:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f4599ad1640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4578066d70 0x7f4578069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.859+0000 7f4599ad1640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4578066d70 0x7f4578069230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:46.863+0000 7f458a7fc640 1 -- 172.21.15.70:0/4245435901 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f458c0ebe30 con 0x7f45940b8340 2023-11-26T07:23:47.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.027+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) v1 -- 0x7f45940b69b0 con 0x7f45940b8340 2023-11-26T07:23:47.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f458a7fc640 1 -- 172.21.15.70:0/4245435901 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v23)=0 v23) v1 ==== 130+0+0 (secure 0 0 0) 0x7f458c0ef450 con 0x7f45940b8340 2023-11-26T07:23:47.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4578066d70 msgr2=0x7f4578069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4578066d70 0x7f4578069230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590009040 comp rx=0 tx=0).stop 2023-11-26T07:23:47.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45940b8340 msgr2=0x7f45941f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45940b8340 0x7f45941f6040 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f458c01ca90 tx=0x7f458c009750 comp rx=0 tx=0).stop 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 shutdown_connections 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4578066d70 0x7f4578069230 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45940b8340 0x7f45941f6040 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f45940b6cd0 0x7f459415f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 --2- 172.21.15.70:0/4245435901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4580005190 0x7f4594160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 >> 172.21.15.70:0/4245435901 conn(0x7f459409c550 msgr2=0x7f45940c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 shutdown_connections 2023-11-26T07:23:47.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.031+0000 7f459bd35640 1 -- 172.21.15.70:0/4245435901 wait complete. 2023-11-26T07:23:47.040 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.039+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.040 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.039+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.040 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.039+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.040 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.039+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.040 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.039+0000 7ff292914640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol84210 subvol_snap78150 subvol_clone62480 2023-11-26T07:23:47.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383f6d6640 1 Processor -- start 2023-11-26T07:23:47.197 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383f6d6640 1 -- start start 2023-11-26T07:23:47.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383f6d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f38380ce7c0 0x7f383815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383f6d6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383806c520 con 0x7f383813e290 2023-11-26T07:23:47.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383f6d6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383806c800 con 0x7f38380cf990 2023-11-26T07:23:47.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383f6d6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383806cae0 con 0x7f38380ce7c0 2023-11-26T07:23:47.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383dc73640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f38380ce7c0 0x7f383815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383d472640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f383813e290 0x7f38380cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:32918/0 (socket says 172.21.15.70:32918) 2023-11-26T07:23:47.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383d472640 1 -- 172.21.15.70:0/603012933 learned_addr learned my addr 172.21.15.70:0/603012933 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:47.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383dc73640 1 -- 172.21.15.70:0/603012933 >> v1:172.21.15.120:6789/0 conn(0x7f38380cf990 legacy=0x7f383815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383dc73640 1 -- 172.21.15.70:0/603012933 >> v1:172.21.15.70:6789/0 conn(0x7f383813e290 legacy=0x7f38380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.199+0000 7f383dc73640 1 -- 172.21.15.70:0/603012933 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383806cdc0 con 0x7f38380ce7c0 2023-11-26T07:23:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383dc73640 1 --2- 172.21.15.70:0/603012933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383815f6b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f3830009d90 tx=0x7f383001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c722abfb4e0a844e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f382ffff640 1 -- 172.21.15.70:0/603012933 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300a5970 con 0x7f38380ce7c0 2023-11-26T07:23:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f382ffff640 1 -- 172.21.15.70:0/603012933 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38300a5ad0 con 0x7f38380ce7c0 2023-11-26T07:23:47.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f382ffff640 1 -- 172.21.15.70:0/603012933 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300a5e60 con 0x7f38380ce7c0 2023-11-26T07:23:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383f6d6640 1 -- 172.21.15.70:0/603012933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 msgr2=0x7f383815f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383f6d6640 1 --2- 172.21.15.70:0/603012933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383815f6b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f3830009d90 tx=0x7f383001c890 comp rx=0 tx=0).stop 2023-11-26T07:23:47.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383f6d6640 1 -- 172.21.15.70:0/603012933 shutdown_connections 2023-11-26T07:23:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383f6d6640 1 --2- 172.21.15.70:0/603012933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383815f6b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383f6d6640 1 -- 172.21.15.70:0/603012933 >> 172.21.15.70:0/603012933 conn(0x7f383806a890 msgr2=0x7f383806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383f6d6640 1 -- 172.21.15.70:0/603012933 shutdown_connections 2023-11-26T07:23:47.204 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.203+0000 7f383f6d6640 1 -- 172.21.15.70:0/603012933 wait complete. 2023-11-26T07:23:47.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 Processor -- start 2023-11-26T07:23:47.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 -- start start 2023-11-26T07:23:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383814f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38380cf990 0x7f3838071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f383813e290 0x7f3838071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38380b1ee0 con 0x7f38380ce7c0 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3838138310 con 0x7f38380cf990 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3838138b70 con 0x7f383813e290 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383814f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383814f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55446/0 (socket says 172.21.15.70:55446) 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 -- 172.21.15.70:0/4233084905 learned_addr learned my addr 172.21.15.70:0/4233084905 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383dc73640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f383813e290 0x7f3838071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383cc71640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38380cf990 0x7f3838071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 -- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f383813e290 msgr2=0x7f3838071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f383813e290 0x7f3838071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 -- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38380cf990 msgr2=0x7f3838071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38380cf990 0x7f3838071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 -- 172.21.15.70:0/4233084905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830009a70 con 0x7f38380ce7c0 2023-11-26T07:23:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383d472640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383814f5b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f383400c400 tx=0x7f383400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f382dffb640 1 -- 172.21.15.70:0/4233084905 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834005cf0 con 0x7f38380ce7c0 2023-11-26T07:23:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f382dffb640 1 -- 172.21.15.70:0/4233084905 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834005e50 con 0x7f38380ce7c0 2023-11-26T07:23:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38381385b0 con 0x7f38380ce7c0 2023-11-26T07:23:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f382dffb640 1 -- 172.21.15.70:0/4233084905 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340072d0 con 0x7f38380ce7c0 2023-11-26T07:23:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.207+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383813a370 con 0x7f38380ce7c0 2023-11-26T07:23:47.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.211+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3838067680 con 0x7f38380ce7c0 2023-11-26T07:23:47.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.211+0000 7f382dffb640 1 -- 172.21.15.70:0/4233084905 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) v1 ==== 86668+0+0 (secure 0 0 0) 0x7f3834007430 con 0x7f38380ce7c0 2023-11-26T07:23:47.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.211+0000 7f382dffb640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f381c066d70 0x7f381c069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.211+0000 7f382dffb640 1 -- 172.21.15.70:0/4233084905 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3834081bf0 con 0x7f38380ce7c0 2023-11-26T07:23:47.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.211+0000 7f383cc71640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f381c066d70 0x7f381c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.211+0000 7f383cc71640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f381c066d70 0x7f381c069230 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f38380b1140 tx=0x7f3828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.215+0000 7f382dffb640 1 -- 172.21.15.70:0/4233084905 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3834050b70 con 0x7f38380ce7c0 2023-11-26T07:23:47.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.395+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol84210", "snap_name": "subvol_snap78150", "target_sub_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7f383806ae80 con 0x7f381c066d70 2023-11-26T07:23:47.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.451+0000 7f382dffb640 1 -- 172.21.15.70:0/4233084905 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f383806ae80 con 0x7f381c066d70 2023-11-26T07:23:47.453 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f381c066d70 msgr2=0x7f381c069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f381c066d70 0x7f381c069230 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f38380b1140 tx=0x7f3828009040 comp rx=0 tx=0).stop 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 msgr2=0x7f383814f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383814f5b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f383400c400 tx=0x7f383400c8c0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 shutdown_connections 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f383813e290 0x7f3838071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38380cf990 0x7f3838071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f381c066d70 0x7f381c069230 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 --2- 172.21.15.70:0/4233084905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38380ce7c0 0x7f383814f5b0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 >> 172.21.15.70:0/4233084905 conn(0x7f383806a890 msgr2=0x7f383813b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 shutdown_connections 2023-11-26T07:23:47.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.455+0000 7f383f6d6640 1 -- 172.21.15.70:0/4233084905 wait complete. 2023-11-26T07:23:47.455 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.455+0000 7ff295119640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.455 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.455+0000 7ff295119640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.455 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.455+0000 7ff295119640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.456 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.455+0000 7ff295119640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.456 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.455+0000 7ff295119640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.471 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.471+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.471 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.471+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.471 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.471+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.471 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.471+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.471 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:47.471+0000 7ff29591a640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-26T07:23:47.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88ff965640 1 Processor -- start 2023-11-26T07:23:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88ff965640 1 -- start start 2023-11-26T07:23:47.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88ff965640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88f80cf280 0x7f88f80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88ff965640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cd1b0 0x7f88f80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88ff965640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80cc730 con 0x7f88f8143ac0 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88ff965640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f8143ea0 con 0x7f88f80cf280 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88ff965640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80cfc50 con 0x7f88f80cd1b0 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88fd701640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f88f8143ac0 0x7f88f8070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:32924/0 (socket says 172.21.15.70:32924) 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.619+0000 7f88fd701640 1 -- 172.21.15.70:0/784569183 learned_addr learned my addr 172.21.15.70:0/784569183 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88fcf00640 1 --2- 172.21.15.70:0/784569183 >> v2:172.21.15.120:3300/0 conn(0x7f88f80cf280 0x7f88f80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88fdf02640 1 --2- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cd1b0 0x7f88f80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88effff640 1 -- 172.21.15.70:0/784569183 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577810494 0 0) 0x7f88f80cc730 con 0x7f88f8143ac0 2023-11-26T07:23:47.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88effff640 1 -- 172.21.15.70:0/784569183 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e4003530 con 0x7f88f8143ac0 2023-11-26T07:23:47.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88fcf00640 1 -- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cd1b0 msgr2=0x7f88f80cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:47.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88fcf00640 1 --2- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cd1b0 0x7f88f80cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88fcf00640 1 -- 172.21.15.70:0/784569183 >> v1:172.21.15.70:6789/0 conn(0x7f88f8143ac0 legacy=0x7f88f8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88fcf00640 1 -- 172.21.15.70:0/784569183 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8070ee0 con 0x7f88f80cf280 2023-11-26T07:23:47.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88fcf00640 1 --2- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f80cf280 0x7f88f80cf710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f88e80097c0 tx=0x7f88e801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52c5af2d15ca0582 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88effff640 1 -- 172.21.15.70:0/784569183 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e80ab680 con 0x7f88f80cf280 2023-11-26T07:23:47.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88effff640 1 -- 172.21.15.70:0/784569183 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e80ab7e0 con 0x7f88f80cf280 2023-11-26T07:23:47.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.623+0000 7f88effff640 1 -- 172.21.15.70:0/784569183 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e80abb50 con 0x7f88f80cf280 2023-11-26T07:23:47.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f80cf280 msgr2=0x7f88f80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 --2- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f80cf280 0x7f88f80cf710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f88e80097c0 tx=0x7f88e801c480 comp rx=0 tx=0).stop 2023-11-26T07:23:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- 172.21.15.70:0/784569183 shutdown_connections 2023-11-26T07:23:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 --2- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cd1b0 0x7f88f80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 --2- 172.21.15.70:0/784569183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f80cf280 0x7f88f80cf710 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- 172.21.15.70:0/784569183 >> 172.21.15.70:0/784569183 conn(0x7f88f806a890 msgr2=0x7f88f806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- 172.21.15.70:0/784569183 shutdown_connections 2023-11-26T07:23:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- 172.21.15.70:0/784569183 wait complete. 2023-11-26T07:23:47.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 Processor -- start 2023-11-26T07:23:47.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- start start 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f80cd1b0 0x7f88f813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cf280 0x7f88f813efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f8143ac0 0x7f88f81f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f81578a0 con 0x7f88f80cd1b0 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80aed90 con 0x7f88f8143ac0 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88ff965640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8157000 con 0x7f88f80cf280 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88fd701640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f80cd1b0 0x7f88f813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88fd701640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f80cd1b0 0x7f88f813eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55488/0 (socket says 172.21.15.70:55488) 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88fd701640 1 -- 172.21.15.70:0/2085054485 learned_addr learned my addr 172.21.15.70:0/2085054485 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88fcf00640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cf280 0x7f88f813efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.627+0000 7f88fdf02640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f8143ac0 0x7f88f81f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88fd701640 1 -- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cf280 msgr2=0x7f88f813efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88fd701640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cf280 0x7f88f813efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88fd701640 1 -- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f8143ac0 msgr2=0x7f88f81f98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88fd701640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f8143ac0 0x7f88f81f98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88fd701640 1 -- 172.21.15.70:0/2085054485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009420 con 0x7f88f80cd1b0 2023-11-26T07:23:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88fd701640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f80cd1b0 0x7f88f813eaa0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f88f40010f0 tx=0x7f88f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88edffb640 1 -- 172.21.15.70:0/2085054485 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4005cf0 con 0x7f88f80cd1b0 2023-11-26T07:23:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88edffb640 1 -- 172.21.15.70:0/2085054485 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4005e70 con 0x7f88f80cd1b0 2023-11-26T07:23:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88edffb640 1 -- 172.21.15.70:0/2085054485 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40072d0 con 0x7f88f80cd1b0 2023-11-26T07:23:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f81572e0 con 0x7f88f80cd1b0 2023-11-26T07:23:47.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f8157c50 con 0x7f88f80cd1b0 2023-11-26T07:23:47.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f80aeb60 con 0x7f88f80cd1b0 2023-11-26T07:23:47.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88edffb640 1 -- 172.21.15.70:0/2085054485 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) v1 ==== 86668+0+0 (secure 0 0 0) 0x7f88f4007430 con 0x7f88f80cd1b0 2023-11-26T07:23:47.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88edffb640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88dc066d70 0x7f88dc069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.631+0000 7f88edffb640 1 -- 172.21.15.70:0/2085054485 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f88f40846c0 con 0x7f88f80cd1b0 2023-11-26T07:23:47.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.635+0000 7f88fcf00640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88dc066d70 0x7f88dc069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.635+0000 7f88fcf00640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88dc066d70 0x7f88dc069230 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f88e80af000 tx=0x7f88e80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.635+0000 7f88edffb640 1 -- 172.21.15.70:0/2085054485 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88f80aeb60 con 0x7f88f80cd1b0 2023-11-26T07:23:47.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.815+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7f88f80aeb60 con 0x7f88dc066d70 2023-11-26T07:23:47.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88edffb640 1 -- 172.21.15.70:0/2085054485 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f88f80aeb60 con 0x7f88dc066d70 2023-11-26T07:23:47.821 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:47.822 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88dc066d70 msgr2=0x7f88dc069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88dc066d70 0x7f88dc069230 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f88e80af000 tx=0x7f88e80a7000 comp rx=0 tx=0).stop 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f80cd1b0 msgr2=0x7f88f813eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f80cd1b0 0x7f88f813eaa0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f88f40010f0 tx=0x7f88f400c8f0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 shutdown_connections 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88f8143ac0 0x7f88f81f98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88f80cf280 0x7f88f813efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88dc066d70 0x7f88dc069230 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 --2- 172.21.15.70:0/2085054485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f80cd1b0 0x7f88f813eaa0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 >> 172.21.15.70:0/2085054485 conn(0x7f88f806a890 msgr2=0x7f88f806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 shutdown_connections 2023-11-26T07:23:47.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.823+0000 7f88ff965640 1 -- 172.21.15.70:0/2085054485 wait complete. 2023-11-26T07:23:47.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:47.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 Processor -- start 2023-11-26T07:23:47.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 -- start start 2023-11-26T07:23:47.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce380cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fce380cf7c0 0x7fce3815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.984 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fce3815f4e0 0x7fce381408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce380cfc40 con 0x7fce380cf7c0 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3806c520 con 0x7fce3815f4e0 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3c9df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3806c800 con 0x7fce3813e290 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce35d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fce380cf7c0 0x7fce3815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce35d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fce380cf7c0 0x7fce3815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55500/0 (socket says 172.21.15.70:55500) 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce35d9b640 1 -- 172.21.15.70:0/319067902 learned_addr learned my addr 172.21.15.70:0/319067902 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce3659c640 1 --2- 172.21.15.70:0/319067902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce380cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.983+0000 7fce36d9d640 1 --2- 172.21.15.70:0/319067902 >> v2:172.21.15.120:3300/0 conn(0x7fce3815f4e0 0x7fce381408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce35d9b640 1 -- 172.21.15.70:0/319067902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 msgr2=0x7fce380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce35d9b640 1 --2- 172.21.15.70:0/319067902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce380cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce35d9b640 1 -- 172.21.15.70:0/319067902 >> v2:172.21.15.120:3300/0 conn(0x7fce3815f4e0 msgr2=0x7fce381408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce35d9b640 1 --2- 172.21.15.70:0/319067902 >> v2:172.21.15.120:3300/0 conn(0x7fce3815f4e0 0x7fce381408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.986 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce35d9b640 1 -- 172.21.15.70:0/319067902 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3806cae0 con 0x7fce380cf7c0 2023-11-26T07:23:47.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce35d9b640 1 --2- 172.21.15.70:0/319067902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce3815efa0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fce38072660 tx=0x7fce2c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbc74f82856707e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce3559a640 1 -- 172.21.15.70:0/319067902 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0ab600 con 0x7fce380cf7c0 2023-11-26T07:23:47.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce3559a640 1 -- 172.21.15.70:0/319067902 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c0a7050 con 0x7fce380cf7c0 2023-11-26T07:23:47.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce3559a640 1 -- 172.21.15.70:0/319067902 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0ab980 con 0x7fce380cf7c0 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce3c9df640 1 -- 172.21.15.70:0/319067902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 msgr2=0x7fce3815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.987+0000 7fce3c9df640 1 --2- 172.21.15.70:0/319067902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce3815efa0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fce38072660 tx=0x7fce2c01c210 comp rx=0 tx=0).stop 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- 172.21.15.70:0/319067902 shutdown_connections 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 --2- 172.21.15.70:0/319067902 >> v2:172.21.15.120:3300/0 conn(0x7fce3815f4e0 0x7fce381408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 --2- 172.21.15.70:0/319067902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce3815efa0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 --2- 172.21.15.70:0/319067902 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce380cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- 172.21.15.70:0/319067902 >> 172.21.15.70:0/319067902 conn(0x7fce3806a890 msgr2=0x7fce3806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- 172.21.15.70:0/319067902 shutdown_connections 2023-11-26T07:23:47.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- 172.21.15.70:0/319067902 wait complete. 2023-11-26T07:23:47.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 Processor -- start 2023-11-26T07:23:47.991 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- start start 2023-11-26T07:23:47.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce380b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce3813f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce3815f4e0 0x7fce3813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3813fb20 con 0x7fce380cf7c0 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce380aece0 con 0x7fce3815f4e0 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3c9df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce380aefc0 con 0x7fce3813e290 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce380b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce380b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55510/0 (socket says 172.21.15.70:55510) 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 -- 172.21.15.70:0/198331686 learned_addr learned my addr 172.21.15.70:0/198331686 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce35d9b640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce3813f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce36d9d640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce3815f4e0 0x7fce3813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 -- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 msgr2=0x7fce3813f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce3813f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 -- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce3815f4e0 msgr2=0x7fce3813f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:47.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce3815f4e0 0x7fce3813f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:47.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce3659c640 1 -- 172.21.15.70:0/198331686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0094d0 con 0x7fce380cf7c0 2023-11-26T07:23:47.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce35d9b640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce3813f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:47.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.991+0000 7fce36d9d640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce3815f4e0 0x7fce3813f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:47.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce3659c640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce380b3710 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fce2800e8b0 tx=0x7fce2800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:47.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce26ffd640 1 -- 172.21.15.70:0/198331686 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800c940 con 0x7fce380cf7c0 2023-11-26T07:23:47.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce26ffd640 1 -- 172.21.15.70:0/198331686 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2800caa0 con 0x7fce380cf7c0 2023-11-26T07:23:47.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce26ffd640 1 -- 172.21.15.70:0/198331686 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2800ce30 con 0x7fce380cf7c0 2023-11-26T07:23:47.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce380af2a0 con 0x7fce380cf7c0 2023-11-26T07:23:47.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce380b3c50 con 0x7fce380cf7c0 2023-11-26T07:23:47.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce38067680 con 0x7fce380cf7c0 2023-11-26T07:23:47.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce26ffd640 1 -- 172.21.15.70:0/198331686 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) v1 ==== 86668+0+0 (secure 0 0 0) 0x7fce28013470 con 0x7fce380cf7c0 2023-11-26T07:23:47.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce26ffd640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fce18066d70 0x7fce18069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:47.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce26ffd640 1 -- 172.21.15.70:0/198331686 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fce28082af0 con 0x7fce380cf7c0 2023-11-26T07:23:47.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.995+0000 7fce35d9b640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fce18066d70 0x7fce18069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:47.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.999+0000 7fce35d9b640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fce18066d70 0x7fce18069230 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0ad000 tx=0x7fce2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:48.000 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:47.999+0000 7fce26ffd640 1 -- 172.21.15.70:0/198331686 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce280517d0 con 0x7fce380cf7c0 2023-11-26T07:23:48.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.183+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7fce3815fb00 con 0x7fce18066d70 2023-11-26T07:23:48.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce26ffd640 1 -- 172.21.15.70:0/198331686 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7fce2c0ab720 con 0x7fce18066d70 2023-11-26T07:23:48.189 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:48.189 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:48.189 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:23:48.189 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:48.189 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:48.189 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:48.190 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:48.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:48.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:48.190 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fce18066d70 msgr2=0x7fce18069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fce18066d70 0x7fce18069230 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0ad000 tx=0x7fce2c008040 comp rx=0 tx=0).stop 2023-11-26T07:23:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 msgr2=0x7fce380b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce380b3710 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fce2800e8b0 tx=0x7fce2800ed70 comp rx=0 tx=0).stop 2023-11-26T07:23:48.191 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 shutdown_connections 2023-11-26T07:23:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce3815f4e0 0x7fce3813f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fce3813e290 0x7fce3813f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fce18066d70 0x7fce18069230 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 --2- 172.21.15.70:0/198331686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce380cf7c0 0x7fce380b3710 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 >> 172.21.15.70:0/198331686 conn(0x7fce3806a890 msgr2=0x7fce38139d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 shutdown_connections 2023-11-26T07:23:48.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:48.191+0000 7fce3c9df640 1 -- 172.21.15.70:0/198331686 wait complete. 2023-11-26T07:23:49.212 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5420832640 1 Processor -- start 2023-11-26T07:23:49.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5420832640 1 -- start start 2023-11-26T07:23:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5420832640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c15d6e0 0x7f541c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5420832640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f541c0b2160 0x7f541c0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5420832640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0cf0e0 con 0x7f541c0d19f0 2023-11-26T07:23:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5420832640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c15dac0 con 0x7f541c0b2160 2023-11-26T07:23:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5420832640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0d1e80 con 0x7f541c15d6e0 2023-11-26T07:23:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541a59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c15d6e0 0x7f541c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f5411d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f541c0b2160 0x7f541c0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541a59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c15d6e0 0x7f541c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:39006/0 (socket says 172.21.15.70:39006) 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541a59c640 1 -- 172.21.15.70:0/2418873594 learned_addr learned my addr 172.21.15.70:0/2418873594 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541ad9d640 1 --1- 172.21.15.70:0/2418873594 >> v1:172.21.15.120:6789/0 conn(0x7f541c0d19f0 0x7f541c0cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:47784/0 (socket says 172.21.15.70:47784) 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541a59c640 1 -- 172.21.15.70:0/2418873594 >> v2:172.21.15.120:3300/0 conn(0x7f541c0b2160 msgr2=0x7f541c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541a59c640 1 --2- 172.21.15.70:0/2418873594 >> v2:172.21.15.120:3300/0 conn(0x7f541c0b2160 0x7f541c0d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541a59c640 1 -- 172.21.15.70:0/2418873594 >> v1:172.21.15.120:6789/0 conn(0x7f541c0d19f0 legacy=0x7f541c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.363+0000 7f541a59c640 1 -- 172.21.15.70:0/2418873594 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0ceb20 con 0x7f541c15d6e0 2023-11-26T07:23:49.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f541a59c640 1 --2- 172.21.15.70:0/2418873594 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c15d6e0 0x7f541c0d0df0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f540c009870 tx=0x7f540c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4735aae48bf7a331 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:49.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5419d9b640 1 -- 172.21.15.70:0/2418873594 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c0a7070 con 0x7f541c15d6e0 2023-11-26T07:23:49.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5419d9b640 1 -- 172.21.15.70:0/2418873594 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c0ab430 con 0x7f541c15d6e0 2023-11-26T07:23:49.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5419d9b640 1 -- 172.21.15.70:0/2418873594 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c0ab7c0 con 0x7f541c15d6e0 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 -- 172.21.15.70:0/2418873594 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c15d6e0 msgr2=0x7f541c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 --2- 172.21.15.70:0/2418873594 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c15d6e0 0x7f541c0d0df0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f540c009870 tx=0x7f540c01c540 comp rx=0 tx=0).stop 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 -- 172.21.15.70:0/2418873594 shutdown_connections 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 --2- 172.21.15.70:0/2418873594 >> v2:172.21.15.120:3300/0 conn(0x7f541c0b2160 0x7f541c0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 --2- 172.21.15.70:0/2418873594 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c15d6e0 0x7f541c0d0df0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 -- 172.21.15.70:0/2418873594 >> 172.21.15.70:0/2418873594 conn(0x7f541c09c550 msgr2=0x7f541c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 -- 172.21.15.70:0/2418873594 shutdown_connections 2023-11-26T07:23:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.367+0000 7f5420832640 1 -- 172.21.15.70:0/2418873594 wait complete. 2023-11-26T07:23:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 Processor -- start 2023-11-26T07:23:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 -- start start 2023-11-26T07:23:49.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c0b2160 0x7f541c14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f541c0d19f0 0x7f541c1600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f541c15d6e0 0x7f541c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c14cc10 con 0x7f541c0d19f0 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c160600 con 0x7f541c15d6e0 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5420832640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c150950 con 0x7f541c0b2160 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f541c0d19f0 0x7f541c1600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f541c0d19f0 0x7f541c1600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55518/0 (socket says 172.21.15.70:55518) 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 -- 172.21.15.70:0/2167558671 learned_addr learned my addr 172.21.15.70:0/2167558671 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f541a59c640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c0b2160 0x7f541c14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f541ad9d640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f541c15d6e0 0x7f541c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 -- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c0b2160 msgr2=0x7f541c14c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c0b2160 0x7f541c14c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 -- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f541c15d6e0 msgr2=0x7f541c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f541c15d6e0 0x7f541c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 -- 172.21.15.70:0/2167558671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0094d0 con 0x7f541c0d19f0 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f541a59c640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c0b2160 0x7f541c14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.371+0000 7f5411d9b640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f541c0d19f0 0x7f541c1600c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f540400efc0 tx=0x7f540400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f54137fe640 1 -- 172.21.15.70:0/2167558671 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404014480 con 0x7f541c0d19f0 2023-11-26T07:23:49.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f54137fe640 1 -- 172.21.15.70:0/2167558671 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400f040 con 0x7f541c0d19f0 2023-11-26T07:23:49.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f54137fe640 1 -- 172.21.15.70:0/2167558671 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404014800 con 0x7f541c0d19f0 2023-11-26T07:23:49.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c150c30 con 0x7f541c0d19f0 2023-11-26T07:23:49.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c1511f0 con 0x7f541c0d19f0 2023-11-26T07:23:49.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c066e50 con 0x7f541c0d19f0 2023-11-26T07:23:49.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f54137fe640 1 -- 172.21.15.70:0/2167558671 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f5404014960 con 0x7f541c0d19f0 2023-11-26T07:23:49.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f54137fe640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53fc066f20 0x7f53fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:49.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f54137fe640 1 -- 172.21.15.70:0/2167558671 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5404083410 con 0x7f541c0d19f0 2023-11-26T07:23:49.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f541a59c640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53fc066f20 0x7f53fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:49.376 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.375+0000 7f541a59c640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53fc066f20 0x7f53fc0693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f540c0af000 tx=0x7f540c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:49.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.379+0000 7f54137fe640 1 -- 172.21.15.70:0/2167558671 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54040521c0 con 0x7f541c0d19f0 2023-11-26T07:23:49.560 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.559+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7f541c0ce810 con 0x7f53fc066f20 2023-11-26T07:23:49.566 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f54137fe640 1 -- 172.21.15.70:0/2167558671 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f540c0bc0c0 con 0x7f53fc066f20 2023-11-26T07:23:49.566 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:49.566 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:49.567 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:49.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53fc066f20 msgr2=0x7f53fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.568 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53fc066f20 0x7f53fc0693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f540c0af000 tx=0x7f540c008040 comp rx=0 tx=0).stop 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f541c0d19f0 msgr2=0x7f541c1600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f541c0d19f0 0x7f541c1600c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f540400efc0 tx=0x7f540400c490 comp rx=0 tx=0).stop 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 shutdown_connections 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f53fc066f20 0x7f53fc0693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f541c0d19f0 0x7f541c1600c0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f541c15d6e0 0x7f541c0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 --2- 172.21.15.70:0/2167558671 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f541c0b2160 0x7f541c14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 >> 172.21.15.70:0/2167558671 conn(0x7f541c09c550 msgr2=0x7f541c156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 shutdown_connections 2023-11-26T07:23:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:49.567+0000 7f5420832640 1 -- 172.21.15.70:0/2167558671 wait complete. 2023-11-26T07:23:50.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:50.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642c72a640 1 Processor -- start 2023-11-26T07:23:50.733 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642c72a640 1 -- start start 2023-11-26T07:23:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642c72a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f64240cf280 0x7f64240cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642c72a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642415b2f0 con 0x7f6424070d10 2023-11-26T07:23:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642c72a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642406c5c0 con 0x7f642406cd50 2023-11-26T07:23:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642c72a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240cfba0 con 0x7f64240cf280 2023-11-26T07:23:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f6429cc5640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6424070d10 0x7f642415d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:32934/0 (socket says 172.21.15.70:32934) 2023-11-26T07:23:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f6429cc5640 1 -- 172.21.15.70:0/4253896911 learned_addr learned my addr 172.21.15.70:0/4253896911 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642a4c6640 1 --2- 172.21.15.70:0/4253896911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f64240cf280 0x7f64240cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f64294c4640 1 -- 172.21.15.70:0/4253896911 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868259623 0 0) 0x7f6414001120 con 0x7f6424070d10 2023-11-26T07:23:50.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f64294c4640 1 -- 172.21.15.70:0/4253896911 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6410003530 con 0x7f6424070d10 2023-11-26T07:23:50.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f64294c4640 1 -- 172.21.15.70:0/4253896911 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839117325 0 0) 0x7f642406c5c0 con 0x7f642406cd50 2023-11-26T07:23:50.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642a4c6640 1 -- 172.21.15.70:0/4253896911 >> v1:172.21.15.120:6789/0 conn(0x7f642406cd50 legacy=0x7f64240b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642a4c6640 1 -- 172.21.15.70:0/4253896911 >> v1:172.21.15.70:6789/0 conn(0x7f6424070d10 legacy=0x7f642415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.735+0000 7f642a4c6640 1 -- 172.21.15.70:0/4253896911 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642415e1a0 con 0x7f64240cf280 2023-11-26T07:23:50.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642a4c6640 1 --2- 172.21.15.70:0/4253896911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f64240cf280 0x7f64240cf660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f64200097f0 tx=0x7f642001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ebe9051a72a65f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:50.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f64294c4640 1 -- 172.21.15.70:0/4253896911 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200a89b0 con 0x7f64240cf280 2023-11-26T07:23:50.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f64294c4640 1 -- 172.21.15.70:0/4253896911 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64200a8b10 con 0x7f64240cf280 2023-11-26T07:23:50.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f64294c4640 1 -- 172.21.15.70:0/4253896911 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64200a8e80 con 0x7f64240cf280 2023-11-26T07:23:50.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642c72a640 1 -- 172.21.15.70:0/4253896911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f64240cf280 msgr2=0x7f64240cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642c72a640 1 --2- 172.21.15.70:0/4253896911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f64240cf280 0x7f64240cf660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f64200097f0 tx=0x7f642001ecb0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642c72a640 1 -- 172.21.15.70:0/4253896911 shutdown_connections 2023-11-26T07:23:50.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642c72a640 1 --2- 172.21.15.70:0/4253896911 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f64240cf280 0x7f64240cf660 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642c72a640 1 -- 172.21.15.70:0/4253896911 >> 172.21.15.70:0/4253896911 conn(0x7f642406a890 msgr2=0x7f642406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:50.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642c72a640 1 -- 172.21.15.70:0/4253896911 shutdown_connections 2023-11-26T07:23:50.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.739+0000 7f642c72a640 1 -- 172.21.15.70:0/4253896911 wait complete. 2023-11-26T07:23:50.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 Processor -- start 2023-11-26T07:23:50.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 -- start start 2023-11-26T07:23:50.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f642406cd50 0x7f6424153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6424070d10 0x7f64240b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64240cf280 0x7f64240cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64241e35f0 con 0x7f6424070d10 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240b0cf0 con 0x7f64240cf280 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6424154340 con 0x7f642406cd50 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6424070d10 0x7f64240b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6424070d10 0x7f64240b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55520/0 (socket says 172.21.15.70:55520) 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 -- 172.21.15.70:0/1474315724 learned_addr learned my addr 172.21.15.70:0/1474315724 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642a4c6640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f642406cd50 0x7f6424153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 -- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f642406cd50 msgr2=0x7f6424153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642acc7640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64240cf280 0x7f64240cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f642406cd50 0x7f6424153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 -- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64240cf280 msgr2=0x7f64240cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64240cf280 0x7f64240cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 -- 172.21.15.70:0/1474315724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420009420 con 0x7f6424070d10 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642a4c6640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f642406cd50 0x7f6424153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642acc7640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64240cf280 0x7f64240cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f6429cc5640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6424070d10 0x7f64240b07b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f641400c700 tx=0x7f641400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f641affd640 1 -- 172.21.15.70:0/1474315724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414005ac0 con 0x7f6424070d10 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f641affd640 1 -- 172.21.15.70:0/1474315724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6414005c60 con 0x7f6424070d10 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f641affd640 1 -- 172.21.15.70:0/1474315724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414001d60 con 0x7f6424070d10 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6424154620 con 0x7f6424070d10 2023-11-26T07:23:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6424154be0 con 0x7f6424070d10 2023-11-26T07:23:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.743+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6424067680 con 0x7f6424070d10 2023-11-26T07:23:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.747+0000 7f641affd640 1 -- 172.21.15.70:0/1474315724 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f6414007070 con 0x7f6424070d10 2023-11-26T07:23:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.747+0000 7f641affd640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6408066f20 0x7f64080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.747+0000 7f641affd640 1 -- 172.21.15.70:0/1474315724 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6414081d30 con 0x7f6424070d10 2023-11-26T07:23:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.747+0000 7f642a4c6640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6408066f20 0x7f64080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.747+0000 7f642a4c6640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6408066f20 0x7f64080693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f64200b2000 tx=0x7f64200aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:50.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.751+0000 7f641affd640 1 -- 172.21.15.70:0/1474315724 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6414050a80 con 0x7f6424070d10 2023-11-26T07:23:50.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.931+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7f642415e760 con 0x7f6408066f20 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.939+0000 7f641affd640 1 -- 172.21.15.70:0/1474315724 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7f64200b04c0 con 0x7f6408066f20 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:50.940 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6408066f20 msgr2=0x7f64080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6408066f20 0x7f64080693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f64200b2000 tx=0x7f64200aa070 comp rx=0 tx=0).stop 2023-11-26T07:23:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6424070d10 msgr2=0x7f64240b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6424070d10 0x7f64240b07b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f641400c700 tx=0x7f641400cbc0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 shutdown_connections 2023-11-26T07:23:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6408066f20 0x7f64080693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6424070d10 0x7f64240b07b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64240cf280 0x7f64240cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 --2- 172.21.15.70:0/1474315724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f642406cd50 0x7f6424153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 >> 172.21.15.70:0/1474315724 conn(0x7f642406a890 msgr2=0x7f642406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 shutdown_connections 2023-11-26T07:23:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:50.943+0000 7f642c72a640 1 -- 172.21.15.70:0/1474315724 wait complete. 2023-11-26T07:23:51.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:52.111 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.111+0000 7ff345fa1640 1 Processor -- start 2023-11-26T07:23:52.112 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.111+0000 7ff345fa1640 1 -- start start 2023-11-26T07:23:52.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff345fa1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff3401596d0 0x7ff340071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:52.113 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff345fa1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff3400ce680 0x7ff3400b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff345fa1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff34015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff345fa1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3400b3240 con 0x7ff3400ce680 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff345fa1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3400cbe00 con 0x7ff3401596d0 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff345fa1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34006c750 con 0x7ff3400b2db0 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff3400ce680 0x7ff3400b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff3400ce680 0x7ff3400b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55530/0 (socket says 172.21.15.70:55530) 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 -- 172.21.15.70:0/573313224 learned_addr learned my addr 172.21.15.70:0/573313224 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff33ffff640 1 --2- 172.21.15.70:0/573313224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff34015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff33f7fe640 1 --2- 172.21.15.70:0/573313224 >> v2:172.21.15.120:3300/0 conn(0x7ff3401596d0 0x7ff340071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 -- 172.21.15.70:0/573313224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 msgr2=0x7ff34015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:52.114 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 --2- 172.21.15.70:0/573313224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff34015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 -- 172.21.15.70:0/573313224 >> v2:172.21.15.120:3300/0 conn(0x7ff3401596d0 msgr2=0x7ff340071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:52.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 --2- 172.21.15.70:0/573313224 >> v2:172.21.15.120:3300/0 conn(0x7ff3401596d0 0x7ff340071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 -- 172.21.15.70:0/573313224 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400b3550 con 0x7ff3400ce680 2023-11-26T07:23:52.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff33f7fe640 1 --2- 172.21.15.70:0/573313224 >> v2:172.21.15.120:3300/0 conn(0x7ff3401596d0 0x7ff340071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:52.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff33ffff640 1 --2- 172.21.15.70:0/573313224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff34015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:52.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff337fff640 1 --2- 172.21.15.70:0/573313224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3400ce680 0x7ff3400b2870 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff34006e4d0 tx=0x7ff32801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa75750c8112651 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:52.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.115+0000 7ff33effd640 1 -- 172.21.15.70:0/573313224 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3280ab600 con 0x7ff3400ce680 2023-11-26T07:23:52.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff33effd640 1 -- 172.21.15.70:0/573313224 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3280a7050 con 0x7ff3400ce680 2023-11-26T07:23:52.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff33effd640 1 -- 172.21.15.70:0/573313224 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3280ab980 con 0x7ff3400ce680 2023-11-26T07:23:52.117 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- 172.21.15.70:0/573313224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3400ce680 msgr2=0x7ff3400b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 --2- 172.21.15.70:0/573313224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3400ce680 0x7ff3400b2870 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff34006e4d0 tx=0x7ff32801c500 comp rx=0 tx=0).stop 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- 172.21.15.70:0/573313224 shutdown_connections 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 --2- 172.21.15.70:0/573313224 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff34015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 --2- 172.21.15.70:0/573313224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3400ce680 0x7ff3400b2870 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 --2- 172.21.15.70:0/573313224 >> v2:172.21.15.120:3300/0 conn(0x7ff3401596d0 0x7ff340071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- 172.21.15.70:0/573313224 >> 172.21.15.70:0/573313224 conn(0x7ff34006a890 msgr2=0x7ff34006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- 172.21.15.70:0/573313224 shutdown_connections 2023-11-26T07:23:52.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- 172.21.15.70:0/573313224 wait complete. 2023-11-26T07:23:52.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 Processor -- start 2023-11-26T07:23:52.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- start start 2023-11-26T07:23:52.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff3401429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:52.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3400ce680 0x7ff34014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:52.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3401596d0 0x7ff34015b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:52.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34014ebb0 con 0x7ff3401596d0 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340150770 con 0x7ff3400ce680 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff345fa1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34014e5f0 con 0x7ff3400b2db0 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff33ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3401596d0 0x7ff34015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff33ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3401596d0 0x7ff34015b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55546/0 (socket says 172.21.15.70:55546) 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff33ffff640 1 -- 172.21.15.70:0/2284069692 learned_addr learned my addr 172.21.15.70:0/2284069692 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff337fff640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3400ce680 0x7ff34014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.119+0000 7ff33f7fe640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff3401429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33ffff640 1 -- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 msgr2=0x7ff3401429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33ffff640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff3401429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33ffff640 1 -- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3400ce680 msgr2=0x7ff34014dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33ffff640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3400ce680 0x7ff34014dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33ffff640 1 -- 172.21.15.70:0/2284069692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280094d0 con 0x7ff3401596d0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33ffff640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3401596d0 0x7ff34015b430 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff33800cef0 tx=0x7ff33800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33cff9640 1 -- 172.21.15.70:0/2284069692 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800d840 con 0x7ff3401596d0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33cff9640 1 -- 172.21.15.70:0/2284069692 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800d9c0 con 0x7ff3401596d0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33cff9640 1 -- 172.21.15.70:0/2284069692 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800dd70 con 0x7ff3401596d0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34014e8d0 con 0x7ff3401596d0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34014e250 con 0x7ff3401596d0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3401508e0 con 0x7ff3401596d0 2023-11-26T07:23:52.123 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33cff9640 1 -- 172.21.15.70:0/2284069692 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7ff33801e3b0 con 0x7ff3401596d0 2023-11-26T07:23:52.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33cff9640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff320066f20 0x7ff3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:52.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33cff9640 1 -- 172.21.15.70:0/2284069692 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff338083200 con 0x7ff3401596d0 2023-11-26T07:23:52.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.123+0000 7ff33f7fe640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff320066f20 0x7ff3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:52.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.127+0000 7ff33f7fe640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff320066f20 0x7ff3200693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff330007330 tx=0x7ff330009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:52.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.127+0000 7ff33cff9640 1 -- 172.21.15.70:0/2284069692 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff338052240 con 0x7ff3401596d0 2023-11-26T07:23:52.310 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.311+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7ff340067680 con 0x7ff320066f20 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.315+0000 7ff33cff9640 1 -- 172.21.15.70:0/2284069692 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+165 (secure 0 0 0) 0x7ff340067680 con 0x7ff320066f20 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "pending", 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:52.317 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:52.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff320066f20 msgr2=0x7ff3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:52.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff320066f20 0x7ff3200693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff330007330 tx=0x7ff330009040 comp rx=0 tx=0).stop 2023-11-26T07:23:52.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3401596d0 msgr2=0x7ff34015b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:52.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3401596d0 0x7ff34015b430 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff33800cef0 tx=0x7ff33800a710 comp rx=0 tx=0).stop 2023-11-26T07:23:52.318 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 shutdown_connections 2023-11-26T07:23:52.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff320066f20 0x7ff3200693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3401596d0 0x7ff34015b430 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3400ce680 0x7ff34014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 --2- 172.21.15.70:0/2284069692 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff3400b2db0 0x7ff3401429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:52.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 >> 172.21.15.70:0/2284069692 conn(0x7ff34006a890 msgr2=0x7ff3400ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:52.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 shutdown_connections 2023-11-26T07:23:52.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:52.319+0000 7ff345fa1640 1 -- 172.21.15.70:0/2284069692 wait complete. 2023-11-26T07:23:53.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:53.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe54cfb5640 1 Processor -- start 2023-11-26T07:23:53.507 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe54cfb5640 1 -- start start 2023-11-26T07:23:53.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe54cfb5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe54815d680 0x7fe5480d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe54cfb5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480cdc40 con 0x7fe54815d2a0 2023-11-26T07:23:53.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe54cfb5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480ce7a0 con 0x7fe5480d1d90 2023-11-26T07:23:53.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe54cfb5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5480d1440 con 0x7fe54815d680 2023-11-26T07:23:53.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe5477fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe54815d2a0 0x7fe5480d1680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:32948/0 (socket says 172.21.15.70:32948) 2023-11-26T07:23:53.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe546ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe54815d680 0x7fe5480d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.507+0000 7fe5477fe640 1 -- 172.21.15.70:0/2367443149 learned_addr learned my addr 172.21.15.70:0/2367443149 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:53.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe5467fc640 1 -- 172.21.15.70:0/2367443149 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352543688 0 0) 0x7fe5480cdc40 con 0x7fe54815d2a0 2023-11-26T07:23:53.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe546ffd640 1 -- 172.21.15.70:0/2367443149 >> v1:172.21.15.120:6789/0 conn(0x7fe5480d1d90 legacy=0x7fe5480b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe546ffd640 1 -- 172.21.15.70:0/2367443149 >> v1:172.21.15.70:6789/0 conn(0x7fe54815d2a0 legacy=0x7fe5480d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.509 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe546ffd640 1 -- 172.21.15.70:0/2367443149 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480cde70 con 0x7fe54815d680 2023-11-26T07:23:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe546ffd640 1 --2- 172.21.15.70:0/2367443149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d680 0x7fe5480d00e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0097f0 tx=0x7fe53c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3e17aea612c9c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe5467fc640 1 -- 172.21.15.70:0/2367443149 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0ad660 con 0x7fe54815d680 2023-11-26T07:23:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe5467fc640 1 -- 172.21.15.70:0/2367443149 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c0ad7c0 con 0x7fe54815d680 2023-11-26T07:23:53.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.511+0000 7fe5467fc640 1 -- 172.21.15.70:0/2367443149 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0adb50 con 0x7fe54815d680 2023-11-26T07:23:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2367443149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d680 msgr2=0x7fe5480d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2367443149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d680 0x7fe5480d00e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0097f0 tx=0x7fe53c01c450 comp rx=0 tx=0).stop 2023-11-26T07:23:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2367443149 shutdown_connections 2023-11-26T07:23:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2367443149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d680 0x7fe5480d00e0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2367443149 >> 172.21.15.70:0/2367443149 conn(0x7fe5480d30a0 msgr2=0x7fe5480d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2367443149 shutdown_connections 2023-11-26T07:23:53.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2367443149 wait complete. 2023-11-26T07:23:53.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 Processor -- start 2023-11-26T07:23:53.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- start start 2023-11-26T07:23:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5480d1d90 0x7fe5480ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d2a0 0x7fe5481584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe54815d680 0x7fe548158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cb950 con 0x7fe54815d2a0 2023-11-26T07:23:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cbb80 con 0x7fe5480d1d90 2023-11-26T07:23:53.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe54cfb5640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cbe60 con 0x7fe54815d680 2023-11-26T07:23:53.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe546ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d2a0 0x7fe5481584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe546ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d2a0 0x7fe5481584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55564/0 (socket says 172.21.15.70:55564) 2023-11-26T07:23:53.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.515+0000 7fe546ffd640 1 -- 172.21.15.70:0/2339322235 learned_addr learned my addr 172.21.15.70:0/2339322235 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:53.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe547fff640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe54815d680 0x7fe548158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe546ffd640 1 -- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe54815d680 msgr2=0x7fe548158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe5477fe640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5480d1d90 0x7fe5480ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe546ffd640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe54815d680 0x7fe548158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe546ffd640 1 -- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5480d1d90 msgr2=0x7fe5480ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe546ffd640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5480d1d90 0x7fe5480ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe546ffd640 1 -- 172.21.15.70:0/2339322235 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009420 con 0x7fe54815d2a0 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe547fff640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe54815d680 0x7fe548158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe5477fe640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5480d1d90 0x7fe5480ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe546ffd640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d2a0 0x7fe5481584e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0b0040 tx=0x7fe53c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe52ffff640 1 -- 172.21.15.70:0/2339322235 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0b6610 con 0x7fe54815d2a0 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe52ffff640 1 -- 172.21.15.70:0/2339322235 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c0b6790 con 0x7fe54815d2a0 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe52ffff640 1 -- 172.21.15.70:0/2339322235 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0b6b40 con 0x7fe54815d2a0 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480cc140 con 0x7fe54815d2a0 2023-11-26T07:23:53.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480cc700 con 0x7fe54815d2a0 2023-11-26T07:23:53.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5480c6a70 con 0x7fe54815d2a0 2023-11-26T07:23:53.520 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.519+0000 7fe52ffff640 1 -- 172.21.15.70:0/2339322235 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fe53c0b4040 con 0x7fe54815d2a0 2023-11-26T07:23:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.523+0000 7fe52ffff640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe534066f50 0x7fe534069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.523+0000 7fe52ffff640 1 -- 172.21.15.70:0/2339322235 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe53c11cae0 con 0x7fe54815d2a0 2023-11-26T07:23:53.521 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.523+0000 7fe5477fe640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe534066f50 0x7fe534069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.523+0000 7fe5477fe640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe534066f50 0x7fe534069410 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe538000f70 tx=0x7fe538009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:53.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.527+0000 7fe52ffff640 1 -- 172.21.15.70:0/2339322235 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe53c0eb9b0 con 0x7fe54815d2a0 2023-11-26T07:23:53.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.743+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5480cbfd0 con 0x7fe534066f50 2023-11-26T07:23:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.751+0000 7fe52ffff640 1 -- 172.21.15.70:0/2339322235 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7fe5480cbfd0 con 0x7fe534066f50 2023-11-26T07:23:53.751 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:53.751 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "in-progress", 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:53.752 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe534066f50 msgr2=0x7fe534069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe534066f50 0x7fe534069410 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe538000f70 tx=0x7fe538009040 comp rx=0 tx=0).stop 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d2a0 msgr2=0x7fe5481584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d2a0 0x7fe5481584e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0b0040 tx=0x7fe53c0191f0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 shutdown_connections 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe534066f50 0x7fe534069410 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54815d2a0 0x7fe5481584e0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe54815d680 0x7fe548158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 --2- 172.21.15.70:0/2339322235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5480d1d90 0x7fe5480ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 >> 172.21.15.70:0/2339322235 conn(0x7fe5480d30a0 msgr2=0x7fe5480b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 shutdown_connections 2023-11-26T07:23:53.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.755+0000 7fe54cfb5640 1 -- 172.21.15.70:0/2339322235 wait complete. 2023-11-26T07:23:53.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:53.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa225e7640 1 Processor -- start 2023-11-26T07:23:53.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa225e7640 1 -- start start 2023-11-26T07:23:53.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa225e7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa225e7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c06c520 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa225e7640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c06c800 con 0x7ffa1c0cf7c0 2023-11-26T07:23:53.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa225e7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0cfc40 con 0x7ffa1c13e290 2023-11-26T07:23:53.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1bfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa20b84640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ffa1c15f6b0 0x7ffa1c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39768/0 (socket says 172.21.15.70:39768) 2023-11-26T07:23:53.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ffa1c0cf7c0 0x7ffa1c15efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:37294/0 (socket says 172.21.15.70:37294) 2023-11-26T07:23:53.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa20b84640 1 -- 172.21.15.70:0/1999858376 learned_addr learned my addr 172.21.15.70:0/1999858376 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:53.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1affd640 1 -- 172.21.15.70:0/1999858376 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432480038 0 0) 0x7ffa1c06c520 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.939 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1affd640 1 -- 172.21.15.70:0/1999858376 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04003530 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1affd640 1 -- 172.21.15.70:0/1999858376 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618579032 0 0) 0x7ffa1c06c800 con 0x7ffa1c0cf7c0 2023-11-26T07:23:53.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1bfff640 1 -- 172.21.15.70:0/1999858376 >> v1:172.21.15.120:6789/0 conn(0x7ffa1c0cf7c0 legacy=0x7ffa1c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1bfff640 1 -- 172.21.15.70:0/1999858376 >> v1:172.21.15.70:6789/0 conn(0x7ffa1c15f6b0 legacy=0x7ffa1c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.939+0000 7ffa1bfff640 1 -- 172.21.15.70:0/1999858376 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c06cae0 con 0x7ffa1c13e290 2023-11-26T07:23:53.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa1bfff640 1 --2- 172.21.15.70:0/1999858376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0cf280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0097f0 tx=0x7ffa0c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d27fca9c3db1b3c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:53.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa1affd640 1 -- 172.21.15.70:0/1999858376 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0ac410 con 0x7ffa1c13e290 2023-11-26T07:23:53.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa1affd640 1 -- 172.21.15.70:0/1999858376 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0ac570 con 0x7ffa1c13e290 2023-11-26T07:23:53.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa1affd640 1 -- 172.21.15.70:0/1999858376 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0ac900 con 0x7ffa1c13e290 2023-11-26T07:23:53.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa225e7640 1 -- 172.21.15.70:0/1999858376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 msgr2=0x7ffa1c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa225e7640 1 --2- 172.21.15.70:0/1999858376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0cf280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0097f0 tx=0x7ffa0c01c4c0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa225e7640 1 -- 172.21.15.70:0/1999858376 shutdown_connections 2023-11-26T07:23:53.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa225e7640 1 --2- 172.21.15.70:0/1999858376 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0cf280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa225e7640 1 -- 172.21.15.70:0/1999858376 >> 172.21.15.70:0/1999858376 conn(0x7ffa1c06a890 msgr2=0x7ffa1c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:53.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa225e7640 1 -- 172.21.15.70:0/1999858376 shutdown_connections 2023-11-26T07:23:53.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.943+0000 7ffa225e7640 1 -- 172.21.15.70:0/1999858376 wait complete. 2023-11-26T07:23:53.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 Processor -- start 2023-11-26T07:23:53.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 -- start start 2023-11-26T07:23:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa1c0cf7c0 0x7ffa1c138880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa1c15f6b0 0x7ffa1c138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0714e0 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c138dc0 con 0x7ffa1c0cf7c0 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa225e7640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0ac2b0 con 0x7ffa1c13e290 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa20b84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa1c15f6b0 0x7ffa1c138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa1b7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa1bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa1c0cf7c0 0x7ffa1c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa1bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa1c0cf7c0 0x7ffa1c138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:59618/0 (socket says 172.21.15.70:59618) 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa1b7fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:39356/0 (socket says 172.21.15.70:39356) 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa1bfff640 1 -- 172.21.15.70:0/590772625 learned_addr learned my addr 172.21.15.70:0/590772625 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa20b84640 1 -- 172.21.15.70:0/590772625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 msgr2=0x7ffa1c0abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa20b84640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa20b84640 1 -- 172.21.15.70:0/590772625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa1c0cf7c0 msgr2=0x7ffa1c138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa20b84640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa1c0cf7c0 0x7ffa1c138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:53.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.947+0000 7ffa20b84640 1 -- 172.21.15.70:0/590772625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009420 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa20b84640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa1c15f6b0 0x7ffa1c138fb0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400cad0 tx=0x7ffa1400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:53.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa18ff9640 1 -- 172.21.15.70:0/590772625 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400ab70 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa18ff9640 1 -- 172.21.15.70:0/590772625 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1400acd0 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c071a10 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa18ff9640 1 -- 172.21.15.70:0/590772625 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14012600 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c0a9a70 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c067680 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa18ff9640 1 -- 172.21.15.70:0/590772625 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7ffa14007070 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.951+0000 7ffa18ff9640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ffa08066f50 0x7ffa08069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.955+0000 7ffa18ff9640 1 -- 172.21.15.70:0/590772625 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffa140826f0 con 0x7ffa1c15f6b0 2023-11-26T07:23:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.955+0000 7ffa1bfff640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ffa08066f50 0x7ffa08069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:53.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.955+0000 7ffa1bfff640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ffa08066f50 0x7ffa08069410 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000c10 tx=0x7ffa0c0a6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:53.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:53.959+0000 7ffa18ff9640 1 -- 172.21.15.70:0/590772625 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa140514a0 con 0x7ffa1c15f6b0 2023-11-26T07:23:54.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.183+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa1c169020 con 0x7ffa08066f50 2023-11-26T07:23:54.189 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa18ff9640 1 -- 172.21.15.70:0/590772625 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7ffa0c004240 con 0x7ffa08066f50 2023-11-26T07:23:54.189 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "in-progress", 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:54.190 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ffa08066f50 msgr2=0x7ffa08069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ffa08066f50 0x7ffa08069410 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000c10 tx=0x7ffa0c0a6040 comp rx=0 tx=0).stop 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa1c15f6b0 msgr2=0x7ffa1c138fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa1c15f6b0 0x7ffa1c138fb0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400cad0 tx=0x7ffa1400ced0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 shutdown_connections 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ffa08066f50 0x7ffa08069410 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa1c15f6b0 0x7ffa1c138fb0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ffa1c13e290 0x7ffa1c0abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 --2- 172.21.15.70:0/590772625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa1c0cf7c0 0x7ffa1c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 >> 172.21.15.70:0/590772625 conn(0x7ffa1c06a890 msgr2=0x7ffa1c13d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:54.192 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 shutdown_connections 2023-11-26T07:23:54.193 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.191+0000 7ffa225e7640 1 -- 172.21.15.70:0/590772625 wait complete. 2023-11-26T07:23:54.212 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:54.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa97972640 1 Processor -- start 2023-11-26T07:23:54.378 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa97972640 1 -- start start 2023-11-26T07:23:54.379 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa97972640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faa90146500 0x7faa900ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa97972640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faa90161770 0x7faa900cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa97972640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa900b3a90 con 0x7faa901468e0 2023-11-26T07:23:54.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa97972640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa90147060 con 0x7faa90161770 2023-11-26T07:23:54.380 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa97972640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa900b3460 con 0x7faa90146500 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa94f0d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7faa901468e0 0x7faa90161060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39770/0 (socket says 172.21.15.70:39770) 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa94f0d640 1 -- 172.21.15.70:0/3812885555 learned_addr learned my addr 172.21.15.70:0/3812885555 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa95f0f640 1 --2- 172.21.15.70:0/3812885555 >> v2:172.21.15.70:3300/0 conn(0x7faa90161770 0x7faa900cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.379+0000 7faa9570e640 1 --2- 172.21.15.70:0/3812885555 >> v2:172.21.15.120:3300/0 conn(0x7faa90146500 0x7faa900ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.383+0000 7faa95f0f640 1 -- 172.21.15.70:0/3812885555 >> v2:172.21.15.120:3300/0 conn(0x7faa90146500 msgr2=0x7faa900ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.383+0000 7faa95f0f640 1 --2- 172.21.15.70:0/3812885555 >> v2:172.21.15.120:3300/0 conn(0x7faa90146500 0x7faa900ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.383+0000 7faa95f0f640 1 -- 172.21.15.70:0/3812885555 >> v1:172.21.15.70:6789/0 conn(0x7faa901468e0 legacy=0x7faa90161060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.383+0000 7faa95f0f640 1 -- 172.21.15.70:0/3812885555 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa900c5fd0 con 0x7faa90161770 2023-11-26T07:23:54.381 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.383+0000 7faa87fff640 1 -- 172.21.15.70:0/3812885555 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042491690 0 0) 0x7faa900b3a90 con 0x7faa901468e0 2023-11-26T07:23:54.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.383+0000 7faa95f0f640 1 --2- 172.21.15.70:0/3812885555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90161770 0x7faa900cf110 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7faa900b2da0 tx=0x7faa8801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71a86ec40b972ff server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:54.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa87fff640 1 -- 172.21.15.70:0/3812885555 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa880a59a0 con 0x7faa90161770 2023-11-26T07:23:54.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa87fff640 1 -- 172.21.15.70:0/3812885555 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa880a5b00 con 0x7faa90161770 2023-11-26T07:23:54.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa87fff640 1 -- 172.21.15.70:0/3812885555 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa880a5e90 con 0x7faa90161770 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 -- 172.21.15.70:0/3812885555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90161770 msgr2=0x7faa900cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 --2- 172.21.15.70:0/3812885555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90161770 0x7faa900cf110 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7faa900b2da0 tx=0x7faa8801c8e0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 -- 172.21.15.70:0/3812885555 shutdown_connections 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 --2- 172.21.15.70:0/3812885555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90161770 0x7faa900cf110 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 --2- 172.21.15.70:0/3812885555 >> v2:172.21.15.120:3300/0 conn(0x7faa90146500 0x7faa900ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 -- 172.21.15.70:0/3812885555 >> 172.21.15.70:0/3812885555 conn(0x7faa90066720 msgr2=0x7faa9006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 -- 172.21.15.70:0/3812885555 shutdown_connections 2023-11-26T07:23:54.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 -- 172.21.15.70:0/3812885555 wait complete. 2023-11-26T07:23:54.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 Processor -- start 2023-11-26T07:23:54.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.387+0000 7faa97972640 1 -- start start 2023-11-26T07:23:54.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90146500 0x7faa900b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa901468e0 0x7faa901404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa90161770 0x7faa9015c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9015b420 con 0x7faa90146500 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa901409e0 con 0x7faa90161770 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa900b5400 con 0x7faa901468e0 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90146500 0x7faa900b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90146500 0x7faa900b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41714/0 (socket says 172.21.15.70:41714) 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 -- 172.21.15.70:0/2553095922 learned_addr learned my addr 172.21.15.70:0/2553095922 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa95f0f640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa90161770 0x7faa9015c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa94f0d640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa901468e0 0x7faa901404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 -- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa901468e0 msgr2=0x7faa901404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa901468e0 0x7faa901404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 -- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa90161770 msgr2=0x7faa9015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa90161770 0x7faa9015c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.391 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 -- 172.21.15.70:0/2553095922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88009a70 con 0x7faa90146500 2023-11-26T07:23:54.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa9570e640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90146500 0x7faa900b4d70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e930 tx=0x7faa8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:54.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa85ffb640 1 -- 172.21.15.70:0/2553095922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c009690 con 0x7faa90146500 2023-11-26T07:23:54.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa85ffb640 1 -- 172.21.15.70:0/2553095922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8c00ca00 con 0x7faa90146500 2023-11-26T07:23:54.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa85ffb640 1 -- 172.21.15.70:0/2553095922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00cd70 con 0x7faa90146500 2023-11-26T07:23:54.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9015b600 con 0x7faa90146500 2023-11-26T07:23:54.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9015bbc0 con 0x7faa90146500 2023-11-26T07:23:54.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.391+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9015bd80 con 0x7faa90146500 2023-11-26T07:23:54.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.395+0000 7faa85ffb640 1 -- 172.21.15.70:0/2553095922 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7faa8c013470 con 0x7faa90146500 2023-11-26T07:23:54.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.395+0000 7faa85ffb640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa74066f20 0x7faa740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:54.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.395+0000 7faa85ffb640 1 -- 172.21.15.70:0/2553095922 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faa8c0829a0 con 0x7faa90146500 2023-11-26T07:23:54.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.395+0000 7faa94f0d640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa74066f20 0x7faa740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.395+0000 7faa94f0d640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa74066f20 0x7faa740693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faa900b2c30 tx=0x7faa80007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.399+0000 7faa85ffb640 1 -- 172.21.15.70:0/2553095922 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa8c0519e0 con 0x7faa90146500 2023-11-26T07:23:54.610 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.611+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7faa900cfe60 con 0x7faa74066f20 2023-11-26T07:23:54.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.619+0000 7faa85ffb640 1 -- 172.21.15.70:0/2553095922 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7faa80007300 con 0x7faa74066f20 2023-11-26T07:23:54.619 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:54.619 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:54.619 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "in-progress", 2023-11-26T07:23:54.620 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:54.620 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:54.620 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:54.620 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:54.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:54.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:54.620 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:54.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa74066f20 msgr2=0x7faa740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa74066f20 0x7faa740693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faa900b2c30 tx=0x7faa80007d60 comp rx=0 tx=0).stop 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90146500 msgr2=0x7faa900b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90146500 0x7faa900b4d70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e930 tx=0x7faa8c00edf0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 shutdown_connections 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa90161770 0x7faa9015c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7faa901468e0 0x7faa901404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7faa74066f20 0x7faa740693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 --2- 172.21.15.70:0/2553095922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa90146500 0x7faa900b4d70 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 >> 172.21.15.70:0/2553095922 conn(0x7faa90066720 msgr2=0x7faa90073550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 shutdown_connections 2023-11-26T07:23:54.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:54.623+0000 7faa97972640 1 -- 172.21.15.70:0/2553095922 wait complete. 2023-11-26T07:23:55.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f40391a1640 1 Processor -- start 2023-11-26T07:23:55.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f40391a1640 1 -- start start 2023-11-26T07:23:55.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f40391a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f403415d6e0 0x7f40340d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f40391a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340b2160 0x7f40340d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f40391a1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340cf0e0 con 0x7f40340d19f0 2023-11-26T07:23:55.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f40391a1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403415dac0 con 0x7f403415d6e0 2023-11-26T07:23:55.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f40391a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40340d1e80 con 0x7f40340b2160 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f403359e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f40340d19f0 0x7f40340cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39782/0 (socket says 172.21.15.70:39782) 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f403359e640 1 -- 172.21.15.70:0/4140572330 learned_addr learned my addr 172.21.15.70:0/4140572330 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f4032d9d640 1 --2- 172.21.15.70:0/4140572330 >> v2:172.21.15.120:3300/0 conn(0x7f403415d6e0 0x7f40340d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.819+0000 7f403259c640 1 --2- 172.21.15.70:0/4140572330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340b2160 0x7f40340d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.823+0000 7f403259c640 1 -- 172.21.15.70:0/4140572330 >> v2:172.21.15.120:3300/0 conn(0x7f403415d6e0 msgr2=0x7f40340d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.823+0000 7f403259c640 1 --2- 172.21.15.70:0/4140572330 >> v2:172.21.15.120:3300/0 conn(0x7f403415d6e0 0x7f40340d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.823+0000 7f403259c640 1 -- 172.21.15.70:0/4140572330 >> v1:172.21.15.70:6789/0 conn(0x7f40340d19f0 legacy=0x7f40340cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.823+0000 7f403259c640 1 -- 172.21.15.70:0/4140572330 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340ceb20 con 0x7f40340b2160 2023-11-26T07:23:55.821 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.823+0000 7f4031d9b640 1 -- 172.21.15.70:0/4140572330 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131974896 0 0) 0x7f40340cf0e0 con 0x7f40340d19f0 2023-11-26T07:23:55.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.823+0000 7f403259c640 1 --2- 172.21.15.70:0/4140572330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340b2160 0x7f40340d14b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40280097c0 tx=0x7f402801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd6d5580f465558 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:55.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f4031d9b640 1 -- 172.21.15.70:0/4140572330 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280ab600 con 0x7f40340b2160 2023-11-26T07:23:55.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f4031d9b640 1 -- 172.21.15.70:0/4140572330 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280a7050 con 0x7f40340b2160 2023-11-26T07:23:55.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f4031d9b640 1 -- 172.21.15.70:0/4140572330 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280ab980 con 0x7f40340b2160 2023-11-26T07:23:55.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 -- 172.21.15.70:0/4140572330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340b2160 msgr2=0x7f40340d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 --2- 172.21.15.70:0/4140572330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340b2160 0x7f40340d14b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40280097c0 tx=0x7f402801c480 comp rx=0 tx=0).stop 2023-11-26T07:23:55.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 -- 172.21.15.70:0/4140572330 shutdown_connections 2023-11-26T07:23:55.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 --2- 172.21.15.70:0/4140572330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340b2160 0x7f40340d14b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 --2- 172.21.15.70:0/4140572330 >> v2:172.21.15.120:3300/0 conn(0x7f403415d6e0 0x7f40340d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 -- 172.21.15.70:0/4140572330 >> 172.21.15.70:0/4140572330 conn(0x7f403409c550 msgr2=0x7f40340d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:55.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 -- 172.21.15.70:0/4140572330 shutdown_connections 2023-11-26T07:23:55.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 -- 172.21.15.70:0/4140572330 wait complete. 2023-11-26T07:23:55.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 Processor -- start 2023-11-26T07:23:55.828 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.827+0000 7f40391a1640 1 -- start start 2023-11-26T07:23:55.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40340b2160 0x7f4034156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340d19f0 0x7f40341571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f403415d6e0 0x7f40340b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.830 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40340b6770 con 0x7f403415d6e0 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40341576e0 con 0x7f40340b2160 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4034156be0 con 0x7f40340d19f0 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f403415d6e0 0x7f40340b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340d19f0 0x7f40341571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f403415d6e0 0x7f40340b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41720/0 (socket says 172.21.15.70:41720) 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f4032d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40340b2160 0x7f4034156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403359e640 1 -- 172.21.15.70:0/2464043383 learned_addr learned my addr 172.21.15.70:0/2464043383 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340d19f0 0x7f40341571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:39394/0 (socket says 172.21.15.70:39394) 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 -- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40340b2160 msgr2=0x7f4034156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.831 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40340b2160 0x7f4034156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 -- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f403415d6e0 msgr2=0x7f40340b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:55.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f403415d6e0 0x7f40340b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:55.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 -- 172.21.15.70:0/2464043383 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028009420 con 0x7f40340d19f0 2023-11-26T07:23:55.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f4032d9d640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40340b2160 0x7f4034156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:23:55.832 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f403259c640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340d19f0 0x7f40341571a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40280ab000 tx=0x7f4028019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:55.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f401b7fe640 1 -- 172.21.15.70:0/2464043383 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280b4840 con 0x7f40340d19f0 2023-11-26T07:23:55.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f401b7fe640 1 -- 172.21.15.70:0/2464043383 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280b49e0 con 0x7f40340d19f0 2023-11-26T07:23:55.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40340b5e40 con 0x7f40340d19f0 2023-11-26T07:23:55.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f401b7fe640 1 -- 172.21.15.70:0/2464043383 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280b4d90 con 0x7f40340d19f0 2023-11-26T07:23:55.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40340b6400 con 0x7f40340d19f0 2023-11-26T07:23:55.833 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.831+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4034067680 con 0x7f40340d19f0 2023-11-26T07:23:55.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.835+0000 7f401b7fe640 1 -- 172.21.15.70:0/2464043383 <== mon.2 v2:172.21.15.120:3301/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f40280b2040 con 0x7f40340d19f0 2023-11-26T07:23:55.834 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.835+0000 7f401b7fe640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4020066f20 0x7f40200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:55.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.835+0000 7f401b7fe640 1 -- 172.21.15.70:0/2464043383 <== mon.2 v2:172.21.15.120:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f402811c8d0 con 0x7f40340d19f0 2023-11-26T07:23:55.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.835+0000 7f4032d9d640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4020066f20 0x7f40200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:55.835 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.835+0000 7f4032d9d640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4020066f20 0x7f40200693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4024009eb0 tx=0x7f4024009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:55.840 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:55.839+0000 7f401b7fe640 1 -- 172.21.15.70:0/2464043383 <== mon.2 v2:172.21.15.120:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40280eb8b0 con 0x7f40340d19f0 2023-11-26T07:23:56.075 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.075+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7f40340ce810 con 0x7f4020066f20 2023-11-26T07:23:56.081 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f401b7fe640 1 -- 172.21.15.70:0/2464043383 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+169 (secure 0 0 0) 0x7f4024011dd0 con 0x7f4020066f20 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "in-progress", 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: "source": { 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: "volume": "cephfs", 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: "subvolume": "subvol84210", 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot": "subvol_snap78150" 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:56.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:56.083 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4020066f20 msgr2=0x7f40200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4020066f20 0x7f40200693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4024009eb0 tx=0x7f4024009190 comp rx=0 tx=0).stop 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340d19f0 msgr2=0x7f40341571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340d19f0 0x7f40341571a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40280ab000 tx=0x7f4028019220 comp rx=0 tx=0).stop 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 shutdown_connections 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4020066f20 0x7f40200693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f403415d6e0 0x7f40340b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40340d19f0 0x7f40341571a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 --2- 172.21.15.70:0/2464043383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40340b2160 0x7f4034156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 >> 172.21.15.70:0/2464043383 conn(0x7f403409c550 msgr2=0x7f40340cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:56.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 shutdown_connections 2023-11-26T07:23:56.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:56.083+0000 7f40391a1640 1 -- 172.21.15.70:0/2464043383 wait complete. 2023-11-26T07:23:57.106 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc590e4640 1 Processor -- start 2023-11-26T07:23:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc590e4640 1 -- start start 2023-11-26T07:23:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc590e4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc5415d6e0 0x7efc540d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc590e4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efc540d1bc0 0x7efc540b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc590e4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540cf0e0 con 0x7efc540b2160 2023-11-26T07:23:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc590e4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5415dac0 con 0x7efc5415d6e0 2023-11-26T07:23:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc590e4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540ceb20 con 0x7efc540d1bc0 2023-11-26T07:23:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc52d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc5415d6e0 0x7efc540d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc52d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc5415d6e0 0x7efc540d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41724/0 (socket says 172.21.15.70:41724) 2023-11-26T07:23:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc52d9d640 1 -- 172.21.15.70:0/1767242622 learned_addr learned my addr 172.21.15.70:0/1767242622 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc5359e640 1 --2- 172.21.15.70:0/1767242622 >> v2:172.21.15.120:3300/0 conn(0x7efc540d1bc0 0x7efc540b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc52d9d640 1 -- 172.21.15.70:0/1767242622 >> v2:172.21.15.120:3300/0 conn(0x7efc540d1bc0 msgr2=0x7efc540b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc52d9d640 1 --2- 172.21.15.70:0/1767242622 >> v2:172.21.15.120:3300/0 conn(0x7efc540d1bc0 0x7efc540b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc52d9d640 1 -- 172.21.15.70:0/1767242622 >> v1:172.21.15.120:6789/0 conn(0x7efc540b2160 legacy=0x7efc540d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.251+0000 7efc52d9d640 1 -- 172.21.15.70:0/1767242622 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540cee00 con 0x7efc5415d6e0 2023-11-26T07:23:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc52d9d640 1 --2- 172.21.15.70:0/1767242622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc540d0df0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7efc540b92d0 tx=0x7efc4401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7ee749030bf334 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc51d9b640 1 -- 172.21.15.70:0/1767242622 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440ac410 con 0x7efc5415d6e0 2023-11-26T07:23:57.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc51d9b640 1 -- 172.21.15.70:0/1767242622 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc440ac570 con 0x7efc5415d6e0 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc51d9b640 1 -- 172.21.15.70:0/1767242622 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc440ac900 con 0x7efc5415d6e0 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 -- 172.21.15.70:0/1767242622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 msgr2=0x7efc540d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 --2- 172.21.15.70:0/1767242622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc540d0df0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7efc540b92d0 tx=0x7efc4401c4c0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 -- 172.21.15.70:0/1767242622 shutdown_connections 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 --2- 172.21.15.70:0/1767242622 >> v2:172.21.15.120:3300/0 conn(0x7efc540d1bc0 0x7efc540b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 --2- 172.21.15.70:0/1767242622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc540d0df0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 -- 172.21.15.70:0/1767242622 >> 172.21.15.70:0/1767242622 conn(0x7efc5409c550 msgr2=0x7efc540d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 -- 172.21.15.70:0/1767242622 shutdown_connections 2023-11-26T07:23:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.255+0000 7efc590e4640 1 -- 172.21.15.70:0/1767242622 wait complete. 2023-11-26T07:23:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 Processor -- start 2023-11-26T07:23:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 -- start start 2023-11-26T07:23:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc540b2160 0x7efc54156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc540d1bc0 0x7efc540c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc5415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5415e9b0 con 0x7efc5415d6e0 2023-11-26T07:23:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5415dda0 con 0x7efc540b2160 2023-11-26T07:23:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5415e080 con 0x7efc540d1bc0 2023-11-26T07:23:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc5415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc5415b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41732/0 (socket says 172.21.15.70:41732) 2023-11-26T07:23:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 -- 172.21.15.70:0/3790466045 learned_addr learned my addr 172.21.15.70:0/3790466045 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5259c640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc540d1bc0 0x7efc540c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc52d9d640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc540b2160 0x7efc54156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 -- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc540d1bc0 msgr2=0x7efc540c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc540d1bc0 0x7efc540c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 -- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc540b2160 msgr2=0x7efc54156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc540b2160 0x7efc54156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 -- 172.21.15.70:0/3790466045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440094d0 con 0x7efc5415d6e0 2023-11-26T07:23:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc52d9d640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc540b2160 0x7efc54156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5259c640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc540d1bc0 0x7efc540c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc5359e640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc5415b760 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7efc4c007e30 tx=0x7efc4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc3b7fe640 1 -- 172.21.15.70:0/3790466045 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c014620 con 0x7efc5415d6e0 2023-11-26T07:23:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc3b7fe640 1 -- 172.21.15.70:0/3790466045 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00ee90 con 0x7efc5415d6e0 2023-11-26T07:23:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc3b7fe640 1 -- 172.21.15.70:0/3790466045 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0149c0 con 0x7efc5415d6e0 2023-11-26T07:23:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5415e360 con 0x7efc5415d6e0 2023-11-26T07:23:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc540c9c50 con 0x7efc5415d6e0 2023-11-26T07:23:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.259+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5415eb60 con 0x7efc5415d6e0 2023-11-26T07:23:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.263+0000 7efc3b7fe640 1 -- 172.21.15.70:0/3790466045 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7efc4c014b20 con 0x7efc5415d6e0 2023-11-26T07:23:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.263+0000 7efc3b7fe640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc40066f20 0x7efc400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.263+0000 7efc3b7fe640 1 -- 172.21.15.70:0/3790466045 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efc4c083170 con 0x7efc5415d6e0 2023-11-26T07:23:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.263+0000 7efc52d9d640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc40066f20 0x7efc400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.263+0000 7efc52d9d640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc40066f20 0x7efc400693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc440ae000 tx=0x7efc44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.267+0000 7efc3b7fe640 1 -- 172.21.15.70:0/3790466045 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc5415eb60 con 0x7efc5415d6e0 2023-11-26T07:23:57.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.443+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7efc54067680 con 0x7efc40066f20 2023-11-26T07:23:57.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc3b7fe640 1 -- 172.21.15.70:0/3790466045 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7efc54067680 con 0x7efc40066f20 2023-11-26T07:23:57.457 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:57.458 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "complete" 2023-11-26T07:23:57.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:57.459 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc40066f20 msgr2=0x7efc400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc40066f20 0x7efc400693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc440ae000 tx=0x7efc44008040 comp rx=0 tx=0).stop 2023-11-26T07:23:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 msgr2=0x7efc5415b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.460 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc5415b760 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7efc4c007e30 tx=0x7efc4c00e4b0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 shutdown_connections 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efc40066f20 0x7efc400693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5415d6e0 0x7efc5415b760 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efc540d1bc0 0x7efc540c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 --2- 172.21.15.70:0/3790466045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc540b2160 0x7efc54156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 >> 172.21.15.70:0/3790466045 conn(0x7efc5409c550 msgr2=0x7efc540b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 shutdown_connections 2023-11-26T07:23:57.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.459+0000 7efc590e4640 1 -- 172.21.15.70:0/3790466045 wait complete. 2023-11-26T07:23:57.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone62480 2023-11-26T07:23:57.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 Processor -- start 2023-11-26T07:23:57.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 -- start start 2023-11-26T07:23:57.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60413e290 0x7fb6040cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb6040cf7c0 0x7fb60415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb60415f4e0 0x7fb6041408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6040cfc40 con 0x7fb60415f4e0 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60406c520 con 0x7fb6040cf7c0 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.619+0000 7fb609832640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60406c800 con 0x7fb60413e290 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb60415f4e0 0x7fb6041408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb60415f4e0 0x7fb6041408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41742/0 (socket says 172.21.15.70:41742) 2023-11-26T07:23:57.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 -- 172.21.15.70:0/1031325072 learned_addr learned my addr 172.21.15.70:0/1031325072 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb602ffd640 1 --2- 172.21.15.70:0/1031325072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60413e290 0x7fb6040cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb5fbfff640 1 --2- 172.21.15.70:0/1031325072 >> v2:172.21.15.120:3300/0 conn(0x7fb6040cf7c0 0x7fb60415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 -- 172.21.15.70:0/1031325072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60413e290 msgr2=0x7fb6040cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 --2- 172.21.15.70:0/1031325072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60413e290 0x7fb6040cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 -- 172.21.15.70:0/1031325072 >> v2:172.21.15.120:3300/0 conn(0x7fb6040cf7c0 msgr2=0x7fb60415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 --2- 172.21.15.70:0/1031325072 >> v2:172.21.15.120:3300/0 conn(0x7fb6040cf7c0 0x7fb60415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 -- 172.21.15.70:0/1031325072 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60406cae0 con 0x7fb60415f4e0 2023-11-26T07:23:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6037fe640 1 --2- 172.21.15.70:0/1031325072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb60415f4e0 0x7fb6041408e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb6040b45c0 tx=0x7fb5fc01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785f68389deacd8c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6027fc640 1 -- 172.21.15.70:0/1031325072 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0a5560 con 0x7fb60415f4e0 2023-11-26T07:23:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6027fc640 1 -- 172.21.15.70:0/1031325072 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0a56c0 con 0x7fb60415f4e0 2023-11-26T07:23:57.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.623+0000 7fb6027fc640 1 -- 172.21.15.70:0/1031325072 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0a5a50 con 0x7fb60415f4e0 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- 172.21.15.70:0/1031325072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb60415f4e0 msgr2=0x7fb6041408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 --2- 172.21.15.70:0/1031325072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb60415f4e0 0x7fb6041408e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb6040b45c0 tx=0x7fb5fc01c6e0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- 172.21.15.70:0/1031325072 shutdown_connections 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 --2- 172.21.15.70:0/1031325072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb60415f4e0 0x7fb6041408e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 --2- 172.21.15.70:0/1031325072 >> v2:172.21.15.120:3300/0 conn(0x7fb6040cf7c0 0x7fb60415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 --2- 172.21.15.70:0/1031325072 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60413e290 0x7fb6040cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- 172.21.15.70:0/1031325072 >> 172.21.15.70:0/1031325072 conn(0x7fb60406a890 msgr2=0x7fb60406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:57.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- 172.21.15.70:0/1031325072 shutdown_connections 2023-11-26T07:23:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- 172.21.15.70:0/1031325072 wait complete. 2023-11-26T07:23:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 Processor -- start 2023-11-26T07:23:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- start start 2023-11-26T07:23:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6040cf7c0 0x7fb6041375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb60413e290 0x7fb60413fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60415f4e0 0x7fb60415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60415e7f0 con 0x7fb6040cf7c0 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60415cbe0 con 0x7fb60413e290 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb609832640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6041f5b60 con 0x7fb60415f4e0 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6040cf7c0 0x7fb6041375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6040cf7c0 0x7fb6041375c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41754/0 (socket says 172.21.15.70:41754) 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 -- 172.21.15.70:0/1059797468 learned_addr learned my addr 172.21.15.70:0/1059797468 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb6037fe640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60415f4e0 0x7fb60415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb5fbfff640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb60413e290 0x7fb60413fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 -- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60415f4e0 msgr2=0x7fb60415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60415f4e0 0x7fb60415c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 -- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb60413e290 msgr2=0x7fb60413fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb60413e290 0x7fb60413fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb602ffd640 1 -- 172.21.15.70:0/1059797468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc009b30 con 0x7fb6040cf7c0 2023-11-26T07:23:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.627+0000 7fb6037fe640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60415f4e0 0x7fb60415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb602ffd640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6040cf7c0 0x7fb6041375c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d800 tx=0x7fb5f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb600ff9640 1 -- 172.21.15.70:0/1059797468 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400b6c0 con 0x7fb6040cf7c0 2023-11-26T07:23:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb600ff9640 1 -- 172.21.15.70:0/1059797468 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400b820 con 0x7fb6040cf7c0 2023-11-26T07:23:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60415e4a0 con 0x7fb6040cf7c0 2023-11-26T07:23:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb600ff9640 1 -- 172.21.15.70:0/1059797468 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400bb90 con 0x7fb6040cf7c0 2023-11-26T07:23:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60415d090 con 0x7fb6040cf7c0 2023-11-26T07:23:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb604067680 con 0x7fb6040cf7c0 2023-11-26T07:23:57.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb600ff9640 1 -- 172.21.15.70:0/1059797468 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fb5f400bcf0 con 0x7fb6040cf7c0 2023-11-26T07:23:57.632 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb600ff9640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb5e4066f20 0x7fb5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb600ff9640 1 -- 172.21.15.70:0/1059797468 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb5f4082d90 con 0x7fb6040cf7c0 2023-11-26T07:23:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.631+0000 7fb5fbfff640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb5e4066f20 0x7fb5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.635+0000 7fb5fbfff640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb5e4066f20 0x7fb5e40693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb604140180 tx=0x7fb5ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.635+0000 7fb600ff9640 1 -- 172.21.15.70:0/1059797468 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5f4051c60 con 0x7fb6040cf7c0 2023-11-26T07:23:57.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.815+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone62480", "target": ["mon-mgr", ""]}) v1 -- 0x7fb60415cd50 con 0x7fb5e4066f20 2023-11-26T07:23:57.820 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.819+0000 7fb600ff9640 1 -- 172.21.15.70:0/1059797468 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7fb60415cd50 con 0x7fb5e4066f20 2023-11-26T07:23:57.821 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:23:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "status": { 2023-11-26T07:23:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "complete" 2023-11-26T07:23:57.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2023-11-26T07:23:57.821 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:23:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb5e4066f20 msgr2=0x7fb5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb5e4066f20 0x7fb5e40693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb604140180 tx=0x7fb5ec008040 comp rx=0 tx=0).stop 2023-11-26T07:23:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6040cf7c0 msgr2=0x7fb6041375c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6040cf7c0 0x7fb6041375c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d800 tx=0x7fb5f400dcc0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 shutdown_connections 2023-11-26T07:23:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fb60415f4e0 0x7fb60415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb60413e290 0x7fb60413fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fb5e4066f20 0x7fb5e40693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 --2- 172.21.15.70:0/1059797468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6040cf7c0 0x7fb6041375c0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 >> 172.21.15.70:0/1059797468 conn(0x7fb60406a890 msgr2=0x7fb6040ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 shutdown_connections 2023-11-26T07:23:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.823+0000 7fb609832640 1 -- 172.21.15.70:0/1059797468 wait complete. 2023-11-26T07:23:57.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol84210 subvol_snap78150 2023-11-26T07:23:57.987 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.987+0000 7f4f115c1640 1 Processor -- start 2023-11-26T07:23:57.988 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.987+0000 7f4f115c1640 1 -- start start 2023-11-26T07:23:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f115c1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4f0c06f000 0x7f4f0c06d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f115c1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4f0c06f3e0 0x7f4f0c06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f115c1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0cf260 con 0x7f4f0c099a70 2023-11-26T07:23:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f115c1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c06d570 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f115c1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c09a010 con 0x7f4f0c06f000 2023-11-26T07:23:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4f0c06f3e0 0x7f4f0c06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4f0c06f3e0 0x7f4f0c06b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41770/0 (socket says 172.21.15.70:41770) 2023-11-26T07:23:57.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 -- 172.21.15.70:0/1536050702 learned_addr learned my addr 172.21.15.70:0/1536050702 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:57.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f0affd640 1 --2- 172.21.15.70:0/1536050702 >> v2:172.21.15.120:3300/0 conn(0x7f4f0c06f000 0x7f4f0c06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 -- 172.21.15.70:0/1536050702 >> v2:172.21.15.120:3300/0 conn(0x7f4f0c06f000 msgr2=0x7f4f0c06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:57.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 --2- 172.21.15.70:0/1536050702 >> v2:172.21.15.120:3300/0 conn(0x7f4f0c06f000 0x7f4f0c06d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 -- 172.21.15.70:0/1536050702 >> v1:172.21.15.120:6789/0 conn(0x7f4f0c099a70 legacy=0x7f4f0c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.990 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 -- 172.21.15.70:0/1536050702 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c09a2f0 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.992 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.991+0000 7f4f027fc640 1 --2- 172.21.15.70:0/1536050702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 0x7f4f0c06b5a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c071b70 tx=0x7f4ef401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82affafbd44f90cb server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f0a7fc640 1 -- 172.21.15.70:0/1536050702 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40a89f0 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f0a7fc640 1 -- 172.21.15.70:0/1536050702 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef40a8b50 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f0a7fc640 1 -- 172.21.15.70:0/1536050702 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40b0440 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.993 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- 172.21.15.70:0/1536050702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 msgr2=0x7f4f0c06b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 --2- 172.21.15.70:0/1536050702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 0x7f4f0c06b5a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c071b70 tx=0x7f4ef401ecf0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- 172.21.15.70:0/1536050702 shutdown_connections 2023-11-26T07:23:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 --2- 172.21.15.70:0/1536050702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 0x7f4f0c06b5a0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 --2- 172.21.15.70:0/1536050702 >> v2:172.21.15.120:3300/0 conn(0x7f4f0c06f000 0x7f4f0c06d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- 172.21.15.70:0/1536050702 >> 172.21.15.70:0/1536050702 conn(0x7f4f0c0b2d10 msgr2=0x7f4f0c0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- 172.21.15.70:0/1536050702 shutdown_connections 2023-11-26T07:23:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- 172.21.15.70:0/1536050702 wait complete. 2023-11-26T07:23:57.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 Processor -- start 2023-11-26T07:23:57.995 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- start start 2023-11-26T07:23:57.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f0c06f000 0x7f4f0c14e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.996 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 0x7f4f0c0adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f0c099a70 0x7f4f0c150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14ea90 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14f810 con 0x7f4f0c06f000 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f115c1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0ae750 con 0x7f4f0c099a70 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.995+0000 7f4f027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 0x7f4f0c0adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f0affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f0c06f000 0x7f4f0c14e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 0x7f4f0c0adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41782/0 (socket says 172.21.15.70:41782) 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 -- 172.21.15.70:0/30370705 learned_addr learned my addr 172.21.15.70:0/30370705 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:57.997 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f0b7fe640 1 --2- 172.21.15.70:0/30370705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f0c099a70 0x7f4f0c150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 -- 172.21.15.70:0/30370705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f0c099a70 msgr2=0x7f4f0c150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 --2- 172.21.15.70:0/30370705 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f4f0c099a70 0x7f4f0c150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 -- 172.21.15.70:0/30370705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f0c06f000 msgr2=0x7f4f0c14e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 --2- 172.21.15.70:0/30370705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f0c06f000 0x7f4f0c14e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 -- 172.21.15.70:0/30370705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40094d0 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f027fc640 1 --2- 172.21.15.70:0/30370705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f0c06f3e0 0x7f4f0c0adf90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4ef401b900 tx=0x7f4ef401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f03fff640 1 -- 172.21.15.70:0/30370705 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40ba600 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f03fff640 1 -- 172.21.15.70:0/30370705 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef40ba760 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f115c1640 1 -- 172.21.15.70:0/30370705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c0ae4d0 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f03fff640 1 -- 172.21.15.70:0/30370705 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40bab10 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f115c1640 1 -- 172.21.15.70:0/30370705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c14f1c0 con 0x7f4f0c06f3e0 2023-11-26T07:23:57.999 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f115c1640 1 -- 172.21.15.70:0/30370705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c14f980 con 0x7f4f0c06f3e0 2023-11-26T07:23:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:57.999+0000 7f4f03fff640 1 -- 172.21.15.70:0/30370705 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f4ef40bac70 con 0x7f4f0c06f3e0 2023-11-26T07:23:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.003+0000 7f4f03fff640 1 --2- 172.21.15.70:0/30370705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4eec066f20 0x7f4eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.003+0000 7f4f03fff640 1 -- 172.21.15.70:0/30370705 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4ef4120ca0 con 0x7f4f0c06f3e0 2023-11-26T07:23:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.003+0000 7f4f0affd640 1 --2- 172.21.15.70:0/30370705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4eec066f20 0x7f4eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.003+0000 7f4f0affd640 1 --2- 172.21.15.70:0/30370705 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4eec066f20 0x7f4eec0693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009b60 tx=0x7f4efc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.007+0000 7f4f03fff640 1 -- 172.21.15.70:0/30370705 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ef40efc20 con 0x7f4f0c06f3e0 2023-11-26T07:23:58.188 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.187+0000 7f4f115c1640 1 -- 172.21.15.70:0/30370705 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol84210", "snap_name": "subvol_snap78150", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f0c0cf490 con 0x7f4eec066f20 2023-11-26T07:23:58.197 INFO:tasks.ceph.mgr.y.smithi070.stderr:2023-11-26T07:23:58.199+0000 7ff29010f640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'subvol_snap78150' has pending clones 2023-11-26T07:23:58.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.199+0000 7f4f03fff640 1 -- 172.21.15.70:0/30370705 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: -11 snapshot 'subvol_snap78150' has pending clones) v1 ==== 54+0+0 (secure 0 0 0) 0x7f4efc011ac0 con 0x7f4eec066f20 2023-11-26T07:23:58.198 INFO:teuthology.orchestra.run.smithi070.stderr:Error EAGAIN: snapshot 'subvol_snap78150' has pending clones 2023-11-26T07:23:58.206 DEBUG:teuthology.orchestra.run:got remote process result: 11 2023-11-26T07:23:58.206 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-26T07:23:58.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:23:58.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-26T07:23:58.387 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-26T07:23:58.388 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:23:58.388 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:23:58.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:23:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 Processor -- start 2023-11-26T07:23:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 -- start start 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40e4143ac0 0x7f40e4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40e40708b0 0x7f40e40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e4143ea0 con 0x7f40e4143ac0 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40cc730 con 0x7f40e40708b0 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40eb51d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40cfbd0 con 0x7f40e40cf7c0 2023-11-26T07:23:58.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40e4143ac0 0x7f40e4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40e4143ac0 0x7f40e4070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41786/0 (socket says 172.21.15.70:41786) 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 -- 172.21.15.70:0/1079350724 learned_addr learned my addr 172.21.15.70:0/1079350724 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e8ab8640 1 --2- 172.21.15.70:0/1079350724 >> v2:172.21.15.120:3300/0 conn(0x7f40e40708b0 0x7f40e40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e9aba640 1 --2- 172.21.15.70:0/1079350724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 -- 172.21.15.70:0/1079350724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 msgr2=0x7f40e40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 --2- 172.21.15.70:0/1079350724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 -- 172.21.15.70:0/1079350724 >> v2:172.21.15.120:3300/0 conn(0x7f40e40708b0 msgr2=0x7f40e40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 --2- 172.21.15.70:0/1079350724 >> v2:172.21.15.120:3300/0 conn(0x7f40e40708b0 0x7f40e40cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.583+0000 7f40e92b9640 1 -- 172.21.15.70:0/1079350724 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4070ee0 con 0x7f40e4143ac0 2023-11-26T07:23:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40e92b9640 1 --2- 172.21.15.70:0/1079350724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e4143ac0 0x7f40e4070370 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f40e40aeb10 tx=0x7f40e001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888bf411965bd92a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40dbfff640 1 -- 172.21.15.70:0/1079350724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00ab600 con 0x7f40e4143ac0 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40dbfff640 1 -- 172.21.15.70:0/1079350724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00a7050 con 0x7f40e4143ac0 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40dbfff640 1 -- 172.21.15.70:0/1079350724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00ab980 con 0x7f40e4143ac0 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 -- 172.21.15.70:0/1079350724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e4143ac0 msgr2=0x7f40e4070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 --2- 172.21.15.70:0/1079350724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e4143ac0 0x7f40e4070370 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f40e40aeb10 tx=0x7f40e001c240 comp rx=0 tx=0).stop 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 -- 172.21.15.70:0/1079350724 shutdown_connections 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 --2- 172.21.15.70:0/1079350724 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 --2- 172.21.15.70:0/1079350724 >> v2:172.21.15.120:3300/0 conn(0x7f40e40708b0 0x7f40e40cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 --2- 172.21.15.70:0/1079350724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e4143ac0 0x7f40e4070370 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 -- 172.21.15.70:0/1079350724 >> 172.21.15.70:0/1079350724 conn(0x7f40e406a890 msgr2=0x7f40e406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 -- 172.21.15.70:0/1079350724 shutdown_connections 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.587+0000 7f40eb51d640 1 -- 172.21.15.70:0/1079350724 wait complete. 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 Processor -- start 2023-11-26T07:23:58.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 -- start start 2023-11-26T07:23:58.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e40708b0 0x7f40e4159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e413e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4143ac0 0x7f40e406c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40b1400 con 0x7f40e40708b0 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e415a060 con 0x7f40e4143ac0 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e413ea50 con 0x7f40e40cf7c0 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e40708b0 0x7f40e4159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e40708b0 0x7f40e4159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41790/0 (socket says 172.21.15.70:41790) 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 -- 172.21.15.70:0/207516415 learned_addr learned my addr 172.21.15.70:0/207516415 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e8ab8640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e413e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e9aba640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4143ac0 0x7f40e406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 -- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 msgr2=0x7f40e413e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e413e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 -- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4143ac0 msgr2=0x7f40e406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4143ac0 0x7f40e406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 -- 172.21.15.70:0/207516415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094d0 con 0x7f40e40708b0 2023-11-26T07:23:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40e92b9640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e40708b0 0x7f40e4159b20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f40e00ae040 tx=0x7f40e0018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40d9ffb640 1 -- 172.21.15.70:0/207516415 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00b4640 con 0x7f40e40708b0 2023-11-26T07:23:58.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40d9ffb640 1 -- 172.21.15.70:0/207516415 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00b47c0 con 0x7f40e40708b0 2023-11-26T07:23:58.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40d9ffb640 1 -- 172.21.15.70:0/207516415 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00b4b70 con 0x7f40e40708b0 2023-11-26T07:23:58.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e413f3b0 con 0x7f40e40708b0 2023-11-26T07:23:58.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e413f970 con 0x7f40e40708b0 2023-11-26T07:23:58.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.591+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4067680 con 0x7f40e40708b0 2023-11-26T07:23:58.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.595+0000 7f40d9ffb640 1 -- 172.21.15.70:0/207516415 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f40e00b2070 con 0x7f40e40708b0 2023-11-26T07:23:58.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.595+0000 7f40d9ffb640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f40c8066f20 0x7f40c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.595+0000 7f40d9ffb640 1 -- 172.21.15.70:0/207516415 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f40e011c700 con 0x7f40e40708b0 2023-11-26T07:23:58.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.595+0000 7f40e8ab8640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f40c8066f20 0x7f40c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.595+0000 7f40e8ab8640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f40c8066f20 0x7f40c80693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f40e415d230 tx=0x7f40d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.599+0000 7f40d9ffb640 1 -- 172.21.15.70:0/207516415 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40e00eb570 con 0x7f40e40708b0 2023-11-26T07:23:58.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.747+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40e40aeb60 con 0x7f40e40708b0 2023-11-26T07:23:58.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.747+0000 7f40d9ffb640 1 -- 172.21.15.70:0/207516415 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16666 (secure 0 0 0) 0x7f40e00b0090 con 0x7f40e40708b0 2023-11-26T07:23:58.747 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:23:58.748 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":80,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:46.861938+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:23:58.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f40c8066f20 msgr2=0x7f40c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f40c8066f20 0x7f40c80693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f40e415d230 tx=0x7f40d4008040 comp rx=0 tx=0).stop 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e40708b0 msgr2=0x7f40e4159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e40708b0 0x7f40e4159b20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f40e00ae040 tx=0x7f40e0018fe0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 shutdown_connections 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4143ac0 0x7f40e406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f40e40cf7c0 0x7f40e413e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f40c8066f20 0x7f40c80693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 --2- 172.21.15.70:0/207516415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e40708b0 0x7f40e4159b20 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 >> 172.21.15.70:0/207516415 conn(0x7f40e406a890 msgr2=0x7f40e4133330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 shutdown_connections 2023-11-26T07:23:58.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.751+0000 7f40eb51d640 1 -- 172.21.15.70:0/207516415 wait complete. 2023-11-26T07:23:58.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:23:06.615543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:23:07.401685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:23:58.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:23:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd2ddf640 1 Processor -- start 2023-11-26T07:23:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd2ddf640 1 -- start start 2023-11-26T07:23:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd2ddf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3fcc1596d0 0x7f3fcc071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd2ddf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3fcc0ce680 0x7f3fcc0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd2ddf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc0b3200 con 0x7f3fcc0b2db0 2023-11-26T07:23:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd2ddf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc0cbe00 con 0x7f3fcc1596d0 2023-11-26T07:23:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd2ddf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fcc06c750 con 0x7f3fcc0ce680 2023-11-26T07:23:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd137c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3fcc0b2db0 0x7f3fcc15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39792/0 (socket says 172.21.15.70:39792) 2023-11-26T07:23:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd137c640 1 -- 172.21.15.70:0/4290445770 learned_addr learned my addr 172.21.15.70:0/4290445770 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd0b7b640 1 --2- 172.21.15.70:0/4290445770 >> v2:172.21.15.70:3300/0 conn(0x7f3fcc1596d0 0x7f3fcc071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fc3fff640 1 --2- 172.21.15.70:0/4290445770 >> v2:172.21.15.120:3300/0 conn(0x7f3fcc0ce680 0x7f3fcc0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd0b7b640 1 -- 172.21.15.70:0/4290445770 >> v2:172.21.15.120:3300/0 conn(0x7f3fcc0ce680 msgr2=0x7f3fcc0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd0b7b640 1 --2- 172.21.15.70:0/4290445770 >> v2:172.21.15.120:3300/0 conn(0x7f3fcc0ce680 0x7f3fcc0b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd0b7b640 1 -- 172.21.15.70:0/4290445770 >> v1:172.21.15.70:6789/0 conn(0x7f3fcc0b2db0 legacy=0x7f3fcc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fc37fe640 1 -- 172.21.15.70:0/4290445770 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319233939 0 0) 0x7f3fc40014a0 con 0x7f3fcc0b2db0 2023-11-26T07:23:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fd0b7b640 1 -- 172.21.15.70:0/4290445770 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0b3550 con 0x7f3fcc1596d0 2023-11-26T07:23:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.911+0000 7f3fc3fff640 1 --2- 172.21.15.70:0/4290445770 >> v2:172.21.15.120:3300/0 conn(0x7f3fcc0ce680 0x7f3fcc0b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:23:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd0b7b640 1 --2- 172.21.15.70:0/4290445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc1596d0 0x7f3fcc071850 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0cbf40 tx=0x7f3fc801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb08746a04074564 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fc37fe640 1 -- 172.21.15.70:0/4290445770 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80ab600 con 0x7f3fcc1596d0 2023-11-26T07:23:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fc37fe640 1 -- 172.21.15.70:0/4290445770 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc80a7050 con 0x7f3fcc1596d0 2023-11-26T07:23:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fc37fe640 1 -- 172.21.15.70:0/4290445770 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80ab980 con 0x7f3fcc1596d0 2023-11-26T07:23:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/4290445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc1596d0 msgr2=0x7f3fcc071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/4290445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc1596d0 0x7f3fcc071850 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0cbf40 tx=0x7f3fc801c440 comp rx=0 tx=0).stop 2023-11-26T07:23:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/4290445770 shutdown_connections 2023-11-26T07:23:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/4290445770 >> v2:172.21.15.120:3300/0 conn(0x7f3fcc0ce680 0x7f3fcc0b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/4290445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc1596d0 0x7f3fcc071850 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/4290445770 >> 172.21.15.70:0/4290445770 conn(0x7f3fcc06a890 msgr2=0x7f3fcc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/4290445770 shutdown_connections 2023-11-26T07:23:58.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.915+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/4290445770 wait complete. 2023-11-26T07:23:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 Processor -- start 2023-11-26T07:23:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 -- start start 2023-11-26T07:23:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fcc0b2db0 0x7f3fcc158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc0ce680 0x7f3fcc0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3fcc1596d0 0x7f3fcc0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc158c80 con 0x7f3fcc0ce680 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0b0850 con 0x7f3fcc0b2db0 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc13f3f0 con 0x7f3fcc1596d0 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc0ce680 0x7f3fcc0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc0ce680 0x7f3fcc0b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41806/0 (socket says 172.21.15.70:41806) 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 -- 172.21.15.70:0/2291553159 learned_addr learned my addr 172.21.15.70:0/2291553159 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd0b7b640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fcc0b2db0 0x7f3fcc158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd137c640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3fcc1596d0 0x7f3fcc0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 -- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3fcc1596d0 msgr2=0x7f3fcc0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3fcc1596d0 0x7f3fcc0ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 -- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fcc0b2db0 msgr2=0x7f3fcc158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fcc0b2db0 0x7f3fcc158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:58.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 -- 172.21.15.70:0/2291553159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8009420 con 0x7f3fcc0ce680 2023-11-26T07:23:58.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd137c640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3fcc1596d0 0x7f3fcc0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:58.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc3fff640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc0ce680 0x7f3fcc0b0310 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e840 tx=0x7f3fbc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc17fa640 1 -- 172.21.15.70:0/2291553159 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00c8d0 con 0x7f3fcc0ce680 2023-11-26T07:23:58.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc17fa640 1 -- 172.21.15.70:0/2291553159 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc00ca30 con 0x7f3fcc0ce680 2023-11-26T07:23:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fc17fa640 1 -- 172.21.15.70:0/2291553159 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00cde0 con 0x7f3fcc0ce680 2023-11-26T07:23:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0afa80 con 0x7f3fcc0ce680 2023-11-26T07:23:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.919+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc14e140 con 0x7f3fcc0ce680 2023-11-26T07:23:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.923+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc067680 con 0x7f3fcc0ce680 2023-11-26T07:23:58.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.923+0000 7f3fc17fa640 1 -- 172.21.15.70:0/2291553159 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f3fbc013410 con 0x7f3fcc0ce680 2023-11-26T07:23:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.923+0000 7f3fc17fa640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3fb8066f20 0x7f3fb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.923+0000 7f3fc17fa640 1 -- 172.21.15.70:0/2291553159 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3fbc082550 con 0x7f3fcc0ce680 2023-11-26T07:23:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.923+0000 7f3fd0b7b640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3fb8066f20 0x7f3fb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:58.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.923+0000 7f3fd0b7b640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3fb8066f20 0x7f3fb80693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80ad000 tx=0x7f3fc80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:58.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:58.927+0000 7f3fc17fa640 1 -- 172.21.15.70:0/2291553159 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fbc051480 con 0x7f3fcc0ce680 2023-11-26T07:23:59.079 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.079+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fcc0709f0 con 0x7f3fcc0ce680 2023-11-26T07:23:59.080 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.079+0000 7f3fc17fa640 1 -- 172.21.15.70:0/2291553159 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fbc054aa0 con 0x7f3fcc0ce680 2023-11-26T07:23:59.080 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:23:59.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3fb8066f20 msgr2=0x7f3fb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3fb8066f20 0x7f3fb80693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80ad000 tx=0x7f3fc80a6000 comp rx=0 tx=0).stop 2023-11-26T07:23:59.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc0ce680 msgr2=0x7f3fcc0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc0ce680 0x7f3fcc0b0310 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e840 tx=0x7f3fbc00ed00 comp rx=0 tx=0).stop 2023-11-26T07:23:59.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 shutdown_connections 2023-11-26T07:23:59.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3fb8066f20 0x7f3fb80693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fcc0ce680 0x7f3fcc0b0310 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3fcc1596d0 0x7f3fcc0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 --2- 172.21.15.70:0/2291553159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fcc0b2db0 0x7f3fcc158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 >> 172.21.15.70:0/2291553159 conn(0x7f3fcc06a890 msgr2=0x7f3fcc1522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:59.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 shutdown_connections 2023-11-26T07:23:59.083 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.083+0000 7f3fd2ddf640 1 -- 172.21.15.70:0/2291553159 wait complete. 2023-11-26T07:23:59.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:23:59.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23b491d640 1 Processor -- start 2023-11-26T07:23:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23b491d640 1 -- start start 2023-11-26T07:23:59.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23b491d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f23b00cf280 0x7f23b00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23b491d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f23b00cd1b0 0x7f23b00cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23b491d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b00cc730 con 0x7f23b0143ac0 2023-11-26T07:23:59.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23b491d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b0143ea0 con 0x7f23b00cd1b0 2023-11-26T07:23:59.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23b491d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00cfc50 con 0x7f23b00cf280 2023-11-26T07:23:59.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23ae59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f23b0143ac0 0x7f23b0070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39808/0 (socket says 172.21.15.70:39808) 2023-11-26T07:23:59.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23ae59c640 1 -- 172.21.15.70:0/3043245155 learned_addr learned my addr 172.21.15.70:0/3043245155 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:23:59.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.243+0000 7f23aed9d640 1 --2- 172.21.15.70:0/3043245155 >> v2:172.21.15.70:3300/0 conn(0x7f23b00cd1b0 0x7f23b00cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23add9b640 1 -- 172.21.15.70:0/3043245155 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643956539 0 0) 0x7f23b00cc730 con 0x7f23b0143ac0 2023-11-26T07:23:59.245 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23a5d9b640 1 --2- 172.21.15.70:0/3043245155 >> v2:172.21.15.120:3300/0 conn(0x7f23b00cf280 0x7f23b00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23add9b640 1 -- 172.21.15.70:0/3043245155 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f239c003530 con 0x7f23b0143ac0 2023-11-26T07:23:59.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23aed9d640 1 -- 172.21.15.70:0/3043245155 >> v2:172.21.15.120:3300/0 conn(0x7f23b00cf280 msgr2=0x7f23b00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:59.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23aed9d640 1 --2- 172.21.15.70:0/3043245155 >> v2:172.21.15.120:3300/0 conn(0x7f23b00cf280 0x7f23b00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23aed9d640 1 -- 172.21.15.70:0/3043245155 >> v1:172.21.15.70:6789/0 conn(0x7f23b0143ac0 legacy=0x7f23b0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23aed9d640 1 -- 172.21.15.70:0/3043245155 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0070ee0 con 0x7f23b00cd1b0 2023-11-26T07:23:59.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23a5d9b640 1 --2- 172.21.15.70:0/3043245155 >> v2:172.21.15.120:3300/0 conn(0x7f23b00cf280 0x7f23b00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:59.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23aed9d640 1 --2- 172.21.15.70:0/3043245155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cd1b0 0x7f23b00cd5c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f23b00aeb10 tx=0x7f23a801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaed67e78502de5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23add9b640 1 -- 172.21.15.70:0/3043245155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80ab660 con 0x7f23b00cd1b0 2023-11-26T07:23:59.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23add9b640 1 -- 172.21.15.70:0/3043245155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a80ab7c0 con 0x7f23b00cd1b0 2023-11-26T07:23:59.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23add9b640 1 -- 172.21.15.70:0/3043245155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80abb50 con 0x7f23b00cd1b0 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23b491d640 1 -- 172.21.15.70:0/3043245155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cd1b0 msgr2=0x7f23b00cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23b491d640 1 --2- 172.21.15.70:0/3043245155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cd1b0 0x7f23b00cd5c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f23b00aeb10 tx=0x7f23a801c460 comp rx=0 tx=0).stop 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23b491d640 1 -- 172.21.15.70:0/3043245155 shutdown_connections 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23b491d640 1 --2- 172.21.15.70:0/3043245155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cd1b0 0x7f23b00cd5c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23b491d640 1 --2- 172.21.15.70:0/3043245155 >> v2:172.21.15.120:3300/0 conn(0x7f23b00cf280 0x7f23b00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.247+0000 7f23b491d640 1 -- 172.21.15.70:0/3043245155 >> 172.21.15.70:0/3043245155 conn(0x7f23b006a890 msgr2=0x7f23b006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 -- 172.21.15.70:0/3043245155 shutdown_connections 2023-11-26T07:23:59.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 -- 172.21.15.70:0/3043245155 wait complete. 2023-11-26T07:23:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 Processor -- start 2023-11-26T07:23:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 -- start start 2023-11-26T07:23:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f23b00cd1b0 0x7f23b013b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cf280 0x7f23b013cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b0143ac0 0x7f23b0156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0158a10 con 0x7f23b00cf280 2023-11-26T07:23:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b013b820 con 0x7f23b0143ac0 2023-11-26T07:23:59.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23b491d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b013bac0 con 0x7f23b00cd1b0 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cf280 0x7f23b013cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cf280 0x7f23b013cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41832/0 (socket says 172.21.15.70:41832) 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 -- 172.21.15.70:0/3378016657 learned_addr learned my addr 172.21.15.70:0/3378016657 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23ae59c640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f23b00cd1b0 0x7f23b013b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23aed9d640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b0143ac0 0x7f23b0156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 -- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f23b00cd1b0 msgr2=0x7f23b013b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f23b00cd1b0 0x7f23b013b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 -- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b0143ac0 msgr2=0x7f23b0156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b0143ac0 0x7f23b0156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.251+0000 7f23a5d9b640 1 -- 172.21.15.70:0/3378016657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009420 con 0x7f23b00cf280 2023-11-26T07:23:59.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23a5d9b640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cf280 0x7f23b013cb60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f239800ce00 tx=0x7f239800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23a77fe640 1 -- 172.21.15.70:0/3378016657 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800f890 con 0x7f23b00cf280 2023-11-26T07:23:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23a77fe640 1 -- 172.21.15.70:0/3378016657 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239800f9f0 con 0x7f23b00cf280 2023-11-26T07:23:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23a77fe640 1 -- 172.21.15.70:0/3378016657 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800fdc0 con 0x7f23b00cf280 2023-11-26T07:23:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b013bda0 con 0x7f23b00cf280 2023-11-26T07:23:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b013c360 con 0x7f23b00cf280 2023-11-26T07:23:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b0067680 con 0x7f23b00cf280 2023-11-26T07:23:59.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23a77fe640 1 -- 172.21.15.70:0/3378016657 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f239800b040 con 0x7f23b00cf280 2023-11-26T07:23:59.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23a77fe640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2390066f50 0x7f2390069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23a77fe640 1 -- 172.21.15.70:0/3378016657 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2398083290 con 0x7f23b00cf280 2023-11-26T07:23:59.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.255+0000 7f23ae59c640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2390066f50 0x7f2390069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.259+0000 7f23ae59c640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2390066f50 0x7f2390069410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23a00011f0 tx=0x7f23a0007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.259+0000 7f23a77fe640 1 -- 172.21.15.70:0/3378016657 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2398051fe0 con 0x7f23b00cf280 2023-11-26T07:23:59.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.411+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23b013d6e0 con 0x7f23b00cf280 2023-11-26T07:23:59.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23a77fe640 1 -- 172.21.15.70:0/3378016657 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2398055600 con 0x7f23b00cf280 2023-11-26T07:23:59.413 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:23:59.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2390066f50 msgr2=0x7f2390069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2390066f50 0x7f2390069410 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23a00011f0 tx=0x7f23a0007d40 comp rx=0 tx=0).stop 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cf280 msgr2=0x7f23b013cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cf280 0x7f23b013cb60 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f239800ce00 tx=0x7f239800a650 comp rx=0 tx=0).stop 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 shutdown_connections 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f2390066f50 0x7f2390069410 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23b00cf280 0x7f23b013cb60 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23b0143ac0 0x7f23b0156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 --2- 172.21.15.70:0/3378016657 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f23b00cd1b0 0x7f23b013b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 >> 172.21.15.70:0/3378016657 conn(0x7f23b006a890 msgr2=0x7f23b00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 shutdown_connections 2023-11-26T07:23:59.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.415+0000 7f23b491d640 1 -- 172.21.15.70:0/3378016657 wait complete. 2023-11-26T07:23:59.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:23:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 Processor -- start 2023-11-26T07:23:59.574 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 -- start start 2023-11-26T07:23:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd23c13e290 0x7fd23c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c0cf7c0 0x7fd23c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd23c15f4e0 0x7fd23c1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0cfc40 con 0x7fd23c13e290 2023-11-26T07:23:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c06c520 con 0x7fd23c15f4e0 2023-11-26T07:23:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd243a9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c06c800 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd23c13e290 0x7fd23c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd23c13e290 0x7fd23c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41836/0 (socket says 172.21.15.70:41836) 2023-11-26T07:23:59.576 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 -- 172.21.15.70:0/2753384582 learned_addr learned my addr 172.21.15.70:0/2753384582 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241037640 1 --2- 172.21.15.70:0/2753384582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c0cf7c0 0x7fd23c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd242039640 1 --2- 172.21.15.70:0/2753384582 >> v2:172.21.15.120:3300/0 conn(0x7fd23c15f4e0 0x7fd23c1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 -- 172.21.15.70:0/2753384582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c0cf7c0 msgr2=0x7fd23c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 --2- 172.21.15.70:0/2753384582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c0cf7c0 0x7fd23c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 -- 172.21.15.70:0/2753384582 >> v2:172.21.15.120:3300/0 conn(0x7fd23c15f4e0 msgr2=0x7fd23c1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 --2- 172.21.15.70:0/2753384582 >> v2:172.21.15.120:3300/0 conn(0x7fd23c15f4e0 0x7fd23c1408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd241838640 1 -- 172.21.15.70:0/2753384582 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c06cae0 con 0x7fd23c13e290 2023-11-26T07:23:59.577 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.575+0000 7fd242039640 1 --2- 172.21.15.70:0/2753384582 >> v2:172.21.15.120:3300/0 conn(0x7fd23c15f4e0 0x7fd23c1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd241838640 1 --2- 172.21.15.70:0/2753384582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c13e290 0x7fd23c0cf280 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd23c072660 tx=0x7fd23801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473dc4ff33aabe62 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd240836640 1 -- 172.21.15.70:0/2753384582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380ab600 con 0x7fd23c13e290 2023-11-26T07:23:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd240836640 1 -- 172.21.15.70:0/2753384582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2380a7050 con 0x7fd23c13e290 2023-11-26T07:23:59.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd240836640 1 -- 172.21.15.70:0/2753384582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380ab980 con 0x7fd23c13e290 2023-11-26T07:23:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 -- 172.21.15.70:0/2753384582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c13e290 msgr2=0x7fd23c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 --2- 172.21.15.70:0/2753384582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c13e290 0x7fd23c0cf280 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd23c072660 tx=0x7fd23801c210 comp rx=0 tx=0).stop 2023-11-26T07:23:59.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 -- 172.21.15.70:0/2753384582 shutdown_connections 2023-11-26T07:23:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 --2- 172.21.15.70:0/2753384582 >> v2:172.21.15.120:3300/0 conn(0x7fd23c15f4e0 0x7fd23c1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 --2- 172.21.15.70:0/2753384582 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c0cf7c0 0x7fd23c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 --2- 172.21.15.70:0/2753384582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c13e290 0x7fd23c0cf280 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 -- 172.21.15.70:0/2753384582 >> 172.21.15.70:0/2753384582 conn(0x7fd23c06a890 msgr2=0x7fd23c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 -- 172.21.15.70:0/2753384582 shutdown_connections 2023-11-26T07:23:59.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.579+0000 7fd243a9c640 1 -- 172.21.15.70:0/2753384582 wait complete. 2023-11-26T07:23:59.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 Processor -- start 2023-11-26T07:23:59.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 -- start start 2023-11-26T07:23:59.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c0cf7c0 0x7fd23c154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c13e290 0x7fd23c15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c15f4e0 0x7fd23c1f9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c137bc0 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1378e0 con 0x7fd23c13e290 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c137030 con 0x7fd23c15f4e0 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c0cf7c0 0x7fd23c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c0cf7c0 0x7fd23c154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41852/0 (socket says 172.21.15.70:41852) 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 -- 172.21.15.70:0/1450227829 learned_addr learned my addr 172.21.15.70:0/1450227829 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241037640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c13e290 0x7fd23c15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd242039640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c15f4e0 0x7fd23c1f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 -- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c15f4e0 msgr2=0x7fd23c1f9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c15f4e0 0x7fd23c1f9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 -- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c13e290 msgr2=0x7fd23c15a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c13e290 0x7fd23c15a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 -- 172.21.15.70:0/1450227829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380094d0 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd241838640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c0cf7c0 0x7fd23c154630 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd2380ae040 tx=0x7fd23801aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd2327fc640 1 -- 172.21.15.70:0/1450227829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380b6620 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd2327fc640 1 -- 172.21.15.70:0/1450227829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2380abe90 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd2327fc640 1 -- 172.21.15.70:0/1450227829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380b69e0 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.583+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c137290 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.587+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c154d40 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.587+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c067680 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.587+0000 7fd2327fc640 1 -- 172.21.15.70:0/1450227829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fd2380b2040 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.587+0000 7fd2327fc640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd220066f20 0x7fd2200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.587+0000 7fd2327fc640 1 -- 172.21.15.70:0/1450227829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd23811ca90 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.587+0000 7fd241037640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd220066f20 0x7fd2200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.587+0000 7fd241037640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd220066f20 0x7fd2200693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd23c1551f0 tx=0x7fd22c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.591+0000 7fd2327fc640 1 -- 172.21.15.70:0/1450227829 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2380eba70 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.739+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd23c06df50 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd2327fc640 1 -- 172.21.15.70:0/1450227829 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2380ef090 con 0x7fd23c0cf7c0 2023-11-26T07:23:59.741 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd220066f20 msgr2=0x7fd2200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd220066f20 0x7fd2200693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd23c1551f0 tx=0x7fd22c008040 comp rx=0 tx=0).stop 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c0cf7c0 msgr2=0x7fd23c154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c0cf7c0 0x7fd23c154630 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd2380ae040 tx=0x7fd23801aa50 comp rx=0 tx=0).stop 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 shutdown_connections 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd23c15f4e0 0x7fd23c1f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c13e290 0x7fd23c15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd220066f20 0x7fd2200693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 --2- 172.21.15.70:0/1450227829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd23c0cf7c0 0x7fd23c154630 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 >> 172.21.15.70:0/1450227829 conn(0x7fd23c06a890 msgr2=0x7fd23c0aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:59.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 shutdown_connections 2023-11-26T07:23:59.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.743+0000 7fd243a9c640 1 -- 172.21.15.70:0/1450227829 wait complete. 2023-11-26T07:23:59.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:23:59.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f626d6ea640 1 Processor -- start 2023-11-26T07:23:59.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f626d6ea640 1 -- start start 2023-11-26T07:23:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f626d6ea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f626806b190 0x7f6268146530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f626d6ea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f626806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f626d6ea640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268146380 con 0x7f6268145fa0 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f626d6ea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6268071480 con 0x7f626806b190 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f626d6ea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268072000 con 0x7f626806a490 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f625ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f626806b190 0x7f6268146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f625ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f626806b190 0x7f6268146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41854/0 (socket says 172.21.15.70:41854) 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f625ffff640 1 -- 172.21.15.70:0/3879404261 learned_addr learned my addr 172.21.15.70:0/3879404261 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f62677fe640 1 --2- 172.21.15.70:0/3879404261 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f626806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f625ffff640 1 -- 172.21.15.70:0/3879404261 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 msgr2=0x7f626806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f625ffff640 1 --2- 172.21.15.70:0/3879404261 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f626806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f625ffff640 1 -- 172.21.15.70:0/3879404261 >> v1:172.21.15.120:6789/0 conn(0x7f6268145fa0 legacy=0x7f6268072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.903+0000 7f625ffff640 1 -- 172.21.15.70:0/3879404261 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268071660 con 0x7f626806b190 2023-11-26T07:23:59.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f625ffff640 1 --2- 172.21.15.70:0/3879404261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f626806b190 0x7f6268146530 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6250009870 tx=0x7f625001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2972ea25cb4ee7 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f62667fc640 1 -- 172.21.15.70:0/3879404261 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500a7070 con 0x7f626806b190 2023-11-26T07:23:59.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f62667fc640 1 -- 172.21.15.70:0/3879404261 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62500ab430 con 0x7f626806b190 2023-11-26T07:23:59.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f62667fc640 1 -- 172.21.15.70:0/3879404261 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500ab7c0 con 0x7f626806b190 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 -- 172.21.15.70:0/3879404261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f626806b190 msgr2=0x7f6268146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 --2- 172.21.15.70:0/3879404261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f626806b190 0x7f6268146530 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6250009870 tx=0x7f625001c540 comp rx=0 tx=0).stop 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 -- 172.21.15.70:0/3879404261 shutdown_connections 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 --2- 172.21.15.70:0/3879404261 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f626806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 --2- 172.21.15.70:0/3879404261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f626806b190 0x7f6268146530 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 -- 172.21.15.70:0/3879404261 >> 172.21.15.70:0/3879404261 conn(0x7f62680cff00 msgr2=0x7f62680d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 -- 172.21.15.70:0/3879404261 shutdown_connections 2023-11-26T07:23:59.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.907+0000 7f626d6ea640 1 -- 172.21.15.70:0/3879404261 wait complete. 2023-11-26T07:23:59.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 Processor -- start 2023-11-26T07:23:59.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 -- start start 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f62680ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f626806b190 0x7f626815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268145fa0 0x7f62680b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626815f730 con 0x7f6268145fa0 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626815e8c0 con 0x7f626806b190 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626815eb20 con 0x7f626806a490 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268145fa0 0x7f62680b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268145fa0 0x7f62680b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41862/0 (socket says 172.21.15.70:41862) 2023-11-26T07:23:59.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 -- 172.21.15.70:0/1101330975 learned_addr learned my addr 172.21.15.70:0/1101330975 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f625ffff640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f626806b190 0x7f626815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 -- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 msgr2=0x7f62680ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f6266ffd640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f62680ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f62680ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 -- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f626806b190 msgr2=0x7f626815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f626806b190 0x7f626815e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 -- 172.21.15.70:0/1101330975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62500094d0 con 0x7f6268145fa0 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f625ffff640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f626806b190 0x7f626815e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f6266ffd640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f62680ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:23:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f62677fe640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268145fa0 0x7f62680b0e30 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f626000efc0 tx=0x7f626000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f625f7fe640 1 -- 172.21.15.70:0/1101330975 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260009ba0 con 0x7f6268145fa0 2023-11-26T07:23:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f625f7fe640 1 -- 172.21.15.70:0/1101330975 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626000f040 con 0x7f6268145fa0 2023-11-26T07:23:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626815ee00 con 0x7f6268145fa0 2023-11-26T07:23:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f625f7fe640 1 -- 172.21.15.70:0/1101330975 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600146c0 con 0x7f6268145fa0 2023-11-26T07:23:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.911+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626815f3c0 con 0x7f6268145fa0 2023-11-26T07:23:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.915+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626814a270 con 0x7f6268145fa0 2023-11-26T07:23:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.915+0000 7f625f7fe640 1 -- 172.21.15.70:0/1101330975 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f6260014820 con 0x7f6268145fa0 2023-11-26T07:23:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.915+0000 7f625f7fe640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6248066f20 0x7f62480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:23:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.915+0000 7f625f7fe640 1 -- 172.21.15.70:0/1101330975 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6260083490 con 0x7f6268145fa0 2023-11-26T07:23:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.915+0000 7f6266ffd640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6248066f20 0x7f62480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:23:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.915+0000 7f6266ffd640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6248066f20 0x7f62480693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6268072160 tx=0x7f6258009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:23:59.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:23:59.919+0000 7f625f7fe640 1 -- 172.21.15.70:0/1101330975 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f626814a270 con 0x7f6268145fa0 2023-11-26T07:24:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.083+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f626814a270 con 0x7f6268145fa0 2023-11-26T07:24:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.083+0000 7f625f7fe640 1 -- 172.21.15.70:0/1101330975 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) v1 ==== 80+0+0 (secure 0 0 0) 0x7f626814a270 con 0x7f6268145fa0 2023-11-26T07:24:00.084 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:24:00.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6248066f20 msgr2=0x7f62480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6248066f20 0x7f62480693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6268072160 tx=0x7f6258009040 comp rx=0 tx=0).stop 2023-11-26T07:24:00.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268145fa0 msgr2=0x7f62680b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268145fa0 0x7f62680b0e30 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f626000efc0 tx=0x7f626000c490 comp rx=0 tx=0).stop 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 shutdown_connections 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6248066f20 0x7f62480693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6268145fa0 0x7f62680b0e30 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f626806b190 0x7f626815e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 --2- 172.21.15.70:0/1101330975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f626806a490 0x7f62680ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 >> 172.21.15.70:0/1101330975 conn(0x7f62680cff00 msgr2=0x7f6268072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 shutdown_connections 2023-11-26T07:24:00.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.087+0000 7f626d6ea640 1 -- 172.21.15.70:0/1101330975 wait complete. 2023-11-26T07:24:00.105 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2023-11-26T07:24:00.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:00.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-26T07:24:00.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[55435]: fuse finished with error 0 and tester_r 0 2023-11-26T07:24:00.180 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:24:00.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:00.181 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-26T07:24:00.336 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:00.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:00.394 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:24:00.394 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:00.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:00.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd922a17640 1 Processor -- start 2023-11-26T07:24:00.578 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd922a17640 1 -- start start 2023-11-26T07:24:00.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd922a17640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd922a17640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd91c0d1bc0 0x7fd91c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd922a17640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c0cf0e0 con 0x7fd91c0b2160 2023-11-26T07:24:00.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd922a17640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c15dac0 con 0x7fd91c0d1bc0 2023-11-26T07:24:00.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd922a17640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0ceb20 con 0x7fd91c15d6e0 2023-11-26T07:24:00.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91bfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd920fb4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd91c0d1bc0 0x7fd91c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd91c0b2160 0x7fd91c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:37326/0 (socket says 172.21.15.70:37326) 2023-11-26T07:24:00.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91b7fe640 1 -- 172.21.15.70:0/857831513 learned_addr learned my addr 172.21.15.70:0/857831513 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:00.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91bfff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:39488/0 (socket says 172.21.15.70:39488) 2023-11-26T07:24:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91bfff640 1 -- 172.21.15.70:0/857831513 >> v2:172.21.15.120:3300/0 conn(0x7fd91c0d1bc0 msgr2=0x7fd91c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91bfff640 1 --2- 172.21.15.70:0/857831513 >> v2:172.21.15.120:3300/0 conn(0x7fd91c0d1bc0 0x7fd91c0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91bfff640 1 -- 172.21.15.70:0/857831513 >> v1:172.21.15.120:6789/0 conn(0x7fd91c0b2160 legacy=0x7fd91c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91bfff640 1 -- 172.21.15.70:0/857831513 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0cee00 con 0x7fd91c15d6e0 2023-11-26T07:24:00.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.579+0000 7fd91affd640 1 -- 172.21.15.70:0/857831513 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952465188 0 0) 0x7fd91c0cf0e0 con 0x7fd91c0b2160 2023-11-26T07:24:00.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd91bfff640 1 --2- 172.21.15.70:0/857831513 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c0d0df0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097c0 tx=0x7fd90c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c5857c3c674c483 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd91affd640 1 -- 172.21.15.70:0/857831513 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0ab600 con 0x7fd91c15d6e0 2023-11-26T07:24:00.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd91affd640 1 -- 172.21.15.70:0/857831513 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0a7050 con 0x7fd91c15d6e0 2023-11-26T07:24:00.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd91affd640 1 -- 172.21.15.70:0/857831513 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0ab980 con 0x7fd91c15d6e0 2023-11-26T07:24:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 -- 172.21.15.70:0/857831513 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 msgr2=0x7fd91c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 --2- 172.21.15.70:0/857831513 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c0d0df0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097c0 tx=0x7fd90c01c480 comp rx=0 tx=0).stop 2023-11-26T07:24:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 -- 172.21.15.70:0/857831513 shutdown_connections 2023-11-26T07:24:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 --2- 172.21.15.70:0/857831513 >> v2:172.21.15.120:3300/0 conn(0x7fd91c0d1bc0 0x7fd91c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 --2- 172.21.15.70:0/857831513 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c0d0df0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 -- 172.21.15.70:0/857831513 >> 172.21.15.70:0/857831513 conn(0x7fd91c09c550 msgr2=0x7fd91c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:00.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 -- 172.21.15.70:0/857831513 shutdown_connections 2023-11-26T07:24:00.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.583+0000 7fd922a17640 1 -- 172.21.15.70:0/857831513 wait complete. 2023-11-26T07:24:00.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 Processor -- start 2023-11-26T07:24:00.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 -- start start 2023-11-26T07:24:00.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd91c0b2160 0x7fd91c0b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd91c0d1bc0 0x7fd91c15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c15f200 con 0x7fd91c0b2160 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c15f4a0 con 0x7fd91c0d1bc0 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c15f780 con 0x7fd91c15d6e0 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd91c0b2160 0x7fd91c0b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd91c0b2160 0x7fd91c0b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41870/0 (socket says 172.21.15.70:41870) 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 -- 172.21.15.70:0/29662158 learned_addr learned my addr 172.21.15.70:0/29662158 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91b7fe640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd91c0d1bc0 0x7fd91c15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd920fb4640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 -- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 msgr2=0x7fd91c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 -- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd91c0d1bc0 msgr2=0x7fd91c15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd91c0d1bc0 0x7fd91c15ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 -- 172.21.15.70:0/29662158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009420 con 0x7fd91c0b2160 2023-11-26T07:24:00.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd91bfff640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd91c0b2160 0x7fd91c0b6f90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd90c01ab30 tx=0x7fd90c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd918ff9640 1 -- 172.21.15.70:0/29662158 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c006e20 con 0x7fd91c0b2160 2023-11-26T07:24:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd918ff9640 1 -- 172.21.15.70:0/29662158 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c004030 con 0x7fd91c0b2160 2023-11-26T07:24:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c15fa60 con 0x7fd91c0b2160 2023-11-26T07:24:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd918ff9640 1 -- 172.21.15.70:0/29662158 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0043a0 con 0x7fd91c0b2160 2023-11-26T07:24:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.587+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c160020 con 0x7fd91c0b2160 2023-11-26T07:24:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.591+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c160210 con 0x7fd91c0b2160 2023-11-26T07:24:00.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.591+0000 7fd918ff9640 1 -- 172.21.15.70:0/29662158 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fd90c003620 con 0x7fd91c0b2160 2023-11-26T07:24:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.591+0000 7fd918ff9640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd908066f20 0x7fd9080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.591+0000 7fd918ff9640 1 -- 172.21.15.70:0/29662158 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd90c11cee0 con 0x7fd91c0b2160 2023-11-26T07:24:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.591+0000 7fd91b7fe640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd908066f20 0x7fd9080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.591+0000 7fd91b7fe640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd908066f20 0x7fd9080693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0c9930 tx=0x7fd910007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.595+0000 7fd918ff9640 1 -- 172.21.15.70:0/29662158 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd90c0ebe60 con 0x7fd91c0b2160 2023-11-26T07:24:00.743 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.743+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd91c067680 con 0x7fd91c0b2160 2023-11-26T07:24:00.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd918ff9640 1 -- 172.21.15.70:0/29662158 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16666 (secure 0 0 0) 0x7fd90c0ba020 con 0x7fd91c0b2160 2023-11-26T07:24:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:00.745 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":80,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:46.861938+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd908066f20 msgr2=0x7fd9080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd908066f20 0x7fd9080693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0c9930 tx=0x7fd910007d60 comp rx=0 tx=0).stop 2023-11-26T07:24:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd91c0b2160 msgr2=0x7fd91c0b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd91c0b2160 0x7fd91c0b6f90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd90c01ab30 tx=0x7fd90c01acc0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 shutdown_connections 2023-11-26T07:24:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd91c15d6e0 0x7fd91c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd91c0d1bc0 0x7fd91c15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd908066f20 0x7fd9080693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 --2- 172.21.15.70:0/29662158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd91c0b2160 0x7fd91c0b6f90 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 >> 172.21.15.70:0/29662158 conn(0x7fd91c09c550 msgr2=0x7fd91c0b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 shutdown_connections 2023-11-26T07:24:00.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.747+0000 7fd922a17640 1 -- 172.21.15.70:0/29662158 wait complete. 2023-11-26T07:24:00.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:23:06.615543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:23:07.401685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:24:00.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:24:00.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.907+0000 7f856d7b8640 1 Processor -- start 2023-11-26T07:24:00.907 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.907+0000 7f856d7b8640 1 -- start start 2023-11-26T07:24:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f856d7b8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f856813e290 0x7f85680cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f856d7b8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85680cf7c0 0x7f856815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f856d7b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f85681408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f856d7b8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85680cfc40 con 0x7f856813e290 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f856d7b8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856806c520 con 0x7f85680cf7c0 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f856d7b8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856806c800 con 0x7f856815f4e0 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f8566ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f856813e290 0x7f85680cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85680cf7c0 0x7f856815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85680cf7c0 0x7f856815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:59838/0 (socket says 172.21.15.70:59838) 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 -- 172.21.15.70:0/83631595 learned_addr learned my addr 172.21.15.70:0/83631595 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f85677fe640 1 --2- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f85681408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 -- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 msgr2=0x7f85681408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 --2- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f85681408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 -- 172.21.15.70:0/83631595 >> v2:172.21.15.70:3300/0 conn(0x7f856813e290 msgr2=0x7f85680cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:00.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 --2- 172.21.15.70:0/83631595 >> v2:172.21.15.70:3300/0 conn(0x7f856813e290 0x7f85680cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.911+0000 7f855e7fc640 1 -- 172.21.15.70:0/83631595 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856806cae0 con 0x7f85680cf7c0 2023-11-26T07:24:00.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f855e7fc640 1 --2- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f856815efa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f85680cfe40 tx=0x7f855801c210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4b4f298d47ce34 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f85667fc640 1 -- 172.21.15.70:0/83631595 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580ab600 con 0x7f85680cf7c0 2023-11-26T07:24:00.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f85667fc640 1 -- 172.21.15.70:0/83631595 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85580a7050 con 0x7f85680cf7c0 2023-11-26T07:24:00.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f85667fc640 1 -- 172.21.15.70:0/83631595 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580ab980 con 0x7f85680cf7c0 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 -- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 msgr2=0x7f856815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 --2- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f856815efa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f85680cfe40 tx=0x7f855801c210 comp rx=0 tx=0).stop 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 -- 172.21.15.70:0/83631595 shutdown_connections 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 --2- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f85681408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 --2- 172.21.15.70:0/83631595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f856815efa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 --2- 172.21.15.70:0/83631595 >> v2:172.21.15.70:3300/0 conn(0x7f856813e290 0x7f85680cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 -- 172.21.15.70:0/83631595 >> 172.21.15.70:0/83631595 conn(0x7f856806a890 msgr2=0x7f856806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 -- 172.21.15.70:0/83631595 shutdown_connections 2023-11-26T07:24:00.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 -- 172.21.15.70:0/83631595 wait complete. 2023-11-26T07:24:00.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.915+0000 7f856d7b8640 1 Processor -- start 2023-11-26T07:24:00.916 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 -- start start 2023-11-26T07:24:00.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f85680b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856813e290 0x7f8568137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f8568071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680b2f60 con 0x7f856813e290 2023-11-26T07:24:00.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85681380f0 con 0x7f85680cf7c0 2023-11-26T07:24:00.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85680b2c80 con 0x7f856815f4e0 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856813e290 0x7f8568137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f8566ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f85680b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856813e290 0x7f8568137bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41892/0 (socket says 172.21.15.70:41892) 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f8566ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f85680b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:59852/0 (socket says 172.21.15.70:59852) 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 -- 172.21.15.70:0/3237617047 learned_addr learned my addr 172.21.15.70:0/3237617047 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f85677fe640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f8568071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 -- 172.21.15.70:0/3237617047 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 msgr2=0x7f8568071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f8568071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 -- 172.21.15.70:0/3237617047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 msgr2=0x7f85680b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f85680b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:00.919 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 -- 172.21.15.70:0/3237617047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580094d0 con 0x7f856813e290 2023-11-26T07:24:00.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855e7fc640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856813e290 0x7f8568137bb0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f855801a8c0 tx=0x7f8558018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855ffff640 1 -- 172.21.15.70:0/3237617047 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580b5400 con 0x7f856813e290 2023-11-26T07:24:00.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855ffff640 1 -- 172.21.15.70:0/3237617047 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85580b5560 con 0x7f856813e290 2023-11-26T07:24:00.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f855ffff640 1 -- 172.21.15.70:0/3237617047 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580b5910 con 0x7f856813e290 2023-11-26T07:24:00.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85680b1e30 con 0x7f856813e290 2023-11-26T07:24:00.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85680b23f0 con 0x7f856813e290 2023-11-26T07:24:00.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.919+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85680b1c30 con 0x7f856813e290 2023-11-26T07:24:00.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.923+0000 7f855ffff640 1 -- 172.21.15.70:0/3237617047 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f85580b5a70 con 0x7f856813e290 2023-11-26T07:24:00.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.923+0000 7f855ffff640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8548066f20 0x7f85480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:00.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.923+0000 7f855ffff640 1 -- 172.21.15.70:0/3237617047 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f855811bcd0 con 0x7f856813e290 2023-11-26T07:24:00.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.923+0000 7f8566ffd640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8548066f20 0x7f85480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:00.922 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.923+0000 7f8566ffd640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8548066f20 0x7f85480693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8568165fd0 tx=0x7f8550009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:00.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:00.927+0000 7f855ffff640 1 -- 172.21.15.70:0/3237617047 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85580eaa80 con 0x7f856813e290 2023-11-26T07:24:01.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8568067680 con 0x7f856813e290 2023-11-26T07:24:01.082 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f855ffff640 1 -- 172.21.15.70:0/3237617047 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85580ee0a0 con 0x7f856813e290 2023-11-26T07:24:01.082 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:24:01.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8548066f20 msgr2=0x7f85480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8548066f20 0x7f85480693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8568165fd0 tx=0x7f8550009190 comp rx=0 tx=0).stop 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856813e290 msgr2=0x7f8568137bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856813e290 0x7f8568137bb0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f855801a8c0 tx=0x7f8558018fb0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 shutdown_connections 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8548066f20 0x7f85480693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f856813e290 0x7f8568137bb0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f856815f4e0 0x7f8568071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 --2- 172.21.15.70:0/3237617047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85680cf7c0 0x7f85680b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 >> 172.21.15.70:0/3237617047 conn(0x7f856806a890 msgr2=0x7f8568140240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:01.085 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 shutdown_connections 2023-11-26T07:24:01.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.083+0000 7f856d7b8640 1 -- 172.21.15.70:0/3237617047 wait complete. 2023-11-26T07:24:01.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:24:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.243+0000 7fde5409c640 1 Processor -- start 2023-11-26T07:24:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.243+0000 7fde5409c640 1 -- start start 2023-11-26T07:24:01.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde5409c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c143ac0 0x7fde4c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde5409c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fde4c0cf990 0x7fde4c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde5409c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c0cc730 con 0x7fde4c0708b0 2023-11-26T07:24:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde5409c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c143ea0 con 0x7fde4c0cf990 2023-11-26T07:24:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde5409c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c070ee0 con 0x7fde4c143ac0 2023-11-26T07:24:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51e38640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c143ac0 0x7fde4c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde52639640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fde4c0cf990 0x7fde4c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51e38640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c143ac0 0x7fde4c070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:39524/0 (socket says 172.21.15.70:39524) 2023-11-26T07:24:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51637640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fde4c0708b0 0x7fde4c0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:37328/0 (socket says 172.21.15.70:37328) 2023-11-26T07:24:01.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51e38640 1 -- 172.21.15.70:0/2079966152 learned_addr learned my addr 172.21.15.70:0/2079966152 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:01.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51e38640 1 -- 172.21.15.70:0/2079966152 >> v2:172.21.15.120:3300/0 conn(0x7fde4c0cf990 msgr2=0x7fde4c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:01.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51e38640 1 --2- 172.21.15.70:0/2079966152 >> v2:172.21.15.120:3300/0 conn(0x7fde4c0cf990 0x7fde4c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51e38640 1 -- 172.21.15.70:0/2079966152 >> v1:172.21.15.120:6789/0 conn(0x7fde4c0708b0 legacy=0x7fde4c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.248 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde50e36640 1 -- 172.21.15.70:0/2079966152 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339514057 0 0) 0x7fde4c0cc730 con 0x7fde4c0708b0 2023-11-26T07:24:01.249 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.247+0000 7fde51e38640 1 -- 172.21.15.70:0/2079966152 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c0711c0 con 0x7fde4c143ac0 2023-11-26T07:24:01.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde51e38640 1 --2- 172.21.15.70:0/2079966152 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c143ac0 0x7fde4c070370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde48009870 tx=0x7fde4801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81268b100e4fb2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde50e36640 1 -- 172.21.15.70:0/2079966152 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480ab650 con 0x7fde4c143ac0 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde50e36640 1 -- 172.21.15.70:0/2079966152 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480ab7b0 con 0x7fde4c143ac0 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde50e36640 1 -- 172.21.15.70:0/2079966152 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480abb40 con 0x7fde4c143ac0 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 -- 172.21.15.70:0/2079966152 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c143ac0 msgr2=0x7fde4c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 --2- 172.21.15.70:0/2079966152 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c143ac0 0x7fde4c070370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde48009870 tx=0x7fde4801c540 comp rx=0 tx=0).stop 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 -- 172.21.15.70:0/2079966152 shutdown_connections 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 --2- 172.21.15.70:0/2079966152 >> v2:172.21.15.120:3300/0 conn(0x7fde4c0cf990 0x7fde4c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 --2- 172.21.15.70:0/2079966152 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c143ac0 0x7fde4c070370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 -- 172.21.15.70:0/2079966152 >> 172.21.15.70:0/2079966152 conn(0x7fde4c06a890 msgr2=0x7fde4c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 -- 172.21.15.70:0/2079966152 shutdown_connections 2023-11-26T07:24:01.251 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 -- 172.21.15.70:0/2079966152 wait complete. 2023-11-26T07:24:01.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 Processor -- start 2023-11-26T07:24:01.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.251+0000 7fde5409c640 1 -- start start 2023-11-26T07:24:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde4c0708b0 0x7fde4c159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c0cf990 0x7fde4c13a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde4c143ac0 0x7fde4c13a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0b0af0 con 0x7fde4c0708b0 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0afa50 con 0x7fde4c143ac0 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0afd30 con 0x7fde4c0cf990 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde4c0708b0 0x7fde4c159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde4c0708b0 0x7fde4c159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41904/0 (socket says 172.21.15.70:41904) 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 -- 172.21.15.70:0/3990559223 learned_addr learned my addr 172.21.15.70:0/3990559223 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51637640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c0cf990 0x7fde4c13a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde52639640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde4c143ac0 0x7fde4c13a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 -- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c0cf990 msgr2=0x7fde4c13a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c0cf990 0x7fde4c13a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 -- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde4c143ac0 msgr2=0x7fde4c13a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde4c143ac0 0x7fde4c13a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 -- 172.21.15.70:0/3990559223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde480094d0 con 0x7fde4c0708b0 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde51e38640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde4c0708b0 0x7fde4c159640 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fde480ad040 tx=0x7fde4801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde427fc640 1 -- 172.21.15.70:0/3990559223 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480b4800 con 0x7fde4c0708b0 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde427fc640 1 -- 172.21.15.70:0/3990559223 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480b4960 con 0x7fde4c0708b0 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde427fc640 1 -- 172.21.15.70:0/3990559223 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480b4d10 con 0x7fde4c0708b0 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c0b0010 con 0x7fde4c0708b0 2023-11-26T07:24:01.256 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c0b05d0 con 0x7fde4c0708b0 2023-11-26T07:24:01.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c0b07c0 con 0x7fde4c0708b0 2023-11-26T07:24:01.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.255+0000 7fde427fc640 1 -- 172.21.15.70:0/3990559223 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fde480b3380 con 0x7fde4c0708b0 2023-11-26T07:24:01.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.259+0000 7fde427fc640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde30066f50 0x7fde30069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.259+0000 7fde427fc640 1 -- 172.21.15.70:0/3990559223 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fde4811cce0 con 0x7fde4c0708b0 2023-11-26T07:24:01.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.259+0000 7fde51637640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde30066f50 0x7fde30069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.259+0000 7fde51637640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde30066f50 0x7fde30069410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0b1bd0 tx=0x7fde3c007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.261 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.263+0000 7fde427fc640 1 -- 172.21.15.70:0/3990559223 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde480ebde0 con 0x7fde4c0708b0 2023-11-26T07:24:01.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde4c067680 con 0x7fde4c0708b0 2023-11-26T07:24:01.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde427fc640 1 -- 172.21.15.70:0/3990559223 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde480ef400 con 0x7fde4c0708b0 2023-11-26T07:24:01.418 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:24:01.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde30066f50 msgr2=0x7fde30069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde30066f50 0x7fde30069410 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0b1bd0 tx=0x7fde3c007b80 comp rx=0 tx=0).stop 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde4c0708b0 msgr2=0x7fde4c159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde4c0708b0 0x7fde4c159640 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fde480ad040 tx=0x7fde4801ad80 comp rx=0 tx=0).stop 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 shutdown_connections 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde4c143ac0 0x7fde4c13a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fde4c0cf990 0x7fde4c13a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fde30066f50 0x7fde30069410 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 --2- 172.21.15.70:0/3990559223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde4c0708b0 0x7fde4c159640 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 >> 172.21.15.70:0/3990559223 conn(0x7fde4c06a890 msgr2=0x7fde4c13b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 shutdown_connections 2023-11-26T07:24:01.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.419+0000 7fde5409c640 1 -- 172.21.15.70:0/3990559223 wait complete. 2023-11-26T07:24:01.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:24:01.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.579+0000 7f71dd032640 1 Processor -- start 2023-11-26T07:24:01.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.579+0000 7f71dd032640 1 -- start start 2023-11-26T07:24:01.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71dd032640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71d80b2f80 0x7f71d8071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.581 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71dd032640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71dd032640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d806c750 con 0x7f71d81596d0 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71dd032640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d80cbe00 con 0x7f71d80b2f80 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71dd032640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80b3550 con 0x7f71d80ce680 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d659c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71d80b2f80 0x7f71d8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d659c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f71d80b2f80 0x7f71d8071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41914/0 (socket says 172.21.15.70:41914) 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d659c640 1 -- 172.21.15.70:0/3289782783 learned_addr learned my addr 172.21.15.70:0/3289782783 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d759e640 1 --2- 172.21.15.70:0/3289782783 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d659c640 1 -- 172.21.15.70:0/3289782783 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 msgr2=0x7f71d806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d659c640 1 --2- 172.21.15.70:0/3289782783 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d806cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d659c640 1 -- 172.21.15.70:0/3289782783 >> v1:172.21.15.120:6789/0 conn(0x7f71d81596d0 legacy=0x7f71d80b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.583+0000 7f71d659c640 1 -- 172.21.15.70:0/3289782783 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8071e80 con 0x7f71d80b2f80 2023-11-26T07:24:01.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71d659c640 1 --2- 172.21.15.70:0/3289782783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d80b2f80 0x7f71d8071850 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009870 tx=0x7f71cc01e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba6b6988da4a5d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71d5d9b640 1 -- 172.21.15.70:0/3289782783 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0b2600 con 0x7f71d80b2f80 2023-11-26T07:24:01.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71d5d9b640 1 -- 172.21.15.70:0/3289782783 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc0b2760 con 0x7f71d80b2f80 2023-11-26T07:24:01.585 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71d5d9b640 1 -- 172.21.15.70:0/3289782783 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0b2af0 con 0x7f71d80b2f80 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 -- 172.21.15.70:0/3289782783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d80b2f80 msgr2=0x7f71d8071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 --2- 172.21.15.70:0/3289782783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d80b2f80 0x7f71d8071850 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009870 tx=0x7f71cc01e750 comp rx=0 tx=0).stop 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 -- 172.21.15.70:0/3289782783 shutdown_connections 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 --2- 172.21.15.70:0/3289782783 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d806cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 --2- 172.21.15.70:0/3289782783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d80b2f80 0x7f71d8071850 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 -- 172.21.15.70:0/3289782783 >> 172.21.15.70:0/3289782783 conn(0x7f71d806a890 msgr2=0x7f71d806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 -- 172.21.15.70:0/3289782783 shutdown_connections 2023-11-26T07:24:01.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 -- 172.21.15.70:0/3289782783 wait complete. 2023-11-26T07:24:01.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 Processor -- start 2023-11-26T07:24:01.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.587+0000 7f71dd032640 1 -- start start 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d80b2f80 0x7f71d814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d81489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d81596d0 0x7f71d814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80cd8e0 con 0x7f71d81596d0 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d814d880 con 0x7f71d80b2f80 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d814cc70 con 0x7f71d80ce680 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d81596d0 0x7f71d814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d81596d0 0x7f71d814dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41926/0 (socket says 172.21.15.70:41926) 2023-11-26T07:24:01.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 -- 172.21.15.70:0/2553739100 learned_addr learned my addr 172.21.15.70:0/2553739100 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d6d9d640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d80b2f80 0x7f71d814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d659c640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d81489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 -- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 msgr2=0x7f71d81489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d81489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 -- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d80b2f80 msgr2=0x7f71d814c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d80b2f80 0x7f71d814c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 -- 172.21.15.70:0/2553739100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0094d0 con 0x7f71d81596d0 2023-11-26T07:24:01.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d6d9d640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d80b2f80 0x7f71d814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:01.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71d759e640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d81596d0 0x7f71d814dd10 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f71d000e960 tx=0x7f71d000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71bf7fe640 1 -- 172.21.15.70:0/2553739100 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00096b0 con 0x7f71d81596d0 2023-11-26T07:24:01.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71bf7fe640 1 -- 172.21.15.70:0/2553739100 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d000c9a0 con 0x7f71d81596d0 2023-11-26T07:24:01.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d814cf50 con 0x7f71d81596d0 2023-11-26T07:24:01.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71bf7fe640 1 -- 172.21.15.70:0/2553739100 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000cd30 con 0x7f71d81596d0 2023-11-26T07:24:01.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d814d510 con 0x7f71d81596d0 2023-11-26T07:24:01.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d814da10 con 0x7f71d81596d0 2023-11-26T07:24:01.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.591+0000 7f71bf7fe640 1 -- 172.21.15.70:0/2553739100 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f71d0013470 con 0x7f71d81596d0 2023-11-26T07:24:01.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.595+0000 7f71bf7fe640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c4066f20 0x7f71c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.595+0000 7f71bf7fe640 1 -- 172.21.15.70:0/2553739100 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f71d0082930 con 0x7f71d81596d0 2023-11-26T07:24:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.595+0000 7f71d6d9d640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c4066f20 0x7f71c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.595+0000 7f71d6d9d640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c4066f20 0x7f71c40693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f71d80ae460 tx=0x7f71c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.599+0000 7f71bf7fe640 1 -- 172.21.15.70:0/2553739100 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71d0051910 con 0x7f71d81596d0 2023-11-26T07:24:01.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.747+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71d8067680 con 0x7f71d81596d0 2023-11-26T07:24:01.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.747+0000 7f71bf7fe640 1 -- 172.21.15.70:0/2553739100 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71d0054f30 con 0x7f71d81596d0 2023-11-26T07:24:01.748 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c4066f20 msgr2=0x7f71c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c4066f20 0x7f71c40693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f71d80ae460 tx=0x7f71c8009040 comp rx=0 tx=0).stop 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d81596d0 msgr2=0x7f71d814dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d81596d0 0x7f71d814dd10 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f71d000e960 tx=0x7f71d000ee20 comp rx=0 tx=0).stop 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 shutdown_connections 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f71c4066f20 0x7f71c40693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71d81596d0 0x7f71d814dd10 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f71d80ce680 0x7f71d81489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 --2- 172.21.15.70:0/2553739100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71d80b2f80 0x7f71d814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 >> 172.21.15.70:0/2553739100 conn(0x7f71d806a890 msgr2=0x7f71d815cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:01.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 shutdown_connections 2023-11-26T07:24:01.751 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.751+0000 7f71dd032640 1 -- 172.21.15.70:0/2553739100 wait complete. 2023-11-26T07:24:01.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-26T07:24:01.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe197301640 1 Processor -- start 2023-11-26T07:24:01.918 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe197301640 1 -- start start 2023-11-26T07:24:01.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe197301640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe1900cf280 0x7fe1900cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.920 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe197301640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900cc730 con 0x7fe190143ac0 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe197301640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe190070ee0 con 0x7fe1900cd1b0 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe197301640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe190143ea0 con 0x7fe1900cf280 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe19489c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe1900cf280 0x7fe1900cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe19509d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe190143ac0 0x7fe190070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39824/0 (socket says 172.21.15.70:39824) 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe19509d640 1 -- 172.21.15.70:0/2823403051 learned_addr learned my addr 172.21.15.70:0/2823403051 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.919+0000 7fe19489c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe1900cf280 0x7fe1900cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41930/0 (socket says 172.21.15.70:41930) 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe19489c640 1 -- 172.21.15.70:0/2823403051 >> v1:172.21.15.120:6789/0 conn(0x7fe1900cd1b0 legacy=0x7fe1900cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe19489c640 1 -- 172.21.15.70:0/2823403051 >> v1:172.21.15.70:6789/0 conn(0x7fe190143ac0 legacy=0x7fe190070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe187fff640 1 -- 172.21.15.70:0/2823403051 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124197967 0 0) 0x7fe1900cc730 con 0x7fe190143ac0 2023-11-26T07:24:01.921 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe19489c640 1 -- 172.21.15.70:0/2823403051 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900711c0 con 0x7fe1900cf280 2023-11-26T07:24:01.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe19489c640 1 --2- 172.21.15.70:0/2823403051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1900cf280 0x7fe1900cf710 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe18001e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255a94a7264116e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.923 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe187fff640 1 -- 172.21.15.70:0/2823403051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800ab670 con 0x7fe1900cf280 2023-11-26T07:24:01.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe187fff640 1 -- 172.21.15.70:0/2823403051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800ab7d0 con 0x7fe1900cf280 2023-11-26T07:24:01.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe187fff640 1 -- 172.21.15.70:0/2823403051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800abb60 con 0x7fe1900cf280 2023-11-26T07:24:01.924 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe197301640 1 -- 172.21.15.70:0/2823403051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1900cf280 msgr2=0x7fe1900cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe197301640 1 --2- 172.21.15.70:0/2823403051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1900cf280 0x7fe1900cf710 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe18001e690 comp rx=0 tx=0).stop 2023-11-26T07:24:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe197301640 1 -- 172.21.15.70:0/2823403051 shutdown_connections 2023-11-26T07:24:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe197301640 1 --2- 172.21.15.70:0/2823403051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1900cf280 0x7fe1900cf710 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.923+0000 7fe197301640 1 -- 172.21.15.70:0/2823403051 >> 172.21.15.70:0/2823403051 conn(0x7fe19006a890 msgr2=0x7fe19006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 -- 172.21.15.70:0/2823403051 shutdown_connections 2023-11-26T07:24:01.925 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 -- 172.21.15.70:0/2823403051 wait complete. 2023-11-26T07:24:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 Processor -- start 2023-11-26T07:24:01.926 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 -- start start 2023-11-26T07:24:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900cd1b0 0x7fe190157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1900cf280 0x7fe1901367f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe190143ac0 0x7fe190159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190158220 con 0x7fe190143ac0 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19013c760 con 0x7fe1900cd1b0 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe190156f20 con 0x7fe1900cf280 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe190143ac0 0x7fe190159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe190143ac0 0x7fe190159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41934/0 (socket says 172.21.15.70:41934) 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 -- 172.21.15.70:0/1033458487 learned_addr learned my addr 172.21.15.70:0/1033458487 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19489c640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1900cf280 0x7fe1901367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19509d640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900cd1b0 0x7fe190157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 -- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1900cf280 msgr2=0x7fe1901367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1900cf280 0x7fe1901367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 -- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900cd1b0 msgr2=0x7fe190157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:01.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900cd1b0 0x7fe190157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 -- 172.21.15.70:0/1033458487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180009420 con 0x7fe190143ac0 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19509d640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900cd1b0 0x7fe190157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe19589e640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe190143ac0 0x7fe190159820 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c770 tx=0x7fe18800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe185ffb640 1 -- 172.21.15.70:0/1033458487 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188003b80 con 0x7fe190143ac0 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe185ffb640 1 -- 172.21.15.70:0/1033458487 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188003ce0 con 0x7fe190143ac0 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe185ffb640 1 -- 172.21.15.70:0/1033458487 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800aa90 con 0x7fe190143ac0 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.927+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190157200 con 0x7fe190143ac0 2023-11-26T07:24:01.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.931+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1901577c0 con 0x7fe190143ac0 2023-11-26T07:24:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.931+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19006c4a0 con 0x7fe190143ac0 2023-11-26T07:24:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.931+0000 7fe185ffb640 1 -- 172.21.15.70:0/1033458487 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fe18800abf0 con 0x7fe190143ac0 2023-11-26T07:24:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.931+0000 7fe185ffb640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe174066f20 0x7fe1740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.931+0000 7fe185ffb640 1 -- 172.21.15.70:0/1033458487 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe188082580 con 0x7fe190143ac0 2023-11-26T07:24:01.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.931+0000 7fe19509d640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe174066f20 0x7fe1740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:01.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.931+0000 7fe19509d640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe174066f20 0x7fe1740693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f70 tx=0x7fe18c007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:01.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:01.935+0000 7fe185ffb640 1 -- 172.21.15.70:0/1033458487 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe188051490 con 0x7fe190143ac0 2023-11-26T07:24:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.099+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe190067680 con 0x7fe190143ac0 2023-11-26T07:24:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.099+0000 7fe185ffb640 1 -- 172.21.15.70:0/1033458487 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe188054ab0 con 0x7fe190143ac0 2023-11-26T07:24:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:listed 0 entries 2023-11-26T07:24:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe174066f20 msgr2=0x7fe1740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe174066f20 0x7fe1740693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f70 tx=0x7fe18c007dd0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe190143ac0 msgr2=0x7fe190159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe190143ac0 0x7fe190159820 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c770 tx=0x7fe18800cc30 comp rx=0 tx=0).stop 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 shutdown_connections 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe174066f20 0x7fe1740693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe190143ac0 0x7fe190159820 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe1900cf280 0x7fe1901367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 --2- 172.21.15.70:0/1033458487 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1900cd1b0 0x7fe190157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 >> 172.21.15.70:0/1033458487 conn(0x7fe19006a890 msgr2=0x7fe190072130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 shutdown_connections 2023-11-26T07:24:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.103+0000 7fe197301640 1 -- 172.21.15.70:0/1033458487 wait complete. 2023-11-26T07:24:02.120 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2023-11-26T07:24:02.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:02.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-26T07:24:02.142 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi120.stderr:ceph-fuse[44641]: fuse finished with error 0 and tester_r 0 2023-11-26T07:24:02.146 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:24:02.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:02.146 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-26T07:24:02.315 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:24:02.315 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:02.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:24:02.325 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:24:02.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:02.325 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-26T07:24:02.380 INFO:teuthology.orchestra.run.smithi070.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-26T07:24:02.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:24:02.381 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:24:02.381 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:02.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:24:02.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:24:02.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:02.391 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-26T07:24:02.444 INFO:teuthology.orchestra.run.smithi120.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-26T07:24:02.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:24:02.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:02.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.583+0000 7f1a5a891640 1 Processor -- start 2023-11-26T07:24:02.584 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.583+0000 7f1a5a891640 1 -- start start 2023-11-26T07:24:02.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a5a891640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a54144510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a5a891640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a5406aba0 0x7f1a54071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.586 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a5a891640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540cf5e0 con 0x7f1a540cd230 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a5a891640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a541442f0 con 0x7f1a5406aba0 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a5a891640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540cecb0 con 0x7f1a54143f10 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a537fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1a540cd230 0x7f1a5406a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39828/0 (socket says 172.21.15.70:39828) 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a537fe640 1 -- 172.21.15.70:0/3552520974 learned_addr learned my addr 172.21.15.70:0/3552520974 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a58e2e640 1 --2- 172.21.15.70:0/3552520974 >> v2:172.21.15.120:3300/0 conn(0x7f1a5406aba0 0x7f1a54071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a53fff640 1 --2- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a54144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a52ffd640 1 -- 172.21.15.70:0/3552520974 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547501923 0 0) 0x7f1a540cf5e0 con 0x7f1a540cd230 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a52ffd640 1 -- 172.21.15.70:0/3552520974 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a3c003530 con 0x7f1a540cd230 2023-11-26T07:24:02.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a58e2e640 1 -- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 msgr2=0x7f1a54144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:02.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a52ffd640 1 -- 172.21.15.70:0/3552520974 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254271177 0 0) 0x7f1a3c003530 con 0x7f1a540cd230 2023-11-26T07:24:02.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a58e2e640 1 --2- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a54144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a58e2e640 1 -- 172.21.15.70:0/3552520974 >> v1:172.21.15.70:6789/0 conn(0x7f1a540cd230 legacy=0x7f1a5406a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.587+0000 7f1a58e2e640 1 -- 172.21.15.70:0/3552520974 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540cef90 con 0x7f1a5406aba0 2023-11-26T07:24:02.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a58e2e640 1 --2- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a5406aba0 0x7f1a54071480 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009d90 tx=0x7f1a4c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de8922088033c00 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:02.589 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a52ffd640 1 -- 172.21.15.70:0/3552520974 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48001680 con 0x7f1a5406aba0 2023-11-26T07:24:02.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a52ffd640 1 -- 172.21.15.70:0/3552520974 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0a5660 con 0x7f1a5406aba0 2023-11-26T07:24:02.590 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a52ffd640 1 -- 172.21.15.70:0/3552520974 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0a59d0 con 0x7f1a5406aba0 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 -- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a5406aba0 msgr2=0x7f1a54071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 --2- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a5406aba0 0x7f1a54071480 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009d90 tx=0x7f1a4c01c840 comp rx=0 tx=0).stop 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 -- 172.21.15.70:0/3552520974 shutdown_connections 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 --2- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a5406aba0 0x7f1a54071480 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 --2- 172.21.15.70:0/3552520974 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a54144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 -- 172.21.15.70:0/3552520974 >> 172.21.15.70:0/3552520974 conn(0x7f1a540cff00 msgr2=0x7f1a540d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 -- 172.21.15.70:0/3552520974 shutdown_connections 2023-11-26T07:24:02.591 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 -- 172.21.15.70:0/3552520974 wait complete. 2023-11-26T07:24:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 Processor -- start 2023-11-26T07:24:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.591+0000 7f1a5a891640 1 -- start start 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a5406aba0 0x7f1a5415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a540cd230 0x7f1a54142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a540b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541432e0 con 0x7f1a5406aba0 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54142d20 con 0x7f1a540cd230 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54143000 con 0x7f1a54143f10 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a5406aba0 0x7f1a5415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a5406aba0 0x7f1a5415a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41946/0 (socket says 172.21.15.70:41946) 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 -- 172.21.15.70:0/4230897583 learned_addr learned my addr 172.21.15.70:0/4230897583 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a537fe640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a540cd230 0x7f1a54142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a58e2e640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a540b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 -- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 msgr2=0x7f1a540b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a540b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 -- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a540cd230 msgr2=0x7f1a54142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a540cd230 0x7f1a54142280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 -- 172.21.15.70:0/4230897583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009a70 con 0x7f1a5406aba0 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a58e2e640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a540b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a53fff640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a5406aba0 0x7f1a5415a920 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400e870 tx=0x7f1a4400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:02.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a50ff9640 1 -- 172.21.15.70:0/4230897583 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44009510 con 0x7f1a5406aba0 2023-11-26T07:24:02.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a50ff9640 1 -- 172.21.15.70:0/4230897583 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4400eec0 con 0x7f1a5406aba0 2023-11-26T07:24:02.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a50ff9640 1 -- 172.21.15.70:0/4230897583 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400cb40 con 0x7f1a5406aba0 2023-11-26T07:24:02.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5412c180 con 0x7f1a5406aba0 2023-11-26T07:24:02.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5413f850 con 0x7f1a5406aba0 2023-11-26T07:24:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5412bfe0 con 0x7f1a5406aba0 2023-11-26T07:24:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.595+0000 7f1a50ff9640 1 -- 172.21.15.70:0/4230897583 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f1a4400cca0 con 0x7f1a5406aba0 2023-11-26T07:24:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.599+0000 7f1a50ff9640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a40066f20 0x7f1a400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.599+0000 7f1a50ff9640 1 -- 172.21.15.70:0/4230897583 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1a44082870 con 0x7f1a5406aba0 2023-11-26T07:24:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.599+0000 7f1a537fe640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a40066f20 0x7f1a400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.599+0000 7f1a537fe640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a40066f20 0x7f1a400693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1a541f9730 tx=0x7f1a480016e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:02.601 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.603+0000 7f1a50ff9640 1 -- 172.21.15.70:0/4230897583 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a5412bfe0 con 0x7f1a5406aba0 2023-11-26T07:24:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a5412bfe0 con 0x7f1a5406aba0 2023-11-26T07:24:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a50ff9640 1 -- 172.21.15.70:0/4230897583 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f1a5412bfe0 con 0x7f1a5406aba0 2023-11-26T07:24:02.786 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:02.786 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/162502503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":162502503},{"type":"v1","addr":"172.21.15.120:6835","nonce":162502503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3659422844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3659422844},{"type":"v1","addr":"172.21.15.70:6835","nonce":3659422844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2807806185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2807806185},{"type":"v1","addr":"172.21.15.70:6837","nonce":2807806185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:08.403306+0000","modified":"2023-11-26T07:23:11.434465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6834/2083039818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2083039818},{"type":"v1","addr":"172.21.15.120:6834","nonce":2083039818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:02.786 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 48 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a40066f20 msgr2=0x7f1a400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a40066f20 0x7f1a400693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1a541f9730 tx=0x7f1a480016e0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a5406aba0 msgr2=0x7f1a5415a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a5406aba0 0x7f1a5415a920 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400e870 tx=0x7f1a4400ec70 comp rx=0 tx=0).stop 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 shutdown_connections 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1a54143f10 0x7f1a540b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a540cd230 0x7f1a54142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1a40066f20 0x7f1a400693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 --2- 172.21.15.70:0/4230897583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a5406aba0 0x7f1a5415a920 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 >> 172.21.15.70:0/4230897583 conn(0x7f1a540cff00 msgr2=0x7f1a541659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:02.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 shutdown_connections 2023-11-26T07:24:02.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.787+0000 7f1a5a891640 1 -- 172.21.15.70:0/4230897583 wait complete. 2023-11-26T07:24:02.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:02.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.943+0000 7fd927679640 1 Processor -- start 2023-11-26T07:24:02.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd927679640 1 -- start start 2023-11-26T07:24:02.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd927679640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd92015d6e0 0x7fd9200d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd927679640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd9200b2160 0x7fd9200d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd927679640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9200cf0e0 con 0x7fd9200d19f0 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd927679640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92015dac0 con 0x7fd9200b2160 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd927679640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9200d1e80 con 0x7fd92015d6e0 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd925c16640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd9200d19f0 0x7fd9200cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39834/0 (socket says 172.21.15.70:39834) 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd925c16640 1 -- 172.21.15.70:0/1571014400 learned_addr learned my addr 172.21.15.70:0/1571014400 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd924c14640 1 --2- 172.21.15.70:0/1571014400 >> v2:172.21.15.120:3300/0 conn(0x7fd9200b2160 0x7fd9200d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd925415640 1 --2- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd92015d6e0 0x7fd9200d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd917fff640 1 -- 172.21.15.70:0/1571014400 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333883548 0 0) 0x7fd9200cf0e0 con 0x7fd9200d19f0 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd917fff640 1 -- 172.21.15.70:0/1571014400 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90c003530 con 0x7fd9200d19f0 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd924c14640 1 -- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd92015d6e0 msgr2=0x7fd9200d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:02.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd924c14640 1 --2- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd92015d6e0 0x7fd9200d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd924c14640 1 -- 172.21.15.70:0/1571014400 >> v1:172.21.15.70:6789/0 conn(0x7fd9200d19f0 legacy=0x7fd9200cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.947+0000 7fd924c14640 1 -- 172.21.15.70:0/1571014400 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9200ceb20 con 0x7fd9200b2160 2023-11-26T07:24:02.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd924c14640 1 --2- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9200b2160 0x7fd9200d14b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097c0 tx=0x7fd91001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d23667c29cb016 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd917fff640 1 -- 172.21.15.70:0/1571014400 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100ab600 con 0x7fd9200b2160 2023-11-26T07:24:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd917fff640 1 -- 172.21.15.70:0/1571014400 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9100a7050 con 0x7fd9200b2160 2023-11-26T07:24:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd917fff640 1 -- 172.21.15.70:0/1571014400 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100ab980 con 0x7fd9200b2160 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 -- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9200b2160 msgr2=0x7fd9200d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 --2- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9200b2160 0x7fd9200d14b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097c0 tx=0x7fd91001c480 comp rx=0 tx=0).stop 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 -- 172.21.15.70:0/1571014400 shutdown_connections 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 --2- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9200b2160 0x7fd9200d14b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 --2- 172.21.15.70:0/1571014400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd92015d6e0 0x7fd9200d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 -- 172.21.15.70:0/1571014400 >> 172.21.15.70:0/1571014400 conn(0x7fd92009c550 msgr2=0x7fd9200d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 -- 172.21.15.70:0/1571014400 shutdown_connections 2023-11-26T07:24:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 -- 172.21.15.70:0/1571014400 wait complete. 2023-11-26T07:24:02.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.951+0000 7fd927679640 1 Processor -- start 2023-11-26T07:24:02.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 -- start start 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9200b2160 0x7fd9200c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd9200d19f0 0x7fd9201f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd92015d6e0 0x7fd92014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92014ff40 con 0x7fd9200b2160 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9201500f0 con 0x7fd92015d6e0 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9201f6950 con 0x7fd9200d19f0 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9200b2160 0x7fd9200c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9200b2160 0x7fd9200c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41948/0 (socket says 172.21.15.70:41948) 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 -- 172.21.15.70:0/706486882 learned_addr learned my addr 172.21.15.70:0/706486882 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 -- 172.21.15.70:0/706486882 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd9200d19f0 msgr2=0x7fd9201f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd9200d19f0 0x7fd9201f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 -- 172.21.15.70:0/706486882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd92015d6e0 msgr2=0x7fd92014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd92015d6e0 0x7fd92014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 -- 172.21.15.70:0/706486882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910009420 con 0x7fd9200b2160 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd925415640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9200b2160 0x7fd9200c81e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00e870 tx=0x7fd91c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd915ffb640 1 -- 172.21.15.70:0/706486882 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c009510 con 0x7fd9200b2160 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd915ffb640 1 -- 172.21.15.70:0/706486882 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c00eec0 con 0x7fd9200b2160 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9201f6c30 con 0x7fd9200b2160 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd915ffb640 1 -- 172.21.15.70:0/706486882 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00cb40 con 0x7fd9200b2160 2023-11-26T07:24:02.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9201f71f0 con 0x7fd9200b2160 2023-11-26T07:24:02.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.955+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd920067680 con 0x7fd9200b2160 2023-11-26T07:24:02.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.959+0000 7fd915ffb640 1 -- 172.21.15.70:0/706486882 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fd91c00cca0 con 0x7fd9200b2160 2023-11-26T07:24:02.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.959+0000 7fd915ffb640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd904066f20 0x7fd9040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:02.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.959+0000 7fd915ffb640 1 -- 172.21.15.70:0/706486882 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd91c082940 con 0x7fd9200b2160 2023-11-26T07:24:02.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.959+0000 7fd924c14640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd904066f20 0x7fd9040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:02.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.959+0000 7fd924c14640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd904066f20 0x7fd9040693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd9100ad000 tx=0x7fd910004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:02.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:02.963+0000 7fd915ffb640 1 -- 172.21.15.70:0/706486882 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd91c051850 con 0x7fd9200b2160 2023-11-26T07:24:03.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.115+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9200b5b00 con 0x7fd9200b2160 2023-11-26T07:24:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.115+0000 7fd915ffb640 1 -- 172.21.15.70:0/706486882 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16666 (secure 0 0 0) 0x7fd91c054e70 con 0x7fd9200b2160 2023-11-26T07:24:03.116 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:03.117 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":80,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:46.861938+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd904066f20 msgr2=0x7fd9040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd904066f20 0x7fd9040693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd9100ad000 tx=0x7fd910004740 comp rx=0 tx=0).stop 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9200b2160 msgr2=0x7fd9200c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9200b2160 0x7fd9200c81e0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00e870 tx=0x7fd91c00ec70 comp rx=0 tx=0).stop 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 shutdown_connections 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd92015d6e0 0x7fd92014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd9200d19f0 0x7fd9201f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd904066f20 0x7fd9040693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 --2- 172.21.15.70:0/706486882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9200b2160 0x7fd9200c81e0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 >> 172.21.15.70:0/706486882 conn(0x7fd92009c550 msgr2=0x7fd9200cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 shutdown_connections 2023-11-26T07:24:03.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.119+0000 7fd927679640 1 -- 172.21.15.70:0/706486882 wait complete. 2023-11-26T07:24:03.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-26T07:17:52.051221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-26T07:23:06.615543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-11-26T07:23:07.401685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-26T07:24:03.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-26T07:24:03.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13ae3df640 1 Processor -- start 2023-11-26T07:24:03.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13ae3df640 1 -- start start 2023-11-26T07:24:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13ae3df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 0x7f13a815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13ae3df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a806c520 con 0x7f13a813e290 2023-11-26T07:24:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13ae3df640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a806c800 con 0x7f13a815f4e0 2023-11-26T07:24:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13ae3df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a806cae0 con 0x7f13a80cf990 2023-11-26T07:24:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13a7fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f13a813e290 0x7f13a80cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:39850/0 (socket says 172.21.15.70:39850) 2023-11-26T07:24:03.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.283+0000 7f13a7fff640 1 -- 172.21.15.70:0/3244731975 learned_addr learned my addr 172.21.15.70:0/3244731975 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:03.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792328394 0 0) 0x7f13a806c520 con 0x7f13a813e290 2023-11-26T07:24:03.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1390003530 con 0x7f13a813e290 2023-11-26T07:24:03.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a77fe640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 0x7f13a815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236201782 0 0) 0x7f1390003530 con 0x7f13a813e290 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 msgr2=0x7f13a815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 0x7f13a815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 >> v1:172.21.15.120:6789/0 conn(0x7f13a815f4e0 legacy=0x7f13a80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a806cdc0 con 0x7f13a813e290 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f1398001680 con 0x7f13a813e290 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 >> v1:172.21.15.70:6789/0 conn(0x7f13a813e290 legacy=0x7f13a80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13900039b0 0x7f1390003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900047d0 0x7f1390004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 0x7f1390005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a806cae0 con 0x7f13900039b0 2023-11-26T07:24:03.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139000ba70 con 0x7f13900047d0 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139000bc30 con 0x7f13a80cf990 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a7fff640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13900039b0 0x7f1390003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a77fe640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900047d0 0x7f1390004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13ac97c640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 0x7f1390005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a7fff640 1 -- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 msgr2=0x7f1390005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a7fff640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a80cf990 0x7f1390005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a7fff640 1 -- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900047d0 msgr2=0x7f1390004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a7fff640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900047d0 0x7f1390004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a7fff640 1 -- 172.21.15.70:0/3244731975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390003530 con 0x7f13900039b0 2023-11-26T07:24:03.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.287+0000 7f13a77fe640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13900047d0 0x7f1390004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13a7fff640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13900039b0 0x7f1390003dd0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1398001ec0 tx=0x7f139801caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae92406a4d3fde8b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398005ae0 con 0x7f13900039b0 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398005c40 con 0x7f13900039b0 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13a6ffd640 1 -- 172.21.15.70:0/3244731975 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398007070 con 0x7f13900039b0 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 -- 172.21.15.70:0/3244731975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13900039b0 msgr2=0x7f1390003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 --2- 172.21.15.70:0/3244731975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13900039b0 0x7f1390003dd0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1398001ec0 tx=0x7f139801caf0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ac97c640 1 -- 172.21.15.70:0/3244731975 reap_dead start 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 -- 172.21.15.70:0/3244731975 shutdown_connections 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 -- 172.21.15.70:0/3244731975 >> 172.21.15.70:0/3244731975 conn(0x7f13a806a890 msgr2=0x7f13a806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 -- 172.21.15.70:0/3244731975 shutdown_connections 2023-11-26T07:24:03.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 -- 172.21.15.70:0/3244731975 wait complete. 2023-11-26T07:24:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 Processor -- start 2023-11-26T07:24:03.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 -- start start 2023-11-26T07:24:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.291+0000 7f13ae3df640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a8138cd0 0x7f13a81f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13a81392d0 0x7f13a813d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815d6c0 0x7f13a815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a815e080 con 0x7f13a815d6c0 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81e8d00 con 0x7f13a81392d0 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81390b0 con 0x7f13a8138cd0 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815d6c0 0x7f13a815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815d6c0 0x7f13a815db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41964/0 (socket says 172.21.15.70:41964) 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 -- 172.21.15.70:0/2072871087 learned_addr learned my addr 172.21.15.70:0/2072871087 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13a7fff640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a8138cd0 0x7f13a81f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13a77fe640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13a81392d0 0x7f13a813d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 -- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a8138cd0 msgr2=0x7f13a81f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a8138cd0 0x7f13a81f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 -- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13a81392d0 msgr2=0x7f13a813d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13a81392d0 0x7f13a813d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 -- 172.21.15.70:0/2072871087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a813b3c0 con 0x7f13a815d6c0 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13a7fff640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a8138cd0 0x7f13a81f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ac97c640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815d6c0 0x7f13a815db40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f13a806e400 tx=0x7f13a000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13a4ff9640 1 -- 172.21.15.70:0/2072871087 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000eed0 con 0x7f13a815d6c0 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13a4ff9640 1 -- 172.21.15.70:0/2072871087 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a0003980 con 0x7f13a815d6c0 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13a4ff9640 1 -- 172.21.15.70:0/2072871087 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0003d30 con 0x7f13a815d6c0 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a81e8f50 con 0x7f13a815d6c0 2023-11-26T07:24:03.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a813b940 con 0x7f13a815d6c0 2023-11-26T07:24:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a8067680 con 0x7f13a815d6c0 2023-11-26T07:24:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.295+0000 7f13a4ff9640 1 -- 172.21.15.70:0/2072871087 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f13a00050d0 con 0x7f13a815d6c0 2023-11-26T07:24:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.299+0000 7f13a4ff9640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1394066f50 0x7f1394069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.299+0000 7f13a4ff9640 1 -- 172.21.15.70:0/2072871087 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f13a00824f0 con 0x7f13a815d6c0 2023-11-26T07:24:03.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.299+0000 7f13a7fff640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1394066f50 0x7f1394069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.299+0000 7f13a7fff640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1394066f50 0x7f1394069410 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f13980ab000 tx=0x7f13980b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.299+0000 7f13a4ff9640 1 -- 172.21.15.70:0/2072871087 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f13a00513c0 con 0x7f13a815d6c0 2023-11-26T07:24:03.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13a80cc230 con 0x7f13a815d6c0 2023-11-26T07:24:03.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13a4ff9640 1 -- 172.21.15.70:0/2072871087 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13a00549e0 con 0x7f13a815d6c0 2023-11-26T07:24:03.455 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2023-11-26T07:24:03.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1394066f50 msgr2=0x7f1394069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1394066f50 0x7f1394069410 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f13980ab000 tx=0x7f13980b1040 comp rx=0 tx=0).stop 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815d6c0 msgr2=0x7f13a815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815d6c0 0x7f13a815db40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f13a806e400 tx=0x7f13a000eb90 comp rx=0 tx=0).stop 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 shutdown_connections 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1394066f50 0x7f1394069410 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a815d6c0 0x7f13a815db40 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13a81392d0 0x7f13a813d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 --2- 172.21.15.70:0/2072871087 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f13a8138cd0 0x7f13a81f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.455+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 >> 172.21.15.70:0/2072871087 conn(0x7f13a806a890 msgr2=0x7f13a815a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.459+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 shutdown_connections 2023-11-26T07:24:03.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.459+0000 7f13ae3df640 1 -- 172.21.15.70:0/2072871087 wait complete. 2023-11-26T07:24:03.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-26T07:24:03.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.615+0000 7ff4ec632640 1 Processor -- start 2023-11-26T07:24:03.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.615+0000 7ff4ec632640 1 -- start start 2023-11-26T07:24:03.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ec632640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e413e290 0x7ff4e40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.618 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ec632640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4e40cf7c0 0x7ff4e415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ec632640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff4e415f4e0 0x7ff4e41408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ec632640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e40cfc40 con 0x7ff4e40cf7c0 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ec632640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e406c520 con 0x7ff4e415f4e0 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ec632640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e406c800 con 0x7ff4e413e290 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4e40cf7c0 0x7ff4e415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4e40cf7c0 0x7ff4e415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54008/0 (socket says 172.21.15.70:54008) 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 -- 172.21.15.70:0/736423408 learned_addr learned my addr 172.21.15.70:0/736423408 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ea3ce640 1 --2- 172.21.15.70:0/736423408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e413e290 0x7ff4e40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4eabcf640 1 --2- 172.21.15.70:0/736423408 >> v2:172.21.15.120:3300/0 conn(0x7ff4e415f4e0 0x7ff4e41408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 -- 172.21.15.70:0/736423408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e413e290 msgr2=0x7ff4e40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 --2- 172.21.15.70:0/736423408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e413e290 0x7ff4e40cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 -- 172.21.15.70:0/736423408 >> v2:172.21.15.120:3300/0 conn(0x7ff4e415f4e0 msgr2=0x7ff4e41408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:03.619 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 --2- 172.21.15.70:0/736423408 >> v2:172.21.15.120:3300/0 conn(0x7ff4e415f4e0 0x7ff4e41408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4e9bcd640 1 -- 172.21.15.70:0/736423408 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e406cae0 con 0x7ff4e40cf7c0 2023-11-26T07:24:03.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4ea3ce640 1 --2- 172.21.15.70:0/736423408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e413e290 0x7ff4e40cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:03.620 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.619+0000 7ff4eabcf640 1 --2- 172.21.15.70:0/736423408 >> v2:172.21.15.120:3300/0 conn(0x7ff4e415f4e0 0x7ff4e41408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:03.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4e9bcd640 1 --2- 172.21.15.70:0/736423408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e40cf7c0 0x7ff4e415efa0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4072660 tx=0x7ff4d401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797b1f4b1e9c732e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4e93cc640 1 -- 172.21.15.70:0/736423408 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40ab600 con 0x7ff4e40cf7c0 2023-11-26T07:24:03.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4e93cc640 1 -- 172.21.15.70:0/736423408 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d40a7050 con 0x7ff4e40cf7c0 2023-11-26T07:24:03.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4e93cc640 1 -- 172.21.15.70:0/736423408 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40ab980 con 0x7ff4e40cf7c0 2023-11-26T07:24:03.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 -- 172.21.15.70:0/736423408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e40cf7c0 msgr2=0x7ff4e415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.622 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 --2- 172.21.15.70:0/736423408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e40cf7c0 0x7ff4e415efa0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4072660 tx=0x7ff4d401c210 comp rx=0 tx=0).stop 2023-11-26T07:24:03.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 -- 172.21.15.70:0/736423408 shutdown_connections 2023-11-26T07:24:03.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 --2- 172.21.15.70:0/736423408 >> v2:172.21.15.120:3300/0 conn(0x7ff4e415f4e0 0x7ff4e41408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 --2- 172.21.15.70:0/736423408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e40cf7c0 0x7ff4e415efa0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 --2- 172.21.15.70:0/736423408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e413e290 0x7ff4e40cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 -- 172.21.15.70:0/736423408 >> 172.21.15.70:0/736423408 conn(0x7ff4e406a890 msgr2=0x7ff4e406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 -- 172.21.15.70:0/736423408 shutdown_connections 2023-11-26T07:24:03.623 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 -- 172.21.15.70:0/736423408 wait complete. 2023-11-26T07:24:03.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 Processor -- start 2023-11-26T07:24:03.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.623+0000 7ff4ec632640 1 -- start start 2023-11-26T07:24:03.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e40cf7c0 0x7ff4e4070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4e413e290 0x7ff4e40b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e415f4e0 0x7ff4e4137160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e40b1aa0 con 0x7ff4e415f4e0 2023-11-26T07:24:03.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4071800 con 0x7ff4e413e290 2023-11-26T07:24:03.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4070bf0 con 0x7ff4e40cf7c0 2023-11-26T07:24:03.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e415f4e0 0x7ff4e4137160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e415f4e0 0x7ff4e4137160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54022/0 (socket says 172.21.15.70:54022) 2023-11-26T07:24:03.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 -- 172.21.15.70:0/2067154385 learned_addr learned my addr 172.21.15.70:0/2067154385 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:03.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4e9bcd640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4e413e290 0x7ff4e40b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ea3ce640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e40cf7c0 0x7ff4e4070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 -- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e40cf7c0 msgr2=0x7ff4e4070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e40cf7c0 0x7ff4e4070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 -- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4e413e290 msgr2=0x7ff4e40b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4e413e290 0x7ff4e40b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 -- 172.21.15.70:0/2067154385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40094d0 con 0x7ff4e415f4e0 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4e9bcd640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4e413e290 0x7ff4e40b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4eabcf640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e415f4e0 0x7ff4e4137160 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc007df0 tx=0x7ff4dc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4daffd640 1 -- 172.21.15.70:0/2067154385 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0039a0 con 0x7ff4e415f4e0 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4daffd640 1 -- 172.21.15.70:0/2067154385 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc00f040 con 0x7ff4e415f4e0 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4daffd640 1 -- 172.21.15.70:0/2067154385 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc003d40 con 0x7ff4e415f4e0 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e4070ed0 con 0x7ff4e415f4e0 2023-11-26T07:24:03.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e4071490 con 0x7ff4e415f4e0 2023-11-26T07:24:03.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.627+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e4067680 con 0x7ff4e415f4e0 2023-11-26T07:24:03.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.631+0000 7ff4daffd640 1 -- 172.21.15.70:0/2067154385 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7ff4dc004030 con 0x7ff4e415f4e0 2023-11-26T07:24:03.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.631+0000 7ff4daffd640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4c8066f50 0x7ff4c8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.631+0000 7ff4daffd640 1 -- 172.21.15.70:0/2067154385 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff4dc082d10 con 0x7ff4e415f4e0 2023-11-26T07:24:03.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.631+0000 7ff4ea3ce640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4c8066f50 0x7ff4c8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.631+0000 7ff4ea3ce640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4c8066f50 0x7ff4c8069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c880 tx=0x7ff4e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.633 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.635+0000 7ff4daffd640 1 -- 172.21.15.70:0/2067154385 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4dc051980 con 0x7ff4e415f4e0 2023-11-26T07:24:03.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4e4071940 con 0x7ff4e415f4e0 2023-11-26T07:24:03.782 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4daffd640 1 -- 172.21.15.70:0/2067154385 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4dc01a0a0 con 0x7ff4e415f4e0 2023-11-26T07:24:03.782 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2023-11-26T07:24:03.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4c8066f50 msgr2=0x7ff4c8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4c8066f50 0x7ff4c8069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c880 tx=0x7ff4e0008040 comp rx=0 tx=0).stop 2023-11-26T07:24:03.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e415f4e0 msgr2=0x7ff4e4137160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e415f4e0 0x7ff4e4137160 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc007df0 tx=0x7ff4dc00d4a0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 shutdown_connections 2023-11-26T07:24:03.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4c8066f50 0x7ff4c8069410 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4e415f4e0 0x7ff4e4137160 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4e413e290 0x7ff4e40b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 --2- 172.21.15.70:0/2067154385 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4e40cf7c0 0x7ff4e4070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 >> 172.21.15.70:0/2067154385 conn(0x7ff4e406a890 msgr2=0x7ff4e4153120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 shutdown_connections 2023-11-26T07:24:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.783+0000 7ff4ec632640 1 -- 172.21.15.70:0/2067154385 wait complete. 2023-11-26T07:24:03.803 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-26T07:24:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.943+0000 7ff4cf09c640 1 Processor -- start 2023-11-26T07:24:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.943+0000 7ff4cf09c640 1 -- start start 2023-11-26T07:24:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cf09c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4c80ce7c0 0x7ff4c815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cf09c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c806c520 con 0x7ff4c80cf990 2023-11-26T07:24:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cf09c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c806c800 con 0x7ff4c813e290 2023-11-26T07:24:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cf09c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c806cae0 con 0x7ff4c80ce7c0 2023-11-26T07:24:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cd639640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4c80ce7c0 0x7ff4c815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4bffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff4c80cf990 0x7ff4c815efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58444/0 (socket says 172.21.15.70:58444) 2023-11-26T07:24:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cd639640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4c80ce7c0 0x7ff4c815f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54030/0 (socket says 172.21.15.70:54030) 2023-11-26T07:24:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4bffff640 1 -- 172.21.15.70:0/108394429 learned_addr learned my addr 172.21.15.70:0/108394429 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cd639640 1 -- 172.21.15.70:0/108394429 >> v1:172.21.15.120:6789/0 conn(0x7ff4c813e290 legacy=0x7ff4c80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cd639640 1 -- 172.21.15.70:0/108394429 >> v1:172.21.15.70:6789/0 conn(0x7ff4c80cf990 legacy=0x7ff4c815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4bf7fe640 1 -- 172.21.15.70:0/108394429 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552927813 0 0) 0x7ff4c806c520 con 0x7ff4c80cf990 2023-11-26T07:24:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.947+0000 7ff4cd639640 1 -- 172.21.15.70:0/108394429 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c806cdc0 con 0x7ff4c80ce7c0 2023-11-26T07:24:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cd639640 1 --2- 172.21.15.70:0/108394429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c80ce7c0 0x7ff4c815f6b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009d90 tx=0x7ff4c001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e192d00754f9a5a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4bf7fe640 1 -- 172.21.15.70:0/108394429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00a5970 con 0x7ff4c80ce7c0 2023-11-26T07:24:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4bf7fe640 1 -- 172.21.15.70:0/108394429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c00a5ad0 con 0x7ff4c80ce7c0 2023-11-26T07:24:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4bf7fe640 1 -- 172.21.15.70:0/108394429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00a5e60 con 0x7ff4c80ce7c0 2023-11-26T07:24:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 -- 172.21.15.70:0/108394429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c80ce7c0 msgr2=0x7ff4c815f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/108394429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c80ce7c0 0x7ff4c815f6b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009d90 tx=0x7ff4c001c890 comp rx=0 tx=0).stop 2023-11-26T07:24:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 -- 172.21.15.70:0/108394429 shutdown_connections 2023-11-26T07:24:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/108394429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c80ce7c0 0x7ff4c815f6b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 -- 172.21.15.70:0/108394429 >> 172.21.15.70:0/108394429 conn(0x7ff4c806a890 msgr2=0x7ff4c806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 -- 172.21.15.70:0/108394429 shutdown_connections 2023-11-26T07:24:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 -- 172.21.15.70:0/108394429 wait complete. 2023-11-26T07:24:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 Processor -- start 2023-11-26T07:24:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.951+0000 7ff4cf09c640 1 -- start start 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4c80ce7c0 0x7ff4c814e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4c80cf990 0x7ff4c814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c813e290 0x7ff4c8134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80b0010 con 0x7ff4c813e290 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c814c920 con 0x7ff4c80cf990 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8134da0 con 0x7ff4c80ce7c0 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c813e290 0x7ff4c8134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c813e290 0x7ff4c8134860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54036/0 (socket says 172.21.15.70:54036) 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 -- 172.21.15.70:0/3539576522 learned_addr learned my addr 172.21.15.70:0/3539576522 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4bffff640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4c80cf990 0x7ff4c814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cce38640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4c80ce7c0 0x7ff4c814e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 -- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4c80ce7c0 msgr2=0x7ff4c814e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4c80ce7c0 0x7ff4c814e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 -- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4c80cf990 msgr2=0x7ff4c814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4c80cf990 0x7ff4c814c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 -- 172.21.15.70:0/3539576522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0009a70 con 0x7ff4c813e290 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4bffff640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4c80cf990 0x7ff4c814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cd639640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c813e290 0x7ff4c8134860 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff4c001a4c0 tx=0x7ff4c0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4bd7fa640 1 -- 172.21.15.70:0/3539576522 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0003ba0 con 0x7ff4c813e290 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4bd7fa640 1 -- 172.21.15.70:0/3539576522 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0003d00 con 0x7ff4c813e290 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4bd7fa640 1 -- 172.21.15.70:0/3539576522 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0004230 con 0x7ff4c813e290 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c80b0260 con 0x7ff4c813e290 2023-11-26T07:24:03.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c80b0820 con 0x7ff4c813e290 2023-11-26T07:24:03.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c80b43f0 con 0x7ff4c813e290 2023-11-26T07:24:03.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.955+0000 7ff4bd7fa640 1 -- 172.21.15.70:0/3539576522 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7ff4c00b4050 con 0x7ff4c813e290 2023-11-26T07:24:03.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.959+0000 7ff4bd7fa640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4b4066f20 0x7ff4b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:03.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.959+0000 7ff4bd7fa640 1 -- 172.21.15.70:0/3539576522 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff4c011dd90 con 0x7ff4c813e290 2023-11-26T07:24:03.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.959+0000 7ff4cce38640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4b4066f20 0x7ff4b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:03.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.959+0000 7ff4cce38640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4b4066f20 0x7ff4b40693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4000f70 tx=0x7ff4c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:03.963+0000 7ff4bd7fa640 1 -- 172.21.15.70:0/3539576522 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4c00ecd20 con 0x7ff4c813e290 2023-11-26T07:24:04.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.115+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4c8138120 con 0x7ff4c813e290 2023-11-26T07:24:04.115 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.115+0000 7ff4bd7fa640 1 -- 172.21.15.70:0/3539576522 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4c00f0340 con 0x7ff4c813e290 2023-11-26T07:24:04.116 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4b4066f20 msgr2=0x7ff4b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4b4066f20 0x7ff4b40693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4000f70 tx=0x7ff4c4009040 comp rx=0 tx=0).stop 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c813e290 msgr2=0x7ff4c8134860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c813e290 0x7ff4c8134860 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff4c001a4c0 tx=0x7ff4c0019630 comp rx=0 tx=0).stop 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 shutdown_connections 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7ff4b4066f20 0x7ff4b40693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c813e290 0x7ff4c8134860 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff4c80cf990 0x7ff4c814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 --2- 172.21.15.70:0/3539576522 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7ff4c80ce7c0 0x7ff4c814e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 >> 172.21.15.70:0/3539576522 conn(0x7ff4c806a890 msgr2=0x7ff4c81553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.118 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 shutdown_connections 2023-11-26T07:24:04.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.119+0000 7ff4cf09c640 1 -- 172.21.15.70:0/3539576522 wait complete. 2023-11-26T07:24:04.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:04.275 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.275+0000 7fcdeda5a640 1 Processor -- start 2023-11-26T07:24:04.276 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.275+0000 7fcdeda5a640 1 -- start start 2023-11-26T07:24:04.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcdeda5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 0x7fcde8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcdeda5a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde80cc730 con 0x7fcde80708b0 2023-11-26T07:24:04.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcdeda5a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde8070ee0 con 0x7fcde80cf990 2023-11-26T07:24:04.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcdeda5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8143ea0 con 0x7fcde8143ac0 2023-11-26T07:24:04.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde67fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fcde80708b0 0x7fcde80cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58456/0 (socket says 172.21.15.70:58456) 2023-11-26T07:24:04.277 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde67fc640 1 -- 172.21.15.70:0/4141326623 learned_addr learned my addr 172.21.15.70:0/4141326623 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:04.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799936226 0 0) 0x7fcde80cc730 con 0x7fcde80708b0 2023-11-26T07:24:04.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdd0003530 con 0x7fcde80708b0 2023-11-26T07:24:04.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 0x7fcde8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201928087 0 0) 0x7fcdd0003530 con 0x7fcde80708b0 2023-11-26T07:24:04.279 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 msgr2=0x7fcde8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 0x7fcde8070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 >> v1:172.21.15.120:6789/0 conn(0x7fcde80cf990 legacy=0x7fcde80cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde80711c0 con 0x7fcde80708b0 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7fcddc0016a0 con 0x7fcde80708b0 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 >> v1:172.21.15.70:6789/0 conn(0x7fcde80708b0 legacy=0x7fcde80cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd00039b0 0x7fcdd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 0x7fcdd00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdd0004d10 0x7fcdd0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.280 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd000ba40 con 0x7fcdd00039b0 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd000bbb0 con 0x7fcdd0004d10 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd000bd70 con 0x7fcde8143ac0 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd00039b0 0x7fcdd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde67fc640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 0x7fcdd00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde77fe640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdd0004d10 0x7fcdd0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde6ffd640 1 -- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 msgr2=0x7fcdd00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcde8143ac0 0x7fcdd00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde6ffd640 1 -- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdd0004d10 msgr2=0x7fcdd0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdd0004d10 0x7fcdd0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.281 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.279+0000 7fcde6ffd640 1 -- 172.21.15.70:0/4141326623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0003530 con 0x7fcdd00039b0 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd00039b0 0x7fcdd0003dd0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009ab0 tx=0x7fcdd801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502a393a477ed33d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80a5510 con 0x7fcdd00039b0 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd80a5670 con 0x7fcdd00039b0 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcde5ffb640 1 -- 172.21.15.70:0/4141326623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80a5a20 con 0x7fcdd00039b0 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 -- 172.21.15.70:0/4141326623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd00039b0 msgr2=0x7fcdd0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 --2- 172.21.15.70:0/4141326623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcdd00039b0 0x7fcdd0003dd0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009ab0 tx=0x7fcdd801ca30 comp rx=0 tx=0).stop 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcde77fe640 1 -- 172.21.15.70:0/4141326623 reap_dead start 2023-11-26T07:24:04.283 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 -- 172.21.15.70:0/4141326623 shutdown_connections 2023-11-26T07:24:04.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 -- 172.21.15.70:0/4141326623 >> 172.21.15.70:0/4141326623 conn(0x7fcde806a890 msgr2=0x7fcde806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 -- 172.21.15.70:0/4141326623 shutdown_connections 2023-11-26T07:24:04.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 -- 172.21.15.70:0/4141326623 wait complete. 2023-11-26T07:24:04.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 Processor -- start 2023-11-26T07:24:04.284 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.283+0000 7fcdeda5a640 1 -- start start 2023-11-26T07:24:04.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcdd00039b0 0x7fcde80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde80b03d0 0x7fcde80caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcde813c830 0x7fcde8157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80cb4a0 con 0x7fcde80b03d0 2023-11-26T07:24:04.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80cb6b0 con 0x7fcde813c830 2023-11-26T07:24:04.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80af610 con 0x7fcdd00039b0 2023-11-26T07:24:04.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde80b03d0 0x7fcde80caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde80b03d0 0x7fcde80caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54056/0 (socket says 172.21.15.70:54056) 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 -- 172.21.15.70:0/2715198051 learned_addr learned my addr 172.21.15.70:0/2715198051 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcdd00039b0 0x7fcde80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde77fe640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcde813c830 0x7fcde8157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 -- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcdd00039b0 msgr2=0x7fcde80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcdd00039b0 0x7fcde80b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 -- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcde813c830 msgr2=0x7fcde8157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcde813c830 0x7fcde8157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 -- 172.21.15.70:0/2715198051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde80af8f0 con 0x7fcde80b03d0 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde77fe640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcde813c830 0x7fcde8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcde67fc640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde80b03d0 0x7fcde80caf60 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00e7b0 tx=0x7fcddc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdcffff640 1 -- 172.21.15.70:0/2715198051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00c870 con 0x7fcde80b03d0 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdcffff640 1 -- 172.21.15.70:0/2715198051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc00c9f0 con 0x7fcde80b03d0 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdcffff640 1 -- 172.21.15.70:0/2715198051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00cda0 con 0x7fcde80b03d0 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde80afbd0 con 0x7fcde80b03d0 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde813ccb0 con 0x7fcde80b03d0 2023-11-26T07:24:04.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde8067680 con 0x7fcde80b03d0 2023-11-26T07:24:04.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.287+0000 7fcdcffff640 1 -- 172.21.15.70:0/2715198051 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fcddc01d460 con 0x7fcde80b03d0 2023-11-26T07:24:04.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.291+0000 7fcdcffff640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcdd4066f20 0x7fcdd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.291+0000 7fcdcffff640 1 -- 172.21.15.70:0/2715198051 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcddc082800 con 0x7fcde80b03d0 2023-11-26T07:24:04.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.291+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcdd4066f20 0x7fcdd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.291+0000 7fcde6ffd640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcdd4066f20 0x7fcdd40693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80af000 tx=0x7fcdd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.295+0000 7fcdcffff640 1 -- 172.21.15.70:0/2715198051 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcddc051790 con 0x7fcde80b03d0 2023-11-26T07:24:04.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.475+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcde80af750 con 0x7fcde80b03d0 2023-11-26T07:24:04.475 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.475+0000 7fcdcffff640 1 -- 172.21.15.70:0/2715198051 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fcde80af750 con 0x7fcde80b03d0 2023-11-26T07:24:04.476 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:04.476 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/162502503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":162502503},{"type":"v1","addr":"172.21.15.120:6835","nonce":162502503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3659422844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3659422844},{"type":"v1","addr":"172.21.15.70:6835","nonce":3659422844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2807806185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2807806185},{"type":"v1","addr":"172.21.15.70:6837","nonce":2807806185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:08.403306+0000","modified":"2023-11-26T07:23:11.434465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6834/2083039818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2083039818},{"type":"v1","addr":"172.21.15.120:6834","nonce":2083039818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:04.476 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 48 2023-11-26T07:24:04.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcdd4066f20 msgr2=0x7fcdd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcdd4066f20 0x7fcdd40693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80af000 tx=0x7fcdd8008040 comp rx=0 tx=0).stop 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde80b03d0 msgr2=0x7fcde80caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde80b03d0 0x7fcde80caf60 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00e7b0 tx=0x7fcddc00ec70 comp rx=0 tx=0).stop 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 shutdown_connections 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fcdd4066f20 0x7fcdd40693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcde80b03d0 0x7fcde80caf60 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcde813c830 0x7fcde8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 --2- 172.21.15.70:0/2715198051 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fcdd00039b0 0x7fcde80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 >> 172.21.15.70:0/2715198051 conn(0x7fcde806a890 msgr2=0x7fcde806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 shutdown_connections 2023-11-26T07:24:04.478 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.479+0000 7fcdeda5a640 1 -- 172.21.15.70:0/2715198051 wait complete. 2023-11-26T07:24:04.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e2dfdf640 1 Processor -- start 2023-11-26T07:24:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e2dfdf640 1 -- start start 2023-11-26T07:24:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e2dfdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e2815d6e0 0x7f3e280d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e2dfdf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e280d1bc0 0x7f3e280b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e2dfdf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e280cf0e0 con 0x7f3e280b2160 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e2dfdf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2815dac0 con 0x7f3e280d1bc0 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e2dfdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280ceb20 con 0x7f3e2815d6e0 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e27fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e280d1bc0 0x7f3e280b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e1ffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3e280b2160 0x7f3e280d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58458/0 (socket says 172.21.15.70:58458) 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e1ffff640 1 -- 172.21.15.70:0/3986026023 learned_addr learned my addr 172.21.15.70:0/3986026023 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e277fe640 1 --2- 172.21.15.70:0/3986026023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e2815d6e0 0x7f3e280d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e26ffd640 1 -- 172.21.15.70:0/3986026023 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352532072 0 0) 0x7f3e280cf0e0 con 0x7f3e280b2160 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e26ffd640 1 -- 172.21.15.70:0/3986026023 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e14003530 con 0x7f3e280b2160 2023-11-26T07:24:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e27fff640 1 -- 172.21.15.70:0/3986026023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e2815d6e0 msgr2=0x7f3e280d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e27fff640 1 --2- 172.21.15.70:0/3986026023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e2815d6e0 0x7f3e280d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e27fff640 1 -- 172.21.15.70:0/3986026023 >> v1:172.21.15.70:6789/0 conn(0x7f3e280b2160 legacy=0x7f3e280d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.635+0000 7f3e27fff640 1 -- 172.21.15.70:0/3986026023 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280cee00 con 0x7f3e280d1bc0 2023-11-26T07:24:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e27fff640 1 --2- 172.21.15.70:0/3986026023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e280b0750 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009d90 tx=0x7f3e2001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b8f9018ee6761d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e26ffd640 1 -- 172.21.15.70:0/3986026023 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200a5900 con 0x7f3e280d1bc0 2023-11-26T07:24:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e26ffd640 1 -- 172.21.15.70:0/3986026023 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e200a5a60 con 0x7f3e280d1bc0 2023-11-26T07:24:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e26ffd640 1 -- 172.21.15.70:0/3986026023 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200a5df0 con 0x7f3e280d1bc0 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/3986026023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 msgr2=0x7f3e280b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/3986026023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e280b0750 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009d90 tx=0x7f3e2001c950 comp rx=0 tx=0).stop 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/3986026023 shutdown_connections 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/3986026023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e280b0750 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/3986026023 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e2815d6e0 0x7f3e280d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/3986026023 >> 172.21.15.70:0/3986026023 conn(0x7f3e2809c550 msgr2=0x7f3e280d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/3986026023 shutdown_connections 2023-11-26T07:24:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.639+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/3986026023 wait complete. 2023-11-26T07:24:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 Processor -- start 2023-11-26T07:24:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 -- start start 2023-11-26T07:24:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e280b2160 0x7f3e28151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e2806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e2815d6e0 0x7f3e28160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28151210 con 0x7f3e280d1bc0 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280c99b0 con 0x7f3e2815d6e0 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28151460 con 0x7f3e280b2160 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e2806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e2806bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54078/0 (socket says 172.21.15.70:54078) 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 -- 172.21.15.70:0/4141258965 learned_addr learned my addr 172.21.15.70:0/4141258965 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e277fe640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e280b2160 0x7f3e28151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e27fff640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e2815d6e0 0x7f3e28160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 -- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e280b2160 msgr2=0x7f3e28151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e280b2160 0x7f3e28151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 -- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e2815d6e0 msgr2=0x7f3e28160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e2815d6e0 0x7f3e28160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 -- 172.21.15.70:0/4141258965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20009a70 con 0x7f3e280d1bc0 2023-11-26T07:24:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e27fff640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e2815d6e0 0x7f3e28160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e1ffff640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e2806bad0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c4d0 tx=0x7f3e1000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e24ff9640 1 -- 172.21.15.70:0/4141258965 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10005cf0 con 0x7f3e280d1bc0 2023-11-26T07:24:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e24ff9640 1 -- 172.21.15.70:0/4141258965 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10005e50 con 0x7f3e280d1bc0 2023-11-26T07:24:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e24ff9640 1 -- 172.21.15.70:0/4141258965 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10007270 con 0x7f3e280d1bc0 2023-11-26T07:24:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e28151740 con 0x7f3e280d1bc0 2023-11-26T07:24:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.643+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e28152480 con 0x7f3e280d1bc0 2023-11-26T07:24:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.647+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e28151c60 con 0x7f3e280d1bc0 2023-11-26T07:24:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.647+0000 7f3e24ff9640 1 -- 172.21.15.70:0/4141258965 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f3e100073d0 con 0x7f3e280d1bc0 2023-11-26T07:24:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.647+0000 7f3e24ff9640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e08066f20 0x7f3e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.647+0000 7f3e24ff9640 1 -- 172.21.15.70:0/4141258965 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3e10081f80 con 0x7f3e280d1bc0 2023-11-26T07:24:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.647+0000 7f3e277fe640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e08066f20 0x7f3e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.647+0000 7f3e277fe640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e08066f20 0x7f3e080693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009a50 tx=0x7f3e18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.651+0000 7f3e24ff9640 1 -- 172.21.15.70:0/4141258965 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e28151c60 con 0x7f3e280d1bc0 2023-11-26T07:24:04.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.803+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e28151c60 con 0x7f3e280d1bc0 2023-11-26T07:24:04.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.803+0000 7f3e24ff9640 1 -- 172.21.15.70:0/4141258965 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16666 (secure 0 0 0) 0x7f3e28151c60 con 0x7f3e280d1bc0 2023-11-26T07:24:04.804 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:04.805 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":80,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:46.861938+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:04.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e08066f20 msgr2=0x7f3e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e08066f20 0x7f3e080693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3e18009a50 tx=0x7f3e18008040 comp rx=0 tx=0).stop 2023-11-26T07:24:04.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 msgr2=0x7f3e2806bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e2806bad0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c4d0 tx=0x7f3e1000c990 comp rx=0 tx=0).stop 2023-11-26T07:24:04.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 shutdown_connections 2023-11-26T07:24:04.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3e08066f20 0x7f3e080693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e280d1bc0 0x7f3e2806bad0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e2815d6e0 0x7f3e28160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 --2- 172.21.15.70:0/4141258965 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f3e280b2160 0x7f3e28151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 >> 172.21.15.70:0/4141258965 conn(0x7f3e2809c550 msgr2=0x7f3e280b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 shutdown_connections 2023-11-26T07:24:04.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.807+0000 7f3e2dfdf640 1 -- 172.21.15.70:0/4141258965 wait complete. 2023-11-26T07:24:04.826 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:24:04.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:04.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.967+0000 7fd63fd94640 1 Processor -- start 2023-11-26T07:24:04.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.967+0000 7fd63fd94640 1 -- start start 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63fd94640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd638143ac0 0x7fd638070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63fd94640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd6380cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63fd94640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd6380cf7c0 0x7fd6380b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63fd94640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd638143ea0 con 0x7fd6380cf7c0 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63fd94640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380cfbf0 con 0x7fd638143ac0 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63fd94640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380cc730 con 0x7fd6380708b0 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd6380cf7c0 0x7fd6380b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd6380cf7c0 0x7fd6380b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54088/0 (socket says 172.21.15.70:54088) 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 -- 172.21.15.70:0/658911400 learned_addr learned my addr 172.21.15.70:0/658911400 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63db30640 1 --2- 172.21.15.70:0/658911400 >> v2:172.21.15.120:3300/0 conn(0x7fd638143ac0 0x7fd638070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.970 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63d32f640 1 --2- 172.21.15.70:0/658911400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd6380cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 -- 172.21.15.70:0/658911400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 msgr2=0x7fd6380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 --2- 172.21.15.70:0/658911400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd6380cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 -- 172.21.15.70:0/658911400 >> v2:172.21.15.120:3300/0 conn(0x7fd638143ac0 msgr2=0x7fd638070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 --2- 172.21.15.70:0/658911400 >> v2:172.21.15.120:3300/0 conn(0x7fd638143ac0 0x7fd638070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63e331640 1 -- 172.21.15.70:0/658911400 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638070ee0 con 0x7fd6380cf7c0 2023-11-26T07:24:04.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.971+0000 7fd63d32f640 1 --2- 172.21.15.70:0/658911400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd6380cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:04.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63e331640 1 --2- 172.21.15.70:0/658911400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd6380b1ef0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd63806dca0 tx=0x7fd63001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac226ff26140315b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63cb2e640 1 -- 172.21.15.70:0/658911400 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300a64b0 con 0x7fd6380cf7c0 2023-11-26T07:24:04.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63cb2e640 1 -- 172.21.15.70:0/658911400 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6300a6610 con 0x7fd6380cf7c0 2023-11-26T07:24:04.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63cb2e640 1 -- 172.21.15.70:0/658911400 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300a69a0 con 0x7fd6380cf7c0 2023-11-26T07:24:04.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 -- 172.21.15.70:0/658911400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 msgr2=0x7fd6380b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 --2- 172.21.15.70:0/658911400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd6380b1ef0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd63806dca0 tx=0x7fd63001c710 comp rx=0 tx=0).stop 2023-11-26T07:24:04.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 -- 172.21.15.70:0/658911400 shutdown_connections 2023-11-26T07:24:04.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 --2- 172.21.15.70:0/658911400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd6380b1ef0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 --2- 172.21.15.70:0/658911400 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd6380cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 --2- 172.21.15.70:0/658911400 >> v2:172.21.15.120:3300/0 conn(0x7fd638143ac0 0x7fd638070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 -- 172.21.15.70:0/658911400 >> 172.21.15.70:0/658911400 conn(0x7fd63806a890 msgr2=0x7fd63806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:04.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 -- 172.21.15.70:0/658911400 shutdown_connections 2023-11-26T07:24:04.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 -- 172.21.15.70:0/658911400 wait complete. 2023-11-26T07:24:04.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 Processor -- start 2023-11-26T07:24:04.976 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.975+0000 7fd63fd94640 1 -- start start 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd63815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd638155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd638143ac0 0x7fd6381402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381373a0 con 0x7fd6380cf7c0 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd638137680 con 0x7fd638143ac0 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd638137960 con 0x7fd6380708b0 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd638155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd638155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54102/0 (socket says 172.21.15.70:54102) 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 -- 172.21.15.70:0/4116626961 learned_addr learned my addr 172.21.15.70:0/4116626961 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63db30640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd63815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63e331640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd638143ac0 0x7fd6381402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 -- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 msgr2=0x7fd63815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd63815cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 -- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd638143ac0 msgr2=0x7fd6381402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:04.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd638143ac0 0x7fd6381402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:04.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 -- 172.21.15.70:0/4116626961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630009b30 con 0x7fd6380cf7c0 2023-11-26T07:24:04.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63d32f640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd638155ac0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd62800e810 tx=0x7fd62800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd62e7fc640 1 -- 172.21.15.70:0/4116626961 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628004030 con 0x7fd6380cf7c0 2023-11-26T07:24:04.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd62e7fc640 1 -- 172.21.15.70:0/4116626961 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd628004190 con 0x7fd6380cf7c0 2023-11-26T07:24:04.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd62e7fc640 1 -- 172.21.15.70:0/4116626961 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628004520 con 0x7fd6380cf7c0 2023-11-26T07:24:04.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd638137c40 con 0x7fd6380cf7c0 2023-11-26T07:24:04.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd638137020 con 0x7fd6380cf7c0 2023-11-26T07:24:04.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.979+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd638067680 con 0x7fd6380cf7c0 2023-11-26T07:24:04.980 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.983+0000 7fd62e7fc640 1 -- 172.21.15.70:0/4116626961 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fd62800c6d0 con 0x7fd6380cf7c0 2023-11-26T07:24:04.981 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.983+0000 7fd62e7fc640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd61c066f20 0x7fd61c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:04.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.983+0000 7fd62e7fc640 1 -- 172.21.15.70:0/4116626961 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6280822f0 con 0x7fd6380cf7c0 2023-11-26T07:24:04.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.983+0000 7fd63db30640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd61c066f20 0x7fd61c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:04.982 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.983+0000 7fd63db30640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd61c066f20 0x7fd61c0693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd634009ac0 tx=0x7fd634009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:04.985 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:04.987+0000 7fd62e7fc640 1 -- 172.21.15.70:0/4116626961 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd628051270 con 0x7fd6380cf7c0 2023-11-26T07:24:05.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.167+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd638072710 con 0x7fd6380cf7c0 2023-11-26T07:24:05.167 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.167+0000 7fd62e7fc640 1 -- 172.21.15.70:0/4116626961 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fd628054890 con 0x7fd6380cf7c0 2023-11-26T07:24:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:05.168 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/162502503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":162502503},{"type":"v1","addr":"172.21.15.120:6835","nonce":162502503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3659422844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3659422844},{"type":"v1","addr":"172.21.15.70:6835","nonce":3659422844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2807806185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2807806185},{"type":"v1","addr":"172.21.15.70:6837","nonce":2807806185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:08.403306+0000","modified":"2023-11-26T07:23:11.434465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6834/2083039818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2083039818},{"type":"v1","addr":"172.21.15.120:6834","nonce":2083039818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:05.168 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 48 2023-11-26T07:24:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd61c066f20 msgr2=0x7fd61c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd61c066f20 0x7fd61c0693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd634009ac0 tx=0x7fd634009190 comp rx=0 tx=0).stop 2023-11-26T07:24:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 msgr2=0x7fd638155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd638155ac0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd62800e810 tx=0x7fd62800ecd0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 shutdown_connections 2023-11-26T07:24:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fd61c066f20 0x7fd61c0693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.170 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6380cf7c0 0x7fd638155ac0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd638143ac0 0x7fd6381402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 --2- 172.21.15.70:0/4116626961 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fd6380708b0 0x7fd63815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 >> 172.21.15.70:0/4116626961 conn(0x7fd63806a890 msgr2=0x7fd6380ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 shutdown_connections 2023-11-26T07:24:05.171 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.171+0000 7fd63fd94640 1 -- 172.21.15.70:0/4116626961 wait complete. 2023-11-26T07:24:05.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:05.326 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 Processor -- start 2023-11-26T07:24:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 -- start start 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f88c0143ac0 0x7f88c0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00708b0 0x7f88c00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f88c00cf7c0 0x7f88c00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c0143ea0 con 0x7f88c0143ac0 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c00cfbf0 con 0x7f88c00cf7c0 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.327+0000 7f88c772a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00cc730 con 0x7f88c00708b0 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f88c0143ac0 0x7f88c0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f88c0143ac0 0x7f88c0070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54108/0 (socket says 172.21.15.70:54108) 2023-11-26T07:24:05.329 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 -- 172.21.15.70:0/4022245103 learned_addr learned my addr 172.21.15.70:0/4022245103 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c5cc7640 1 --2- 172.21.15.70:0/4022245103 >> v2:172.21.15.120:3300/0 conn(0x7f88c00cf7c0 0x7f88c00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c4cc5640 1 --2- 172.21.15.70:0/4022245103 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00708b0 0x7f88c00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 -- 172.21.15.70:0/4022245103 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00708b0 msgr2=0x7f88c00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 --2- 172.21.15.70:0/4022245103 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00708b0 0x7f88c00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 -- 172.21.15.70:0/4022245103 >> v2:172.21.15.120:3300/0 conn(0x7f88c00cf7c0 msgr2=0x7f88c00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 --2- 172.21.15.70:0/4022245103 >> v2:172.21.15.120:3300/0 conn(0x7f88c00cf7c0 0x7f88c00b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 -- 172.21.15.70:0/4022245103 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c0070ee0 con 0x7f88c0143ac0 2023-11-26T07:24:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88c54c6640 1 --2- 172.21.15.70:0/4022245103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c0143ac0 0x7f88c0070370 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f88c00718d0 tx=0x7f88bc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c37dcb95e4b6d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88b7fff640 1 -- 172.21.15.70:0/4022245103 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc0ab600 con 0x7f88c0143ac0 2023-11-26T07:24:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88b7fff640 1 -- 172.21.15.70:0/4022245103 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc0a7050 con 0x7f88c0143ac0 2023-11-26T07:24:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.331+0000 7f88b7fff640 1 -- 172.21.15.70:0/4022245103 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc0ab980 con 0x7f88c0143ac0 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- 172.21.15.70:0/4022245103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c0143ac0 msgr2=0x7f88c0070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 --2- 172.21.15.70:0/4022245103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c0143ac0 0x7f88c0070370 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f88c00718d0 tx=0x7f88bc01c240 comp rx=0 tx=0).stop 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- 172.21.15.70:0/4022245103 shutdown_connections 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 --2- 172.21.15.70:0/4022245103 >> v2:172.21.15.120:3300/0 conn(0x7f88c00cf7c0 0x7f88c00b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 --2- 172.21.15.70:0/4022245103 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00708b0 0x7f88c00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 --2- 172.21.15.70:0/4022245103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c0143ac0 0x7f88c0070370 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- 172.21.15.70:0/4022245103 >> 172.21.15.70:0/4022245103 conn(0x7f88c006a890 msgr2=0x7f88c006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- 172.21.15.70:0/4022245103 shutdown_connections 2023-11-26T07:24:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- 172.21.15.70:0/4022245103 wait complete. 2023-11-26T07:24:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 Processor -- start 2023-11-26T07:24:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- start start 2023-11-26T07:24:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c00708b0 0x7f88c0141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00cf7c0 0x7f88c00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88c0143ac0 0x7f88c0159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0158ff0 con 0x7f88c00708b0 2023-11-26T07:24:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c01406a0 con 0x7f88c0143ac0 2023-11-26T07:24:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c772a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0140980 con 0x7f88c00cf7c0 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c00708b0 0x7f88c0141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c00708b0 0x7f88c0141740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54118/0 (socket says 172.21.15.70:54118) 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 -- 172.21.15.70:0/1525727768 learned_addr learned my addr 172.21.15.70:0/1525727768 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c4cc5640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00cf7c0 0x7f88c00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c5cc7640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88c0143ac0 0x7f88c0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 -- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00cf7c0 msgr2=0x7f88c00aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00cf7c0 0x7f88c00aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 -- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88c0143ac0 msgr2=0x7f88c0159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88c0143ac0 0x7f88c0159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c54c6640 1 -- 172.21.15.70:0/1525727768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc0094d0 con 0x7f88c00708b0 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.335+0000 7f88c5cc7640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88c0143ac0 0x7f88c0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:05.337 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88c54c6640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c00708b0 0x7f88c0141740 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0ae040 tx=0x7f88bc018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.338 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88b5ffb640 1 -- 172.21.15.70:0/1525727768 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc0b4440 con 0x7f88c00708b0 2023-11-26T07:24:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88b5ffb640 1 -- 172.21.15.70:0/1525727768 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc0b45c0 con 0x7f88c00708b0 2023-11-26T07:24:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c0140c60 con 0x7f88c00708b0 2023-11-26T07:24:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88b5ffb640 1 -- 172.21.15.70:0/1525727768 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc0b4970 con 0x7f88c00708b0 2023-11-26T07:24:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c0141220 con 0x7f88c00708b0 2023-11-26T07:24:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c0067680 con 0x7f88c00708b0 2023-11-26T07:24:05.339 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88b5ffb640 1 -- 172.21.15.70:0/1525727768 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f88bc0b2070 con 0x7f88c00708b0 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88b5ffb640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88a4066f20 0x7f88a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88b5ffb640 1 -- 172.21.15.70:0/1525727768 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f88bc11c6e0 con 0x7f88c00708b0 2023-11-26T07:24:05.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.339+0000 7f88c4cc5640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88a4066f20 0x7f88a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.341 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.343+0000 7f88c4cc5640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88a4066f20 0x7f88a40693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f88c006b300 tx=0x7f88b0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.343+0000 7f88b5ffb640 1 -- 172.21.15.70:0/1525727768 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88bc0eb4a0 con 0x7f88c00708b0 2023-11-26T07:24:05.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c015d480 con 0x7f88c00708b0 2023-11-26T07:24:05.530 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88b5ffb640 1 -- 172.21.15.70:0/1525727768 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f88bc0b0090 con 0x7f88c00708b0 2023-11-26T07:24:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:05.530 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/162502503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":162502503},{"type":"v1","addr":"172.21.15.120:6835","nonce":162502503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3659422844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3659422844},{"type":"v1","addr":"172.21.15.70:6835","nonce":3659422844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2807806185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2807806185},{"type":"v1","addr":"172.21.15.70:6837","nonce":2807806185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-26T07:23:08.403306+0000","modified":"2023-11-26T07:23:11.434465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6870},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6870":{"gid":6870,"name":"d","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6834/2083039818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2083039818},{"type":"v1","addr":"172.21.15.120:6834","nonce":2083039818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-26T07:24:05.530 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 48 2023-11-26T07:24:05.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88a4066f20 msgr2=0x7f88a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88a4066f20 0x7f88a40693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f88c006b300 tx=0x7f88b0009190 comp rx=0 tx=0).stop 2023-11-26T07:24:05.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c00708b0 msgr2=0x7f88c0141740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.532 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c00708b0 0x7f88c0141740 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0ae040 tx=0x7f88bc018fe0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 shutdown_connections 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f88c0143ac0 0x7f88c0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f88c00cf7c0 0x7f88c00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f88a4066f20 0x7f88a40693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 --2- 172.21.15.70:0/1525727768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88c00708b0 0x7f88c0141740 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 >> 172.21.15.70:0/1525727768 conn(0x7f88c006a890 msgr2=0x7f88c00ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 shutdown_connections 2023-11-26T07:24:05.533 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.531+0000 7f88c772a640 1 -- 172.21.15.70:0/1525727768 wait complete. 2023-11-26T07:24:05.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:05.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72acc32640 1 Processor -- start 2023-11-26T07:24:05.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72acc32640 1 -- start start 2023-11-26T07:24:05.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72acc32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a815d6e0 0x7f72a80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72acc32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f72a80d1bc0 0x7f72a80b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72acc32640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a80cf0e0 con 0x7f72a80b2160 2023-11-26T07:24:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72acc32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a815dac0 con 0x7f72a80d1bc0 2023-11-26T07:24:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72acc32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80ceb20 con 0x7f72a815d6e0 2023-11-26T07:24:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a6d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f72a80d1bc0 0x7f72a80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a5d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f72a80b2160 0x7f72a80d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58468/0 (socket says 172.21.15.70:58468) 2023-11-26T07:24:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a5d9b640 1 -- 172.21.15.70:0/939627315 learned_addr learned my addr 172.21.15.70:0/939627315 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:05.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a6d9d640 1 -- 172.21.15.70:0/939627315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a815d6e0 msgr2=0x7f72a80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a6d9d640 1 --2- 172.21.15.70:0/939627315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a815d6e0 0x7f72a80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a6d9d640 1 -- 172.21.15.70:0/939627315 >> v1:172.21.15.70:6789/0 conn(0x7f72a80b2160 legacy=0x7f72a80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a559a640 1 -- 172.21.15.70:0/939627315 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515563572 0 0) 0x7f72a80cf0e0 con 0x7f72a80b2160 2023-11-26T07:24:05.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.691+0000 7f72a6d9d640 1 -- 172.21.15.70:0/939627315 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a80cee00 con 0x7f72a80d1bc0 2023-11-26T07:24:05.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72a6d9d640 1 --2- 172.21.15.70:0/939627315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80d1bc0 0x7f72a80b0750 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009d90 tx=0x7f72a001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895278b6e59ee24d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72a559a640 1 -- 172.21.15.70:0/939627315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00a5900 con 0x7f72a80d1bc0 2023-11-26T07:24:05.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72a559a640 1 -- 172.21.15.70:0/939627315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a00a5a60 con 0x7f72a80d1bc0 2023-11-26T07:24:05.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72a559a640 1 -- 172.21.15.70:0/939627315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00a5df0 con 0x7f72a80d1bc0 2023-11-26T07:24:05.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 -- 172.21.15.70:0/939627315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80d1bc0 msgr2=0x7f72a80b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 --2- 172.21.15.70:0/939627315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80d1bc0 0x7f72a80b0750 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009d90 tx=0x7f72a001c950 comp rx=0 tx=0).stop 2023-11-26T07:24:05.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 -- 172.21.15.70:0/939627315 shutdown_connections 2023-11-26T07:24:05.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 --2- 172.21.15.70:0/939627315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80d1bc0 0x7f72a80b0750 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 --2- 172.21.15.70:0/939627315 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a815d6e0 0x7f72a80d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 -- 172.21.15.70:0/939627315 >> 172.21.15.70:0/939627315 conn(0x7f72a809c550 msgr2=0x7f72a80d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 -- 172.21.15.70:0/939627315 shutdown_connections 2023-11-26T07:24:05.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.695+0000 7f72acc32640 1 -- 172.21.15.70:0/939627315 wait complete. 2023-11-26T07:24:05.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 Processor -- start 2023-11-26T07:24:05.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 -- start start 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80b2160 0x7f72a80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a80d1bc0 0x7f72a80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a815d6e0 0x7f72a815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80b6170 con 0x7f72a80b2160 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81552c0 con 0x7f72a815d6e0 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80b8320 con 0x7f72a80d1bc0 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80b2160 0x7f72a80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80b2160 0x7f72a80b8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54124/0 (socket says 172.21.15.70:54124) 2023-11-26T07:24:05.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 -- 172.21.15.70:0/678180427 learned_addr learned my addr 172.21.15.70:0/678180427 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 -- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a80d1bc0 msgr2=0x7f72a80b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a80d1bc0 0x7f72a80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 -- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a815d6e0 msgr2=0x7f72a815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a6d9d640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a815d6e0 0x7f72a815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a815d6e0 0x7f72a815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 -- 172.21.15.70:0/678180427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009a70 con 0x7f72a80b2160 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a6d9d640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a815d6e0 0x7f72a815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72a659c640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80b2160 0x7f72a80b8b20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f729800b410 tx=0x7f729800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f7296ffd640 1 -- 172.21.15.70:0/678180427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011830 con 0x7f72a80b2160 2023-11-26T07:24:05.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f7296ffd640 1 -- 172.21.15.70:0/678180427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298011990 con 0x7f72a80b2160 2023-11-26T07:24:05.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f7296ffd640 1 -- 172.21.15.70:0/678180427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011d40 con 0x7f72a80b2160 2023-11-26T07:24:05.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a80b8600 con 0x7f72a80b2160 2023-11-26T07:24:05.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a80b3b60 con 0x7f72a80b2160 2023-11-26T07:24:05.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.699+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a8067680 con 0x7f72a80b2160 2023-11-26T07:24:05.701 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.703+0000 7f7296ffd640 1 -- 172.21.15.70:0/678180427 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f729801a400 con 0x7f72a80b2160 2023-11-26T07:24:05.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.703+0000 7f7296ffd640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7288066f20 0x7f72880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:05.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.703+0000 7f7296ffd640 1 -- 172.21.15.70:0/678180427 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7298082990 con 0x7f72a80b2160 2023-11-26T07:24:05.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.703+0000 7f72a5d9b640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7288066f20 0x7f72880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:05.703 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.703+0000 7f72a5d9b640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7288066f20 0x7f72880693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f729c0011f0 tx=0x7f729c007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:05.706 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.707+0000 7f7296ffd640 1 -- 172.21.15.70:0/678180427 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72980518a0 con 0x7f72a80b2160 2023-11-26T07:24:05.858 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.859+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72a8155480 con 0x7f72a80b2160 2023-11-26T07:24:05.859 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.859+0000 7f7296ffd640 1 -- 172.21.15.70:0/678180427 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16666 (secure 0 0 0) 0x7f7298054ec0 con 0x7f72a80b2160 2023-11-26T07:24:05.860 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:05.860 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":80,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:23:46.861938+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-11-26T07:23:06.615543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-11-26T07:23:07.401685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7288066f20 msgr2=0x7f72880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7288066f20 0x7f72880693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f729c0011f0 tx=0x7f729c007930 comp rx=0 tx=0).stop 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80b2160 msgr2=0x7f72a80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80b2160 0x7f72a80b8b20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f729800b410 tx=0x7f729800b8d0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 shutdown_connections 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72a815d6e0 0x7f72a815dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f72a80d1bc0 0x7f72a80b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.862 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7288066f20 0x7f72880693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 --2- 172.21.15.70:0/678180427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a80b2160 0x7f72a80b8b20 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:05.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 >> 172.21.15.70:0/678180427 conn(0x7f72a809c550 msgr2=0x7f72a8159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:05.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 shutdown_connections 2023-11-26T07:24:05.863 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:05.863+0000 7f72acc32640 1 -- 172.21.15.70:0/678180427 wait complete. 2023-11-26T07:24:05.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-26T07:24:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.019+0000 7f1808194640 1 Processor -- start 2023-11-26T07:24:06.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.019+0000 7f1808194640 1 -- start start 2023-11-26T07:24:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1808194640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f180015d6e0 0x7f18000d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1808194640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000b2160 0x7f18000d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1808194640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000cf0e0 con 0x7f18000d19f0 2023-11-26T07:24:06.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1808194640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180015dac0 con 0x7f180015d6e0 2023-11-26T07:24:06.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1808194640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000d1e80 con 0x7f18000b2160 2023-11-26T07:24:06.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f180572f640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000b2160 0x7f18000d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1805f30640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f180015d6e0 0x7f18000d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1806731640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f18000d19f0 0x7f18000cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:36476/0 (socket says 172.21.15.70:36476) 2023-11-26T07:24:06.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f1806731640 1 -- 172.21.15.70:0/3871443287 learned_addr learned my addr 172.21.15.70:0/3871443287 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:06.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f180572f640 1 -- 172.21.15.70:0/3871443287 >> v2:172.21.15.120:3300/0 conn(0x7f180015d6e0 msgr2=0x7f18000d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:06.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f180572f640 1 --2- 172.21.15.70:0/3871443287 >> v2:172.21.15.120:3300/0 conn(0x7f180015d6e0 0x7f18000d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f180572f640 1 -- 172.21.15.70:0/3871443287 >> v1:172.21.15.120:6789/0 conn(0x7f18000d19f0 legacy=0x7f18000cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.023+0000 7f180572f640 1 -- 172.21.15.70:0/3871443287 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000ceb20 con 0x7f18000b2160 2023-11-26T07:24:06.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f180572f640 1 --2- 172.21.15.70:0/3871443287 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000b2160 0x7f18000d14b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f17f00097c0 tx=0x7f17f001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=546f5048de43ed4f server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1804f2e640 1 -- 172.21.15.70:0/3871443287 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00ab600 con 0x7f18000b2160 2023-11-26T07:24:06.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1804f2e640 1 -- 172.21.15.70:0/3871443287 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00a7050 con 0x7f18000b2160 2023-11-26T07:24:06.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1804f2e640 1 -- 172.21.15.70:0/3871443287 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00ab980 con 0x7f18000b2160 2023-11-26T07:24:06.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 -- 172.21.15.70:0/3871443287 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000b2160 msgr2=0x7f18000d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 --2- 172.21.15.70:0/3871443287 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000b2160 0x7f18000d14b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f17f00097c0 tx=0x7f17f001c480 comp rx=0 tx=0).stop 2023-11-26T07:24:06.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 -- 172.21.15.70:0/3871443287 shutdown_connections 2023-11-26T07:24:06.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 --2- 172.21.15.70:0/3871443287 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000b2160 0x7f18000d14b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 --2- 172.21.15.70:0/3871443287 >> v2:172.21.15.120:3300/0 conn(0x7f180015d6e0 0x7f18000d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 -- 172.21.15.70:0/3871443287 >> 172.21.15.70:0/3871443287 conn(0x7f180009c550 msgr2=0x7f18000d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 -- 172.21.15.70:0/3871443287 shutdown_connections 2023-11-26T07:24:06.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 -- 172.21.15.70:0/3871443287 wait complete. 2023-11-26T07:24:06.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 Processor -- start 2023-11-26T07:24:06.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.027+0000 7f1808194640 1 -- start start 2023-11-26T07:24:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18000b2160 0x7f18000b6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000d19f0 0x7f18000b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f180015d6e0 0x7f180006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180006ba50 con 0x7f180015d6e0 2023-11-26T07:24:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180006b160 con 0x7f18000b2160 2023-11-26T07:24:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000b6e50 con 0x7f18000d19f0 2023-11-26T07:24:06.030 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f180015d6e0 0x7f180006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f180015d6e0 0x7f180006bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54128/0 (socket says 172.21.15.70:54128) 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 -- 172.21.15.70:0/2504330216 learned_addr learned my addr 172.21.15.70:0/2504330216 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1805f30640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18000b2160 0x7f18000b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f180572f640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000d19f0 0x7f18000b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 -- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000d19f0 msgr2=0x7f18000b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000d19f0 0x7f18000b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 -- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18000b2160 msgr2=0x7f18000b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18000b2160 0x7f18000b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 -- 172.21.15.70:0/2504330216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0009420 con 0x7f180015d6e0 2023-11-26T07:24:06.031 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1806731640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f180015d6e0 0x7f180006bee0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f17f800cbc0 tx=0x7f17f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f17f67fc640 1 -- 172.21.15.70:0/2504330216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800ad40 con 0x7f180015d6e0 2023-11-26T07:24:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f17f67fc640 1 -- 172.21.15.70:0/2504330216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f8012400 con 0x7f180015d6e0 2023-11-26T07:24:06.032 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f17f67fc640 1 -- 172.21.15.70:0/2504330216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800aea0 con 0x7f180015d6e0 2023-11-26T07:24:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180006b400 con 0x7f180015d6e0 2023-11-26T07:24:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18000c8090 con 0x7f180015d6e0 2023-11-26T07:24:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.031+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180006bbc0 con 0x7f180015d6e0 2023-11-26T07:24:06.033 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.035+0000 7f17f67fc640 1 -- 172.21.15.70:0/2504330216 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f17f8007070 con 0x7f180015d6e0 2023-11-26T07:24:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.035+0000 7f17f67fc640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f17e4066f20 0x7f17e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.035+0000 7f17f67fc640 1 -- 172.21.15.70:0/2504330216 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f17f80828b0 con 0x7f180015d6e0 2023-11-26T07:24:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.035+0000 7f1805f30640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f17e4066f20 0x7f17e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.034 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.035+0000 7f1805f30640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f17e4066f20 0x7f17e40693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009ac0 tx=0x7f17fc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.039+0000 7f17f67fc640 1 -- 172.21.15.70:0/2504330216 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17f80515e0 con 0x7f180015d6e0 2023-11-26T07:24:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.227+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1800067680 con 0x7f180015d6e0 2023-11-26T07:24:06.225 INFO:tasks.ceph.mon.a.smithi070.stderr:2023-11-26T07:24:06.227+0000 7fe8c07be640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-26T07:24:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.227+0000 7f17f67fc640 1 -- 172.21.15.70:0/2504330216 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7f17f8054c00 con 0x7f180015d6e0 2023-11-26T07:24:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-26T07:24:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f17e4066f20 msgr2=0x7f17e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f17e4066f20 0x7f17e40693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009ac0 tx=0x7f17fc009190 comp rx=0 tx=0).stop 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f180015d6e0 msgr2=0x7f180006bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f180015d6e0 0x7f180006bee0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f17f800cbc0 tx=0x7f17f800a430 comp rx=0 tx=0).stop 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 shutdown_connections 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f17e4066f20 0x7f17e40693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f180015d6e0 0x7f180006bee0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f18000d19f0 0x7f18000b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 --2- 172.21.15.70:0/2504330216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18000b2160 0x7f18000b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 >> 172.21.15.70:0/2504330216 conn(0x7f180009c550 msgr2=0x7f18000d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 shutdown_connections 2023-11-26T07:24:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.231+0000 7f1808194640 1 -- 172.21.15.70:0/2504330216 wait complete. 2023-11-26T07:24:06.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-26T07:24:06.299 INFO:tasks.ceph.mds.d.smithi120.stdout:starting mds.d at 2023-11-26T07:24:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41963a4640 1 Processor -- start 2023-11-26T07:24:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41963a4640 1 -- start start 2023-11-26T07:24:06.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41963a4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4190143710 0x7f41900ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41963a4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900b2eb0 0x7f41900b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41963a4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419015de30 con 0x7f41900ae5a0 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41963a4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41900b3840 con 0x7f4190143710 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41963a4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419015e630 con 0x7f41900b2eb0 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41953a2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4190143710 0x7f41900ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41953a2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4190143710 0x7f41900ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54130/0 (socket says 172.21.15.70:54130) 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f4194ba1640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f41900ae5a0 0x7f419015d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58484/0 (socket says 172.21.15.70:58484) 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f41953a2640 1 -- 172.21.15.70:0/3535875100 learned_addr learned my addr 172.21.15.70:0/3535875100 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.391+0000 7f4195ba3640 1 --2- 172.21.15.70:0/3535875100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900b2eb0 0x7f41900b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41953a2640 1 -- 172.21.15.70:0/3535875100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900b2eb0 msgr2=0x7f41900b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41953a2640 1 --2- 172.21.15.70:0/3535875100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900b2eb0 0x7f41900b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41953a2640 1 -- 172.21.15.70:0/3535875100 >> v1:172.21.15.70:6789/0 conn(0x7f41900ae5a0 legacy=0x7f419015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41953a2640 1 -- 172.21.15.70:0/3535875100 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900ad7c0 con 0x7f4190143710 2023-11-26T07:24:06.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f4187fff640 1 -- 172.21.15.70:0/3535875100 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38728761 0 0) 0x7f4180001120 con 0x7f41900ae5a0 2023-11-26T07:24:06.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41953a2640 1 --2- 172.21.15.70:0/3535875100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f41900ad280 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62034e96862d67c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f4187fff640 1 -- 172.21.15.70:0/3535875100 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0a9400 con 0x7f4190143710 2023-11-26T07:24:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f4187fff640 1 -- 172.21.15.70:0/3535875100 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c0a9560 con 0x7f4190143710 2023-11-26T07:24:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f4187fff640 1 -- 172.21.15.70:0/3535875100 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0a98f0 con 0x7f4190143710 2023-11-26T07:24:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41963a4640 1 -- 172.21.15.70:0/3535875100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 msgr2=0x7f41900ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41963a4640 1 --2- 172.21.15.70:0/3535875100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f41900ad280 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c01c540 comp rx=0 tx=0).stop 2023-11-26T07:24:06.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41963a4640 1 -- 172.21.15.70:0/3535875100 shutdown_connections 2023-11-26T07:24:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41963a4640 1 --2- 172.21.15.70:0/3535875100 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900b2eb0 0x7f41900b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41963a4640 1 --2- 172.21.15.70:0/3535875100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f41900ad280 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.395+0000 7f41963a4640 1 -- 172.21.15.70:0/3535875100 >> 172.21.15.70:0/3535875100 conn(0x7f41900b0aa0 msgr2=0x7f41900b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 -- 172.21.15.70:0/3535875100 shutdown_connections 2023-11-26T07:24:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 -- 172.21.15.70:0/3535875100 wait complete. 2023-11-26T07:24:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 Processor -- start 2023-11-26T07:24:06.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 -- start start 2023-11-26T07:24:06.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900ae5a0 0x7f41900b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41900b2eb0 0x7f419013da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f419013df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419013a3b0 con 0x7f4190143710 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419013a690 con 0x7f41900b2eb0 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41963a4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419013a970 con 0x7f41900ae5a0 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f419013df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f419013df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54140/0 (socket says 172.21.15.70:54140) 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 -- 172.21.15.70:0/1906231209 learned_addr learned my addr 172.21.15.70:0/1906231209 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f41953a2640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900ae5a0 0x7f41900b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4194ba1640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41900b2eb0 0x7f419013da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 -- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900ae5a0 msgr2=0x7f41900b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900ae5a0 0x7f41900b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 -- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41900b2eb0 msgr2=0x7f419013da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41900b2eb0 0x7f419013da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 -- 172.21.15.70:0/1906231209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0094d0 con 0x7f4190143710 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.399+0000 7f4195ba3640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f419013df40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4188007e40 tx=0x7f418800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f4185ffb640 1 -- 172.21.15.70:0/1906231209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188014620 con 0x7f4190143710 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f4185ffb640 1 -- 172.21.15.70:0/1906231209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418800ee90 con 0x7f4190143710 2023-11-26T07:24:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f4185ffb640 1 -- 172.21.15.70:0/1906231209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880149e0 con 0x7f4190143710 2023-11-26T07:24:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419013ac50 con 0x7f4190143710 2023-11-26T07:24:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419013bae0 con 0x7f4190143710 2023-11-26T07:24:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4190067500 con 0x7f4190143710 2023-11-26T07:24:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f4185ffb640 1 -- 172.21.15.70:0/1906231209 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f4188014b40 con 0x7f4190143710 2023-11-26T07:24:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f4185ffb640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4174066f50 0x7f4174069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f4185ffb640 1 -- 172.21.15.70:0/1906231209 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4188083040 con 0x7f4190143710 2023-11-26T07:24:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.403+0000 7f41953a2640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4174066f50 0x7f4174069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.407+0000 7f41953a2640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4174066f50 0x7f4174069410 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f418c0ae000 tx=0x7f418c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:06.408 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.407+0000 7f4185ffb640 1 -- 172.21.15.70:0/1906231209 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4188051fc0 con 0x7f4190143710 2023-11-26T07:24:06.592 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:06.595+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f419013b100 con 0x7f4190143710 2023-11-26T07:24:07.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f4185ffb640 1 -- 172.21.15.70:0/1906231209 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7f41880555e0 con 0x7f4190143710 2023-11-26T07:24:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4174066f50 msgr2=0x7f4174069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4174066f50 0x7f4174069410 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f418c0ae000 tx=0x7f418c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:07.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 msgr2=0x7f419013df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f419013df40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4188007e40 tx=0x7f418800e4b0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 shutdown_connections 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f4174066f50 0x7f4174069410 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4190143710 0x7f419013df40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41900b2eb0 0x7f419013da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 --2- 172.21.15.70:0/1906231209 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f41900ae5a0 0x7f41900b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.231+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 >> 172.21.15.70:0/1906231209 conn(0x7f41900b0aa0 msgr2=0x7f41900aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.235+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 shutdown_connections 2023-11-26T07:24:07.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.235+0000 7f41963a4640 1 -- 172.21.15.70:0/1906231209 wait complete. 2023-11-26T07:24:07.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-26T07:24:07.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.399+0000 7fc885c32640 1 Processor -- start 2023-11-26T07:24:07.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.399+0000 7fc885c32640 1 -- start start 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc885c32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc88013e290 0x7fc8800cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc885c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8800cf7c0 0x7fc88015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc885c32640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88006c520 con 0x7fc88015f4e0 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc885c32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800cfc40 con 0x7fc88013e290 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc885c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88006c800 con 0x7fc8800cf7c0 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc88013e290 0x7fc8800cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc88013e290 0x7fc8800cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54156/0 (socket says 172.21.15.70:54156) 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3015739408 learned_addr learned my addr 172.21.15.70:0/3015739408 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87ffff640 1 --1- 172.21.15.70:0/3015739408 >> v1:172.21.15.70:6789/0 conn(0x7fc88015f4e0 0x7fc8801408e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58496/0 (socket says 172.21.15.70:58496) 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3015739408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8800cf7c0 msgr2=0x7fc88015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:07.402 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87f7fe640 1 --2- 172.21.15.70:0/3015739408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8800cf7c0 0x7fc88015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3015739408 >> v1:172.21.15.70:6789/0 conn(0x7fc88015f4e0 legacy=0x7fc8801408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.403+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3015739408 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88006cae0 con 0x7fc88013e290 2023-11-26T07:24:07.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc87f7fe640 1 --2- 172.21.15.70:0/3015739408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc88013e290 0x7fc8800cf280 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc870009870 tx=0x7fc87001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1035f4be4f796d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:07.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc87e7fc640 1 -- 172.21.15.70:0/3015739408 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700aa670 con 0x7fc88013e290 2023-11-26T07:24:07.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc87e7fc640 1 -- 172.21.15.70:0/3015739408 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700aa7d0 con 0x7fc88013e290 2023-11-26T07:24:07.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc87e7fc640 1 -- 172.21.15.70:0/3015739408 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700aab60 con 0x7fc88013e290 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 -- 172.21.15.70:0/3015739408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc88013e290 msgr2=0x7fc8800cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 --2- 172.21.15.70:0/3015739408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc88013e290 0x7fc8800cf280 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc870009870 tx=0x7fc87001c510 comp rx=0 tx=0).stop 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 -- 172.21.15.70:0/3015739408 shutdown_connections 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 --2- 172.21.15.70:0/3015739408 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc8800cf7c0 0x7fc88015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 --2- 172.21.15.70:0/3015739408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc88013e290 0x7fc8800cf280 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 -- 172.21.15.70:0/3015739408 >> 172.21.15.70:0/3015739408 conn(0x7fc88006a890 msgr2=0x7fc88006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 -- 172.21.15.70:0/3015739408 shutdown_connections 2023-11-26T07:24:07.406 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 -- 172.21.15.70:0/3015739408 wait complete. 2023-11-26T07:24:07.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 Processor -- start 2023-11-26T07:24:07.407 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 -- start start 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8800cf7c0 0x7fc88015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.407+0000 7fc885c32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc88013e290 0x7fc880154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc885c32640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc88015f4e0 0x7fc88015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc885c32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88015cde0 con 0x7fc8800cf7c0 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc885c32640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88015d0c0 con 0x7fc88013e290 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc885c32640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88015d3a0 con 0x7fc88015f4e0 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8800cf7c0 0x7fc88015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.410 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8800cf7c0 0x7fc88015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54170/0 (socket says 172.21.15.70:54170) 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3182668576 learned_addr learned my addr 172.21.15.70:0/3182668576 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87effd640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc88013e290 0x7fc880154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87ffff640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc88015f4e0 0x7fc88015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc88015f4e0 msgr2=0x7fc88015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc88015f4e0 0x7fc88015bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc88013e290 msgr2=0x7fc880154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc88013e290 0x7fc880154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 -- 172.21.15.70:0/3182668576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700094d0 con 0x7fc8800cf7c0 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87effd640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc88013e290 0x7fc880154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:07.411 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87ffff640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc88015f4e0 0x7fc88015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:07.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc87f7fe640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8800cf7c0 0x7fc88015de80 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc8700ac040 tx=0x7fc87001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:07.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc867fff640 1 -- 172.21.15.70:0/3182668576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700b38c0 con 0x7fc8800cf7c0 2023-11-26T07:24:07.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc867fff640 1 -- 172.21.15.70:0/3182668576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700b3a40 con 0x7fc8800cf7c0 2023-11-26T07:24:07.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc867fff640 1 -- 172.21.15.70:0/3182668576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700b3df0 con 0x7fc8800cf7c0 2023-11-26T07:24:07.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88015d680 con 0x7fc8800cf7c0 2023-11-26T07:24:07.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88015e3c0 con 0x7fc8800cf7c0 2023-11-26T07:24:07.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc880067680 con 0x7fc8800cf7c0 2023-11-26T07:24:07.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.411+0000 7fc867fff640 1 -- 172.21.15.70:0/3182668576 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fc8700b2380 con 0x7fc8800cf7c0 2023-11-26T07:24:07.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.415+0000 7fc867fff640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc86c066f20 0x7fc86c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:07.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.415+0000 7fc867fff640 1 -- 172.21.15.70:0/3182668576 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc87011d220 con 0x7fc8800cf7c0 2023-11-26T07:24:07.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.415+0000 7fc87effd640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc86c066f20 0x7fc86c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:07.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.415+0000 7fc87effd640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc86c066f20 0x7fc86c0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc880139b00 tx=0x7fc874008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:07.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.419+0000 7fc867fff640 1 -- 172.21.15.70:0/3182668576 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8700ec200 con 0x7fc8800cf7c0 2023-11-26T07:24:07.575 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:07.575+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc88006df50 con 0x7fc8800cf7c0 2023-11-26T07:24:08.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.239+0000 7fc867fff640 1 -- 172.21.15.70:0/3182668576 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc8700ef820 con 0x7fc8800cf7c0 2023-11-26T07:24:08.240 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2023-11-26T07:24:08.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc86c066f20 msgr2=0x7fc86c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc86c066f20 0x7fc86c0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc880139b00 tx=0x7fc874008040 comp rx=0 tx=0).stop 2023-11-26T07:24:08.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8800cf7c0 msgr2=0x7fc88015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8800cf7c0 0x7fc88015de80 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc8700ac040 tx=0x7fc87001ad50 comp rx=0 tx=0).stop 2023-11-26T07:24:08.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 shutdown_connections 2023-11-26T07:24:08.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fc88015f4e0 0x7fc88015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc88013e290 0x7fc880154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fc86c066f20 0x7fc86c0693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 --2- 172.21.15.70:0/3182668576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8800cf7c0 0x7fc88015de80 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 >> 172.21.15.70:0/3182668576 conn(0x7fc88006a890 msgr2=0x7fc8800b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:08.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 shutdown_connections 2023-11-26T07:24:08.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.243+0000 7fc885c32640 1 -- 172.21.15.70:0/3182668576 wait complete. 2023-11-26T07:24:08.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-26T07:24:08.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0feb432640 1 Processor -- start 2023-11-26T07:24:08.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0feb432640 1 -- start start 2023-11-26T07:24:08.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0feb432640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0fe40cf990 0x7f0fe40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0feb432640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0fe4070e00 0x7f0fe4162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0feb432640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe4162080 con 0x7f0fe414b1e0 2023-11-26T07:24:08.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0feb432640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe4161d70 con 0x7f0fe4070e00 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0feb432640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe414b5c0 con 0x7f0fe40cf990 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0fe99cf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0fe4070e00 0x7f0fe4162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0fe99cf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0fe4070e00 0x7f0fe4162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54184/0 (socket says 172.21.15.70:54184) 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1271194194 learned_addr learned my addr 172.21.15.70:0/1271194194 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0fe91ce640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f0fe414b1e0 0x7f0fe40cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58500/0 (socket says 172.21.15.70:58500) 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0fe89cd640 1 --2- 172.21.15.70:0/1271194194 >> v2:172.21.15.120:3300/0 conn(0x7f0fe40cf990 0x7f0fe40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.419+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1271194194 >> v2:172.21.15.120:3300/0 conn(0x7f0fe40cf990 msgr2=0x7f0fe40708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fe99cf640 1 --2- 172.21.15.70:0/1271194194 >> v2:172.21.15.120:3300/0 conn(0x7f0fe40cf990 0x7f0fe40708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1271194194 >> v1:172.21.15.70:6789/0 conn(0x7f0fe414b1e0 legacy=0x7f0fe40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1271194194 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4071580 con 0x7f0fe4070e00 2023-11-26T07:24:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fdbfff640 1 -- 172.21.15.70:0/1271194194 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76961860 0 0) 0x7f0fe4162080 con 0x7f0fe414b1e0 2023-11-26T07:24:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fe89cd640 1 --2- 172.21.15.70:0/1271194194 >> v2:172.21.15.120:3300/0 conn(0x7f0fe40cf990 0x7f0fe40708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fe99cf640 1 --2- 172.21.15.70:0/1271194194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe4070e00 0x7f0fe4162510 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f0fe406dfa0 tx=0x7f0fdc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c120ee3dad7585a server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fdbfff640 1 -- 172.21.15.70:0/1271194194 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0a5860 con 0x7f0fe4070e00 2023-11-26T07:24:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fdbfff640 1 -- 172.21.15.70:0/1271194194 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc0a59c0 con 0x7f0fe4070e00 2023-11-26T07:24:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0fdbfff640 1 -- 172.21.15.70:0/1271194194 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0a5d50 con 0x7f0fe4070e00 2023-11-26T07:24:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 -- 172.21.15.70:0/1271194194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe4070e00 msgr2=0x7f0fe4162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 --2- 172.21.15.70:0/1271194194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe4070e00 0x7f0fe4162510 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f0fe406dfa0 tx=0x7f0fdc01c9a0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 -- 172.21.15.70:0/1271194194 shutdown_connections 2023-11-26T07:24:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 --2- 172.21.15.70:0/1271194194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe4070e00 0x7f0fe4162510 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 --2- 172.21.15.70:0/1271194194 >> v2:172.21.15.120:3300/0 conn(0x7f0fe40cf990 0x7f0fe40708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 -- 172.21.15.70:0/1271194194 >> 172.21.15.70:0/1271194194 conn(0x7f0fe406a890 msgr2=0x7f0fe406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 -- 172.21.15.70:0/1271194194 shutdown_connections 2023-11-26T07:24:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.423+0000 7f0feb432640 1 -- 172.21.15.70:0/1271194194 wait complete. 2023-11-26T07:24:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 Processor -- start 2023-11-26T07:24:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 -- start start 2023-11-26T07:24:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe4070e00 0x7f0fe4142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fe40cf990 0x7f0fe41464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe414b1e0 0x7f0fe4143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe40af080 con 0x7f0fe414b1e0 2023-11-26T07:24:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe41456d0 con 0x7f0fe4070e00 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe40aea70 con 0x7f0fe40cf990 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe414b1e0 0x7f0fe4143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe414b1e0 0x7f0fe4143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54190/0 (socket says 172.21.15.70:54190) 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1518177279 learned_addr learned my addr 172.21.15.70:0/1518177279 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe91ce640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe4070e00 0x7f0fe4142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe89cd640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fe40cf990 0x7f0fe41464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fe40cf990 msgr2=0x7f0fe41464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fe40cf990 0x7f0fe41464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe4070e00 msgr2=0x7f0fe4142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe4070e00 0x7f0fe4142280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 -- 172.21.15.70:0/1518177279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc009b30 con 0x7f0fe414b1e0 2023-11-26T07:24:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fe99cf640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe414b1e0 0x7f0fe4143fd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0195b0 tx=0x7f0fdc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fd9ffb640 1 -- 172.21.15.70:0/1518177279 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0b8880 con 0x7f0fe414b1e0 2023-11-26T07:24:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fd9ffb640 1 -- 172.21.15.70:0/1518177279 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc0b8a00 con 0x7f0fe414b1e0 2023-11-26T07:24:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe415d850 con 0x7f0fe414b1e0 2023-11-26T07:24:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.427+0000 7f0fd9ffb640 1 -- 172.21.15.70:0/1518177279 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0b8df0 con 0x7f0fe414b1e0 2023-11-26T07:24:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.431+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe4146a10 con 0x7f0fe414b1e0 2023-11-26T07:24:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.431+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe406e110 con 0x7f0fe414b1e0 2023-11-26T07:24:08.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.431+0000 7f0fd9ffb640 1 -- 172.21.15.70:0/1518177279 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f0fdc0c3460 con 0x7f0fe414b1e0 2023-11-26T07:24:08.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.431+0000 7f0fd9ffb640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0fc8066f20 0x7f0fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:08.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.431+0000 7f0fd9ffb640 1 -- 172.21.15.70:0/1518177279 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f0fdc11df90 con 0x7f0fe414b1e0 2023-11-26T07:24:08.431 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.431+0000 7f0fe91ce640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0fc8066f20 0x7f0fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:08.432 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.431+0000 7f0fe91ce640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0fc8066f20 0x7f0fc80693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f70 tx=0x7f0fe0007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:08.435 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.435+0000 7f0fd9ffb640 1 -- 172.21.15.70:0/1518177279 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0fdc0ed000 con 0x7f0fe414b1e0 2023-11-26T07:24:08.587 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:08.587+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0fe4067680 con 0x7f0fe414b1e0 2023-11-26T07:24:09.246 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.247+0000 7f0fd9ffb640 1 -- 172.21.15.70:0/1518177279 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0fdc0f0620 con 0x7f0fe414b1e0 2023-11-26T07:24:09.246 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2023-11-26T07:24:09.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.251+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0fc8066f20 msgr2=0x7f0fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.251+0000 7f0feb432640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0fc8066f20 0x7f0fc80693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f70 tx=0x7f0fe0007c10 comp rx=0 tx=0).stop 2023-11-26T07:24:09.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.251+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe414b1e0 msgr2=0x7f0fe4143fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.252 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.251+0000 7f0feb432640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe414b1e0 0x7f0fe4143fd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0195b0 tx=0x7f0fdc019740 comp rx=0 tx=0).stop 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 shutdown_connections 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0fc8066f20 0x7f0fc80693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0fe414b1e0 0x7f0fe4143fd0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f0fe40cf990 0x7f0fe41464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 --2- 172.21.15.70:0/1518177279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe4070e00 0x7f0fe4142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 >> 172.21.15.70:0/1518177279 conn(0x7f0fe406a890 msgr2=0x7f0fe40b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 shutdown_connections 2023-11-26T07:24:09.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.255+0000 7f0feb432640 1 -- 172.21.15.70:0/1518177279 wait complete. 2023-11-26T07:24:09.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2023-11-26T07:24:09.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.435+0000 7f771fe5a640 1 Processor -- start 2023-11-26T07:24:09.436 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771fe5a640 1 -- start start 2023-11-26T07:24:09.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771fe5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7718070d10 0x7f771815d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771fe5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f77180b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771fe5a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771815b2f0 con 0x7f77180cf280 2023-11-26T07:24:09.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771fe5a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771806c5c0 con 0x7f7718070d10 2023-11-26T07:24:09.438 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771fe5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771815e1a0 con 0x7f771806cd50 2023-11-26T07:24:09.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771d3f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7718070d10 0x7f771815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771e3f7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f77180b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771d3f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7718070d10 0x7f771815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:45806/0 (socket says 172.21.15.70:45806) 2023-11-26T07:24:09.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771d3f5640 1 -- 172.21.15.70:0/1819548517 learned_addr learned my addr 172.21.15.70:0/1819548517 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:09.439 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771e3f7640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f77180b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:50790/0 (socket says 172.21.15.70:50790) 2023-11-26T07:24:09.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771dbf6640 1 --1- 172.21.15.70:0/1819548517 >> v1:172.21.15.120:6789/0 conn(0x7f77180cf280 0x7f77180cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:36490/0 (socket says 172.21.15.70:36490) 2023-11-26T07:24:09.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771d3f5640 1 -- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 msgr2=0x7f77180b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:09.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771d3f5640 1 --2- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f77180b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771d3f5640 1 -- 172.21.15.70:0/1819548517 >> v1:172.21.15.120:6789/0 conn(0x7f77180cf280 legacy=0x7f77180cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771d3f5640 1 -- 172.21.15.70:0/1819548517 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771815e480 con 0x7f7718070d10 2023-11-26T07:24:09.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771e3f7640 1 --2- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f77180b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:24:09.440 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.439+0000 7f771cbf4640 1 -- 172.21.15.70:0/1819548517 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149544484 0 0) 0x7f7714001120 con 0x7f77180cf280 2023-11-26T07:24:09.441 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771d3f5640 1 --2- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7718070d10 0x7f771815d900 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7708009870 tx=0x7f770801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9355321caf477468 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.442 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771cbf4640 1 -- 172.21.15.70:0/1819548517 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080a8a30 con 0x7f7718070d10 2023-11-26T07:24:09.442 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771cbf4640 1 -- 172.21.15.70:0/1819548517 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77080a8b90 con 0x7f7718070d10 2023-11-26T07:24:09.442 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771cbf4640 1 -- 172.21.15.70:0/1819548517 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080b0440 con 0x7f7718070d10 2023-11-26T07:24:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 -- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7718070d10 msgr2=0x7f771815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 --2- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7718070d10 0x7f771815d900 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7708009870 tx=0x7f770801ed30 comp rx=0 tx=0).stop 2023-11-26T07:24:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 -- 172.21.15.70:0/1819548517 shutdown_connections 2023-11-26T07:24:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 --2- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f77180b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 --2- 172.21.15.70:0/1819548517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7718070d10 0x7f771815d900 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 -- 172.21.15.70:0/1819548517 >> 172.21.15.70:0/1819548517 conn(0x7f771806a890 msgr2=0x7f771806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 -- 172.21.15.70:0/1819548517 shutdown_connections 2023-11-26T07:24:09.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.443+0000 7f771fe5a640 1 -- 172.21.15.70:0/1819548517 wait complete. 2023-11-26T07:24:09.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 Processor -- start 2023-11-26T07:24:09.445 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 -- start start 2023-11-26T07:24:09.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f7718156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7718070d10 0x7f77181e5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77180cf280 0x7f77181e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180ce710 con 0x7f7718070d10 2023-11-26T07:24:09.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77181573f0 con 0x7f77180cf280 2023-11-26T07:24:09.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180ce150 con 0x7f771806cd50 2023-11-26T07:24:09.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7718070d10 0x7f77181e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7718070d10 0x7f77181e5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54202/0 (socket says 172.21.15.70:54202) 2023-11-26T07:24:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 -- 172.21.15.70:0/3991754170 learned_addr learned my addr 172.21.15.70:0/3991754170 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771dbf6640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f7718156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771e3f7640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77180cf280 0x7f77181e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 -- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 msgr2=0x7f7718156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f7718156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 -- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77180cf280 msgr2=0x7f77181e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77180cf280 0x7f77181e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 -- 172.21.15.70:0/3991754170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710009a70 con 0x7f7718070d10 2023-11-26T07:24:09.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771d3f5640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7718070d10 0x7f77181e5630 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f77080b3040 tx=0x7f770801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f770e7fc640 1 -- 172.21.15.70:0/3991754170 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080b0dd0 con 0x7f7718070d10 2023-11-26T07:24:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f770e7fc640 1 -- 172.21.15.70:0/3991754170 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77080bb460 con 0x7f7718070d10 2023-11-26T07:24:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77080094d0 con 0x7f7718070d10 2023-11-26T07:24:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f770e7fc640 1 -- 172.21.15.70:0/3991754170 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080bb810 con 0x7f7718070d10 2023-11-26T07:24:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77180cc3d0 con 0x7f7718070d10 2023-11-26T07:24:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.447+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7718067680 con 0x7f7718070d10 2023-11-26T07:24:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.451+0000 7f770e7fc640 1 -- 172.21.15.70:0/3991754170 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f77080bb970 con 0x7f7718070d10 2023-11-26T07:24:09.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.451+0000 7f770e7fc640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f76fc066f20 0x7f76fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.451+0000 7f770e7fc640 1 -- 172.21.15.70:0/3991754170 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7708120300 con 0x7f7718070d10 2023-11-26T07:24:09.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.451+0000 7f771dbf6640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f76fc066f20 0x7f76fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.451+0000 7f771dbf6640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f76fc066f20 0x7f76fc0693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7714000f70 tx=0x7f7714007ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.455+0000 7f770e7fc640 1 -- 172.21.15.70:0/3991754170 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77080ef280 con 0x7f7718070d10 2023-11-26T07:24:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.623+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) v1 -- 0x7f771815d070 con 0x7f7718070d10 2023-11-26T07:24:09.625 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f770e7fc640 1 -- 172.21.15.70:0/3991754170 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v24) v1 ==== 115+0+0 (secure 0 0 0) 0x7f77080f28a0 con 0x7f7718070d10 2023-11-26T07:24:09.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f76fc066f20 msgr2=0x7f76fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f76fc066f20 0x7f76fc0693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7714000f70 tx=0x7f7714007ba0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7718070d10 msgr2=0x7f77181e5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7718070d10 0x7f77181e5630 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f77080b3040 tx=0x7f770801bad0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 shutdown_connections 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f76fc066f20 0x7f76fc0693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7718070d10 0x7f77181e5630 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77180cf280 0x7f77181e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 --2- 172.21.15.70:0/3991754170 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f771806cd50 0x7f7718156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 >> 172.21.15.70:0/3991754170 conn(0x7f771806a890 msgr2=0x7f77180cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 shutdown_connections 2023-11-26T07:24:09.628 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.627+0000 7f771fe5a640 1 -- 172.21.15.70:0/3991754170 wait complete. 2023-11-26T07:24:09.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-26T07:24:09.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe92ac640 1 Processor -- start 2023-11-26T07:24:09.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe92ac640 1 -- start start 2023-11-26T07:24:09.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe92ac640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fabe41614f0 0x7fabe40d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe92ac640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe40cf050 0x7fabe40d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe92ac640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe40cebc0 con 0x7fabe41618d0 2023-11-26T07:24:09.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe92ac640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe40cdfb0 con 0x7fabe41614f0 2023-11-26T07:24:09.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe92ac640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe40ce290 con 0x7fabe40cf050 2023-11-26T07:24:09.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fabe41614f0 0x7fabe40d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fabe41614f0 0x7fabe40d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54214/0 (socket says 172.21.15.70:54214) 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe8aab640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fabe41618d0 0x7fabe415d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58508/0 (socket says 172.21.15.70:58508) 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe3fff640 1 -- 172.21.15.70:0/801375020 learned_addr learned my addr 172.21.15.70:0/801375020 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.787+0000 7fabe37fe640 1 --2- 172.21.15.70:0/801375020 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe40cf050 0x7fabe40d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe3fff640 1 -- 172.21.15.70:0/801375020 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe40cf050 msgr2=0x7fabe40d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe3fff640 1 --2- 172.21.15.70:0/801375020 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe40cf050 0x7fabe40d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe3fff640 1 -- 172.21.15.70:0/801375020 >> v1:172.21.15.70:6789/0 conn(0x7fabe41618d0 legacy=0x7fabe415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe3fff640 1 -- 172.21.15.70:0/801375020 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40ce570 con 0x7fabe41614f0 2023-11-26T07:24:09.791 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe3fff640 1 --2- 172.21.15.70:0/801375020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe41614f0 0x7fabe40d0020 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009870 tx=0x7fabd401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c66f6f606406cf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe2ffd640 1 -- 172.21.15.70:0/801375020 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40ad640 con 0x7fabe41614f0 2023-11-26T07:24:09.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe2ffd640 1 -- 172.21.15.70:0/801375020 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40ad7a0 con 0x7fabe41614f0 2023-11-26T07:24:09.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.791+0000 7fabe2ffd640 1 -- 172.21.15.70:0/801375020 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40adb30 con 0x7fabe41614f0 2023-11-26T07:24:09.792 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- 172.21.15.70:0/801375020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe41614f0 msgr2=0x7fabe40d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 --2- 172.21.15.70:0/801375020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe41614f0 0x7fabe40d0020 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009870 tx=0x7fabd401c480 comp rx=0 tx=0).stop 2023-11-26T07:24:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- 172.21.15.70:0/801375020 shutdown_connections 2023-11-26T07:24:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 --2- 172.21.15.70:0/801375020 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe40cf050 0x7fabe40d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 --2- 172.21.15.70:0/801375020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe41614f0 0x7fabe40d0020 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- 172.21.15.70:0/801375020 >> 172.21.15.70:0/801375020 conn(0x7fabe40d3050 msgr2=0x7fabe40d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- 172.21.15.70:0/801375020 shutdown_connections 2023-11-26T07:24:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- 172.21.15.70:0/801375020 wait complete. 2023-11-26T07:24:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 Processor -- start 2023-11-26T07:24:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- start start 2023-11-26T07:24:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe40cf050 0x7fabe4160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe41614f0 0x7fabe414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe41618d0 0x7fabe4158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe414b030 con 0x7fabe40cf050 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe414b1e0 con 0x7fabe41614f0 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe92ac640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe414ba80 con 0x7fabe41618d0 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe40cf050 0x7fabe4160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe40cf050 0x7fabe4160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54222/0 (socket says 172.21.15.70:54222) 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 -- 172.21.15.70:0/1449423801 learned_addr learned my addr 172.21.15.70:0/1449423801 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe8aab640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe41618d0 0x7fabe4158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe37fe640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe41614f0 0x7fabe414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 -- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe41618d0 msgr2=0x7fabe4158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe41618d0 0x7fabe4158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 -- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe41614f0 msgr2=0x7fabe414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe41614f0 0x7fabe414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe3fff640 1 -- 172.21.15.70:0/1449423801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40094d0 con 0x7fabe40cf050 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe37fe640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe41614f0 0x7fabe414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.795+0000 7fabe8aab640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe41618d0 0x7fabe4158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe3fff640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe40cf050 0x7fabe4160320 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fabd40b0040 tx=0x7fabd4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe0ff9640 1 -- 172.21.15.70:0/1449423801 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40ad640 con 0x7fabe40cf050 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe0ff9640 1 -- 172.21.15.70:0/1449423801 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40a6040 con 0x7fabe40cf050 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe414c9e0 con 0x7fabe40cf050 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe0ff9640 1 -- 172.21.15.70:0/1449423801 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40b7a30 con 0x7fabe40cf050 2023-11-26T07:24:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe414b430 con 0x7fabe40cf050 2023-11-26T07:24:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe4067500 con 0x7fabe40cf050 2023-11-26T07:24:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe0ff9640 1 -- 172.21.15.70:0/1449423801 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fabd40b7b90 con 0x7fabe40cf050 2023-11-26T07:24:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe0ff9640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fabd0066f50 0x7fabd0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe0ff9640 1 -- 172.21.15.70:0/1449423801 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fabd411d5a0 con 0x7fabe40cf050 2023-11-26T07:24:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.799+0000 7fabe37fe640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fabd0066f50 0x7fabd0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.803+0000 7fabe37fe640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fabd0066f50 0x7fabd0069410 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fabe4153700 tx=0x7fabd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:09.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.803+0000 7fabe0ff9640 1 -- 172.21.15.70:0/1449423801 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fabd40ec590 con 0x7fabe40cf050 2023-11-26T07:24:09.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.955+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fabe4150120 con 0x7fabe40cf050 2023-11-26T07:24:09.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe0ff9640 1 -- 172.21.15.70:0/1449423801 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fabd40efbb0 con 0x7fabe40cf050 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fabd0066f50 msgr2=0x7fabd0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fabd0066f50 0x7fabd0069410 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fabe4153700 tx=0x7fabd8008040 comp rx=0 tx=0).stop 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe40cf050 msgr2=0x7fabe4160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe40cf050 0x7fabe4160320 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fabd40b0040 tx=0x7fabd4019220 comp rx=0 tx=0).stop 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 shutdown_connections 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fabe41618d0 0x7fabe4158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe41614f0 0x7fabe414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fabd0066f50 0x7fabd0069410 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 --2- 172.21.15.70:0/1449423801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabe40cf050 0x7fabe4160320 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 >> 172.21.15.70:0/1449423801 conn(0x7fabe40d3050 msgr2=0x7fabe406c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 shutdown_connections 2023-11-26T07:24:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:09.959+0000 7fabe92ac640 1 -- 172.21.15.70:0/1449423801 wait complete. 2023-11-26T07:24:09.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete' 2023-11-26T07:24:10.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.119+0000 7fe2ba9aa640 1 Processor -- start 2023-11-26T07:24:10.119 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.119+0000 7fe2ba9aa640 1 -- start start 2023-11-26T07:24:10.120 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.119+0000 7fe2ba9aa640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe2b41614b0 0x7fe2b40cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.119+0000 7fe2ba9aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4071970 0x7fe2b4161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.119+0000 7fe2ba9aa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b415d970 con 0x7fe2b4070ba0 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.119+0000 7fe2ba9aa640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b4161dd0 con 0x7fe2b41614b0 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.119+0000 7fe2ba9aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415dc30 con 0x7fe2b4071970 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe2b41614b0 0x7fe2b40cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b8f47640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe2b4070ba0 0x7fe2b406dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58524/0 (socket says 172.21.15.70:58524) 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b8f47640 1 -- 172.21.15.70:0/588353525 learned_addr learned my addr 172.21.15.70:0/588353525 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b37fe640 1 --2- 172.21.15.70:0/588353525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4071970 0x7fe2b4161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b3fff640 1 -- 172.21.15.70:0/588353525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4071970 msgr2=0x7fe2b4161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b3fff640 1 --2- 172.21.15.70:0/588353525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4071970 0x7fe2b4161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.121 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b3fff640 1 -- 172.21.15.70:0/588353525 >> v1:172.21.15.70:6789/0 conn(0x7fe2b4070ba0 legacy=0x7fe2b406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b3fff640 1 -- 172.21.15.70:0/588353525 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b415df10 con 0x7fe2b41614b0 2023-11-26T07:24:10.122 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b2ffd640 1 -- 172.21.15.70:0/588353525 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852979434 0 0) 0x7fe2b415d970 con 0x7fe2b4070ba0 2023-11-26T07:24:10.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b3fff640 1 --2- 172.21.15.70:0/588353525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b40cd610 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40097c0 tx=0x7fe2a401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2639e9d3af657c25 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b2ffd640 1 -- 172.21.15.70:0/588353525 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40ab620 con 0x7fe2b41614b0 2023-11-26T07:24:10.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b2ffd640 1 -- 172.21.15.70:0/588353525 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a40ab780 con 0x7fe2b41614b0 2023-11-26T07:24:10.124 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.123+0000 7fe2b2ffd640 1 -- 172.21.15.70:0/588353525 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40abb10 con 0x7fe2b41614b0 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/588353525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 msgr2=0x7fe2b40cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/588353525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b40cd610 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40097c0 tx=0x7fe2a401c450 comp rx=0 tx=0).stop 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/588353525 shutdown_connections 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/588353525 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4071970 0x7fe2b4161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/588353525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b40cd610 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/588353525 >> 172.21.15.70:0/588353525 conn(0x7fe2b40cf710 msgr2=0x7fe2b40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/588353525 shutdown_connections 2023-11-26T07:24:10.125 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/588353525 wait complete. 2023-11-26T07:24:10.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 Processor -- start 2023-11-26T07:24:10.126 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- start start 2023-11-26T07:24:10.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4070ba0 0x7fe2b415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4071970 0x7fe2b41677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b4155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b41569d0 con 0x7fe2b41614b0 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415fbe0 con 0x7fe2b4071970 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2ba9aa640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415fec0 con 0x7fe2b4070ba0 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2b8f47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b4155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2b8f47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b4155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54232/0 (socket says 172.21.15.70:54232) 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2b8f47640 1 -- 172.21.15.70:0/4117712104 learned_addr learned my addr 172.21.15.70:0/4117712104 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2b3fff640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4070ba0 0x7fe2b415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.127+0000 7fe2b37fe640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4071970 0x7fe2b41677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b8f47640 1 -- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4070ba0 msgr2=0x7fe2b415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b8f47640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4070ba0 0x7fe2b415f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b8f47640 1 -- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4071970 msgr2=0x7fe2b41677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b8f47640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4071970 0x7fe2b41677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:10.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b8f47640 1 -- 172.21.15.70:0/4117712104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009420 con 0x7fe2b41614b0 2023-11-26T07:24:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b8f47640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b4155b00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c780 tx=0x7fe2ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b0ff9640 1 -- 172.21.15.70:0/4117712104 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00ce90 con 0x7fe2b41614b0 2023-11-26T07:24:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b0ff9640 1 -- 172.21.15.70:0/4117712104 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac00a640 con 0x7fe2b41614b0 2023-11-26T07:24:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b41601a0 con 0x7fe2b41614b0 2023-11-26T07:24:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b0ff9640 1 -- 172.21.15.70:0/4117712104 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00a9d0 con 0x7fe2b41614b0 2023-11-26T07:24:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b415f900 con 0x7fe2b41614b0 2023-11-26T07:24:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b41603e0 con 0x7fe2b41614b0 2023-11-26T07:24:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b0ff9640 1 -- 172.21.15.70:0/4117712104 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fe2ac00ab30 con 0x7fe2b41614b0 2023-11-26T07:24:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b0ff9640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2a0066f50 0x7fe2a0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b0ff9640 1 -- 172.21.15.70:0/4117712104 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2ac081d80 con 0x7fe2b41614b0 2023-11-26T07:24:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.131+0000 7fe2b3fff640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2a0066f50 0x7fe2a0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.135+0000 7fe2b3fff640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2a0066f50 0x7fe2a0069410 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40af000 tx=0x7fe2a40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:10.135 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.135+0000 7fe2b0ff9640 1 -- 172.21.15.70:0/4117712104 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2b41603e0 con 0x7fe2b41614b0 2023-11-26T07:24:10.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:10.343+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]} v 0) v1 -- 0x7fe2b415b970 con 0x7fe2b41614b0 2023-11-26T07:24:11.250 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.251+0000 7fe2b0ff9640 1 -- 172.21.15.70:0/4117712104 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_pending_in_progress_complete"]}]=0 v329) v1 ==== 187+0+0 (secure 0 0 0) 0x7fe2b415b970 con 0x7fe2b41614b0 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2a0066f50 msgr2=0x7fe2a0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2a0066f50 0x7fe2a0069410 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40af000 tx=0x7fe2a40a7000 comp rx=0 tx=0).stop 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 msgr2=0x7fe2b4155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b4155b00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c780 tx=0x7fe2ac00cc40 comp rx=0 tx=0).stop 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 shutdown_connections 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fe2a0066f50 0x7fe2a0069410 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2b41614b0 0x7fe2b4155b00 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.253 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4071970 0x7fe2b41677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 --2- 172.21.15.70:0/4117712104 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fe2b4070ba0 0x7fe2b415f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:11.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 >> 172.21.15.70:0/4117712104 conn(0x7fe2b40cf710 msgr2=0x7fe2b40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:11.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 shutdown_connections 2023-11-26T07:24:11.254 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:11.255+0000 7fe2ba9aa640 1 -- 172.21.15.70:0/4117712104 wait complete. 2023-11-26T07:24:11.279 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state ... ERROR 2023-11-26T07:24:11.279 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:11.279 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-26T07:24:11.279 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 6589, in test_clone_failure_status_pending_in_progress_complete 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "snapshot", "rm", self.volname, subvolume, snapshot) 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-26T07:24:11.280 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol84210 subvol_snap78150' 2023-11-26T07:24:11.281 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner:Ran 4 tests in 338.689s 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner:ensure failure status is not shown when clone is not in failed/cancelled state 2023-11-26T07:24:11.282 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 6589, in test_clone_failure_status_pending_in_progress_complete 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "snapshot", "rm", self.volname, subvolume, snapshot) 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-26T07:24:11.283 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/remote.py", line 522, in run 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 455, in run 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi070 with status 11: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol84210 subvol_snap78150' 2023-11-26T07:24:11.284 INFO:tasks.cephfs_test_runner: 2023-11-26T07:24:11.284 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:11.347 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=efd03f8ae89c4bee9e5d844142555bf5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_44c2237fe77713214148c1fd622c872f346f1b99/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2023-11-26T07:24:11.348 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-26T07:24:11.357 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-26T07:24:11.365 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-26T07:24:11.366 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:24:11.366 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:11.382 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:24:11.383 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-26T07:24:11.383 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:11.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9415 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-26T07:24:11.433 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:24:11.433 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:11.443 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:24:11.443 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-11-26T07:24:11.443 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-26T07:24:11.494 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354624k,nr_inodes=4088656,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2866 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-26T07:24:11.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:11.494 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2023-11-26T07:24:11.503 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-26T07:24:11.504 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-26T07:24:11.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:11.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-26T07:24:11.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:11.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-26T07:24:11.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:11.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2023-11-26T07:24:11.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:11.859 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2023-11-26T07:24:11.870 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-26T07:24:11.870 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-26T07:24:11.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:11.870 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-26T07:24:11.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:11.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-26T07:24:12.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-26T07:24:12.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2023-11-26T07:24:12.200 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-26T07:24:12.209 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-26T07:24:12.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:12.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdb04ba1640 1 Processor -- start 2023-11-26T07:24:12.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdb04ba1640 1 -- start start 2023-11-26T07:24:12.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdb04ba1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb0015d580 0x7fdb000d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdb04ba1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdb000d3e60 0x7fdb000d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.358 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdb04ba1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb000d21e0 con 0x7fdb000d1d30 2023-11-26T07:24:12.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdb04ba1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb000d0bc0 con 0x7fdb000d3e60 2023-11-26T07:24:12.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdb04ba1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000d0320 con 0x7fdb0015d580 2023-11-26T07:24:12.359 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafe59c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb0015d580 0x7fdb000d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafdd9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdb000d3e60 0x7fdb000d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafed9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdb000d1d30 0x7fdb000cdce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.70:36504/0 (socket says 172.21.15.70:36504) 2023-11-26T07:24:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafed9d640 1 -- 172.21.15.70:0/3449653735 learned_addr learned my addr 172.21.15.70:0/3449653735 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafdd9b640 1 -- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb0015d580 msgr2=0x7fdb000d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafdd9b640 1 --2- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb0015d580 0x7fdb000d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafdd9b640 1 -- 172.21.15.70:0/3449653735 >> v1:172.21.15.120:6789/0 conn(0x7fdb000d1d30 legacy=0x7fdb000cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafdd9b640 1 -- 172.21.15.70:0/3449653735 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000d0600 con 0x7fdb000d3e60 2023-11-26T07:24:12.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafe59c640 1 --2- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb0015d580 0x7fdb000d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:24:12.361 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.359+0000 7fdafd59a640 1 -- 172.21.15.70:0/3449653735 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256432280 0 0) 0x7fdb000d21e0 con 0x7fdb000d1d30 2023-11-26T07:24:12.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdafdd9b640 1 --2- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000d3e60 0x7fdb000d17f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40097c0 tx=0x7fdaf401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434550bcea5b1796 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdafd59a640 1 -- 172.21.15.70:0/3449653735 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40ab650 con 0x7fdb000d3e60 2023-11-26T07:24:12.362 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdafd59a640 1 -- 172.21.15.70:0/3449653735 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40ab7b0 con 0x7fdb000d3e60 2023-11-26T07:24:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdafd59a640 1 -- 172.21.15.70:0/3449653735 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40abb40 con 0x7fdb000d3e60 2023-11-26T07:24:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000d3e60 msgr2=0x7fdb000d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000d3e60 0x7fdb000d17f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40097c0 tx=0x7fdaf401c450 comp rx=0 tx=0).stop 2023-11-26T07:24:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3449653735 shutdown_connections 2023-11-26T07:24:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000d3e60 0x7fdb000d17f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3449653735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb0015d580 0x7fdb000d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3449653735 >> 172.21.15.70:0/3449653735 conn(0x7fdb0009c550 msgr2=0x7fdb000d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3449653735 shutdown_connections 2023-11-26T07:24:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.363+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3449653735 wait complete. 2023-11-26T07:24:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 Processor -- start 2023-11-26T07:24:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 -- start start 2023-11-26T07:24:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb000d1d30 0x7fdb00154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb000d3e60 0x7fdb000c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb0015d580 0x7fdb000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000b88a0 con 0x7fdb000d3e60 2023-11-26T07:24:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000c8dc0 con 0x7fdb0015d580 2023-11-26T07:24:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000b85c0 con 0x7fdb000d1d30 2023-11-26T07:24:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb000d3e60 0x7fdb000c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb000d3e60 0x7fdb000c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54234/0 (socket says 172.21.15.70:54234) 2023-11-26T07:24:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 -- 172.21.15.70:0/3354143848 learned_addr learned my addr 172.21.15.70:0/3354143848 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafe59c640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb000d1d30 0x7fdb00154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafed9d640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb0015d580 0x7fdb000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 -- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb000d1d30 msgr2=0x7fdb00154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb000d1d30 0x7fdb00154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 -- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb0015d580 msgr2=0x7fdb000b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb0015d580 0x7fdb000b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 -- 172.21.15.70:0/3354143848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf0009420 con 0x7fdb000d3e60 2023-11-26T07:24:12.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafe59c640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb000d1d30 0x7fdb00154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:24:12.369 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafed9d640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb0015d580 0x7fdb000b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:24:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdafdd9b640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb000d3e60 0x7fdb000c9250 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdaf401ab00 tx=0x7fdaf401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdaeeffd640 1 -- 172.21.15.70:0/3354143848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4004230 con 0x7fdb000d3e60 2023-11-26T07:24:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdaeeffd640 1 -- 172.21.15.70:0/3354143848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40b9070 con 0x7fdb000d3e60 2023-11-26T07:24:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf4009420 con 0x7fdb000d3e60 2023-11-26T07:24:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdaeeffd640 1 -- 172.21.15.70:0/3354143848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4003620 con 0x7fdb000d3e60 2023-11-26T07:24:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.367+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb000c8a50 con 0x7fdb000d3e60 2023-11-26T07:24:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.371+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb000c85d0 con 0x7fdb000d3e60 2023-11-26T07:24:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.371+0000 7fdaeeffd640 1 -- 172.21.15.70:0/3354143848 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fdaf4003780 con 0x7fdb000d3e60 2023-11-26T07:24:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.371+0000 7fdaeeffd640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdae0066f20 0x7fdae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.371+0000 7fdaeeffd640 1 -- 172.21.15.70:0/3354143848 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdaf40bb070 con 0x7fdb000d3e60 2023-11-26T07:24:12.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.371+0000 7fdafe59c640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdae0066f20 0x7fdae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.372 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.371+0000 7fdafe59c640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdae0066f20 0x7fdae00693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0011310 tx=0x7fdaf0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.374 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.375+0000 7fdaeeffd640 1 -- 172.21.15.70:0/3354143848 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb000c85d0 con 0x7fdb000d3e60 2023-11-26T07:24:12.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.523+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb000b1d20 con 0x7fdae0066f20 2023-11-26T07:24:12.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdaeeffd640 1 -- 172.21.15.70:0/3354143848 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51100 (secure 0 0 0) 0x7fdb000b1d20 con 0x7fdae0066f20 2023-11-26T07:24:12.526 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:12.526 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:24:12.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdae0066f20 msgr2=0x7fdae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdae0066f20 0x7fdae00693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0011310 tx=0x7fdaf0009190 comp rx=0 tx=0).stop 2023-11-26T07:24:12.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb000d3e60 msgr2=0x7fdb000c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb000d3e60 0x7fdb000c9250 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdaf401ab00 tx=0x7fdaf401ac90 comp rx=0 tx=0).stop 2023-11-26T07:24:12.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 shutdown_connections 2023-11-26T07:24:12.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fdae0066f20 0x7fdae00693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb000d3e60 0x7fdb000c9250 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb0015d580 0x7fdb000b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 --2- 172.21.15.70:0/3354143848 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fdb000d1d30 0x7fdb00154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 >> 172.21.15.70:0/3354143848 conn(0x7fdb0009c550 msgr2=0x7fdb000b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.528 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 shutdown_connections 2023-11-26T07:24:12.529 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.527+0000 7fdb04ba1640 1 -- 172.21.15.70:0/3354143848 wait complete. 2023-11-26T07:24:12.546 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2023-11-26T07:24:12.069049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":279396,"kb_used_data":9128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695324,"statfs":{"total":773094113280,"available":772808011776,"internally_reserved":0,"allocated":9347072,"data_stored":4668032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422027672,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-946,"num_write_kb":-412284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001361"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-26T07:24:08.248997+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:24:08.248997+0000","last_peered":"2023-11-26T07:24:08.248997+0000","last_clean":"2023-11-26T07:24:08.248997+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:24:08.248997+0000","last_undegraded":"2023-11-26T07:24:08.248997+0000","last_fullsized":"2023-11-26T07:24:08.248997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.621},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.872,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57999999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.64300000000000002},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.028,"5min":1.028,"15min":1.6950000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63500000000000001,"15min":0.70499999999999996},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.88900000000000001,"15min":0.91500000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.755},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.71399999999999997,"15min":0.76800000000000002},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.76900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84699999999999998,"5min":1.171,"15min":1.171},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65800000000000003,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":1.093,"15min":1.093},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67800000000000005,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.872,"5min":0.91900000000000004,"15min":1.1559999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.76200000000000001},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":0.98899999999999999,"15min":1.089},"last":0.68899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.48399999999999999,"15min":0.46500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.76300000000000001},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.872,"5min":1.046,"15min":1.0629999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.39900000000000002},"max":{"1min":0.92800000000000005,"5min":0.94199999999999995,"15min":1.018},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64600000000000002,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83499999999999996,"5min":1.038,"15min":1.133},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93999999999999995,"5min":1.016,"15min":1.042},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.93999999999999995,"5min":1.0820000000000001,"15min":1.196},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0980000000000001,"15min":1.2090000000000001},"last":0.65100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.93300000000000005},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":6.8019999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.96099999999999997},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96999999999999997,"5min":1.0980000000000001,"15min":7.2329999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":1.022},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91000000000000003,"5min":1.591,"15min":7.5640000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76000000000000001,"15min":0.92400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.93400000000000005},"min":{"1min":0.46000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":6.7530000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70999999999999996,"15min":1.056},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.544,"15min":7.7789999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.79700000000000004,"15min":1.089},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":0.86899999999999999,"5min":8.4039999999999999,"15min":8.7530000000000001},"last":0.81999999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.88900000000000001,"15min":6.6879999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.99199999999999999},"min":{"1min":0.47299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.635,"15min":7.1680000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.85299999999999998},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70699999999999996,"15min":1.7669999999999999},"min":{"1min":0.5,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":24.623000000000001},"last":0.93200000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71299999999999997,"15min":1.1060000000000001},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.84399999999999997,"5min":1.679,"15min":7.6390000000000002},"last":0.747},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.80000000000000004,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99099999999999999,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.94999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.45300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79700000000000004,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.65100000000000002},"min":{"1min":0.52600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92400000000000004,"5min":1.218,"15min":1.218},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.51300000000000001},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.91200000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.47499999999999998},"max":{"1min":0.90300000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.85099999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.70299999999999996},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":1.238,"15min":1.238},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.91300000000000003,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.79900000000000004},"min":{"1min":0.52800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0900000000000001,"15min":1.095},"last":0.83699999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88900000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.81499999999999995},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96299999999999997,"5min":1.302,"15min":1.302},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.439},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44}]},{"osd":1,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.99299999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.635,"5min":1.635,"15min":3.1970000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.659,"5min":1.659,"15min":3.2480000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.83699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92100000000000004,"5min":1.0289999999999999,"15min":3.4289999999999998},"last":0.495},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.73399999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.55800000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.86899999999999999},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.708,"5min":1.708,"15min":3.3210000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96699999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.745},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72499999999999998,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":3.2890000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68999999999999995,"15min":0.89400000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":1.0880000000000001,"15min":3.476},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71899999999999997,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.442,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":2.056,"15min":2.056},"last":0.621}]},{"osd":1,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60399999999999998,"5min":1.175,"15min":1.175},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.44600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73699999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93400000000000005,"5min":1.351,"15min":1.351},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96099999999999997,"5min":1.752,"15min":1.752},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90400000000000003,"5min":1.214,"15min":1.214},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.79200000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92600000000000005,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.74299999999999999,"15min":0.77700000000000002},"min":{"1min":0.59799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":1.421,"15min":1.421},"last":0.79700000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.56499999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91900000000000004,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39200000000000002,"15min":0.47799999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":0.752,"15min":2.5619999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.4159999999999999},"last":0.437}]},{"osd":2,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42999999999999999,"15min":0.498},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52400000000000002,"5min":0.68200000000000005,"15min":1.6140000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":2.6030000000000002},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59799999999999998,"5min":0.752,"15min":2.6429999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61299999999999999,"5min":0.95199999999999996,"15min":1.7470000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96299999999999997,"5min":1.085,"15min":2.4049999999999998},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.034,"15min":1.329},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.01,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0880000000000001,"15min":2.5129999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.58999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.7070000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.3799999999999999},"last":0.745},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.61299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":1.1279999999999999,"15min":1.173},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.58599999999999997},"min":{"1min":0.26100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.747,"15min":4.3760000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.53000000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":2.5779999999999998},"last":0.436}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.96099999999999997,"15min":2.415},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.68000000000000005},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60799999999999998,"5min":0.79000000000000004,"15min":5.234},"last":0.56000000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.57899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":0.85399999999999998,"15min":3.726},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.52300000000000002,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":5.1959999999999997},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.89700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91300000000000003,"5min":1.105,"15min":5.1639999999999997},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.69299999999999995,"15min":0.80200000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":1.1659999999999999,"15min":2.7530000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.81000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.238,"15min":2.835},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.84899999999999998},"min":{"1min":0.55100000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85799999999999998,"5min":1.1080000000000001,"15min":3.3679999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71799999999999997,"15min":0.84899999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85399999999999998,"5min":1.1359999999999999,"15min":3.4700000000000002},"last":1.081},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72599999999999998,"15min":0.82599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":1.1850000000000001,"15min":2.9940000000000002},"last":0.92600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72499999999999998,"15min":0.85399999999999998},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":1.1379999999999999,"15min":3.3300000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.2450000000000001,"15min":2.798},"last":0.90700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:12.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:12.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd52757640 1 Processor -- start 2023-11-26T07:24:12.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd52757640 1 -- start start 2023-11-26T07:24:12.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd52757640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efd4c0b2160 0x7efd4c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd52757640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0cf0e0 con 0x7efd4c15d6e0 2023-11-26T07:24:12.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd52757640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0ceb20 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd52757640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c15dac0 con 0x7efd4c0b2160 2023-11-26T07:24:12.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd4bfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efd4c15d6e0 0x7efd4c0d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58526/0 (socket says 172.21.15.70:58526) 2023-11-26T07:24:12.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd4bfff640 1 -- 172.21.15.70:0/1570097442 learned_addr learned my addr 172.21.15.70:0/1570097442 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:12.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd50cf4640 1 --2- 172.21.15.70:0/1570097442 >> v2:172.21.15.70:3300/0 conn(0x7efd4c0b2160 0x7efd4c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd4affd640 1 -- 172.21.15.70:0/1570097442 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130418752 0 0) 0x7efd4c0cf0e0 con 0x7efd4c15d6e0 2023-11-26T07:24:12.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd4affd640 1 -- 172.21.15.70:0/1570097442 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd34003530 con 0x7efd4c15d6e0 2023-11-26T07:24:12.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd50cf4640 1 -- 172.21.15.70:0/1570097442 >> v1:172.21.15.120:6789/0 conn(0x7efd4c0d1bc0 legacy=0x7efd4c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd50cf4640 1 -- 172.21.15.70:0/1570097442 >> v1:172.21.15.70:6789/0 conn(0x7efd4c15d6e0 legacy=0x7efd4c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.687+0000 7efd50cf4640 1 -- 172.21.15.70:0/1570097442 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0cee00 con 0x7efd4c0b2160 2023-11-26T07:24:12.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd50cf4640 1 --2- 172.21.15.70:0/1570097442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0b2160 0x7efd4c0d0df0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7efd44009d90 tx=0x7efd4401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dcf1c8d59adaf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd4affd640 1 -- 172.21.15.70:0/1570097442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440a5900 con 0x7efd4c0b2160 2023-11-26T07:24:12.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd4affd640 1 -- 172.21.15.70:0/1570097442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd440a5a60 con 0x7efd4c0b2160 2023-11-26T07:24:12.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd4affd640 1 -- 172.21.15.70:0/1570097442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440a5df0 con 0x7efd4c0b2160 2023-11-26T07:24:12.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd52757640 1 -- 172.21.15.70:0/1570097442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0b2160 msgr2=0x7efd4c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd52757640 1 --2- 172.21.15.70:0/1570097442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0b2160 0x7efd4c0d0df0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7efd44009d90 tx=0x7efd4401c950 comp rx=0 tx=0).stop 2023-11-26T07:24:12.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd52757640 1 -- 172.21.15.70:0/1570097442 shutdown_connections 2023-11-26T07:24:12.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd52757640 1 --2- 172.21.15.70:0/1570097442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0b2160 0x7efd4c0d0df0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd52757640 1 -- 172.21.15.70:0/1570097442 >> 172.21.15.70:0/1570097442 conn(0x7efd4c09c550 msgr2=0x7efd4c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd52757640 1 -- 172.21.15.70:0/1570097442 shutdown_connections 2023-11-26T07:24:12.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.691+0000 7efd52757640 1 -- 172.21.15.70:0/1570097442 wait complete. 2023-11-26T07:24:12.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 Processor -- start 2023-11-26T07:24:12.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 -- start start 2023-11-26T07:24:12.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd4c0b2160 0x7efd4c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0d1bc0 0x7efd4c0b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd4c15d6e0 0x7efd4c144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0cb400 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0ca780 con 0x7efd4c0b2160 2023-11-26T07:24:12.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0caa60 con 0x7efd4c15d6e0 2023-11-26T07:24:12.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0d1bc0 0x7efd4c0b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0d1bc0 0x7efd4c0b8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54260/0 (socket says 172.21.15.70:54260) 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 -- 172.21.15.70:0/61840775 learned_addr learned my addr 172.21.15.70:0/61840775 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd4c0b2160 0x7efd4c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd50cf4640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd4c15d6e0 0x7efd4c144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 -- 172.21.15.70:0/61840775 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd4c15d6e0 msgr2=0x7efd4c144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd4c15d6e0 0x7efd4c144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 -- 172.21.15.70:0/61840775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd4c0b2160 msgr2=0x7efd4c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd4c0b2160 0x7efd4c0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 -- 172.21.15.70:0/61840775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44009a70 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd4b7fe640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0d1bc0 0x7efd4c0b8560 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c500 tx=0x7efd4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd48ff9640 1 -- 172.21.15.70:0/61840775 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40005220 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd48ff9640 1 -- 172.21.15.70:0/61840775 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40005380 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd48ff9640 1 -- 172.21.15.70:0/61840775 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40007270 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c0cad40 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.695+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c0b8aa0 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.699+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4c067680 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.699+0000 7efd48ff9640 1 -- 172.21.15.70:0/61840775 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7efd400073d0 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.699 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.699+0000 7efd48ff9640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd38066f20 0x7efd380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:12.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.699+0000 7efd48ff9640 1 -- 172.21.15.70:0/61840775 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd40081d90 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.699+0000 7efd4bfff640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd38066f20 0x7efd380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:12.700 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.699+0000 7efd4bfff640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd38066f20 0x7efd380693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0011f0 tx=0x7efd3c007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:12.702 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.703+0000 7efd48ff9640 1 -- 172.21.15.70:0/61840775 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd40050a60 con 0x7efd4c0d1bc0 2023-11-26T07:24:12.848 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.847+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd4c066e50 con 0x7efd38066f20 2023-11-26T07:24:12.850 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.851+0000 7efd48ff9640 1 -- 172.21.15.70:0/61840775 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51100 (secure 0 0 0) 0x7efd4c066e50 con 0x7efd38066f20 2023-11-26T07:24:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:12.851 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:24:12.852 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd38066f20 msgr2=0x7efd380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd38066f20 0x7efd380693e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0011f0 tx=0x7efd3c007d40 comp rx=0 tx=0).stop 2023-11-26T07:24:12.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0d1bc0 msgr2=0x7efd4c0b8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:12.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0d1bc0 0x7efd4c0b8560 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c500 tx=0x7efd4000c9c0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 shutdown_connections 2023-11-26T07:24:12.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efd38066f20 0x7efd380693e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.853 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd4c0d1bc0 0x7efd4c0b8560 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efd4c15d6e0 0x7efd4c144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 --2- 172.21.15.70:0/61840775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd4c0b2160 0x7efd4c0cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:12.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 >> 172.21.15.70:0/61840775 conn(0x7efd4c09c550 msgr2=0x7efd4c158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:12.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 shutdown_connections 2023-11-26T07:24:12.854 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:12.855+0000 7efd52757640 1 -- 172.21.15.70:0/61840775 wait complete. 2023-11-26T07:24:12.872 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2023-11-26T07:24:12.069049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":279396,"kb_used_data":9128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695324,"statfs":{"total":773094113280,"available":772808011776,"internally_reserved":0,"allocated":9347072,"data_stored":4668032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422027672,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-946,"num_write_kb":-412284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001361"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-26T07:24:08.248997+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:24:08.248997+0000","last_peered":"2023-11-26T07:24:08.248997+0000","last_clean":"2023-11-26T07:24:08.248997+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:24:08.248997+0000","last_undegraded":"2023-11-26T07:24:08.248997+0000","last_fullsized":"2023-11-26T07:24:08.248997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.621},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.872,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57999999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.64300000000000002},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.028,"5min":1.028,"15min":1.6950000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63500000000000001,"15min":0.70499999999999996},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.88900000000000001,"15min":0.91500000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.755},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.71399999999999997,"15min":0.76800000000000002},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.76900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84699999999999998,"5min":1.171,"15min":1.171},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65800000000000003,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":1.093,"15min":1.093},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67800000000000005,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.872,"5min":0.91900000000000004,"15min":1.1559999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.76200000000000001},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":0.98899999999999999,"15min":1.089},"last":0.68899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.48399999999999999,"15min":0.46500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.76300000000000001},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.872,"5min":1.046,"15min":1.0629999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.39900000000000002},"max":{"1min":0.92800000000000005,"5min":0.94199999999999995,"15min":1.018},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64600000000000002,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83499999999999996,"5min":1.038,"15min":1.133},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93999999999999995,"5min":1.016,"15min":1.042},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.93999999999999995,"5min":1.0820000000000001,"15min":1.196},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0980000000000001,"15min":1.2090000000000001},"last":0.65100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.93300000000000005},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":6.8019999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.96099999999999997},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96999999999999997,"5min":1.0980000000000001,"15min":7.2329999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":1.022},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91000000000000003,"5min":1.591,"15min":7.5640000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76000000000000001,"15min":0.92400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.93400000000000005},"min":{"1min":0.46000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":6.7530000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70999999999999996,"15min":1.056},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.544,"15min":7.7789999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.79700000000000004,"15min":1.089},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":0.86899999999999999,"5min":8.4039999999999999,"15min":8.7530000000000001},"last":0.81999999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.88900000000000001,"15min":6.6879999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.99199999999999999},"min":{"1min":0.47299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.635,"15min":7.1680000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.85299999999999998},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70699999999999996,"15min":1.7669999999999999},"min":{"1min":0.5,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":24.623000000000001},"last":0.93200000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71299999999999997,"15min":1.1060000000000001},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.84399999999999997,"5min":1.679,"15min":7.6390000000000002},"last":0.747},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.80000000000000004,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99099999999999999,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.94999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.45300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79700000000000004,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.65100000000000002},"min":{"1min":0.52600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92400000000000004,"5min":1.218,"15min":1.218},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.51300000000000001},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.91200000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.47499999999999998},"max":{"1min":0.90300000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.85099999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.70299999999999996},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":1.238,"15min":1.238},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.91300000000000003,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.79900000000000004},"min":{"1min":0.52800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0900000000000001,"15min":1.095},"last":0.83699999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88900000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.81499999999999995},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96299999999999997,"5min":1.302,"15min":1.302},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.439},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44}]},{"osd":1,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.99299999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.635,"5min":1.635,"15min":3.1970000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.659,"5min":1.659,"15min":3.2480000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.83699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92100000000000004,"5min":1.0289999999999999,"15min":3.4289999999999998},"last":0.495},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.73399999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.55800000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.86899999999999999},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.708,"5min":1.708,"15min":3.3210000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96699999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.745},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72499999999999998,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":3.2890000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68999999999999995,"15min":0.89400000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":1.0880000000000001,"15min":3.476},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71899999999999997,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.442,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":2.056,"15min":2.056},"last":0.621}]},{"osd":1,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60399999999999998,"5min":1.175,"15min":1.175},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.44600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73699999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93400000000000005,"5min":1.351,"15min":1.351},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96099999999999997,"5min":1.752,"15min":1.752},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90400000000000003,"5min":1.214,"15min":1.214},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.79200000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92600000000000005,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.74299999999999999,"15min":0.77700000000000002},"min":{"1min":0.59799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":1.421,"15min":1.421},"last":0.79700000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.56499999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91900000000000004,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39200000000000002,"15min":0.47799999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":0.752,"15min":2.5619999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.4159999999999999},"last":0.437}]},{"osd":2,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42999999999999999,"15min":0.498},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52400000000000002,"5min":0.68200000000000005,"15min":1.6140000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":2.6030000000000002},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59799999999999998,"5min":0.752,"15min":2.6429999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61299999999999999,"5min":0.95199999999999996,"15min":1.7470000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96299999999999997,"5min":1.085,"15min":2.4049999999999998},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.034,"15min":1.329},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.01,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0880000000000001,"15min":2.5129999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.58999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.7070000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.3799999999999999},"last":0.745},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.61299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":1.1279999999999999,"15min":1.173},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.58599999999999997},"min":{"1min":0.26100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.747,"15min":4.3760000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.53000000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":2.5779999999999998},"last":0.436}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.96099999999999997,"15min":2.415},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.68000000000000005},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60799999999999998,"5min":0.79000000000000004,"15min":5.234},"last":0.56000000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.57899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":0.85399999999999998,"15min":3.726},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.52300000000000002,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":5.1959999999999997},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.89700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91300000000000003,"5min":1.105,"15min":5.1639999999999997},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.69299999999999995,"15min":0.80200000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":1.1659999999999999,"15min":2.7530000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.81000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.238,"15min":2.835},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.84899999999999998},"min":{"1min":0.55100000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85799999999999998,"5min":1.1080000000000001,"15min":3.3679999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71799999999999997,"15min":0.84899999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85399999999999998,"5min":1.1359999999999999,"15min":3.4700000000000002},"last":1.081},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72599999999999998,"15min":0.82599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":1.1850000000000001,"15min":2.9940000000000002},"last":0.92600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72499999999999998,"15min":0.85399999999999998},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":1.1379999999999999,"15min":3.3300000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.2450000000000001,"15min":2.798},"last":0.90700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:12.873 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-26T07:24:12.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:13.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.011+0000 7f6c82396640 1 Processor -- start 2023-11-26T07:24:13.012 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.011+0000 7f6c82396640 1 -- start start 2023-11-26T07:24:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c82396640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c1613f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c82396640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0d4170 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c82396640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0ce290 con 0x7f6c7c160850 2023-11-26T07:24:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c82396640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c161930 con 0x7f6c7c160f60 2023-11-26T07:24:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c80b93640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6c7c0d3d30 0x7f6c7c0cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:58536/0 (socket says 172.21.15.70:58536) 2023-11-26T07:24:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c80b93640 1 -- 172.21.15.70:0/3697835972 learned_addr learned my addr 172.21.15.70:0/3697835972 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c81b95640 1 --2- 172.21.15.70:0/3697835972 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c1613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c73fff640 1 -- 172.21.15.70:0/3697835972 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626676622 0 0) 0x7f6c7c0d4170 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c73fff640 1 -- 172.21.15.70:0/3697835972 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c68003530 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c73fff640 1 -- 172.21.15.70:0/3697835972 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462782760 0 0) 0x7f6c7c0ce290 con 0x7f6c7c160850 2023-11-26T07:24:13.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c73fff640 1 -- 172.21.15.70:0/3697835972 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c0d4170 con 0x7f6c7c160850 2023-11-26T07:24:13.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c81b95640 1 -- 172.21.15.70:0/3697835972 >> v1:172.21.15.120:6789/0 conn(0x7f6c7c160850 legacy=0x7f6c7c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c81b95640 1 -- 172.21.15.70:0/3697835972 >> v1:172.21.15.70:6789/0 conn(0x7f6c7c0d3d30 legacy=0x7f6c7c0cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.015+0000 7f6c81b95640 1 -- 172.21.15.70:0/3697835972 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0ce570 con 0x7f6c7c160f60 2023-11-26T07:24:13.016 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c81b95640 1 --2- 172.21.15.70:0/3697835972 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c1613f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009dc0 tx=0x7f6c7401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9ee09448d94669 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c73fff640 1 -- 172.21.15.70:0/3697835972 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740a5a00 con 0x7f6c7c160f60 2023-11-26T07:24:13.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c73fff640 1 -- 172.21.15.70:0/3697835972 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c740a5b60 con 0x7f6c7c160f60 2023-11-26T07:24:13.017 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c73fff640 1 -- 172.21.15.70:0/3697835972 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740ad440 con 0x7f6c7c160f60 2023-11-26T07:24:13.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 -- 172.21.15.70:0/3697835972 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 msgr2=0x7f6c7c1613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 --2- 172.21.15.70:0/3697835972 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c1613f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009dc0 tx=0x7f6c7401c940 comp rx=0 tx=0).stop 2023-11-26T07:24:13.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 -- 172.21.15.70:0/3697835972 shutdown_connections 2023-11-26T07:24:13.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 --2- 172.21.15.70:0/3697835972 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c1613f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.018 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 -- 172.21.15.70:0/3697835972 >> 172.21.15.70:0/3697835972 conn(0x7f6c7c09c5a0 msgr2=0x7f6c7c0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 -- 172.21.15.70:0/3697835972 shutdown_connections 2023-11-26T07:24:13.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 -- 172.21.15.70:0/3697835972 wait complete. 2023-11-26T07:24:13.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 Processor -- start 2023-11-26T07:24:13.019 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.019+0000 7f6c82396640 1 -- start start 2023-11-26T07:24:13.021 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c7c0d3d30 0x7f6c7c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c7c160850 0x7f6c7c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b7c80 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0cbd70 con 0x7f6c7c160850 2023-11-26T07:24:13.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b7690 con 0x7f6c7c160f60 2023-11-26T07:24:13.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c7c0d3d30 0x7f6c7c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.022 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c7c0d3d30 0x7f6c7c0cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54262/0 (socket says 172.21.15.70:54262) 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 -- 172.21.15.70:0/3727570607 learned_addr learned my addr 172.21.15.70:0/3727570607 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c80b93640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c7c160850 0x7f6c7c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81b95640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 -- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 msgr2=0x7f6c7c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 -- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c7c160850 msgr2=0x7f6c7c1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c7c160850 0x7f6c7c1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 -- 172.21.15.70:0/3727570607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74009a70 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c81394640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c7c0d3d30 0x7f6c7c0cd160 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c430 tx=0x7f6c7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c71ffb640 1 -- 172.21.15.70:0/3727570607 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780052d0 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c71ffb640 1 -- 172.21.15.70:0/3727570607 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c78005450 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c71ffb640 1 -- 172.21.15.70:0/3727570607 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78003840 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.024 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c0cb7b0 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c0b78a0 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c0cd6a0 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.023+0000 7f6c71ffb640 1 -- 172.21.15.70:0/3727570607 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f6c780039a0 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.025 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.027+0000 7f6c71ffb640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c60066f20 0x7f6c600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.027+0000 7f6c71ffb640 1 -- 172.21.15.70:0/3727570607 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c78081f10 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.027+0000 7f6c80b93640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c60066f20 0x7f6c600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.026 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.027+0000 7f6c80b93640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c60066f20 0x7f6c600693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0b7620 tx=0x7f6c6c007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.031+0000 7f6c71ffb640 1 -- 172.21.15.70:0/3727570607 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c78050cc0 con 0x7f6c7c0d3d30 2023-11-26T07:24:13.177 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.179+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c7c160c30 con 0x7f6c60066f20 2023-11-26T07:24:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.179+0000 7f6c71ffb640 1 -- 172.21.15.70:0/3727570607 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51100 (secure 0 0 0) 0x7f6c6c005860 con 0x7f6c60066f20 2023-11-26T07:24:13.180 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:24:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c60066f20 msgr2=0x7f6c600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c60066f20 0x7f6c600693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0b7620 tx=0x7f6c6c007d40 comp rx=0 tx=0).stop 2023-11-26T07:24:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c7c0d3d30 msgr2=0x7f6c7c0cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c7c0d3d30 0x7f6c7c0cd160 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800c430 tx=0x7f6c7800c8f0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 shutdown_connections 2023-11-26T07:24:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f6c7c160f60 0x7f6c7c0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c7c160850 0x7f6c7c1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f6c60066f20 0x7f6c600693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 --2- 172.21.15.70:0/3727570607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c7c0d3d30 0x7f6c7c0cd160 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 >> 172.21.15.70:0/3727570607 conn(0x7f6c7c09c5a0 msgr2=0x7f6c7c06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 shutdown_connections 2023-11-26T07:24:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.183+0000 7f6c82396640 1 -- 172.21.15.70:0/3727570607 wait complete. 2023-11-26T07:24:13.200 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2023-11-26T07:24:12.069049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":279396,"kb_used_data":9128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695324,"statfs":{"total":773094113280,"available":772808011776,"internally_reserved":0,"allocated":9347072,"data_stored":4668032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-422027672,"num_objects":-427,"num_object_clones":-1,"num_object_copies":-854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-427,"num_whiteouts":-1,"num_read":-209,"num_read_kb":-204809,"num_write":-946,"num_write_kb":-412284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001361"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-26T07:24:08.248997+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:24:08.248997+0000","last_peered":"2023-11-26T07:24:08.248997+0000","last_clean":"2023-11-26T07:24:08.248997+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:24:08.248997+0000","last_undegraded":"2023-11-26T07:24:08.248997+0000","last_fullsized":"2023-11-26T07:24:08.248997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.621},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.872,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57999999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.64300000000000002},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.028,"5min":1.028,"15min":1.6950000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63500000000000001,"15min":0.70499999999999996},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.88900000000000001,"15min":0.91500000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.755},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.71399999999999997,"15min":0.76800000000000002},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.76900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84699999999999998,"5min":1.171,"15min":1.171},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65800000000000003,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":1.093,"15min":1.093},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67800000000000005,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.872,"5min":0.91900000000000004,"15min":1.1559999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.76200000000000001},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":0.98899999999999999,"15min":1.089},"last":0.68899999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.48399999999999999,"15min":0.46500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.76300000000000001},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.872,"5min":1.046,"15min":1.0629999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.39900000000000002},"max":{"1min":0.92800000000000005,"5min":0.94199999999999995,"15min":1.018},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64600000000000002,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83499999999999996,"5min":1.038,"15min":1.133},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93999999999999995,"5min":1.016,"15min":1.042},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.93999999999999995,"5min":1.0820000000000001,"15min":1.196},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0980000000000001,"15min":1.2090000000000001},"last":0.65100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.93300000000000005},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":6.8019999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.96099999999999997},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96999999999999997,"5min":1.0980000000000001,"15min":7.2329999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":1.022},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91000000000000003,"5min":1.591,"15min":7.5640000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76000000000000001,"15min":0.92400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.93400000000000005},"min":{"1min":0.46000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":6.7530000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70999999999999996,"15min":1.056},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.544,"15min":7.7789999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.79700000000000004,"15min":1.089},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":0.86899999999999999,"5min":8.4039999999999999,"15min":8.7530000000000001},"last":0.81999999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.88900000000000001,"15min":6.6879999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.99199999999999999},"min":{"1min":0.47299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.635,"15min":7.1680000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.85299999999999998},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70699999999999996,"15min":1.7669999999999999},"min":{"1min":0.5,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":24.623000000000001},"last":0.93200000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71299999999999997,"15min":1.1060000000000001},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.84399999999999997,"5min":1.679,"15min":7.6390000000000002},"last":0.747},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.80000000000000004,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99099999999999999,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.94999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.45300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79700000000000004,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.65100000000000002},"min":{"1min":0.52600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92400000000000004,"5min":1.218,"15min":1.218},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.51300000000000001},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.91200000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.47499999999999998},"max":{"1min":0.90300000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.85099999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64100000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.70299999999999996},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":1.238,"15min":1.238},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.91300000000000003,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.79900000000000004},"min":{"1min":0.52800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0900000000000001,"15min":1.095},"last":0.83699999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88900000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.81499999999999995},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96299999999999997,"5min":1.302,"15min":1.302},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.439},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.44}]},{"osd":1,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.99299999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.635,"5min":1.635,"15min":3.1970000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.659,"5min":1.659,"15min":3.2480000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.83699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92100000000000004,"5min":1.0289999999999999,"15min":3.4289999999999998},"last":0.495},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.73399999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.55800000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.86899999999999999},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.708,"5min":1.708,"15min":3.3210000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96699999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.745},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72499999999999998,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":3.2890000000000001},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68999999999999995,"15min":0.89400000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":1.0880000000000001,"15min":3.476},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71899999999999997,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.442,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":2.056,"15min":2.056},"last":0.621}]},{"osd":1,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60399999999999998,"5min":1.175,"15min":1.175},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.44600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73699999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93400000000000005,"5min":1.351,"15min":1.351},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96099999999999997,"5min":1.752,"15min":1.752},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90400000000000003,"5min":1.214,"15min":1.214},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.79200000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92600000000000005,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.74299999999999999,"15min":0.77700000000000002},"min":{"1min":0.59799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":1.421,"15min":1.421},"last":0.79700000000000004}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.56499999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91900000000000004,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39200000000000002,"15min":0.47799999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":0.752,"15min":2.5619999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.4159999999999999},"last":0.437}]},{"osd":2,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42999999999999999,"15min":0.498},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52400000000000002,"5min":0.68200000000000005,"15min":1.6140000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":2.6030000000000002},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59799999999999998,"5min":0.752,"15min":2.6429999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61299999999999999,"5min":0.95199999999999996,"15min":1.7470000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96299999999999997,"5min":1.085,"15min":2.4049999999999998},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.034,"15min":1.329},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.01,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0880000000000001,"15min":2.5129999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.58999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.7070000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.3799999999999999},"last":0.745},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.61299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":1.1279999999999999,"15min":1.173},"last":0.86299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.58599999999999997},"min":{"1min":0.26100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.747,"15min":4.3760000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.53000000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":2.5779999999999998},"last":0.436}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.96099999999999997,"15min":2.415},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.68000000000000005},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60799999999999998,"5min":0.79000000000000004,"15min":5.234},"last":0.56000000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.57899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":0.85399999999999998,"15min":3.726},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.52300000000000002,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":5.1959999999999997},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.89700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91300000000000003,"5min":1.105,"15min":5.1639999999999997},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.69299999999999995,"15min":0.80200000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":1.1659999999999999,"15min":2.7530000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.81000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.238,"15min":2.835},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.84899999999999998},"min":{"1min":0.55100000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85799999999999998,"5min":1.1080000000000001,"15min":3.3679999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71799999999999997,"15min":0.84899999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85399999999999998,"5min":1.1359999999999999,"15min":3.4700000000000002},"last":1.081},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72599999999999998,"15min":0.82599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":1.1850000000000001,"15min":2.9940000000000002},"last":0.92600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72499999999999998,"15min":0.85399999999999998},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":1.1379999999999999,"15min":3.3300000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.2450000000000001,"15min":2.798},"last":0.90700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:13.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-26T07:24:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.339+0000 7f7fba172640 1 Processor -- start 2023-11-26T07:24:13.340 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.339+0000 7f7fba172640 1 -- start start 2023-11-26T07:24:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fba172640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb41596d0 0x7f7fb4071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fba172640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7fb40ce680 0x7f7fb40b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fba172640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb406c750 con 0x7f7fb40b2db0 2023-11-26T07:24:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fba172640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40b3240 con 0x7f7fb40ce680 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fba172640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40cbe00 con 0x7f7fb41596d0 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb2ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7fb40ce680 0x7f7fb40b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb41596d0 0x7f7fb4071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb2ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7fb40ce680 0x7f7fb40b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.70:45904/0 (socket says 172.21.15.70:45904) 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb2ffd640 1 -- 172.21.15.70:0/1520423542 learned_addr learned my addr 172.21.15.70:0/1520423542 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb2ffd640 1 -- 172.21.15.70:0/1520423542 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb41596d0 msgr2=0x7f7fb4071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb2ffd640 1 --2- 172.21.15.70:0/1520423542 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb41596d0 0x7f7fb4071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb2ffd640 1 -- 172.21.15.70:0/1520423542 >> v1:172.21.15.120:6789/0 conn(0x7f7fb40b2db0 legacy=0x7f7fb415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.344 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.343+0000 7f7fb2ffd640 1 -- 172.21.15.70:0/1520423542 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40b3550 con 0x7f7fb40ce680 2023-11-26T07:24:13.345 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fb2ffd640 1 --2- 172.21.15.70:0/1520423542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb40ce680 0x7f7fb40b2870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8006fd0 tx=0x7f7fa801e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeeb912c9b658392 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fb27fc640 1 -- 172.21.15.70:0/1520423542 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8004230 con 0x7f7fb40ce680 2023-11-26T07:24:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fb27fc640 1 -- 172.21.15.70:0/1520423542 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa80ab070 con 0x7f7fb40ce680 2023-11-26T07:24:13.346 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fb27fc640 1 -- 172.21.15.70:0/1520423542 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80a7710 con 0x7f7fb40ce680 2023-11-26T07:24:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 -- 172.21.15.70:0/1520423542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb40ce680 msgr2=0x7f7fb40b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 --2- 172.21.15.70:0/1520423542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb40ce680 0x7f7fb40b2870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8006fd0 tx=0x7f7fa801e9d0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 -- 172.21.15.70:0/1520423542 shutdown_connections 2023-11-26T07:24:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 --2- 172.21.15.70:0/1520423542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb40ce680 0x7f7fb40b2870 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.347 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 --2- 172.21.15.70:0/1520423542 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb41596d0 0x7f7fb4071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 -- 172.21.15.70:0/1520423542 >> 172.21.15.70:0/1520423542 conn(0x7f7fb406a890 msgr2=0x7f7fb406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 -- 172.21.15.70:0/1520423542 shutdown_connections 2023-11-26T07:24:13.348 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 -- 172.21.15.70:0/1520423542 wait complete. 2023-11-26T07:24:13.350 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 Processor -- start 2023-11-26T07:24:13.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.347+0000 7f7fba172640 1 -- start start 2023-11-26T07:24:13.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40b2db0 0x7f7fb4139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb40ce680 0x7f7fb41398b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb41596d0 0x7f7fb40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb415a730 con 0x7f7fb40b2db0 2023-11-26T07:24:13.351 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4139df0 con 0x7f7fb41596d0 2023-11-26T07:24:13.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb414e220 con 0x7f7fb40ce680 2023-11-26T07:24:13.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40b2db0 0x7f7fb4139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40b2db0 0x7f7fb4139370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54272/0 (socket says 172.21.15.70:54272) 2023-11-26T07:24:13.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 -- 172.21.15.70:0/2177902949 learned_addr learned my addr 172.21.15.70:0/2177902949 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:13.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb2ffd640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb40ce680 0x7f7fb41398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.352 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb3fff640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb41596d0 0x7f7fb40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 -- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb40ce680 msgr2=0x7f7fb41398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb40ce680 0x7f7fb41398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 -- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb41596d0 msgr2=0x7f7fb40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb41596d0 0x7f7fb40ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 -- 172.21.15.70:0/2177902949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa800b780 con 0x7f7fb40b2db0 2023-11-26T07:24:13.353 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb2ffd640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb40ce680 0x7f7fb41398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:24:13.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fb37fe640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40b2db0 0x7f7fb4139370 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e8a0 tx=0x7f7fa400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7f9bfff640 1 -- 172.21.15.70:0/2177902949 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4009510 con 0x7f7fb40b2db0 2023-11-26T07:24:13.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4159dd0 con 0x7f7fb40b2db0 2023-11-26T07:24:13.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7f9bfff640 1 -- 172.21.15.70:0/2177902949 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400c940 con 0x7f7fb40b2db0 2023-11-26T07:24:13.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7f9bfff640 1 -- 172.21.15.70:0/2177902949 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400ccb0 con 0x7f7fb40b2db0 2023-11-26T07:24:13.354 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb415a350 con 0x7f7fb40b2db0 2023-11-26T07:24:13.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4067680 con 0x7f7fb40b2db0 2023-11-26T07:24:13.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.351+0000 7f7f9bfff640 1 -- 172.21.15.70:0/2177902949 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f7fa4013470 con 0x7f7fb40b2db0 2023-11-26T07:24:13.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.355+0000 7f7f9bfff640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fa0066f20 0x7f7fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:13.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.355+0000 7f7f9bfff640 1 -- 172.21.15.70:0/2177902949 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7fa40828d0 con 0x7f7fb40b2db0 2023-11-26T07:24:13.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.355+0000 7f7fb2ffd640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fa0066f20 0x7f7fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:13.356 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.355+0000 7f7fb2ffd640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fa0066f20 0x7f7fa00693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b1000 tx=0x7f7fa80a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:13.357 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.359+0000 7f7f9bfff640 1 -- 172.21.15.70:0/2177902949 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fa40517d0 con 0x7f7fb40b2db0 2023-11-26T07:24:13.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.507+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fb40709f0 con 0x7f7fb40b2db0 2023-11-26T07:24:13.508 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7f9bfff640 1 -- 172.21.15.70:0/2177902949 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+12989 (secure 0 0 0) 0x7f7fa4054df0 con 0x7f7fb40b2db0 2023-11-26T07:24:13.509 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:13.509 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"35961970-1319-4bbb-b3aa-e783ca1e0d4a","created":"2023-11-26T07:17:38.988164+0000","modified":"2023-11-26T07:24:09.243253+0000","last_up_change":"2023-11-26T07:17:50.575885+0000","last_in_change":"2023-11-26T07:17:41.541729+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-26T07:17:52.051221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7f617f30-acde-4a42-9bca-1c4da35adc04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6825","nonce":1953415072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6827","nonce":1953415072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6831","nonce":1953415072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":1953415072},{"type":"v1","addr":"172.21.15.70:6829","nonce":1953415072}]},"public_addr":"172.21.15.70:6825/1953415072","cluster_addr":"172.21.15.70:6827/1953415072","heartbeat_back_addr":"172.21.15.70:6831/1953415072","heartbeat_front_addr":"172.21.15.70:6829/1953415072","state":["exists","up"]},{"osd":1,"uuid":"d6a69912-aa01-4bcf-931b-ac2886810112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6803","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6806","nonce":1649140554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6812","nonce":1649140554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6822","nonce":1649140554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6815","nonce":1649140554},{"type":"v1","addr":"172.21.15.70:6818","nonce":1649140554}]},"public_addr":"172.21.15.70:6806/1649140554","cluster_addr":"172.21.15.70:6812/1649140554","heartbeat_back_addr":"172.21.15.70:6822/1649140554","heartbeat_front_addr":"172.21.15.70:6818/1649140554","state":["exists","up"]},{"osd":2,"uuid":"c6c38537-0e14-4e7d-b7f3-0889d8123cf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6807","nonce":4252988777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6813","nonce":4252988777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6823","nonce":4252988777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":4252988777},{"type":"v1","addr":"172.21.15.70:6819","nonce":4252988777}]},"public_addr":"172.21.15.70:6807/4252988777","cluster_addr":"172.21.15.70:6813/4252988777","heartbeat_back_addr":"172.21.15.70:6823/4252988777","heartbeat_front_addr":"172.21.15.70:6819/4252988777","state":["exists","up"]},{"osd":3,"uuid":"a8f222d5-be8c-4f49-8a76-931257753b67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6801","nonce":102590499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6805","nonce":102590499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6816","nonce":102590499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":102590499},{"type":"v1","addr":"172.21.15.70:6811","nonce":102590499}]},"public_addr":"172.21.15.70:6801/102590499","cluster_addr":"172.21.15.70:6805/102590499","heartbeat_back_addr":"172.21.15.70:6816/102590499","heartbeat_front_addr":"172.21.15.70:6811/102590499","state":["exists","up"]},{"osd":4,"uuid":"03f81073-1152-4a51-be86-287aa4b40aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6825","nonce":2950360410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6827","nonce":2950360410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6831","nonce":2950360410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":2950360410},{"type":"v1","addr":"172.21.15.120:6829","nonce":2950360410}]},"public_addr":"172.21.15.120:6825/2950360410","cluster_addr":"172.21.15.120:6827/2950360410","heartbeat_back_addr":"172.21.15.120:6831/2950360410","heartbeat_front_addr":"172.21.15.120:6829/2950360410","state":["exists","up"]},{"osd":5,"uuid":"9c070a19-1766-4918-b937-75107bfe163f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6801","nonce":1452349968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6803","nonce":1452349968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6807","nonce":1452349968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1452349968},{"type":"v1","addr":"172.21.15.120:6805","nonce":1452349968}]},"public_addr":"172.21.15.120:6801/1452349968","cluster_addr":"172.21.15.120:6803/1452349968","heartbeat_back_addr":"172.21.15.120:6807/1452349968","heartbeat_front_addr":"172.21.15.120:6805/1452349968","state":["exists","up"]},{"osd":6,"uuid":"520cc563-cde2-4144-98c0-7425192c41dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6809","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6811","nonce":1672802144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6813","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6815","nonce":1672802144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6823","nonce":1672802144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":1672802144},{"type":"v1","addr":"172.21.15.120:6819","nonce":1672802144}]},"public_addr":"172.21.15.120:6811/1672802144","cluster_addr":"172.21.15.120:6815/1672802144","heartbeat_back_addr":"172.21.15.120:6823/1672802144","heartbeat_front_addr":"172.21.15.120:6819/1672802144","state":["exists","up"]},{"osd":7,"uuid":"e850d242-cf65-409f-809e-16d5626a8026","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6810","nonce":3467251727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6814","nonce":3467251727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6822","nonce":3467251727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":3467251727},{"type":"v1","addr":"172.21.15.120:6818","nonce":3467251727}]},"public_addr":"172.21.15.120:6810/3467251727","cluster_addr":"172.21.15.120:6814/3467251727","heartbeat_back_addr":"172.21.15.120:6822/3467251727","heartbeat_front_addr":"172.21.15.120:6818/3467251727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.185795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.301666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.293924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.323298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.286773+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.189231+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.295763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-26T07:17:47.226976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6834/2083039818":"2023-11-27T07:24:06.228219+0000","172.21.15.120:6832/2083039818":"2023-11-27T07:24:06.228219+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-26T07:24:13.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fa0066f20 msgr2=0x7f7fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fa0066f20 0x7f7fa00693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b1000 tx=0x7f7fa80a9070 comp rx=0 tx=0).stop 2023-11-26T07:24:13.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40b2db0 msgr2=0x7f7fb4139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:13.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40b2db0 0x7f7fb4139370 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e8a0 tx=0x7f7fa400eca0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.511 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 shutdown_connections 2023-11-26T07:24:13.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb41596d0 0x7f7fb40ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f7fb40ce680 0x7f7fb41398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7fa0066f20 0x7f7fa00693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 --2- 172.21.15.70:0/2177902949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40b2db0 0x7f7fb4139370 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:13.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 >> 172.21.15.70:0/2177902949 conn(0x7f7fb406a890 msgr2=0x7f7fb40b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:13.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 shutdown_connections 2023-11-26T07:24:13.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:13.511+0000 7f7fba172640 1 -- 172.21.15.70:0/2177902949 wait complete. 2023-11-26T07:24:14.530 INFO:tasks.ceph:Scrubbing osd.0 2023-11-26T07:24:14.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:14.682 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 Processor -- start 2023-11-26T07:24:14.683 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 -- start start 2023-11-26T07:24:14.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323813e290 0x7f32380cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f32380cf7c0 0x7f323815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.684 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f323815f4e0 0x7f32381408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32380cfc40 con 0x7f32380cf7c0 2023-11-26T07:24:14.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323806c520 con 0x7f323815f4e0 2023-11-26T07:24:14.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f323de6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323806c800 con 0x7f323813e290 2023-11-26T07:24:14.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f3236ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f32380cf7c0 0x7f323815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f3236ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f32380cf7c0 0x7f323815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52006/0 (socket says 172.21.15.70:52006) 2023-11-26T07:24:14.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.683+0000 7f3236ffd640 1 -- 172.21.15.70:0/1964067084 learned_addr learned my addr 172.21.15.70:0/1964067084 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:14.685 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3237fff640 1 --2- 172.21.15.70:0/1964067084 >> v2:172.21.15.120:3300/0 conn(0x7f323815f4e0 0x7f32381408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f32377fe640 1 --2- 172.21.15.70:0/1964067084 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323813e290 0x7f32380cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3236ffd640 1 -- 172.21.15.70:0/1964067084 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323813e290 msgr2=0x7f32380cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3236ffd640 1 --2- 172.21.15.70:0/1964067084 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323813e290 0x7f32380cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3236ffd640 1 -- 172.21.15.70:0/1964067084 >> v2:172.21.15.120:3300/0 conn(0x7f323815f4e0 msgr2=0x7f32381408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3236ffd640 1 --2- 172.21.15.70:0/1964067084 >> v2:172.21.15.120:3300/0 conn(0x7f323815f4e0 0x7f32381408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3236ffd640 1 -- 172.21.15.70:0/1964067084 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323806cae0 con 0x7f32380cf7c0 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3237fff640 1 --2- 172.21.15.70:0/1964067084 >> v2:172.21.15.120:3300/0 conn(0x7f323815f4e0 0x7f32381408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:14.686 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f32377fe640 1 --2- 172.21.15.70:0/1964067084 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323813e290 0x7f32380cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:14.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f3236ffd640 1 --2- 172.21.15.70:0/1964067084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f323815efa0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f3238072660 tx=0x7f322c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d905de3cbef625 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f32367fc640 1 -- 172.21.15.70:0/1964067084 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0ab600 con 0x7f32380cf7c0 2023-11-26T07:24:14.687 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f32367fc640 1 -- 172.21.15.70:0/1964067084 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c0a7050 con 0x7f32380cf7c0 2023-11-26T07:24:14.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f32367fc640 1 -- 172.21.15.70:0/1964067084 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0ab980 con 0x7f32380cf7c0 2023-11-26T07:24:14.688 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 -- 172.21.15.70:0/1964067084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 msgr2=0x7f323815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 --2- 172.21.15.70:0/1964067084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f323815efa0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f3238072660 tx=0x7f322c01c210 comp rx=0 tx=0).stop 2023-11-26T07:24:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 -- 172.21.15.70:0/1964067084 shutdown_connections 2023-11-26T07:24:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 --2- 172.21.15.70:0/1964067084 >> v2:172.21.15.120:3300/0 conn(0x7f323815f4e0 0x7f32381408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 --2- 172.21.15.70:0/1964067084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f323815efa0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 --2- 172.21.15.70:0/1964067084 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323813e290 0x7f32380cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 -- 172.21.15.70:0/1964067084 >> 172.21.15.70:0/1964067084 conn(0x7f323806a890 msgr2=0x7f323806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.687+0000 7f323de6b640 1 -- 172.21.15.70:0/1964067084 shutdown_connections 2023-11-26T07:24:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 -- 172.21.15.70:0/1964067084 wait complete. 2023-11-26T07:24:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 Processor -- start 2023-11-26T07:24:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 -- start start 2023-11-26T07:24:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f3238137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f323813e290 0x7f3238137130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323815f4e0 0x7f323813d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32380b29b0 con 0x7f32380cf7c0 2023-11-26T07:24:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238137670 con 0x7f323813e290 2023-11-26T07:24:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f323de6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32381fa350 con 0x7f323815f4e0 2023-11-26T07:24:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f3238137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f3238137d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52020/0 (socket says 172.21.15.70:52020) 2023-11-26T07:24:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 -- 172.21.15.70:0/659854612 learned_addr learned my addr 172.21.15.70:0/659854612 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f3236ffd640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f323813e290 0x7f3238137130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f3237fff640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323815f4e0 0x7f323813d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 -- 172.21.15.70:0/659854612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323815f4e0 msgr2=0x7f323813d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f323815f4e0 0x7f323813d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 -- 172.21.15.70:0/659854612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f323813e290 msgr2=0x7f3238137130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f323813e290 0x7f3238137130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 -- 172.21.15.70:0/659854612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0094d0 con 0x7f32380cf7c0 2023-11-26T07:24:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.691+0000 7f32377fe640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f3238137d00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f322800c7c0 tx=0x7f322800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228007a30 con 0x7f32380cf7c0 2023-11-26T07:24:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228007b90 con 0x7f32380cf7c0 2023-11-26T07:24:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323813d920 con 0x7f32380cf7c0 2023-11-26T07:24:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800ce70 con 0x7f32380cf7c0 2023-11-26T07:24:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32381f9a20 con 0x7f32380cf7c0 2023-11-26T07:24:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f323815fb00 con 0x7f32380cf7c0 2023-11-26T07:24:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f32280113f0 con 0x7f32380cf7c0 2023-11-26T07:24:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3224066f50 0x7f3224069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3228082810 con 0x7f32380cf7c0 2023-11-26T07:24:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f3236ffd640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3224066f50 0x7f3224069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7f322406cdb0 0x7f322406f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 --> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f322406f880 con 0x7f322406cdb0 2023-11-26T07:24:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32280875e0 con 0x7f32380cf7c0 2023-11-26T07:24:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f3237fff640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7f322406cdb0 0x7f322406f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.695+0000 7f3236ffd640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3224066f50 0x7f3224069410 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f322c0ad000 tx=0x7f322c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.699+0000 7f3237fff640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7f322406cdb0 0x7f322406f1d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.699+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== osd.0 v2:172.21.15.70:6824/1953415072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f322406f880 con 0x7f322406cdb0 2023-11-26T07:24:14.709 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 --> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f32381fa490 con 0x7f322406cdb0 2023-11-26T07:24:14.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f321ffff640 1 -- 172.21.15.70:0/659854612 <== osd.0 v2:172.21.15.70:6824/1953415072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f323000f3f0 con 0x7f322406cdb0 2023-11-26T07:24:14.710 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:14.711 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:14.711 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:14.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7f322406cdb0 msgr2=0x7f322406f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6824/1953415072,v1:172.21.15.70:6825/1953415072] conn(0x7f322406cdb0 0x7f322406f1d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3224066f50 msgr2=0x7f3224069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3224066f50 0x7f3224069410 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f322c0ad000 tx=0x7f322c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:14.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 msgr2=0x7f3238137d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 --2- 172.21.15.70:0/659854612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32380cf7c0 0x7f3238137d00 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f322800c7c0 tx=0x7f322800cc80 comp rx=0 tx=0).stop 2023-11-26T07:24:14.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f3237fff640 1 -- 172.21.15.70:0/659854612 reap_dead start 2023-11-26T07:24:14.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 shutdown_connections 2023-11-26T07:24:14.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 >> 172.21.15.70:0/659854612 conn(0x7f323806a890 msgr2=0x7f323806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:14.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 shutdown_connections 2023-11-26T07:24:14.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.711+0000 7f323de6b640 1 -- 172.21.15.70:0/659854612 wait complete. 2023-11-26T07:24:14.728 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-26T07:24:14.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.867+0000 7f182da6b640 1 Processor -- start 2023-11-26T07:24:14.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.867+0000 7f182da6b640 1 -- start start 2023-11-26T07:24:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f182da6b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f182813e290 0x7f18280cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f182da6b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f182815f6b0 0x7f18280cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f182da6b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182815fb20 con 0x7f18280cf7c0 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f182da6b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280cfc40 con 0x7f182815f6b0 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f182da6b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182806c520 con 0x7f182813e290 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1826ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f18280cf7c0 0x7f182815efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34846/0 (socket says 172.21.15.70:34846) 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1826ffd640 1 -- 172.21.15.70:0/3436981193 learned_addr learned my addr 172.21.15.70:0/3436981193 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1827fff640 1 --2- 172.21.15.70:0/3436981193 >> v2:172.21.15.70:3300/0 conn(0x7f182815f6b0 0x7f18280cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f18277fe640 1 --2- 172.21.15.70:0/3436981193 >> v2:172.21.15.120:3300/0 conn(0x7f182813e290 0x7f18280cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f18267fc640 1 -- 172.21.15.70:0/3436981193 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524793333 0 0) 0x7f181c001120 con 0x7f18280cf7c0 2023-11-26T07:24:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1827fff640 1 -- 172.21.15.70:0/3436981193 >> v2:172.21.15.120:3300/0 conn(0x7f182813e290 msgr2=0x7f18280cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1827fff640 1 --2- 172.21.15.70:0/3436981193 >> v2:172.21.15.120:3300/0 conn(0x7f182813e290 0x7f18280cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1827fff640 1 -- 172.21.15.70:0/3436981193 >> v1:172.21.15.70:6789/0 conn(0x7f18280cf7c0 legacy=0x7f182815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1827fff640 1 -- 172.21.15.70:0/3436981193 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182806c800 con 0x7f182815f6b0 2023-11-26T07:24:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f1827fff640 1 --2- 172.21.15.70:0/3436981193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f182815f6b0 0x7f18280cd7b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f18280725a0 tx=0x7f182001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d4103027994fde server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f18267fc640 1 -- 172.21.15.70:0/3436981193 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200a59a0 con 0x7f182815f6b0 2023-11-26T07:24:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f18267fc640 1 -- 172.21.15.70:0/3436981193 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18200a5b00 con 0x7f182815f6b0 2023-11-26T07:24:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.871+0000 7f18267fc640 1 -- 172.21.15.70:0/3436981193 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200a5e90 con 0x7f182815f6b0 2023-11-26T07:24:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- 172.21.15.70:0/3436981193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f182815f6b0 msgr2=0x7f18280cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 --2- 172.21.15.70:0/3436981193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f182815f6b0 0x7f18280cd7b0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f18280725a0 tx=0x7f182001c8e0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- 172.21.15.70:0/3436981193 shutdown_connections 2023-11-26T07:24:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 --2- 172.21.15.70:0/3436981193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f182815f6b0 0x7f18280cd7b0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 --2- 172.21.15.70:0/3436981193 >> v2:172.21.15.120:3300/0 conn(0x7f182813e290 0x7f18280cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- 172.21.15.70:0/3436981193 >> 172.21.15.70:0/3436981193 conn(0x7f182806a890 msgr2=0x7f182806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- 172.21.15.70:0/3436981193 shutdown_connections 2023-11-26T07:24:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- 172.21.15.70:0/3436981193 wait complete. 2023-11-26T07:24:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 Processor -- start 2023-11-26T07:24:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- start start 2023-11-26T07:24:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18280cf7c0 0x7f18280b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182813e290 0x7f1828137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f182815f6b0 0x7f1828152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828154d30 con 0x7f18280cf7c0 2023-11-26T07:24:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182813a040 con 0x7f182813e290 2023-11-26T07:24:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f182da6b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1828137ed0 con 0x7f182815f6b0 2023-11-26T07:24:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f18277fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18280cf7c0 0x7f18280b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f18277fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18280cf7c0 0x7f18280b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52048/0 (socket says 172.21.15.70:52048) 2023-11-26T07:24:14.877 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.875+0000 7f18277fe640 1 -- 172.21.15.70:0/2965577953 learned_addr learned my addr 172.21.15.70:0/2965577953 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f1827fff640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f182815f6b0 0x7f1828152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f1826ffd640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182813e290 0x7f1828137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f18277fe640 1 -- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f182815f6b0 msgr2=0x7f1828152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f18277fe640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f182815f6b0 0x7f1828152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f18277fe640 1 -- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182813e290 msgr2=0x7f1828137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f18277fe640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182813e290 0x7f1828137990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f18277fe640 1 -- 172.21.15.70:0/2965577953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820009a70 con 0x7f18280cf7c0 2023-11-26T07:24:14.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f1827fff640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f182815f6b0 0x7f1828152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:14.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f1826ffd640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182813e290 0x7f1828137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:14.879 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f18277fe640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18280cf7c0 0x7f18280b1560 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f181800e960 tx=0x7f181800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.880 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f180ffff640 1 -- 172.21.15.70:0/2965577953 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818009690 con 0x7f18280cf7c0 2023-11-26T07:24:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f180ffff640 1 -- 172.21.15.70:0/2965577953 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800ca00 con 0x7f18280cf7c0 2023-11-26T07:24:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f180ffff640 1 -- 172.21.15.70:0/2965577953 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800cd70 con 0x7f18280cf7c0 2023-11-26T07:24:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1828154390 con 0x7f18280cf7c0 2023-11-26T07:24:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1828154950 con 0x7f18280cf7c0 2023-11-26T07:24:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1828067680 con 0x7f18280cf7c0 2023-11-26T07:24:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f180ffff640 1 -- 172.21.15.70:0/2965577953 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f1818013470 con 0x7f18280cf7c0 2023-11-26T07:24:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f180ffff640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1814066f50 0x7f1814069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:14.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f180ffff640 1 -- 172.21.15.70:0/2965577953 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f18180829c0 con 0x7f18280cf7c0 2023-11-26T07:24:14.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.879+0000 7f1826ffd640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1814066f50 0x7f1814069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:14.882 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.883+0000 7f1826ffd640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1814066f50 0x7f1814069410 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f181c007fd0 tx=0x7f181c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:14.884 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:14.883+0000 7f180ffff640 1 -- 172.21.15.70:0/2965577953 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18180518f0 con 0x7f18280cf7c0 2023-11-26T07:24:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.035+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f182806df50 con 0x7f1814066f50 2023-11-26T07:24:15.036 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.035+0000 7f180ffff640 1 -- 172.21.15.70:0/2965577953 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f182806df50 con 0x7f1814066f50 2023-11-26T07:24:15.037 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2023-11-26T07:24:15.037 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1814066f50 msgr2=0x7f1814069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1814066f50 0x7f1814069410 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f181c007fd0 tx=0x7f181c009040 comp rx=0 tx=0).stop 2023-11-26T07:24:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18280cf7c0 msgr2=0x7f18280b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18280cf7c0 0x7f18280b1560 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f181800e960 tx=0x7f181800ee20 comp rx=0 tx=0).stop 2023-11-26T07:24:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 shutdown_connections 2023-11-26T07:24:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f182815f6b0 0x7f1828152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.038 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182813e290 0x7f1828137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1814066f50 0x7f1814069410 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 --2- 172.21.15.70:0/2965577953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18280cf7c0 0x7f18280b1560 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 >> 172.21.15.70:0/2965577953 conn(0x7f182806a890 msgr2=0x7f18280b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 shutdown_connections 2023-11-26T07:24:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.039+0000 7f182da6b640 1 -- 172.21.15.70:0/2965577953 wait complete. 2023-11-26T07:24:15.056 INFO:tasks.ceph:Scrubbing osd.1 2023-11-26T07:24:15.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae87ce4640 1 Processor -- start 2023-11-26T07:24:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae87ce4640 1 -- start start 2023-11-26T07:24:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae87ce4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fae800cf990 0x7fae8015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae87ce4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8006c520 con 0x7fae8013e290 2023-11-26T07:24:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae87ce4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8006c800 con 0x7fae8015f4e0 2023-11-26T07:24:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae87ce4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8006cae0 con 0x7fae800cf990 2023-11-26T07:24:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae85a80640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fae8013e290 0x7fae800cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34862/0 (socket says 172.21.15.70:34862) 2023-11-26T07:24:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.199+0000 7fae85a80640 1 -- 172.21.15.70:0/1108568801 learned_addr learned my addr 172.21.15.70:0/1108568801 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae8527f640 1 --2- 172.21.15.70:0/1108568801 >> v2:172.21.15.120:3300/0 conn(0x7fae800cf990 0x7fae8015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae84a7e640 1 -- 172.21.15.70:0/1108568801 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87937549 0 0) 0x7fae8006c520 con 0x7fae8013e290 2023-11-26T07:24:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae84a7e640 1 -- 172.21.15.70:0/1108568801 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6c003530 con 0x7fae8013e290 2023-11-26T07:24:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae8527f640 1 -- 172.21.15.70:0/1108568801 >> v1:172.21.15.120:6789/0 conn(0x7fae8015f4e0 legacy=0x7fae800cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae8527f640 1 -- 172.21.15.70:0/1108568801 >> v1:172.21.15.70:6789/0 conn(0x7fae8013e290 legacy=0x7fae800cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae8527f640 1 -- 172.21.15.70:0/1108568801 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8006cdc0 con 0x7fae800cf990 2023-11-26T07:24:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae8527f640 1 --2- 172.21.15.70:0/1108568801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 0x7fae8015efa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fae700097c0 tx=0x7fae7001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77dd2b18d2fe036c server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae84a7e640 1 -- 172.21.15.70:0/1108568801 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700ab670 con 0x7fae800cf990 2023-11-26T07:24:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae84a7e640 1 -- 172.21.15.70:0/1108568801 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae700ab7d0 con 0x7fae800cf990 2023-11-26T07:24:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.203+0000 7fae84a7e640 1 -- 172.21.15.70:0/1108568801 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700abb60 con 0x7fae800cf990 2023-11-26T07:24:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- 172.21.15.70:0/1108568801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 msgr2=0x7fae8015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 --2- 172.21.15.70:0/1108568801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 0x7fae8015efa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fae700097c0 tx=0x7fae7001c450 comp rx=0 tx=0).stop 2023-11-26T07:24:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- 172.21.15.70:0/1108568801 shutdown_connections 2023-11-26T07:24:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 --2- 172.21.15.70:0/1108568801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 0x7fae8015efa0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- 172.21.15.70:0/1108568801 >> 172.21.15.70:0/1108568801 conn(0x7fae8006a890 msgr2=0x7fae8006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- 172.21.15.70:0/1108568801 shutdown_connections 2023-11-26T07:24:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- 172.21.15.70:0/1108568801 wait complete. 2023-11-26T07:24:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 Processor -- start 2023-11-26T07:24:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- start start 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 0x7fae8015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae8013e290 0x7fae80136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fae8015f4e0 0x7fae8015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800afff0 con 0x7fae8013e290 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800b05b0 con 0x7fae800cf990 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae87ce4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8015e640 con 0x7fae8015f4e0 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae8527f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae8013e290 0x7fae80136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae8527f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae8013e290 0x7fae80136c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52062/0 (socket says 172.21.15.70:52062) 2023-11-26T07:24:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae8527f640 1 -- 172.21.15.70:0/3273959740 learned_addr learned my addr 172.21.15.70:0/3273959740 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae85a80640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 0x7fae8015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.207+0000 7fae86281640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fae8015f4e0 0x7fae8015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae8527f640 1 -- 172.21.15.70:0/3273959740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fae8015f4e0 msgr2=0x7fae8015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae8527f640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fae8015f4e0 0x7fae8015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae8527f640 1 -- 172.21.15.70:0/3273959740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 msgr2=0x7fae8015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae8527f640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae800cf990 0x7fae8015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae8527f640 1 -- 172.21.15.70:0/3273959740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70009420 con 0x7fae8013e290 2023-11-26T07:24:15.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae86281640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fae8015f4e0 0x7fae8015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:15.211 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae8527f640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae8013e290 0x7fae80136c90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fae70019060 tx=0x7fae7001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700b5810 con 0x7fae8013e290 2023-11-26T07:24:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae700b5970 con 0x7fae8013e290 2023-11-26T07:24:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae800b0240 con 0x7fae8013e290 2023-11-26T07:24:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700b5d20 con 0x7fae8013e290 2023-11-26T07:24:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae801371d0 con 0x7fae8013e290 2023-11-26T07:24:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae800ccd90 con 0x7fae8013e290 2023-11-26T07:24:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fae700bf410 con 0x7fae8013e290 2023-11-26T07:24:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fae64066f20 0x7fae640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fae8015fb00 con 0x7fae8013e290 2023-11-26T07:24:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae85a80640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fae64066f20 0x7fae640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7fae6406cd80 0x7fae6406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.211+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 --> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae6406f850 con 0x7fae6406cd80 2023-11-26T07:24:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.215+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae70120200 con 0x7fae8013e290 2023-11-26T07:24:15.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.215+0000 7fae86281640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7fae6406cd80 0x7fae6406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.215+0000 7fae85a80640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fae64066f20 0x7fae640693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0011f0 tx=0x7fae7c007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.215+0000 7fae86281640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7fae6406cd80 0x7fae6406f1a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.215 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.215+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== osd.1 v2:172.21.15.70:6803/1649140554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fae6406f850 con 0x7fae6406cd80 2023-11-26T07:24:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 --> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fae80169020 con 0x7fae6406cd80 2023-11-26T07:24:15.226 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae767fc640 1 -- 172.21.15.70:0/3273959740 <== osd.1 v2:172.21.15.70:6803/1649140554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fae78001ea0 con 0x7fae6406cd80 2023-11-26T07:24:15.227 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:15.227 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:15.227 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7fae6406cd80 msgr2=0x7fae6406f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6803/1649140554,v1:172.21.15.70:6806/1649140554] conn(0x7fae6406cd80 0x7fae6406f1a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fae64066f20 msgr2=0x7fae640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fae64066f20 0x7fae640693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0011f0 tx=0x7fae7c007d40 comp rx=0 tx=0).stop 2023-11-26T07:24:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae8013e290 msgr2=0x7fae80136c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 --2- 172.21.15.70:0/3273959740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae8013e290 0x7fae80136c90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fae70019060 tx=0x7fae7001ac90 comp rx=0 tx=0).stop 2023-11-26T07:24:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae86281640 1 -- 172.21.15.70:0/3273959740 reap_dead start 2023-11-26T07:24:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 shutdown_connections 2023-11-26T07:24:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 >> 172.21.15.70:0/3273959740 conn(0x7fae8006a890 msgr2=0x7fae801552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 shutdown_connections 2023-11-26T07:24:15.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.227+0000 7fae87ce4640 1 -- 172.21.15.70:0/3273959740 wait complete. 2023-11-26T07:24:15.245 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-26T07:24:15.382 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.383+0000 7f81b752a640 1 Processor -- start 2023-11-26T07:24:15.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.383+0000 7f81b752a640 1 -- start start 2023-11-26T07:24:15.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.383+0000 7f81b752a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.383+0000 7f81b752a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f81b00cf7c0 0x7f81b00708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.383+0000 7f81b752a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b00cfc20 con 0x7f81b0070e00 2023-11-26T07:24:15.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.383+0000 7f81b752a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b0162080 con 0x7f81b00cf7c0 2023-11-26T07:24:15.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.383+0000 7f81b752a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b0161d70 con 0x7f81b014b1e0 2023-11-26T07:24:15.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b4ac5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f81b00cf7c0 0x7f81b00708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b5ac7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f81b0070e00 0x7f81b00b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34868/0 (socket says 172.21.15.70:34868) 2023-11-26T07:24:15.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b5ac7640 1 -- 172.21.15.70:0/2399325605 learned_addr learned my addr 172.21.15.70:0/2399325605 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:15.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b52c6640 1 --2- 172.21.15.70:0/2399325605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.386 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81a7fff640 1 -- 172.21.15.70:0/2399325605 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124396910 0 0) 0x7f81b00cfc20 con 0x7f81b0070e00 2023-11-26T07:24:15.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81a7fff640 1 -- 172.21.15.70:0/2399325605 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f819c003530 con 0x7f81b0070e00 2023-11-26T07:24:15.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b4ac5640 1 -- 172.21.15.70:0/2399325605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 msgr2=0x7f81b00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:15.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b4ac5640 1 --2- 172.21.15.70:0/2399325605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b4ac5640 1 -- 172.21.15.70:0/2399325605 >> v1:172.21.15.70:6789/0 conn(0x7f81b0070e00 legacy=0x7f81b00b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b4ac5640 1 -- 172.21.15.70:0/2399325605 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b014b5c0 con 0x7f81b00cf7c0 2023-11-26T07:24:15.387 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b52c6640 1 --2- 172.21.15.70:0/2399325605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:15.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81b4ac5640 1 --2- 172.21.15.70:0/2399325605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b00cf7c0 0x7f81b00708c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f81a00097c0 tx=0x7f81a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cfbfafbd25e7e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81a7fff640 1 -- 172.21.15.70:0/2399325605 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a00ab650 con 0x7f81b00cf7c0 2023-11-26T07:24:15.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81a7fff640 1 -- 172.21.15.70:0/2399325605 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a00ab7b0 con 0x7f81b00cf7c0 2023-11-26T07:24:15.388 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.387+0000 7f81a7fff640 1 -- 172.21.15.70:0/2399325605 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a00abb20 con 0x7f81b00cf7c0 2023-11-26T07:24:15.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- 172.21.15.70:0/2399325605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b00cf7c0 msgr2=0x7f81b00708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.389 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 --2- 172.21.15.70:0/2399325605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b00cf7c0 0x7f81b00708c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f81a00097c0 tx=0x7f81a001c450 comp rx=0 tx=0).stop 2023-11-26T07:24:15.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- 172.21.15.70:0/2399325605 shutdown_connections 2023-11-26T07:24:15.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 --2- 172.21.15.70:0/2399325605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b00cf7c0 0x7f81b00708c0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 --2- 172.21.15.70:0/2399325605 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- 172.21.15.70:0/2399325605 >> 172.21.15.70:0/2399325605 conn(0x7f81b006a890 msgr2=0x7f81b006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- 172.21.15.70:0/2399325605 shutdown_connections 2023-11-26T07:24:15.390 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- 172.21.15.70:0/2399325605 wait complete. 2023-11-26T07:24:15.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 Processor -- start 2023-11-26T07:24:15.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- start start 2023-11-26T07:24:15.392 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b0070e00 0x7f81b01429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81b00cf7c0 0x7f81b00acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00ac1c0 con 0x7f81b0070e00 2023-11-26T07:24:15.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00ab5b0 con 0x7f81b00cf7c0 2023-11-26T07:24:15.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b752a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00ab890 con 0x7f81b014b1e0 2023-11-26T07:24:15.393 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b52c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b0070e00 0x7f81b01429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b52c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b0070e00 0x7f81b01429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52080/0 (socket says 172.21.15.70:52080) 2023-11-26T07:24:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b52c6640 1 -- 172.21.15.70:0/2937096079 learned_addr learned my addr 172.21.15.70:0/2937096079 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b52c6640 1 -- 172.21.15.70:0/2937096079 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 msgr2=0x7f81b00b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b52c6640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b52c6640 1 -- 172.21.15.70:0/2937096079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81b00cf7c0 msgr2=0x7f81b00acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.394 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.391+0000 7f81b52c6640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81b00cf7c0 0x7f81b00acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81b52c6640 1 -- 172.21.15.70:0/2937096079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a0009420 con 0x7f81b0070e00 2023-11-26T07:24:15.395 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81b52c6640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b0070e00 0x7f81b01429a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00d800 tx=0x7f81ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81a5ffb640 1 -- 172.21.15.70:0/2937096079 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0096c0 con 0x7f81b0070e00 2023-11-26T07:24:15.396 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81a5ffb640 1 -- 172.21.15.70:0/2937096079 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac009820 con 0x7f81b0070e00 2023-11-26T07:24:15.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b00abb70 con 0x7f81b0070e00 2023-11-26T07:24:15.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81a5ffb640 1 -- 172.21.15.70:0/2937096079 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac009bd0 con 0x7f81b0070e00 2023-11-26T07:24:15.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b0142ee0 con 0x7f81b0070e00 2023-11-26T07:24:15.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0067680 con 0x7f81b0070e00 2023-11-26T07:24:15.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.395+0000 7f81a5ffb640 1 -- 172.21.15.70:0/2937096079 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f81ac009d30 con 0x7f81b0070e00 2023-11-26T07:24:15.397 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.399+0000 7f81a5ffb640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8194066f20 0x7f81940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.399+0000 7f81a5ffb640 1 -- 172.21.15.70:0/2937096079 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f81ac082f00 con 0x7f81b0070e00 2023-11-26T07:24:15.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.399+0000 7f81b4ac5640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8194066f20 0x7f81940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.398 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.399+0000 7f81b4ac5640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8194066f20 0x7f81940693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f81a00af000 tx=0x7f81a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.400 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.403+0000 7f81a5ffb640 1 -- 172.21.15.70:0/2937096079 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81ac051dd0 con 0x7f81b0070e00 2023-11-26T07:24:15.548 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.547+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f81b00b0480 con 0x7f8194066f20 2023-11-26T07:24:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81a5ffb640 1 -- 172.21.15.70:0/2937096079 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f81b00b0480 con 0x7f8194066f20 2023-11-26T07:24:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2023-11-26T07:24:15.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8194066f20 msgr2=0x7f81940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8194066f20 0x7f81940693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f81a00af000 tx=0x7f81a0008040 comp rx=0 tx=0).stop 2023-11-26T07:24:15.550 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b0070e00 msgr2=0x7f81b01429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b0070e00 0x7f81b01429a0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00d800 tx=0x7f81ac00dcc0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 shutdown_connections 2023-11-26T07:24:15.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f81b014b1e0 0x7f81b00b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81b00cf7c0 0x7f81b00acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8194066f20 0x7f81940693e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 --2- 172.21.15.70:0/2937096079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81b0070e00 0x7f81b01429a0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.551 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 >> 172.21.15.70:0/2937096079 conn(0x7f81b006a890 msgr2=0x7f81b006d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 shutdown_connections 2023-11-26T07:24:15.552 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.551+0000 7f81b752a640 1 -- 172.21.15.70:0/2937096079 wait complete. 2023-11-26T07:24:15.569 INFO:tasks.ceph:Scrubbing osd.2 2023-11-26T07:24:15.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:15.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f087212a640 1 Processor -- start 2023-11-26T07:24:15.710 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f087212a640 1 -- start start 2023-11-26T07:24:15.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f087212a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f086c15d580 0x7f086c0d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f087212a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f086c0d1f00 0x7f086c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.712 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f087212a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c0d0bc0 con 0x7f086c0d3e60 2023-11-26T07:24:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f087212a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0d0320 con 0x7f086c15d580 2023-11-26T07:24:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f087212a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c0d0600 con 0x7f086c0d1f00 2023-11-26T07:24:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f086c15d580 0x7f086c0d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086b7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f086c15d580 0x7f086c0d3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52086/0 (socket says 172.21.15.70:52086) 2023-11-26T07:24:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086b7fe640 1 -- 172.21.15.70:0/2134389195 learned_addr learned my addr 172.21.15.70:0/2134389195 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086affd640 1 --1- 172.21.15.70:0/2134389195 >> v1:172.21.15.70:6789/0 conn(0x7f086c0d3e60 0x7f086c0d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34874/0 (socket says 172.21.15.70:34874) 2023-11-26T07:24:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086bfff640 1 --2- 172.21.15.70:0/2134389195 >> v2:172.21.15.120:3300/0 conn(0x7f086c0d1f00 0x7f086c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086b7fe640 1 -- 172.21.15.70:0/2134389195 >> v2:172.21.15.120:3300/0 conn(0x7f086c0d1f00 msgr2=0x7f086c0b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086b7fe640 1 --2- 172.21.15.70:0/2134389195 >> v2:172.21.15.120:3300/0 conn(0x7f086c0d1f00 0x7f086c0b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086b7fe640 1 -- 172.21.15.70:0/2134389195 >> v1:172.21.15.70:6789/0 conn(0x7f086c0d3e60 legacy=0x7f086c0d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086b7fe640 1 -- 172.21.15.70:0/2134389195 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0d08e0 con 0x7f086c15d580 2023-11-26T07:24:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.711+0000 7f086a7fc640 1 -- 172.21.15.70:0/2134389195 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973475016 0 0) 0x7f086c0d0bc0 con 0x7f086c0d3e60 2023-11-26T07:24:15.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f086b7fe640 1 --2- 172.21.15.70:0/2134389195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0d3920 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f086c08d400 tx=0x7f085c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebb551efeb74233 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.716 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f086a7fc640 1 -- 172.21.15.70:0/2134389195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0ab600 con 0x7f086c15d580 2023-11-26T07:24:15.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f086a7fc640 1 -- 172.21.15.70:0/2134389195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c0ab760 con 0x7f086c15d580 2023-11-26T07:24:15.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f086a7fc640 1 -- 172.21.15.70:0/2134389195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c0abaf0 con 0x7f086c15d580 2023-11-26T07:24:15.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 -- 172.21.15.70:0/2134389195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 msgr2=0x7f086c0d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.717 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 --2- 172.21.15.70:0/2134389195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0d3920 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f086c08d400 tx=0x7f085c01c4d0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 -- 172.21.15.70:0/2134389195 shutdown_connections 2023-11-26T07:24:15.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 --2- 172.21.15.70:0/2134389195 >> v2:172.21.15.120:3300/0 conn(0x7f086c0d1f00 0x7f086c0b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 --2- 172.21.15.70:0/2134389195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0d3920 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.718 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 -- 172.21.15.70:0/2134389195 >> 172.21.15.70:0/2134389195 conn(0x7f086c09c550 msgr2=0x7f086c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 -- 172.21.15.70:0/2134389195 shutdown_connections 2023-11-26T07:24:15.719 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.715+0000 7f087212a640 1 -- 172.21.15.70:0/2134389195 wait complete. 2023-11-26T07:24:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 Processor -- start 2023-11-26T07:24:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 -- start start 2023-11-26T07:24:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f086c0d1f00 0x7f086c153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f086c0d3e60 0x7f086c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0b2180 con 0x7f086c15d580 2023-11-26T07:24:15.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c153b50 con 0x7f086c0d3e60 2023-11-26T07:24:15.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0cd100 con 0x7f086c0d1f00 2023-11-26T07:24:15.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0b70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52102/0 (socket says 172.21.15.70:52102) 2023-11-26T07:24:15.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 -- 172.21.15.70:0/3959832446 learned_addr learned my addr 172.21.15.70:0/3959832446 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:15.722 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086b7fe640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f086c0d1f00 0x7f086c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086affd640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f086c0d3e60 0x7f086c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 -- 172.21.15.70:0/3959832446 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f086c0d1f00 msgr2=0x7f086c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f086c0d1f00 0x7f086c153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 -- 172.21.15.70:0/3959832446 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f086c0d3e60 msgr2=0x7f086c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f086c0d3e60 0x7f086c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 -- 172.21.15.70:0/3959832446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0094d0 con 0x7f086c15d580 2023-11-26T07:24:15.723 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086affd640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f086c0d3e60 0x7f086c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f086bfff640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0b70b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0864007e30 tx=0x7f086400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864014620 con 0x7f086c15d580 2023-11-26T07:24:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400ee90 con 0x7f086c15d580 2023-11-26T07:24:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640149c0 con 0x7f086c15d580 2023-11-26T07:24:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.719+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c0cd3e0 con 0x7f086c15d580 2023-11-26T07:24:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0b26b0 con 0x7f086c15d580 2023-11-26T07:24:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f086c0d15c0 con 0x7f086c15d580 2023-11-26T07:24:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f0864014b20 con 0x7f086c15d580 2023-11-26T07:24:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f0853fff640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0858066f20 0x7f08580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08640830f0 con 0x7f086c15d580 2023-11-26T07:24:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f0853fff640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f085806cd80 0x7f085806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f086b7fe640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0858066f20 0x7f08580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 --> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f085806f850 con 0x7f085806cd80 2023-11-26T07:24:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0864087db0 con 0x7f086c15d580 2023-11-26T07:24:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f086affd640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f085806cd80 0x7f085806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f086b7fe640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0858066f20 0x7f08580693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f085c0af000 tx=0x7f085c0b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.723+0000 7f086affd640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f085806cd80 0x7f085806f1a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.727+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== osd.2 v2:172.21.15.70:6804/4252988777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f085806f850 con 0x7f085806cd80 2023-11-26T07:24:15.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 --> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f086c067680 con 0x7f085806cd80 2023-11-26T07:24:15.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f0853fff640 1 -- 172.21.15.70:0/3959832446 <== osd.2 v2:172.21.15.70:6804/4252988777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f086c067680 con 0x7f085806cd80 2023-11-26T07:24:15.739 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:15.739 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:15.739 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:15.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f085806cd80 msgr2=0x7f085806f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6804/4252988777,v1:172.21.15.70:6807/4252988777] conn(0x7f085806cd80 0x7f085806f1a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0858066f20 msgr2=0x7f08580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0858066f20 0x7f08580693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f085c0af000 tx=0x7f085c0b6040 comp rx=0 tx=0).stop 2023-11-26T07:24:15.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 msgr2=0x7f086c0b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 --2- 172.21.15.70:0/3959832446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f086c15d580 0x7f086c0b70b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0864007e30 tx=0x7f086400e4b0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f086bfff640 1 -- 172.21.15.70:0/3959832446 reap_dead start 2023-11-26T07:24:15.741 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 shutdown_connections 2023-11-26T07:24:15.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 >> 172.21.15.70:0/3959832446 conn(0x7f086c09c550 msgr2=0x7f086c15c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 shutdown_connections 2023-11-26T07:24:15.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.739+0000 7f087212a640 1 -- 172.21.15.70:0/3959832446 wait complete. 2023-11-26T07:24:15.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-26T07:24:15.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f3822491640 1 Processor -- start 2023-11-26T07:24:15.899 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f3822491640 1 -- start start 2023-11-26T07:24:15.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f3822491640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f381c15d6e0 0x7f381c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f3822491640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c0b2160 0x7f381c0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.900 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f3822491640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c0cf0e0 con 0x7f381c0d19f0 2023-11-26T07:24:15.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f3822491640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c15dac0 con 0x7f381c15d6e0 2023-11-26T07:24:15.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f3822491640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0d1e80 con 0x7f381c0b2160 2023-11-26T07:24:15.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f381c15d6e0 0x7f381c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381bfff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f381c15d6e0 0x7f381c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52106/0 (socket says 172.21.15.70:52106) 2023-11-26T07:24:15.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381bfff640 1 -- 172.21.15.70:0/3946672959 learned_addr learned my addr 172.21.15.70:0/3946672959 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:15.901 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381b7fe640 1 --2- 172.21.15.70:0/3946672959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c0b2160 0x7f381c0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381bfff640 1 -- 172.21.15.70:0/3946672959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c0b2160 msgr2=0x7f381c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:15.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381bfff640 1 --2- 172.21.15.70:0/3946672959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c0b2160 0x7f381c0d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381bfff640 1 -- 172.21.15.70:0/3946672959 >> v1:172.21.15.120:6789/0 conn(0x7f381c0d19f0 legacy=0x7f381c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.902 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.899+0000 7f381bfff640 1 -- 172.21.15.70:0/3946672959 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0ceb20 con 0x7f381c15d6e0 2023-11-26T07:24:15.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f381bfff640 1 --2- 172.21.15.70:0/3946672959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c15d6e0 0x7f381c0d0df0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f380c009870 tx=0x7f380c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b3a1f133cc6dae server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f381affd640 1 -- 172.21.15.70:0/3946672959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0a7070 con 0x7f381c15d6e0 2023-11-26T07:24:15.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f381affd640 1 -- 172.21.15.70:0/3946672959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c0ab430 con 0x7f381c15d6e0 2023-11-26T07:24:15.903 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f381affd640 1 -- 172.21.15.70:0/3946672959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0ab7c0 con 0x7f381c15d6e0 2023-11-26T07:24:15.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 -- 172.21.15.70:0/3946672959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c15d6e0 msgr2=0x7f381c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 --2- 172.21.15.70:0/3946672959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c15d6e0 0x7f381c0d0df0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f380c009870 tx=0x7f380c01c540 comp rx=0 tx=0).stop 2023-11-26T07:24:15.904 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 -- 172.21.15.70:0/3946672959 shutdown_connections 2023-11-26T07:24:15.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 --2- 172.21.15.70:0/3946672959 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c0b2160 0x7f381c0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 --2- 172.21.15.70:0/3946672959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c15d6e0 0x7f381c0d0df0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 -- 172.21.15.70:0/3946672959 >> 172.21.15.70:0/3946672959 conn(0x7f381c09c550 msgr2=0x7f381c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:15.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 -- 172.21.15.70:0/3946672959 shutdown_connections 2023-11-26T07:24:15.905 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.903+0000 7f3822491640 1 -- 172.21.15.70:0/3946672959 wait complete. 2023-11-26T07:24:15.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 Processor -- start 2023-11-26T07:24:15.906 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 -- start start 2023-11-26T07:24:15.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f381c0b2160 0x7f381c0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c0d19f0 0x7f381c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c15d6e0 0x7f381c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.908 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0c9550 con 0x7f381c0d19f0 2023-11-26T07:24:15.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b9100 con 0x7f381c0b2160 2023-11-26T07:24:15.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0b83d0 con 0x7f381c15d6e0 2023-11-26T07:24:15.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c0d19f0 0x7f381c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c0d19f0 0x7f381c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52112/0 (socket says 172.21.15.70:52112) 2023-11-26T07:24:15.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 -- 172.21.15.70:0/1586512784 learned_addr learned my addr 172.21.15.70:0/1586512784 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:15.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381bfff640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f381c0b2160 0x7f381c0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.909 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3820a2e640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c15d6e0 0x7f381c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 -- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c15d6e0 msgr2=0x7f381c1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c15d6e0 0x7f381c1423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 -- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f381c0b2160 msgr2=0x7f381c0ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:15.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f381c0b2160 0x7f381c0ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:15.910 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 -- 172.21.15.70:0/1586512784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c0094d0 con 0x7f381c0d19f0 2023-11-26T07:24:15.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3820a2e640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c15d6e0 0x7f381c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:15.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f381b7fe640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c0d19f0 0x7f381c15c080 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f381000d830 tx=0x7f381000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3818ff9640 1 -- 172.21.15.70:0/1586512784 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000b660 con 0x7f381c0d19f0 2023-11-26T07:24:15.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3818ff9640 1 -- 172.21.15.70:0/1586512784 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381000b800 con 0x7f381c0d19f0 2023-11-26T07:24:15.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3818ff9640 1 -- 172.21.15.70:0/1586512784 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000bbb0 con 0x7f381c0d19f0 2023-11-26T07:24:15.911 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.907+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c0cd260 con 0x7f381c0d19f0 2023-11-26T07:24:15.912 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.911+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c0b8620 con 0x7f381c0d19f0 2023-11-26T07:24:15.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.911+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c067680 con 0x7f381c0d19f0 2023-11-26T07:24:15.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.911+0000 7f3818ff9640 1 -- 172.21.15.70:0/1586512784 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f381001e460 con 0x7f381c0d19f0 2023-11-26T07:24:15.913 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.911+0000 7f3818ff9640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3808066f50 0x7f3808069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:15.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.911+0000 7f3818ff9640 1 -- 172.21.15.70:0/1586512784 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3810082eb0 con 0x7f381c0d19f0 2023-11-26T07:24:15.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.911+0000 7f381bfff640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3808066f50 0x7f3808069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:15.914 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.911+0000 7f381bfff640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3808066f50 0x7f3808069410 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f380c0af000 tx=0x7f380c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:15.915 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:15.915+0000 7f3818ff9640 1 -- 172.21.15.70:0/1586512784 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3810051d80 con 0x7f381c0d19f0 2023-11-26T07:24:16.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.063+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f381c0ce810 con 0x7f3808066f50 2023-11-26T07:24:16.065 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3818ff9640 1 -- 172.21.15.70:0/1586512784 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f380c0bc090 con 0x7f3808066f50 2023-11-26T07:24:16.065 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2023-11-26T07:24:16.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3808066f50 msgr2=0x7f3808069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3808066f50 0x7f3808069410 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f380c0af000 tx=0x7f380c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:16.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c0d19f0 msgr2=0x7f381c15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c0d19f0 0x7f381c15c080 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f381000d830 tx=0x7f381000dcf0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 shutdown_connections 2023-11-26T07:24:16.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f3808066f50 0x7f3808069410 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.067 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f381c0d19f0 0x7f381c15c080 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f381c15d6e0 0x7f381c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 --2- 172.21.15.70:0/1586512784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f381c0b2160 0x7f381c0ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 >> 172.21.15.70:0/1586512784 conn(0x7f381c09c550 msgr2=0x7f381c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 shutdown_connections 2023-11-26T07:24:16.068 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.067+0000 7f3822491640 1 -- 172.21.15.70:0/1586512784 wait complete. 2023-11-26T07:24:16.087 INFO:tasks.ceph:Scrubbing osd.3 2023-11-26T07:24:16.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:16.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.227+0000 7f92b918d640 1 Processor -- start 2023-11-26T07:24:16.228 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.227+0000 7f92b918d640 1 -- start start 2023-11-26T07:24:16.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b918d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f92b4070ba0 0x7f92b406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.229 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b918d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4161cf0 0x7f92b4070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b918d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b40714c0 con 0x7f92b40cdd10 2023-11-26T07:24:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b918d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b40cd610 con 0x7f92b4070ba0 2023-11-26T07:24:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b918d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b40cd8f0 con 0x7f92b4161cf0 2023-11-26T07:24:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b2d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f92b4070ba0 0x7f92b406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b2d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f92b4070ba0 0x7f92b406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52120/0 (socket says 172.21.15.70:52120) 2023-11-26T07:24:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b2d9d640 1 -- 172.21.15.70:0/1770845541 learned_addr learned my addr 172.21.15.70:0/1770845541 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:16.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92aa59c640 1 --2- 172.21.15.70:0/1770845541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4161cf0 0x7f92b4070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b2d9d640 1 -- 172.21.15.70:0/1770845541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4161cf0 msgr2=0x7f92b4070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b2d9d640 1 --2- 172.21.15.70:0/1770845541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4161cf0 0x7f92b4070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.231 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b2d9d640 1 -- 172.21.15.70:0/1770845541 >> v1:172.21.15.120:6789/0 conn(0x7f92b40cdd10 legacy=0x7f92b406a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92b2d9d640 1 -- 172.21.15.70:0/1770845541 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4161210 con 0x7f92b4070ba0 2023-11-26T07:24:16.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.231+0000 7f92aa59c640 1 --2- 172.21.15.70:0/1770845541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4161cf0 0x7f92b4070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:16.232 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b2d9d640 1 --2- 172.21.15.70:0/1770845541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4070ba0 0x7f92b406bae0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f929c009870 tx=0x7f929c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c31efaa54153e03 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b259c640 1 -- 172.21.15.70:0/1770845541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c0ab600 con 0x7f92b4070ba0 2023-11-26T07:24:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b259c640 1 -- 172.21.15.70:0/1770845541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c0a7050 con 0x7f92b4070ba0 2023-11-26T07:24:16.233 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b259c640 1 -- 172.21.15.70:0/1770845541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c0ab980 con 0x7f92b4070ba0 2023-11-26T07:24:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 -- 172.21.15.70:0/1770845541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4070ba0 msgr2=0x7f92b406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 --2- 172.21.15.70:0/1770845541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4070ba0 0x7f92b406bae0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f929c009870 tx=0x7f929c01c500 comp rx=0 tx=0).stop 2023-11-26T07:24:16.234 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 -- 172.21.15.70:0/1770845541 shutdown_connections 2023-11-26T07:24:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 --2- 172.21.15.70:0/1770845541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4161cf0 0x7f92b4070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 --2- 172.21.15.70:0/1770845541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4070ba0 0x7f92b406bae0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 -- 172.21.15.70:0/1770845541 >> 172.21.15.70:0/1770845541 conn(0x7f92b40cf710 msgr2=0x7f92b40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 -- 172.21.15.70:0/1770845541 shutdown_connections 2023-11-26T07:24:16.235 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 -- 172.21.15.70:0/1770845541 wait complete. 2023-11-26T07:24:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 Processor -- start 2023-11-26T07:24:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.235+0000 7f92b918d640 1 -- start start 2023-11-26T07:24:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4070ba0 0x7f92b414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92b40cdd10 0x7f92b40b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4161cf0 0x7f92b414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.237 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b40b4950 con 0x7f92b4161cf0 2023-11-26T07:24:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b414e490 con 0x7f92b40cdd10 2023-11-26T07:24:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b40b4390 con 0x7f92b4070ba0 2023-11-26T07:24:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4161cf0 0x7f92b414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b2d9d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4070ba0 0x7f92b414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92aa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92b40cdd10 0x7f92b40b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b2d9d640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4070ba0 0x7f92b414fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:57754/0 (socket says 172.21.15.70:57754) 2023-11-26T07:24:16.238 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b2d9d640 1 -- 172.21.15.70:0/2691407710 learned_addr learned my addr 172.21.15.70:0/2691407710 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b359e640 1 -- 172.21.15.70:0/2691407710 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4070ba0 msgr2=0x7f92b414fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b359e640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4070ba0 0x7f92b414fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b359e640 1 -- 172.21.15.70:0/2691407710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92b40cdd10 msgr2=0x7f92b40b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b359e640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92b40cdd10 0x7f92b40b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b359e640 1 -- 172.21.15.70:0/2691407710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0094d0 con 0x7f92b4161cf0 2023-11-26T07:24:16.240 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b2d9d640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f92b4070ba0 0x7f92b414fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-26T07:24:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b359e640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4161cf0 0x7f92b414c5c0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c780 tx=0x7f92ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00aa50 con 0x7f92b4161cf0 2023-11-26T07:24:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac00abb0 con 0x7f92b4161cf0 2023-11-26T07:24:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b40b4670 con 0x7f92b4161cf0 2023-11-26T07:24:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00ce30 con 0x7f92b4161cf0 2023-11-26T07:24:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b40b4080 con 0x7f92b4161cf0 2023-11-26T07:24:16.241 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92b414df10 con 0x7f92b4161cf0 2023-11-26T07:24:16.242 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.239+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f92ac012420 con 0x7f92b4161cf0 2023-11-26T07:24:16.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92abfff640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9294066f20 0x7f92940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f92ac082a10 con 0x7f92b4161cf0 2023-11-26T07:24:16.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92b2d9d640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9294066f20 0x7f92940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92abfff640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f929406cd80 0x7f929406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.243 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 --> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f929406f850 con 0x7f929406cd80 2023-11-26T07:24:16.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92ac0875e0 con 0x7f92b4161cf0 2023-11-26T07:24:16.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92aa59c640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f929406cd80 0x7f929406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92b2d9d640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9294066f20 0x7f92940693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f929c009870 tx=0x7f929c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92aa59c640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f929406cd80 0x7f929406f1a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.244 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.243+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== osd.3 v2:172.21.15.70:6800/102590499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f929406f850 con 0x7f929406cd80 2023-11-26T07:24:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.255+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 --> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f92b4067680 con 0x7f929406cd80 2023-11-26T07:24:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.255+0000 7f92abfff640 1 -- 172.21.15.70:0/2691407710 <== osd.3 v2:172.21.15.70:6800/102590499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f92b4067680 con 0x7f929406cd80 2023-11-26T07:24:16.256 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:16.256 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:16.256 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:16.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.255+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f929406cd80 msgr2=0x7f929406f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.255+0000 7f92b918d640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6800/102590499,v1:172.21.15.70:6801/102590499] conn(0x7f929406cd80 0x7f929406f1a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9294066f20 msgr2=0x7f92940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9294066f20 0x7f92940693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f929c009870 tx=0x7f929c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4161cf0 msgr2=0x7f92b414c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 --2- 172.21.15.70:0/2691407710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92b4161cf0 0x7f92b414c5c0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c780 tx=0x7f92ac00cc40 comp rx=0 tx=0).stop 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b359e640 1 -- 172.21.15.70:0/2691407710 reap_dead start 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 shutdown_connections 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 >> 172.21.15.70:0/2691407710 conn(0x7f92b40cf710 msgr2=0x7f92b40cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 shutdown_connections 2023-11-26T07:24:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.259+0000 7f92b918d640 1 -- 172.21.15.70:0/2691407710 wait complete. 2023-11-26T07:24:16.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-26T07:24:16.412 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8218bb8640 1 Processor -- start 2023-11-26T07:24:16.413 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8218bb8640 1 -- start start 2023-11-26T07:24:16.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8218bb8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8214143ac0 0x7f8214070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8218bb8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f82140708b0 0x7f82140cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8218bb8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82140cfbf0 con 0x7f82140cf7c0 2023-11-26T07:24:16.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8218bb8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8214143ea0 con 0x7f82140708b0 2023-11-26T07:24:16.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8218bb8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140cc730 con 0x7f8214143ac0 2023-11-26T07:24:16.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8212d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f82140cf7c0 0x7f82140b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34876/0 (socket says 172.21.15.70:34876) 2023-11-26T07:24:16.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8212d9d640 1 -- 172.21.15.70:0/1666896563 learned_addr learned my addr 172.21.15.70:0/1666896563 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f820bfff640 1 --2- 172.21.15.70:0/1666896563 >> v2:172.21.15.120:3300/0 conn(0x7f82140708b0 0x7f82140cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f821259c640 1 --2- 172.21.15.70:0/1666896563 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8214143ac0 0x7f8214070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8211d9b640 1 -- 172.21.15.70:0/1666896563 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165735888 0 0) 0x7f82140cfbf0 con 0x7f82140cf7c0 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f8211d9b640 1 -- 172.21.15.70:0/1666896563 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8200003530 con 0x7f82140cf7c0 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f821259c640 1 -- 172.21.15.70:0/1666896563 >> v2:172.21.15.120:3300/0 conn(0x7f82140708b0 msgr2=0x7f82140cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f821259c640 1 --2- 172.21.15.70:0/1666896563 >> v2:172.21.15.120:3300/0 conn(0x7f82140708b0 0x7f82140cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f821259c640 1 -- 172.21.15.70:0/1666896563 >> v1:172.21.15.70:6789/0 conn(0x7f82140cf7c0 legacy=0x7f82140b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.415+0000 7f821259c640 1 -- 172.21.15.70:0/1666896563 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214070ee0 con 0x7f8214143ac0 2023-11-26T07:24:16.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f821259c640 1 --2- 172.21.15.70:0/1666896563 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8214143ac0 0x7f8214070370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82040097c0 tx=0x7f820401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaee7cd572d412bd server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8211d9b640 1 -- 172.21.15.70:0/1666896563 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040ad640 con 0x7f8214143ac0 2023-11-26T07:24:16.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8211d9b640 1 -- 172.21.15.70:0/1666896563 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82040ad7a0 con 0x7f8214143ac0 2023-11-26T07:24:16.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8211d9b640 1 -- 172.21.15.70:0/1666896563 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040adb30 con 0x7f8214143ac0 2023-11-26T07:24:16.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 -- 172.21.15.70:0/1666896563 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8214143ac0 msgr2=0x7f8214070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 --2- 172.21.15.70:0/1666896563 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8214143ac0 0x7f8214070370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82040097c0 tx=0x7f820401c480 comp rx=0 tx=0).stop 2023-11-26T07:24:16.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 -- 172.21.15.70:0/1666896563 shutdown_connections 2023-11-26T07:24:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 --2- 172.21.15.70:0/1666896563 >> v2:172.21.15.120:3300/0 conn(0x7f82140708b0 0x7f82140cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 --2- 172.21.15.70:0/1666896563 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f8214143ac0 0x7f8214070370 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 -- 172.21.15.70:0/1666896563 >> 172.21.15.70:0/1666896563 conn(0x7f821406a890 msgr2=0x7f821406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 -- 172.21.15.70:0/1666896563 shutdown_connections 2023-11-26T07:24:16.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.419+0000 7f8218bb8640 1 -- 172.21.15.70:0/1666896563 wait complete. 2023-11-26T07:24:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 Processor -- start 2023-11-26T07:24:16.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 -- start start 2023-11-26T07:24:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82140708b0 0x7f82140ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f82140cf7c0 0x7f82140a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8214143ac0 0x7f82140aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140ad5c0 con 0x7f8214143ac0 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82141394e0 con 0x7f82140708b0 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140ac940 con 0x7f82140cf7c0 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8214143ac0 0x7f82140aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8214143ac0 0x7f82140aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52132/0 (socket says 172.21.15.70:52132) 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 -- 172.21.15.70:0/2185658541 learned_addr learned my addr 172.21.15.70:0/2185658541 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f821259c640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82140708b0 0x7f82140ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f820bfff640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f82140cf7c0 0x7f82140a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 -- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f82140cf7c0 msgr2=0x7f82140a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f82140cf7c0 0x7f82140a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 -- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82140708b0 msgr2=0x7f82140ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82140708b0 0x7f82140ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 -- 172.21.15.70:0/2185658541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009420 con 0x7f8214143ac0 2023-11-26T07:24:16.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8212d9d640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8214143ac0 0x7f82140aeb10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f820c00cb30 tx=0x7f820c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f820affd640 1 -- 172.21.15.70:0/2185658541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00aca0 con 0x7f8214143ac0 2023-11-26T07:24:16.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f820affd640 1 -- 172.21.15.70:0/2185658541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00ae00 con 0x7f8214143ac0 2023-11-26T07:24:16.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82140acc20 con 0x7f8214143ac0 2023-11-26T07:24:16.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f820affd640 1 -- 172.21.15.70:0/2185658541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c012600 con 0x7f8214143ac0 2023-11-26T07:24:16.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82140ad1e0 con 0x7f8214143ac0 2023-11-26T07:24:16.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.423+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82140ad700 con 0x7f8214143ac0 2023-11-26T07:24:16.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.427+0000 7f820affd640 1 -- 172.21.15.70:0/2185658541 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f820c012820 con 0x7f8214143ac0 2023-11-26T07:24:16.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.427+0000 7f820affd640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f81f4066f20 0x7f81f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.427+0000 7f820affd640 1 -- 172.21.15.70:0/2185658541 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f820c0828a0 con 0x7f8214143ac0 2023-11-26T07:24:16.427 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.427+0000 7f821259c640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f81f4066f20 0x7f81f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.428 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.427+0000 7f821259c640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f81f4066f20 0x7f81f40693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f82040af000 tx=0x7f8204008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.429 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.431+0000 7f820affd640 1 -- 172.21.15.70:0/2185658541 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f820c0515f0 con 0x7f8214143ac0 2023-11-26T07:24:16.579 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.579+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8214071c30 con 0x7f81f4066f20 2023-11-26T07:24:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.579+0000 7f820affd640 1 -- 172.21.15.70:0/2185658541 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f82040a6040 con 0x7f81f4066f20 2023-11-26T07:24:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2023-11-26T07:24:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f81f4066f20 msgr2=0x7f81f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f81f4066f20 0x7f81f40693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f82040af000 tx=0x7f8204008040 comp rx=0 tx=0).stop 2023-11-26T07:24:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8214143ac0 msgr2=0x7f82140aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8214143ac0 0x7f82140aeb10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f820c00cb30 tx=0x7f820c00a060 comp rx=0 tx=0).stop 2023-11-26T07:24:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 shutdown_connections 2023-11-26T07:24:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f81f4066f20 0x7f81f40693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8214143ac0 0x7f82140aeb10 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f82140cf7c0 0x7f82140a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 --2- 172.21.15.70:0/2185658541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82140708b0 0x7f82140ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 >> 172.21.15.70:0/2185658541 conn(0x7f821406a890 msgr2=0x7f821415c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 shutdown_connections 2023-11-26T07:24:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.583+0000 7f8218bb8640 1 -- 172.21.15.70:0/2185658541 wait complete. 2023-11-26T07:24:16.601 INFO:tasks.ceph:Scrubbing osd.4 2023-11-26T07:24:16.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:16.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 Processor -- start 2023-11-26T07:24:16.742 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 -- start start 2023-11-26T07:24:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf013e290 0x7fbdf00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbdf00cf7c0 0x7fbdf015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbdf015f4e0 0x7fbdf01408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00cfc40 con 0x7fbdf00cf7c0 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf006c520 con 0x7fbdf015f4e0 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdf4c5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf006c800 con 0x7fbdf013e290 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbde5d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbdf00cf7c0 0x7fbdf015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbde5d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbdf00cf7c0 0x7fbdf015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52142/0 (socket says 172.21.15.70:52142) 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbde5d9b640 1 -- 172.21.15.70:0/2846962856 learned_addr learned my addr 172.21.15.70:0/2846962856 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdeed9d640 1 --2- 172.21.15.70:0/2846962856 >> v2:172.21.15.120:3300/0 conn(0x7fbdf015f4e0 0x7fbdf01408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.743+0000 7fbdee59c640 1 --2- 172.21.15.70:0/2846962856 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf013e290 0x7fbdf00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbde5d9b640 1 -- 172.21.15.70:0/2846962856 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf013e290 msgr2=0x7fbdf00cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbde5d9b640 1 --2- 172.21.15.70:0/2846962856 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf013e290 0x7fbdf00cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbde5d9b640 1 -- 172.21.15.70:0/2846962856 >> v2:172.21.15.120:3300/0 conn(0x7fbdf015f4e0 msgr2=0x7fbdf01408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbde5d9b640 1 --2- 172.21.15.70:0/2846962856 >> v2:172.21.15.120:3300/0 conn(0x7fbdf015f4e0 0x7fbdf01408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbde5d9b640 1 -- 172.21.15.70:0/2846962856 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf006cae0 con 0x7fbdf00cf7c0 2023-11-26T07:24:16.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbde5d9b640 1 --2- 172.21.15.70:0/2846962856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf00cf7c0 0x7fbdf015efa0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0072660 tx=0x7fbdd801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e492dc913956768 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdedd9b640 1 -- 172.21.15.70:0/2846962856 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80ab600 con 0x7fbdf00cf7c0 2023-11-26T07:24:16.747 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdedd9b640 1 -- 172.21.15.70:0/2846962856 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd80a7050 con 0x7fbdf00cf7c0 2023-11-26T07:24:16.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdedd9b640 1 -- 172.21.15.70:0/2846962856 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80ab980 con 0x7fbdf00cf7c0 2023-11-26T07:24:16.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/2846962856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf00cf7c0 msgr2=0x7fbdf015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.748 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdf4c5a640 1 --2- 172.21.15.70:0/2846962856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf00cf7c0 0x7fbdf015efa0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0072660 tx=0x7fbdd801c210 comp rx=0 tx=0).stop 2023-11-26T07:24:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/2846962856 shutdown_connections 2023-11-26T07:24:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdf4c5a640 1 --2- 172.21.15.70:0/2846962856 >> v2:172.21.15.120:3300/0 conn(0x7fbdf015f4e0 0x7fbdf01408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdf4c5a640 1 --2- 172.21.15.70:0/2846962856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf00cf7c0 0x7fbdf015efa0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdf4c5a640 1 --2- 172.21.15.70:0/2846962856 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf013e290 0x7fbdf00cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.747+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/2846962856 >> 172.21.15.70:0/2846962856 conn(0x7fbdf006a890 msgr2=0x7fbdf006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/2846962856 shutdown_connections 2023-11-26T07:24:16.749 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/2846962856 wait complete. 2023-11-26T07:24:16.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 Processor -- start 2023-11-26T07:24:16.750 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 -- start start 2023-11-26T07:24:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf00cf7c0 0x7fbdf0137230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdf013e290 0x7fbdf0153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf015f4e0 0x7fbdf0134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf01433e0 con 0x7fbdf015f4e0 2023-11-26T07:24:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0143980 con 0x7fbdf013e290 2023-11-26T07:24:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdf4c5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00b1a20 con 0x7fbdf00cf7c0 2023-11-26T07:24:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf015f4e0 0x7fbdf0134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf015f4e0 0x7fbdf0134790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52146/0 (socket says 172.21.15.70:52146) 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 -- 172.21.15.70:0/3235608195 learned_addr learned my addr 172.21.15.70:0/3235608195 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdee59c640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf00cf7c0 0x7fbdf0137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbde5d9b640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdf013e290 0x7fbdf0153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 -- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf00cf7c0 msgr2=0x7fbdf0137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbdf00cf7c0 0x7fbdf0137230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 -- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdf013e290 msgr2=0x7fbdf0153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdf013e290 0x7fbdf0153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 -- 172.21.15.70:0/3235608195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80094d0 con 0x7fbdf015f4e0 2023-11-26T07:24:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.751+0000 7fbdeed9d640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf015f4e0 0x7fbdf0134790 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e820 tx=0x7fbde800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8009530 con 0x7fbdf015f4e0 2023-11-26T07:24:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800eed0 con 0x7fbdf015f4e0 2023-11-26T07:24:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf01418f0 con 0x7fbdf015f4e0 2023-11-26T07:24:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800cb60 con 0x7fbdf015f4e0 2023-11-26T07:24:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf0143610 con 0x7fbdf015f4e0 2023-11-26T07:24:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdf01377d0 con 0x7fbdf015f4e0 2023-11-26T07:24:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fbde800ccc0 con 0x7fbdf015f4e0 2023-11-26T07:24:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbdd0066f50 0x7fbdd0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbde8082800 con 0x7fbdf015f4e0 2023-11-26T07:24:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fbdd006cdb0 0x7fbdd006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 --> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdd006f880 con 0x7fbdd006cdb0 2023-11-26T07:24:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbdee59c640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbdd0066f50 0x7fbdd0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbde80874c0 con 0x7fbdf015f4e0 2023-11-26T07:24:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbde5d9b640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fbdd006cdb0 0x7fbdd006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.755+0000 7fbdee59c640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbdd0066f50 0x7fbdd0069410 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbde0011360 tx=0x7fbde000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.759+0000 7fbde5d9b640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fbdd006cdb0 0x7fbdd006f1d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.759+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== osd.4 v2:172.21.15.120:6824/2950360410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbdd006f880 con 0x7fbdd006cdb0 2023-11-26T07:24:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 --> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbdf015fb00 con 0x7fbdd006cdb0 2023-11-26T07:24:16.770 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbde77fe640 1 -- 172.21.15.70:0/3235608195 <== osd.4 v2:172.21.15.120:6824/2950360410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbdd80ab620 con 0x7fbdd006cdb0 2023-11-26T07:24:16.771 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:16.771 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:16.771 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fbdd006cdb0 msgr2=0x7fbdd006f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.120:6824/2950360410,v1:172.21.15.120:6825/2950360410] conn(0x7fbdd006cdb0 0x7fbdd006f1d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbdd0066f50 msgr2=0x7fbdd0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbdd0066f50 0x7fbdd0069410 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbde0011360 tx=0x7fbde000d040 comp rx=0 tx=0).stop 2023-11-26T07:24:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf015f4e0 msgr2=0x7fbdf0134790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 --2- 172.21.15.70:0/3235608195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdf015f4e0 0x7fbdf0134790 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e820 tx=0x7fbde800ece0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdeed9d640 1 -- 172.21.15.70:0/3235608195 reap_dead start 2023-11-26T07:24:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 shutdown_connections 2023-11-26T07:24:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 >> 172.21.15.70:0/3235608195 conn(0x7fbdf006a890 msgr2=0x7fbdf0140680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 shutdown_connections 2023-11-26T07:24:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.771+0000 7fbdf4c5a640 1 -- 172.21.15.70:0/3235608195 wait complete. 2023-11-26T07:24:16.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-26T07:24:16.927 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.927+0000 7efcf02ea640 1 Processor -- start 2023-11-26T07:24:16.928 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.927+0000 7efcf02ea640 1 -- start start 2023-11-26T07:24:16.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcf02ea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 0x7efce8071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcf02ea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efce8070ba0 0x7efce8071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcf02ea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce8071eb0 con 0x7efce81614b0 2023-11-26T07:24:16.929 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcf02ea640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce8071550 con 0x7efce8070ba0 2023-11-26T07:24:16.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcf02ea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce815d970 con 0x7efce80cd610 2023-11-26T07:24:16.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee086640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efce81614b0 0x7efce8161890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34888/0 (socket says 172.21.15.70:34888) 2023-11-26T07:24:16.930 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee086640 1 -- 172.21.15.70:0/3537172203 learned_addr learned my addr 172.21.15.70:0/3537172203 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:16.931 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee887640 1 --2- 172.21.15.70:0/3537172203 >> v2:172.21.15.120:3300/0 conn(0x7efce8070ba0 0x7efce8071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced885640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 0x7efce8071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873039775 0 0) 0x7efce8071eb0 con 0x7efce81614b0 2023-11-26T07:24:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd4003530 con 0x7efce81614b0 2023-11-26T07:24:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3998031500 0 0) 0x7efcd4003530 con 0x7efce81614b0 2023-11-26T07:24:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 msgr2=0x7efce8071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 0x7efce8071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 >> v2:172.21.15.120:3300/0 conn(0x7efce8070ba0 msgr2=0x7efce8071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 --2- 172.21.15.70:0/3537172203 >> v2:172.21.15.120:3300/0 conn(0x7efce8070ba0 0x7efce8071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce815dc30 con 0x7efce81614b0 2023-11-26T07:24:16.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7efce4001680 con 0x7efce81614b0 2023-11-26T07:24:16.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 >> v1:172.21.15.70:6789/0 conn(0x7efce81614b0 legacy=0x7efce8161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcd4003980 0x7efcd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 0x7efcd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.933 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcd4004d10 0x7efcd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce8071550 con 0x7efcd4004d10 2023-11-26T07:24:16.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce815d970 con 0x7efcd4003980 2023-11-26T07:24:16.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd400b990 con 0x7efce80cd610 2023-11-26T07:24:16.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee887640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcd4004d10 0x7efcd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee086640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcd4003980 0x7efcd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efced885640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 0x7efcd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.934 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee887640 1 -- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 msgr2=0x7efcd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee887640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efce80cd610 0x7efcd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee887640 1 -- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcd4003980 msgr2=0x7efcd4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:16.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee887640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcd4003980 0x7efcd4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.935 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.931+0000 7efcee887640 1 -- 172.21.15.70:0/3537172203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4003530 con 0x7efcd4004d10 2023-11-26T07:24:16.936 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcee887640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcd4004d10 0x7efcd4005190 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7efce000e170 tx=0x7efce001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e3c9f372325b0d server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00a5c90 con 0x7efcd4004d10 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000f040 con 0x7efcd4004d10 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efced084640 1 -- 172.21.15.70:0/3537172203 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00ad440 con 0x7efcd4004d10 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcf02ea640 1 -- 172.21.15.70:0/3537172203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcd4004d10 msgr2=0x7efcd4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcf02ea640 1 --2- 172.21.15.70:0/3537172203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcd4004d10 0x7efcd4005190 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7efce000e170 tx=0x7efce001cc80 comp rx=0 tx=0).stop 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcee887640 1 -- 172.21.15.70:0/3537172203 reap_dead start 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcf02ea640 1 -- 172.21.15.70:0/3537172203 shutdown_connections 2023-11-26T07:24:16.937 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcf02ea640 1 -- 172.21.15.70:0/3537172203 >> 172.21.15.70:0/3537172203 conn(0x7efce80cf710 msgr2=0x7efce80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:16.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcf02ea640 1 -- 172.21.15.70:0/3537172203 shutdown_connections 2023-11-26T07:24:16.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.935+0000 7efcf02ea640 1 -- 172.21.15.70:0/3537172203 wait complete. 2023-11-26T07:24:16.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 Processor -- start 2023-11-26T07:24:16.938 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 -- start start 2023-11-26T07:24:16.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcd4004d10 0x7efce81469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efce8143f00 0x7efce81f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efce81454d0 0x7efce8145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.940 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce8157220 con 0x7efce81454d0 2023-11-26T07:24:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce8146ee0 con 0x7efce8143f00 2023-11-26T07:24:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce81f2990 con 0x7efcd4004d10 2023-11-26T07:24:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efce81454d0 0x7efce8145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efce81454d0 0x7efce8145980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52172/0 (socket says 172.21.15.70:52172) 2023-11-26T07:24:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 -- 172.21.15.70:0/1756412330 learned_addr learned my addr 172.21.15.70:0/1756412330 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efced885640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efce8143f00 0x7efce81f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.941 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee086640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcd4004d10 0x7efce81469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 -- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcd4004d10 msgr2=0x7efce81469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcd4004d10 0x7efce81469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 -- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efce8143f00 msgr2=0x7efce81f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:16.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efce8143f00 0x7efce81f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:16.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 -- 172.21.15.70:0/1756412330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8144430 con 0x7efce81454d0 2023-11-26T07:24:16.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee086640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcd4004d10 0x7efce81469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:16.942 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efced885640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efce8143f00 0x7efce81f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcee887640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efce81454d0 0x7efce8145980 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7efce000e170 tx=0x7efce0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcdeffd640 1 -- 172.21.15.70:0/1756412330 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0003ba0 con 0x7efce81454d0 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcdeffd640 1 -- 172.21.15.70:0/1756412330 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0003d00 con 0x7efce81454d0 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcdeffd640 1 -- 172.21.15.70:0/1756412330 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00adb60 con 0x7efce81454d0 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce8144710 con 0x7efce81454d0 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce8144cd0 con 0x7efce81454d0 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.939+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce8067680 con 0x7efce81454d0 2023-11-26T07:24:16.943 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.943+0000 7efcdeffd640 1 -- 172.21.15.70:0/1756412330 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7efce00b4040 con 0x7efce81454d0 2023-11-26T07:24:16.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.943+0000 7efcdeffd640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efccc066f50 0x7efccc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:16.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.943+0000 7efcdeffd640 1 -- 172.21.15.70:0/1756412330 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efce011c700 con 0x7efce81454d0 2023-11-26T07:24:16.944 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.943+0000 7efcee086640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efccc066f50 0x7efccc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:16.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.943+0000 7efcee086640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efccc066f50 0x7efccc069410 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c10 tx=0x7efce4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:16.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:16.947+0000 7efcdeffd640 1 -- 172.21.15.70:0/1756412330 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efce00eb6e0 con 0x7efce81454d0 2023-11-26T07:24:17.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.095+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efce815e1f0 con 0x7efccc066f50 2023-11-26T07:24:17.095 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.095+0000 7efcdeffd640 1 -- 172.21.15.70:0/1756412330 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efce4001b80 con 0x7efccc066f50 2023-11-26T07:24:17.095 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 4 to deep-scrub 2023-11-26T07:24:17.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efccc066f50 msgr2=0x7efccc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.097 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efccc066f50 0x7efccc069410 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efce4000c10 tx=0x7efce4009040 comp rx=0 tx=0).stop 2023-11-26T07:24:17.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efce81454d0 msgr2=0x7efce8145980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efce81454d0 0x7efce8145980 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7efce000e170 tx=0x7efce0009750 comp rx=0 tx=0).stop 2023-11-26T07:24:17.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 shutdown_connections 2023-11-26T07:24:17.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7efccc066f50 0x7efccc069410 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efce81454d0 0x7efce8145980 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.098 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efce8143f00 0x7efce81f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 --2- 172.21.15.70:0/1756412330 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7efcd4004d10 0x7efce81469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 >> 172.21.15.70:0/1756412330 conn(0x7efce80cf710 msgr2=0x7efce80b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 shutdown_connections 2023-11-26T07:24:17.099 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.099+0000 7efcf02ea640 1 -- 172.21.15.70:0/1756412330 wait complete. 2023-11-26T07:24:17.116 INFO:tasks.ceph:Scrubbing osd.5 2023-11-26T07:24:17.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:17.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cdc980640 1 Processor -- start 2023-11-26T07:24:17.257 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cdc980640 1 -- start start 2023-11-26T07:24:17.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cdc980640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd80cdb60 0x7f1cd80aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cdc980640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1cd806a490 0x7f1cd806a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cdc980640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd80b3690 con 0x7f1cd8070ba0 2023-11-26T07:24:17.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cdc980640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80b3ca0 con 0x7f1cd806a490 2023-11-26T07:24:17.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cdc980640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80cf080 con 0x7f1cd80cdb60 2023-11-26T07:24:17.259 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cd6d9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1cd806a490 0x7f1cd806a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cd659c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1cd8070ba0 0x7f1cd8070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34898/0 (socket says 172.21.15.70:34898) 2023-11-26T07:24:17.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cd659c640 1 -- 172.21.15.70:0/1431989151 learned_addr learned my addr 172.21.15.70:0/1431989151 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:17.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1ccdd9b640 1 --2- 172.21.15.70:0/1431989151 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd80cdb60 0x7f1cd80aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cd6d9d640 1 -- 172.21.15.70:0/1431989151 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd80cdb60 msgr2=0x7f1cd80aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:17.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cd6d9d640 1 --2- 172.21.15.70:0/1431989151 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd80cdb60 0x7f1cd80aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cd6d9d640 1 -- 172.21.15.70:0/1431989151 >> v1:172.21.15.70:6789/0 conn(0x7f1cd8070ba0 legacy=0x7f1cd8070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.260 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.259+0000 7f1cd6d9d640 1 -- 172.21.15.70:0/1431989151 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80cd8c0 con 0x7f1cd806a490 2023-11-26T07:24:17.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cd6d9d640 1 --2- 172.21.15.70:0/1431989151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd806a490 0x7f1cd806a920 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009d90 tx=0x7f1cd001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eff4fbdbb9bb8c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cd5d9b640 1 -- 172.21.15.70:0/1431989151 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00a5890 con 0x7f1cd806a490 2023-11-26T07:24:17.262 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cd5d9b640 1 -- 172.21.15.70:0/1431989151 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd00a59f0 con 0x7f1cd806a490 2023-11-26T07:24:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cd5d9b640 1 -- 172.21.15.70:0/1431989151 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00a5d80 con 0x7f1cd806a490 2023-11-26T07:24:17.263 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 -- 172.21.15.70:0/1431989151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd806a490 msgr2=0x7f1cd806a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 --2- 172.21.15.70:0/1431989151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd806a490 0x7f1cd806a920 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009d90 tx=0x7f1cd001c8c0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 -- 172.21.15.70:0/1431989151 shutdown_connections 2023-11-26T07:24:17.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 --2- 172.21.15.70:0/1431989151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd806a490 0x7f1cd806a920 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 --2- 172.21.15.70:0/1431989151 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd80cdb60 0x7f1cd80aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 -- 172.21.15.70:0/1431989151 >> 172.21.15.70:0/1431989151 conn(0x7f1cd80cf710 msgr2=0x7f1cd80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 -- 172.21.15.70:0/1431989151 shutdown_connections 2023-11-26T07:24:17.264 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.263+0000 7f1cdc980640 1 -- 172.21.15.70:0/1431989151 wait complete. 2023-11-26T07:24:17.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 Processor -- start 2023-11-26T07:24:17.265 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 -- start start 2023-11-26T07:24:17.266 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd806a490 0x7f1cd8154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd8070ba0 0x7f1cd80b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cd80cdb60 0x7f1cd8151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8156050 con 0x7f1cd8070ba0 2023-11-26T07:24:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd81553d0 con 0x7f1cd80cdb60 2023-11-26T07:24:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd81556b0 con 0x7f1cd806a490 2023-11-26T07:24:17.267 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd8070ba0 0x7f1cd80b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd8070ba0 0x7f1cd80b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52196/0 (socket says 172.21.15.70:52196) 2023-11-26T07:24:17.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 -- 172.21.15.70:0/2143785466 learned_addr learned my addr 172.21.15.70:0/2143785466 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:17.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cd6d9d640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cd80cdb60 0x7f1cd8151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.268 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cd659c640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd806a490 0x7f1cd8154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 -- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd806a490 msgr2=0x7f1cd8154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f1cd806a490 0x7f1cd8154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.269 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 -- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cd80cdb60 msgr2=0x7f1cd8151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cd80cdb60 0x7f1cd8151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 -- 172.21.15.70:0/2143785466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd0009a70 con 0x7f1cd8070ba0 2023-11-26T07:24:17.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cd6d9d640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cd80cdb60 0x7f1cd8151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:17.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccdd9b640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd8070ba0 0x7f1cd80b0590 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000d5f0 tx=0x7f1cc000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00125f0 con 0x7f1cd8070ba0 2023-11-26T07:24:17.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc0012750 con 0x7f1cd8070ba0 2023-11-26T07:24:17.270 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0012ae0 con 0x7f1cd8070ba0 2023-11-26T07:24:17.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd8155990 con 0x7f1cd8070ba0 2023-11-26T07:24:17.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.267+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd80b0ad0 con 0x7f1cd8070ba0 2023-11-26T07:24:17.271 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cd8168260 con 0x7f1cd8070ba0 2023-11-26T07:24:17.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f1cc0012c40 con 0x7f1cd8070ba0 2023-11-26T07:24:17.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1ccf7fe640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1cb8066f20 0x7f1cb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.272 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1cc0083710 con 0x7f1cd8070ba0 2023-11-26T07:24:17.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1cd659c640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1cb8066f20 0x7f1cb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1ccf7fe640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7f1cb806cd80 0x7f1cb806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 --> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cb806f850 con 0x7f1cb806cd80 2023-11-26T07:24:17.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cc0086110 con 0x7f1cd8070ba0 2023-11-26T07:24:17.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1cd6d9d640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7f1cb806cd80 0x7f1cb806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.271+0000 7f1cd659c640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1cb8066f20 0x7f1cb80693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8005890 tx=0x7f1cc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.273 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.275+0000 7f1cd6d9d640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7f1cb806cd80 0x7f1cb806f1a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.274 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.275+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== osd.5 v2:172.21.15.120:6800/1452349968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1cb806f850 con 0x7f1cb806cd80 2023-11-26T07:24:17.286 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 --> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1cd8067680 con 0x7f1cb806cd80 2023-11-26T07:24:17.287 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1ccf7fe640 1 -- 172.21.15.70:0/2143785466 <== osd.5 v2:172.21.15.120:6800/1452349968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1cd8067680 con 0x7f1cb806cd80 2023-11-26T07:24:17.287 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:17.287 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:17.287 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7f1cb806cd80 msgr2=0x7f1cb806f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.288 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.120:6800/1452349968,v1:172.21.15.120:6801/1452349968] conn(0x7f1cb806cd80 0x7f1cb806f1a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1cb8066f20 msgr2=0x7f1cb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f1cb8066f20 0x7f1cb80693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8005890 tx=0x7f1cc8009040 comp rx=0 tx=0).stop 2023-11-26T07:24:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd8070ba0 msgr2=0x7f1cd80b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 --2- 172.21.15.70:0/2143785466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1cd8070ba0 0x7f1cd80b0590 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000d5f0 tx=0x7f1cc000dab0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cd6d9d640 1 -- 172.21.15.70:0/2143785466 reap_dead start 2023-11-26T07:24:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 shutdown_connections 2023-11-26T07:24:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 >> 172.21.15.70:0/2143785466 conn(0x7f1cd80cf710 msgr2=0x7f1cd815c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 shutdown_connections 2023-11-26T07:24:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.287+0000 7f1cdc980640 1 -- 172.21.15.70:0/2143785466 wait complete. 2023-11-26T07:24:17.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-26T07:24:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf683d1640 1 Processor -- start 2023-11-26T07:24:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf683d1640 1 -- start start 2023-11-26T07:24:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf683d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbf600cf710 0x7fbf600cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf683d1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600cc730 con 0x7fbf600cf280 2023-11-26T07:24:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf683d1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf60070ee0 con 0x7fbf60143ac0 2023-11-26T07:24:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf683d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf60143ea0 con 0x7fbf600cf710 2023-11-26T07:24:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf6696e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbf600cf710 0x7fbf600cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf6596c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbf600cf280 0x7fbf600cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34908/0 (socket says 172.21.15.70:34908) 2023-11-26T07:24:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf6596c640 1 -- 172.21.15.70:0/211739217 learned_addr learned my addr 172.21.15.70:0/211739217 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf6696e640 1 -- 172.21.15.70:0/211739217 >> v1:172.21.15.120:6789/0 conn(0x7fbf60143ac0 legacy=0x7fbf60070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf6696e640 1 -- 172.21.15.70:0/211739217 >> v1:172.21.15.70:6789/0 conn(0x7fbf600cf280 legacy=0x7fbf600cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf6696e640 1 -- 172.21.15.70:0/211739217 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600711c0 con 0x7fbf600cf710 2023-11-26T07:24:17.448 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.447+0000 7fbf6516b640 1 -- 172.21.15.70:0/211739217 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461363267 0 0) 0x7fbf600cc730 con 0x7fbf600cf280 2023-11-26T07:24:17.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf6696e640 1 --2- 172.21.15.70:0/211739217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf600cf710 0x7fbf600cd8c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009d90 tx=0x7fbf5801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4a8dec9e2fba65 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.449 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf6516b640 1 -- 172.21.15.70:0/211739217 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf580a59d0 con 0x7fbf600cf710 2023-11-26T07:24:17.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf6516b640 1 -- 172.21.15.70:0/211739217 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf580a5b30 con 0x7fbf600cf710 2023-11-26T07:24:17.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf6516b640 1 -- 172.21.15.70:0/211739217 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf580ad440 con 0x7fbf600cf710 2023-11-26T07:24:17.450 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf683d1640 1 -- 172.21.15.70:0/211739217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf600cf710 msgr2=0x7fbf600cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf683d1640 1 --2- 172.21.15.70:0/211739217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf600cf710 0x7fbf600cd8c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009d90 tx=0x7fbf5801c910 comp rx=0 tx=0).stop 2023-11-26T07:24:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf683d1640 1 -- 172.21.15.70:0/211739217 shutdown_connections 2023-11-26T07:24:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf683d1640 1 --2- 172.21.15.70:0/211739217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf600cf710 0x7fbf600cd8c0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf683d1640 1 -- 172.21.15.70:0/211739217 >> 172.21.15.70:0/211739217 conn(0x7fbf6006a890 msgr2=0x7fbf6006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf683d1640 1 -- 172.21.15.70:0/211739217 shutdown_connections 2023-11-26T07:24:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.451+0000 7fbf683d1640 1 -- 172.21.15.70:0/211739217 wait complete. 2023-11-26T07:24:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 Processor -- start 2023-11-26T07:24:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 -- start start 2023-11-26T07:24:17.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf600cf280 0x7fbf60159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf600cf710 0x7fbf600a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf60143ac0 0x7fbf600aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.454 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601f7330 con 0x7fbf60143ac0 2023-11-26T07:24:17.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6015a270 con 0x7fbf600cf280 2023-11-26T07:24:17.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600a9320 con 0x7fbf600cf710 2023-11-26T07:24:17.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf60143ac0 0x7fbf600aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf60143ac0 0x7fbf600aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52224/0 (socket says 172.21.15.70:52224) 2023-11-26T07:24:17.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 -- 172.21.15.70:0/3279215560 learned_addr learned my addr 172.21.15.70:0/3279215560 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:17.455 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6596c640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf600cf710 0x7fbf600a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6616d640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf600cf280 0x7fbf60159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 -- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf600cf710 msgr2=0x7fbf600a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf600cf710 0x7fbf600a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 -- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf600cf280 msgr2=0x7fbf60159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf600cf280 0x7fbf60159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 -- 172.21.15.70:0/3279215560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58009a70 con 0x7fbf60143ac0 2023-11-26T07:24:17.456 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6616d640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf600cf280 0x7fbf60159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:17.457 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf6696e640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf60143ac0 0x7fbf600aa440 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fbf58019520 tx=0x7fbf600ce610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf56ffd640 1 -- 172.21.15.70:0/3279215560 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf580be070 con 0x7fbf60143ac0 2023-11-26T07:24:17.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf56ffd640 1 -- 172.21.15.70:0/3279215560 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf580adbc0 con 0x7fbf60143ac0 2023-11-26T07:24:17.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf56ffd640 1 -- 172.21.15.70:0/3279215560 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf580b6400 con 0x7fbf60143ac0 2023-11-26T07:24:17.458 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf600a9600 con 0x7fbf60143ac0 2023-11-26T07:24:17.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf600aefc0 con 0x7fbf60143ac0 2023-11-26T07:24:17.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.455+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf600aeb40 con 0x7fbf60143ac0 2023-11-26T07:24:17.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.459+0000 7fbf56ffd640 1 -- 172.21.15.70:0/3279215560 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7fbf580b4040 con 0x7fbf60143ac0 2023-11-26T07:24:17.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.459+0000 7fbf56ffd640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf44066f50 0x7fbf44069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.459+0000 7fbf56ffd640 1 -- 172.21.15.70:0/3279215560 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf5811cbe0 con 0x7fbf60143ac0 2023-11-26T07:24:17.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.459+0000 7fbf6616d640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf44066f50 0x7fbf44069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.459 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.459+0000 7fbf6616d640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf44066f50 0x7fbf44069410 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0098b0 tx=0x7fbf5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.461 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.463+0000 7fbf56ffd640 1 -- 172.21.15.70:0/3279215560 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf600aeb40 con 0x7fbf60143ac0 2023-11-26T07:24:17.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.611+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf600cfb20 con 0x7fbf44066f50 2023-11-26T07:24:17.611 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.611+0000 7fbf56ffd640 1 -- 172.21.15.70:0/3279215560 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf5c0094a0 con 0x7fbf44066f50 2023-11-26T07:24:17.613 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 5 to deep-scrub 2023-11-26T07:24:17.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf44066f50 msgr2=0x7fbf44069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf44066f50 0x7fbf44069410 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0098b0 tx=0x7fbf5c008040 comp rx=0 tx=0).stop 2023-11-26T07:24:17.614 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf60143ac0 msgr2=0x7fbf600aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf60143ac0 0x7fbf600aa440 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fbf58019520 tx=0x7fbf600ce610 comp rx=0 tx=0).stop 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 shutdown_connections 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7fbf44066f50 0x7fbf44069410 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf60143ac0 0x7fbf600aa440 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7fbf600cf710 0x7fbf600a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 --2- 172.21.15.70:0/3279215560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf600cf280 0x7fbf60159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 >> 172.21.15.70:0/3279215560 conn(0x7fbf6006a890 msgr2=0x7fbf60071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 shutdown_connections 2023-11-26T07:24:17.616 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.615+0000 7fbf683d1640 1 -- 172.21.15.70:0/3279215560 wait complete. 2023-11-26T07:24:17.632 INFO:tasks.ceph:Scrubbing osd.6 2023-11-26T07:24:17.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9018a5a640 1 Processor -- start 2023-11-26T07:24:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9018a5a640 1 -- start start 2023-11-26T07:24:17.774 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9018a5a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f901415d580 0x7f90140d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9018a5a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90140d0bc0 con 0x7f90140d3e60 2023-11-26T07:24:17.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9018a5a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90140d0320 con 0x7f90140d1f00 2023-11-26T07:24:17.775 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9018a5a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90140d0600 con 0x7f901415d580 2023-11-26T07:24:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f901259c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f901415d580 0x7f90140d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9009d9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f90140d3e60 0x7f90140d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34910/0 (socket says 172.21.15.70:34910) 2023-11-26T07:24:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9009d9b640 1 -- 172.21.15.70:0/3474332010 learned_addr learned my addr 172.21.15.70:0/3474332010 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f901259c640 1 -- 172.21.15.70:0/3474332010 >> v1:172.21.15.120:6789/0 conn(0x7f90140d1f00 legacy=0x7f90140b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f901259c640 1 -- 172.21.15.70:0/3474332010 >> v1:172.21.15.70:6789/0 conn(0x7f90140d3e60 legacy=0x7f90140d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.776 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f901259c640 1 -- 172.21.15.70:0/3474332010 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140d08e0 con 0x7f901415d580 2023-11-26T07:24:17.777 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.775+0000 7f9011d9b640 1 -- 172.21.15.70:0/3474332010 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750115641 0 0) 0x7f90140d0bc0 con 0x7f90140d3e60 2023-11-26T07:24:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f901259c640 1 --2- 172.21.15.70:0/3474332010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f901415d580 0x7f90140d3920 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0097c0 tx=0x7f8ffc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbdbde03d043982 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9011d9b640 1 -- 172.21.15.70:0/3474332010 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0ad680 con 0x7f901415d580 2023-11-26T07:24:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9011d9b640 1 -- 172.21.15.70:0/3474332010 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc0ad7e0 con 0x7f901415d580 2023-11-26T07:24:17.779 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9011d9b640 1 -- 172.21.15.70:0/3474332010 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0adb70 con 0x7f901415d580 2023-11-26T07:24:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9018a5a640 1 -- 172.21.15.70:0/3474332010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f901415d580 msgr2=0x7f90140d3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9018a5a640 1 --2- 172.21.15.70:0/3474332010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f901415d580 0x7f90140d3920 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0097c0 tx=0x7f8ffc01c450 comp rx=0 tx=0).stop 2023-11-26T07:24:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9018a5a640 1 -- 172.21.15.70:0/3474332010 shutdown_connections 2023-11-26T07:24:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9018a5a640 1 --2- 172.21.15.70:0/3474332010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f901415d580 0x7f90140d3920 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.780 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9018a5a640 1 -- 172.21.15.70:0/3474332010 >> 172.21.15.70:0/3474332010 conn(0x7f901409c550 msgr2=0x7f90140d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9018a5a640 1 -- 172.21.15.70:0/3474332010 shutdown_connections 2023-11-26T07:24:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.779+0000 7f9018a5a640 1 -- 172.21.15.70:0/3474332010 wait complete. 2023-11-26T07:24:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 Processor -- start 2023-11-26T07:24:17.781 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 -- start start 2023-11-26T07:24:17.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90140d1f00 0x7f90140ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90140d3e60 0x7f90141561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f901415d580 0x7f90140c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90140cca80 con 0x7f90140d3e60 2023-11-26T07:24:17.783 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90140ccd60 con 0x7f90140d1f00 2023-11-26T07:24:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140cd040 con 0x7f901415d580 2023-11-26T07:24:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90140d3e60 0x7f90141561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90140d3e60 0x7f90141561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52246/0 (socket says 172.21.15.70:52246) 2023-11-26T07:24:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 -- 172.21.15.70:0/917323930 learned_addr learned my addr 172.21.15.70:0/917323930 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f901259c640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90140d1f00 0x7f90140ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9012d9d640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f901415d580 0x7f90140c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.784 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 -- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f901415d580 msgr2=0x7f90140c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f901415d580 0x7f90140c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 -- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90140d1f00 msgr2=0x7f90140ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90140d1f00 0x7f90140ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 -- 172.21.15.70:0/917323930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009420 con 0x7f90140d3e60 2023-11-26T07:24:17.785 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9009d9b640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90140d3e60 0x7f90141561e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f900400c4a0 tx=0x7f900400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.786 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040074e0 con 0x7f90140d3e60 2023-11-26T07:24:17.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9004007640 con 0x7f90140d3e60 2023-11-26T07:24:17.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90141530f0 con 0x7f90140d3e60 2023-11-26T07:24:17.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004004a30 con 0x7f90140d3e60 2023-11-26T07:24:17.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.783+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90140ca820 con 0x7f90140d3e60 2023-11-26T07:24:17.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90140d15c0 con 0x7f90140d3e60 2023-11-26T07:24:17.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f9004004b90 con 0x7f90140d3e60 2023-11-26T07:24:17.787 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f900b7fe640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ff4066f20 0x7f8ff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9004081ea0 con 0x7f90140d3e60 2023-11-26T07:24:17.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f901259c640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ff4066f20 0x7f8ff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f900b7fe640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f8ff406cd80 0x7f8ff406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 --> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ff406f850 con 0x7f8ff406cd80 2023-11-26T07:24:17.788 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9004086ad0 con 0x7f90140d3e60 2023-11-26T07:24:17.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f9012d9d640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f8ff406cd80 0x7f8ff406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f901259c640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ff4066f20 0x7f8ff40693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0af000 tx=0x7f8ffc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.787+0000 7f9012d9d640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f8ff406cd80 0x7f8ff406f1a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.789 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.791+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== osd.6 v2:172.21.15.120:6809/1672802144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8ff406f850 con 0x7f8ff406cd80 2023-11-26T07:24:17.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 --> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9014067680 con 0x7f8ff406cd80 2023-11-26T07:24:17.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f900b7fe640 1 -- 172.21.15.70:0/917323930 <== osd.6 v2:172.21.15.120:6809/1672802144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9014067680 con 0x7f8ff406cd80 2023-11-26T07:24:17.802 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:17.802 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:17.803 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:17.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f8ff406cd80 msgr2=0x7f8ff406f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.120:6809/1672802144,v1:172.21.15.120:6811/1672802144] conn(0x7f8ff406cd80 0x7f8ff406f1a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ff4066f20 msgr2=0x7f8ff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f8ff4066f20 0x7f8ff40693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0af000 tx=0x7f8ffc0a7000 comp rx=0 tx=0).stop 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90140d3e60 msgr2=0x7f90141561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 --2- 172.21.15.70:0/917323930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90140d3e60 0x7f90141561e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f900400c4a0 tx=0x7f900400c960 comp rx=0 tx=0).stop 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9012d9d640 1 -- 172.21.15.70:0/917323930 reap_dead start 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 shutdown_connections 2023-11-26T07:24:17.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 >> 172.21.15.70:0/917323930 conn(0x7f901409c550 msgr2=0x7f90140b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 shutdown_connections 2023-11-26T07:24:17.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.803+0000 7f9018a5a640 1 -- 172.21.15.70:0/917323930 wait complete. 2023-11-26T07:24:17.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-26T07:24:17.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 Processor -- start 2023-11-26T07:24:17.961 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 -- start start 2023-11-26T07:24:17.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9a440cf280 0x7f9a440cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9a44070d10 0x7f9a4415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a4406cd50 0x7f9a440b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4415b2f0 con 0x7f9a440cf280 2023-11-26T07:24:17.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4406c5c0 con 0x7f9a44070d10 2023-11-26T07:24:17.963 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4b2e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440cfba0 con 0x7f9a4406cd50 2023-11-26T07:24:17.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9a440cf280 0x7f9a440cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9a440cf280 0x7f9a440cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52258/0 (socket says 172.21.15.70:52258) 2023-11-26T07:24:17.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 -- 172.21.15.70:0/2745049997 learned_addr learned my addr 172.21.15.70:0/2745049997 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:17.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4887e640 1 --2- 172.21.15.70:0/2745049997 >> v2:172.21.15.120:3300/0 conn(0x7f9a44070d10 0x7f9a4415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a49880640 1 --2- 172.21.15.70:0/2745049997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a4406cd50 0x7f9a440b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 -- 172.21.15.70:0/2745049997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a4406cd50 msgr2=0x7f9a440b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:17.964 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 --2- 172.21.15.70:0/2745049997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a4406cd50 0x7f9a440b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 -- 172.21.15.70:0/2745049997 >> v2:172.21.15.120:3300/0 conn(0x7f9a44070d10 msgr2=0x7f9a4415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:17.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 --2- 172.21.15.70:0/2745049997 >> v2:172.21.15.120:3300/0 conn(0x7f9a44070d10 0x7f9a4415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.963+0000 7f9a4907f640 1 -- 172.21.15.70:0/2745049997 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4415e1a0 con 0x7f9a440cf280 2023-11-26T07:24:17.965 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4907f640 1 --2- 172.21.15.70:0/2745049997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a440cf280 0x7f9a440cf660 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9a4406e480 tx=0x7f9a4001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e265f1999d68f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a3bfff640 1 -- 172.21.15.70:0/2745049997 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400a89b0 con 0x7f9a440cf280 2023-11-26T07:24:17.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a3bfff640 1 -- 172.21.15.70:0/2745049997 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a400a8b10 con 0x7f9a440cf280 2023-11-26T07:24:17.966 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a3bfff640 1 -- 172.21.15.70:0/2745049997 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400a8ea0 con 0x7f9a440cf280 2023-11-26T07:24:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2745049997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a440cf280 msgr2=0x7f9a440cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2745049997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a440cf280 0x7f9a440cf660 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9a4406e480 tx=0x7f9a4001ecf0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.967 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2745049997 shutdown_connections 2023-11-26T07:24:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2745049997 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a4406cd50 0x7f9a440b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2745049997 >> v2:172.21.15.120:3300/0 conn(0x7f9a44070d10 0x7f9a4415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2745049997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a440cf280 0x7f9a440cf660 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2745049997 >> 172.21.15.70:0/2745049997 conn(0x7f9a4406a890 msgr2=0x7f9a4406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2745049997 shutdown_connections 2023-11-26T07:24:17.968 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.967+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2745049997 wait complete. 2023-11-26T07:24:17.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 Processor -- start 2023-11-26T07:24:17.969 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 -- start start 2023-11-26T07:24:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a4406cd50 0x7f9a44159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a44070d10 0x7f9a441f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a440cf280 0x7f9a440cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a441f8190 con 0x7f9a4406cd50 2023-11-26T07:24:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440ccc10 con 0x7f9a44070d10 2023-11-26T07:24:17.971 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440ccef0 con 0x7f9a440cf280 2023-11-26T07:24:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a4406cd50 0x7f9a44159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a4406cd50 0x7f9a44159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52274/0 (socket says 172.21.15.70:52274) 2023-11-26T07:24:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 -- 172.21.15.70:0/2994534818 learned_addr learned my addr 172.21.15.70:0/2994534818 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a49880640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a440cf280 0x7f9a440cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4887e640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a44070d10 0x7f9a441f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 -- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a440cf280 msgr2=0x7f9a440cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.972 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a440cf280 0x7f9a440cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 -- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a44070d10 msgr2=0x7f9a441f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a44070d10 0x7f9a441f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 -- 172.21.15.70:0/2994534818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400094d0 con 0x7f9a4406cd50 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4907f640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a4406cd50 0x7f9a44159e90 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9a4001d3a0 tx=0x7f9a4001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a39ffb640 1 -- 172.21.15.70:0/2994534818 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400ba600 con 0x7f9a4406cd50 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a39ffb640 1 -- 172.21.15.70:0/2994534818 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a400ba760 con 0x7f9a4406cd50 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a440cd1d0 con 0x7f9a4406cd50 2023-11-26T07:24:17.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a39ffb640 1 -- 172.21.15.70:0/2994534818 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400bab10 con 0x7f9a4406cd50 2023-11-26T07:24:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.971+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a440cd790 con 0x7f9a4406cd50 2023-11-26T07:24:17.974 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.975+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a440cd980 con 0x7f9a4406cd50 2023-11-26T07:24:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.975+0000 7f9a39ffb640 1 -- 172.21.15.70:0/2994534818 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f9a400bac70 con 0x7f9a4406cd50 2023-11-26T07:24:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.975+0000 7f9a39ffb640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a28066f20 0x7f9a280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.975+0000 7f9a39ffb640 1 -- 172.21.15.70:0/2994534818 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a40120d60 con 0x7f9a4406cd50 2023-11-26T07:24:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.975+0000 7f9a4887e640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a28066f20 0x7f9a280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:17.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.975+0000 7f9a4887e640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a28066f20 0x7f9a280693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9a441f4e10 tx=0x7f9a34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:17.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:17.979+0000 7f9a39ffb640 1 -- 172.21.15.70:0/2994534818 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a400efc30 con 0x7f9a4406cd50 2023-11-26T07:24:18.128 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a4415de40 con 0x7f9a28066f20 2023-11-26T07:24:18.129 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a39ffb640 1 -- 172.21.15.70:0/2994534818 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a340118b0 con 0x7f9a28066f20 2023-11-26T07:24:18.129 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 6 to deep-scrub 2023-11-26T07:24:18.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a28066f20 msgr2=0x7f9a280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a28066f20 0x7f9a280693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9a441f4e10 tx=0x7f9a34008040 comp rx=0 tx=0).stop 2023-11-26T07:24:18.131 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a4406cd50 msgr2=0x7f9a44159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a4406cd50 0x7f9a44159e90 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9a4001d3a0 tx=0x7f9a4001ba90 comp rx=0 tx=0).stop 2023-11-26T07:24:18.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 shutdown_connections 2023-11-26T07:24:18.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a440cf280 0x7f9a440cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a44070d10 0x7f9a441f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a28066f20 0x7f9a280693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 --2- 172.21.15.70:0/2994534818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a4406cd50 0x7f9a44159e90 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.132 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 >> 172.21.15.70:0/2994534818 conn(0x7f9a4406a890 msgr2=0x7f9a440acb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 shutdown_connections 2023-11-26T07:24:18.133 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.131+0000 7f9a4b2e3640 1 -- 172.21.15.70:0/2994534818 wait complete. 2023-11-26T07:24:18.150 INFO:tasks.ceph:Scrubbing osd.7 2023-11-26T07:24:18.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-26T07:24:18.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.291+0000 7f5a1a3c4640 1 Processor -- start 2023-11-26T07:24:18.291 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.291+0000 7f5a1a3c4640 1 -- start start 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a1a3c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a140cf990 0x7f5a1415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a1a3c4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a1415f4e0 0x7f5a140cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a1a3c4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1406c520 con 0x7f5a1413e290 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a1a3c4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1406c800 con 0x7f5a1415f4e0 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a1a3c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1406cae0 con 0x7f5a140cf990 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a1415f4e0 0x7f5a140cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5a1415f4e0 0x7f5a140cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52284/0 (socket says 172.21.15.70:52284) 2023-11-26T07:24:18.293 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 -- 172.21.15.70:0/3855456603 learned_addr learned my addr 172.21.15.70:0/3855456603 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:18.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a137fe640 1 --2- 172.21.15.70:0/3855456603 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a140cf990 0x7f5a1415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 -- 172.21.15.70:0/3855456603 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a140cf990 msgr2=0x7f5a1415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:18.294 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 --2- 172.21.15.70:0/3855456603 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a140cf990 0x7f5a1415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 -- 172.21.15.70:0/3855456603 >> v1:172.21.15.120:6789/0 conn(0x7f5a1413e290 legacy=0x7f5a140cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.295 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 -- 172.21.15.70:0/3855456603 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1406cdc0 con 0x7f5a1415f4e0 2023-11-26T07:24:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.295+0000 7f5a18961640 1 --2- 172.21.15.70:0/3855456603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1415f4e0 0x7f5a140cd7b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009e50 tx=0x7f5a0c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8b19bd8463c3f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a12ffd640 1 -- 172.21.15.70:0/3855456603 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0a58d0 con 0x7f5a1415f4e0 2023-11-26T07:24:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a12ffd640 1 -- 172.21.15.70:0/3855456603 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c0a5a30 con 0x7f5a1415f4e0 2023-11-26T07:24:18.296 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a12ffd640 1 -- 172.21.15.70:0/3855456603 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0a5dc0 con 0x7f5a1415f4e0 2023-11-26T07:24:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3855456603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1415f4e0 msgr2=0x7f5a140cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 --2- 172.21.15.70:0/3855456603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1415f4e0 0x7f5a140cd7b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009e50 tx=0x7f5a0c01c9e0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3855456603 shutdown_connections 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 --2- 172.21.15.70:0/3855456603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1415f4e0 0x7f5a140cd7b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 --2- 172.21.15.70:0/3855456603 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a140cf990 0x7f5a1415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3855456603 >> 172.21.15.70:0/3855456603 conn(0x7f5a1406a890 msgr2=0x7f5a1406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3855456603 shutdown_connections 2023-11-26T07:24:18.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3855456603 wait complete. 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 Processor -- start 2023-11-26T07:24:18.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- start start 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a140cf990 0x7f5a14137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1413e290 0x7f5a1415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a1415f4e0 0x7f5a1415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1415c9e0 con 0x7f5a1413e290 2023-11-26T07:24:18.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1415bdd0 con 0x7f5a140cf990 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a1a3c4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1415c0b0 con 0x7f5a1415f4e0 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a137fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1413e290 0x7f5a1415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a137fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1413e290 0x7f5a1415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52298/0 (socket says 172.21.15.70:52298) 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.299+0000 7f5a137fe640 1 -- 172.21.15.70:0/3118076128 learned_addr learned my addr 172.21.15.70:0/3118076128 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a18961640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a1415f4e0 0x7f5a1415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a13fff640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a140cf990 0x7f5a14137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a137fe640 1 -- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a1415f4e0 msgr2=0x7f5a1415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a137fe640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a1415f4e0 0x7f5a1415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a137fe640 1 -- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a140cf990 msgr2=0x7f5a14137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a137fe640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a140cf990 0x7f5a14137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a137fe640 1 -- 172.21.15.70:0/3118076128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009b30 con 0x7f5a1413e290 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a18961640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5a1415f4e0 0x7f5a1415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a13fff640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a140cf990 0x7f5a14137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a137fe640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1413e290 0x7f5a1415b510 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800e930 tx=0x7f5a0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08009690 con 0x7f5a1413e290 2023-11-26T07:24:18.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0800ca00 con 0x7f5a1413e290 2023-11-26T07:24:18.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1415c390 con 0x7f5a1413e290 2023-11-26T07:24:18.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800cd70 con 0x7f5a1413e290 2023-11-26T07:24:18.304 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1415ba50 con 0x7f5a1413e290 2023-11-26T07:24:18.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a14067680 con 0x7f5a1413e290 2023-11-26T07:24:18.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f5a08013470 con 0x7f5a1413e290 2023-11-26T07:24:18.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a10ff9640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5a00066f50 0x7f5a00069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5a08082a50 con 0x7f5a1413e290 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.303+0000 7f5a13fff640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5a00066f50 0x7f5a00069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.307+0000 7f5a10ff9640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f5a0006cdb0 0x7f5a0006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.307+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 --> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a0006f880 con 0x7f5a0006cdb0 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.307+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a08087680 con 0x7f5a1413e290 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.307+0000 7f5a13fff640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5a00066f50 0x7f5a00069410 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5a140cc100 tx=0x7f5a04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.307+0000 7f5a18961640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f5a0006cdb0 0x7f5a0006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.307+0000 7f5a18961640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f5a0006cdb0 0x7f5a0006f1d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.307+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== osd.7 v2:172.21.15.120:6808/3467251727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5a0006f880 con 0x7f5a0006cdb0 2023-11-26T07:24:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.319+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 --> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5a1415c840 con 0x7f5a0006cdb0 2023-11-26T07:24:18.320 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a10ff9640 1 -- 172.21.15.70:0/3118076128 <== osd.7 v2:172.21.15.120:6808/3467251727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5a0c0090d0 con 0x7f5a0006cdb0 2023-11-26T07:24:18.320 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2023-11-26T07:24:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-26T07:24:18.321 INFO:teuthology.orchestra.run.smithi070.stdout:} 2023-11-26T07:24:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f5a0006cdb0 msgr2=0x7f5a0006f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.120:6808/3467251727,v1:172.21.15.120:6810/3467251727] conn(0x7f5a0006cdb0 0x7f5a0006f1d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5a00066f50 msgr2=0x7f5a00069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f5a00066f50 0x7f5a00069410 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5a140cc100 tx=0x7f5a04009040 comp rx=0 tx=0).stop 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1413e290 msgr2=0x7f5a1415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 --2- 172.21.15.70:0/3118076128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5a1413e290 0x7f5a1415b510 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800e930 tx=0x7f5a0800edf0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a18961640 1 -- 172.21.15.70:0/3118076128 reap_dead start 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 shutdown_connections 2023-11-26T07:24:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 >> 172.21.15.70:0/3118076128 conn(0x7f5a1406a890 msgr2=0x7f5a1406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 shutdown_connections 2023-11-26T07:24:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.323+0000 7f5a1a3c4640 1 -- 172.21.15.70:0/3118076128 wait complete. 2023-11-26T07:24:18.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-26T07:24:18.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6e3b4640 1 Processor -- start 2023-11-26T07:24:18.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6e3b4640 1 -- start start 2023-11-26T07:24:18.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6e3b4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9a680d0e40 0x7f9a680ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6e3b4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a680d3d20 con 0x7f9a680b1860 2023-11-26T07:24:18.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6e3b4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a680afd70 con 0x7f9a680cfa70 2023-11-26T07:24:18.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6e3b4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a680d4000 con 0x7f9a680d0e40 2023-11-26T07:24:18.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6cbb1640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9a680b1860 0x7f9a680cdd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34916/0 (socket says 172.21.15.70:34916) 2023-11-26T07:24:18.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6cbb1640 1 -- 172.21.15.70:0/3652286859 learned_addr learned my addr 172.21.15.70:0/3652286859 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:18.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6dbb3640 1 --2- 172.21.15.70:0/3652286859 >> v2:172.21.15.120:3300/0 conn(0x7f9a680d0e40 0x7f9a680ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a5ffff640 1 -- 172.21.15.70:0/3652286859 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298222460 0 0) 0x7f9a680d3d20 con 0x7f9a680b1860 2023-11-26T07:24:18.480 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a5ffff640 1 -- 172.21.15.70:0/3652286859 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a54003530 con 0x7f9a680b1860 2023-11-26T07:24:18.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6dbb3640 1 -- 172.21.15.70:0/3652286859 >> v1:172.21.15.120:6789/0 conn(0x7f9a680cfa70 legacy=0x7f9a680cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a5ffff640 1 -- 172.21.15.70:0/3652286859 <== mon.1 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884473589 0 0) 0x7f9a680afd70 con 0x7f9a680cfa70 2023-11-26T07:24:18.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6dbb3640 1 -- 172.21.15.70:0/3652286859 >> v1:172.21.15.70:6789/0 conn(0x7f9a680b1860 legacy=0x7f9a680cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.479+0000 7f9a6dbb3640 1 -- 172.21.15.70:0/3652286859 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a680b0050 con 0x7f9a680d0e40 2023-11-26T07:24:18.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6dbb3640 1 --2- 172.21.15.70:0/3652286859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 0x7f9a680ce430 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009d90 tx=0x7f9a6001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f420b01d4b9964b server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a5ffff640 1 -- 172.21.15.70:0/3652286859 <== mon.1 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600a5920 con 0x7f9a680d0e40 2023-11-26T07:24:18.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a5ffff640 1 -- 172.21.15.70:0/3652286859 <== mon.1 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a600a5a80 con 0x7f9a680d0e40 2023-11-26T07:24:18.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a5ffff640 1 -- 172.21.15.70:0/3652286859 <== mon.1 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600a5e10 con 0x7f9a680d0e40 2023-11-26T07:24:18.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3652286859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 msgr2=0x7f9a680ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3652286859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 0x7f9a680ce430 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009d90 tx=0x7f9a6001c950 comp rx=0 tx=0).stop 2023-11-26T07:24:18.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3652286859 shutdown_connections 2023-11-26T07:24:18.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3652286859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 0x7f9a680ce430 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3652286859 >> 172.21.15.70:0/3652286859 conn(0x7f9a680d3060 msgr2=0x7f9a680d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3652286859 shutdown_connections 2023-11-26T07:24:18.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.483+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3652286859 wait complete. 2023-11-26T07:24:18.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 Processor -- start 2023-11-26T07:24:18.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 -- start start 2023-11-26T07:24:18.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a680b1860 0x7f9a68153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a680cfa70 0x7f9a68154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 0x7f9a68155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680c6ec0 con 0x7f9a680cfa70 2023-11-26T07:24:18.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68155ab0 con 0x7f9a680d0e40 2023-11-26T07:24:18.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68155d90 con 0x7f9a680b1860 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a680cfa70 0x7f9a68154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a680cfa70 0x7f9a68154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52314/0 (socket says 172.21.15.70:52314) 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 -- 172.21.15.70:0/3385647407 learned_addr learned my addr 172.21.15.70:0/3385647407 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6d3b2640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a680b1860 0x7f9a68153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6dbb3640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 0x7f9a68155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 -- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a680b1860 msgr2=0x7f9a68153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a680b1860 0x7f9a68153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.488 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 -- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 msgr2=0x7f9a68155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 0x7f9a68155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 -- 172.21.15.70:0/3385647407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60009a70 con 0x7f9a680cfa70 2023-11-26T07:24:18.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6cbb1640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a680cfa70 0x7f9a68154d40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c420 tx=0x7f9a5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a5dffb640 1 -- 172.21.15.70:0/3385647407 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58005cf0 con 0x7f9a680cfa70 2023-11-26T07:24:18.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a5dffb640 1 -- 172.21.15.70:0/3385647407 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a58005e70 con 0x7f9a680cfa70 2023-11-26T07:24:18.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a5dffb640 1 -- 172.21.15.70:0/3385647407 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a580072f0 con 0x7f9a680cfa70 2023-11-26T07:24:18.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a68156070 con 0x7f9a680cfa70 2023-11-26T07:24:18.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.487+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a681557c0 con 0x7f9a680cfa70 2023-11-26T07:24:18.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.491+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a680c7030 con 0x7f9a680cfa70 2023-11-26T07:24:18.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.491+0000 7f9a5dffb640 1 -- 172.21.15.70:0/3385647407 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f9a58007490 con 0x7f9a680cfa70 2023-11-26T07:24:18.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.491+0000 7f9a5dffb640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a4c066f20 0x7f9a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.491+0000 7f9a5dffb640 1 -- 172.21.15.70:0/3385647407 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a58081f70 con 0x7f9a680cfa70 2023-11-26T07:24:18.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.491+0000 7f9a6d3b2640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a4c066f20 0x7f9a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.491+0000 7f9a6d3b2640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a4c066f20 0x7f9a4c0693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9a64000f70 tx=0x7f9a64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.494 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.495+0000 7f9a5dffb640 1 -- 172.21.15.70:0/3385647407 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a58050d80 con 0x7f9a680cfa70 2023-11-26T07:24:18.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.643+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a68155f00 con 0x7f9a4c066f20 2023-11-26T07:24:18.643 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.643+0000 7f9a5dffb640 1 -- 172.21.15.70:0/3385647407 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a68155f00 con 0x7f9a4c066f20 2023-11-26T07:24:18.644 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 7 to deep-scrub 2023-11-26T07:24:18.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a4c066f20 msgr2=0x7f9a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a4c066f20 0x7f9a4c0693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9a64000f70 tx=0x7f9a64009040 comp rx=0 tx=0).stop 2023-11-26T07:24:18.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a680cfa70 msgr2=0x7f9a68154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a680cfa70 0x7f9a68154d40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c420 tx=0x7f9a5800c8e0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 shutdown_connections 2023-11-26T07:24:18.646 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f9a4c066f20 0x7f9a4c0693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a680cfa70 0x7f9a68154d40 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a680d0e40 0x7f9a68155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 --2- 172.21.15.70:0/3385647407 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f9a680b1860 0x7f9a68153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 >> 172.21.15.70:0/3385647407 conn(0x7f9a680d3060 msgr2=0x7f9a680cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 shutdown_connections 2023-11-26T07:24:18.647 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.647+0000 7f9a6e3b4640 1 -- 172.21.15.70:0/3385647407 wait complete. 2023-11-26T07:24:18.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:18.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f79a08fe640 1 Processor -- start 2023-11-26T07:24:18.801 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f79a08fe640 1 -- start start 2023-11-26T07:24:18.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f79a08fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f799c06f000 0x7f799c06d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f79a08fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c099a70 0x7f799c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f79a08fe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0cf260 con 0x7f799c06f3e0 2023-11-26T07:24:18.802 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f79a08fe640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c06d570 con 0x7f799c06f000 2023-11-26T07:24:18.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f79a08fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c09a010 con 0x7f799c099a70 2023-11-26T07:24:18.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f7993fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f799c06f3e0 0x7f799c06b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:34930/0 (socket says 172.21.15.70:34930) 2023-11-26T07:24:18.803 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f7993fff640 1 -- 172.21.15.70:0/2655417576 learned_addr learned my addr 172.21.15.70:0/2655417576 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:18.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f799ad9d640 1 --2- 172.21.15.70:0/2655417576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c099a70 0x7f799c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f799a59c640 1 --2- 172.21.15.70:0/2655417576 >> v2:172.21.15.120:3300/0 conn(0x7f799c06f000 0x7f799c06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f7999d9b640 1 -- 172.21.15.70:0/2655417576 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818530248 0 0) 0x7f799c0cf260 con 0x7f799c06f3e0 2023-11-26T07:24:18.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f7999d9b640 1 -- 172.21.15.70:0/2655417576 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7988003530 con 0x7f799c06f3e0 2023-11-26T07:24:18.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f799ad9d640 1 -- 172.21.15.70:0/2655417576 >> v2:172.21.15.120:3300/0 conn(0x7f799c06f000 msgr2=0x7f799c06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:18.804 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f799ad9d640 1 --2- 172.21.15.70:0/2655417576 >> v2:172.21.15.120:3300/0 conn(0x7f799c06f000 0x7f799c06d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f799ad9d640 1 -- 172.21.15.70:0/2655417576 >> v1:172.21.15.70:6789/0 conn(0x7f799c06f3e0 legacy=0x7f799c06b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.805 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.803+0000 7f799ad9d640 1 -- 172.21.15.70:0/2655417576 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c09a2f0 con 0x7f799c099a70 2023-11-26T07:24:18.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f799ad9d640 1 --2- 172.21.15.70:0/2655417576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c099a70 0x7f799c06bcb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7994009d90 tx=0x7f799401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=175527dbd203732e server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f7999d9b640 1 -- 172.21.15.70:0/2655417576 <== mon.2 v2:172.21.15.120:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940af600 con 0x7f799c099a70 2023-11-26T07:24:18.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f7999d9b640 1 -- 172.21.15.70:0/2655417576 <== mon.2 v2:172.21.15.120:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79940ab050 con 0x7f799c099a70 2023-11-26T07:24:18.806 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f7999d9b640 1 -- 172.21.15.70:0/2655417576 <== mon.2 v2:172.21.15.120:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940af980 con 0x7f799c099a70 2023-11-26T07:24:18.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 -- 172.21.15.70:0/2655417576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c099a70 msgr2=0x7f799c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 --2- 172.21.15.70:0/2655417576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c099a70 0x7f799c06bcb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7994009d90 tx=0x7f799401f130 comp rx=0 tx=0).stop 2023-11-26T07:24:18.807 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 -- 172.21.15.70:0/2655417576 shutdown_connections 2023-11-26T07:24:18.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 --2- 172.21.15.70:0/2655417576 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c099a70 0x7f799c06bcb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 --2- 172.21.15.70:0/2655417576 >> v2:172.21.15.120:3300/0 conn(0x7f799c06f000 0x7f799c06d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 -- 172.21.15.70:0/2655417576 >> 172.21.15.70:0/2655417576 conn(0x7f799c0b2d10 msgr2=0x7f799c0b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 -- 172.21.15.70:0/2655417576 shutdown_connections 2023-11-26T07:24:18.808 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.807+0000 7f79a08fe640 1 -- 172.21.15.70:0/2655417576 wait complete. 2023-11-26T07:24:18.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 Processor -- start 2023-11-26T07:24:18.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 -- start start 2023-11-26T07:24:18.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f799c06f000 0x7f799c0b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c06f3e0 0x7f799c154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f799c099a70 0x7f799c154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0b6ee0 con 0x7f799c099a70 2023-11-26T07:24:18.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c15ebd0 con 0x7f799c06f000 2023-11-26T07:24:18.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c15eeb0 con 0x7f799c06f3e0 2023-11-26T07:24:18.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f799c099a70 0x7f799c154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f799c099a70 0x7f799c154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52330/0 (socket says 172.21.15.70:52330) 2023-11-26T07:24:18.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 -- 172.21.15.70:0/3263704653 learned_addr learned my addr 172.21.15.70:0/3263704653 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:18.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799a59c640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f799c06f000 0x7f799c0b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f7993fff640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c06f3e0 0x7f799c154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 -- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c06f3e0 msgr2=0x7f799c154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c06f3e0 0x7f799c154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 -- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f799c06f000 msgr2=0x7f799c0b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f799c06f000 0x7f799c0b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.812 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 -- 172.21.15.70:0/3263704653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994009a70 con 0x7f799c099a70 2023-11-26T07:24:18.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f799ad9d640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f799c099a70 0x7f799c154890 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f79940b2040 tx=0x7f799401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f7992ffd640 1 -- 172.21.15.70:0/3263704653 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994009450 con 0x7f799c099a70 2023-11-26T07:24:18.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f7992ffd640 1 -- 172.21.15.70:0/3263704653 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79940b9410 con 0x7f799c099a70 2023-11-26T07:24:18.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f7992ffd640 1 -- 172.21.15.70:0/3263704653 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940b97c0 con 0x7f799c099a70 2023-11-26T07:24:18.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c15f190 con 0x7f799c099a70 2023-11-26T07:24:18.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.811+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c1e8d30 con 0x7f799c099a70 2023-11-26T07:24:18.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.815+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c067680 con 0x7f799c099a70 2023-11-26T07:24:18.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.815+0000 7f7992ffd640 1 -- 172.21.15.70:0/3263704653 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f79940b6050 con 0x7f799c099a70 2023-11-26T07:24:18.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.815+0000 7f7992ffd640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f797c066f20 0x7f797c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:18.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.815+0000 7f7992ffd640 1 -- 172.21.15.70:0/3263704653 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7994120c10 con 0x7f799c099a70 2023-11-26T07:24:18.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.815+0000 7f799a59c640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f797c066f20 0x7f797c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:18.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.815+0000 7f799a59c640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f797c066f20 0x7f797c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f798c009b60 tx=0x7f798c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:18.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.819+0000 7f7992ffd640 1 -- 172.21.15.70:0/3263704653 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79940efbd0 con 0x7f799c099a70 2023-11-26T07:24:18.973 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.975+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f799c15f640 con 0x7f797c066f20 2023-11-26T07:24:18.975 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.975+0000 7f7992ffd640 1 -- 172.21.15.70:0/3263704653 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50911 (secure 0 0 0) 0x7f799c15f640 con 0x7f797c066f20 2023-11-26T07:24:18.976 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:18.976 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:24:18.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f797c066f20 msgr2=0x7f797c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f797c066f20 0x7f797c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f798c009b60 tx=0x7f798c009190 comp rx=0 tx=0).stop 2023-11-26T07:24:18.977 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f799c099a70 msgr2=0x7f799c154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f799c099a70 0x7f799c154890 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f79940b2040 tx=0x7f799401bed0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 shutdown_connections 2023-11-26T07:24:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f797c066f20 0x7f797c0693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f799c099a70 0x7f799c154890 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f799c06f3e0 0x7f799c154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 --2- 172.21.15.70:0/3263704653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f799c06f000 0x7f799c0b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:18.978 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 >> 172.21.15.70:0/3263704653 conn(0x7f799c0b2d10 msgr2=0x7f799c06ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:18.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 shutdown_connections 2023-11-26T07:24:18.979 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:18.979+0000 7f79a08fe640 1 -- 172.21.15.70:0/3263704653 wait complete. 2023-11-26T07:24:18.996 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2023-11-26T07:24:18.070181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":279396,"kb_used_data":9128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695324,"statfs":{"total":773094113280,"available":772808011776,"internally_reserved":0,"allocated":9347072,"data_stored":4668032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-419430941,"num_objects":-404,"num_object_clones":-1,"num_object_copies":-808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-404,"num_whiteouts":-1,"num_read":-206,"num_read_kb":-204806,"num_write":-408,"num_write_kb":-409605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-7,"num_bytes_recovered":-7340032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.826610"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-11-26T07:24:08.248997+0000","last_change":"2023-11-26T07:17:54.087949+0000","last_active":"2023-11-26T07:24:08.248997+0000","last_peered":"2023-11-26T07:24:08.248997+0000","last_clean":"2023-11-26T07:24:08.248997+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:24:08.248997+0000","last_undegraded":"2023-11-26T07:24:08.248997+0000","last_fullsized":"2023-11-26T07:24:08.248997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-26T07:17:52.930561+0000","last_clean_scrub_stamp":"2023-11-26T07:17:52.930561+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T09:40:45.191954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.621},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.872,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57999999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.64300000000000002},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.028,"5min":1.028,"15min":1.6950000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63500000000000001,"15min":0.70499999999999996},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.88900000000000001,"15min":0.91500000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.755},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.71399999999999997,"15min":0.76800000000000002},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.76900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84699999999999998,"5min":1.171,"15min":1.171},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65800000000000003,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":1.093,"15min":1.093},"last":0.80700000000000005}]},{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67800000000000005,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.872,"5min":0.91900000000000004,"15min":1.1559999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70399999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.76200000000000001},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":0.98899999999999999,"15min":1.089},"last":0.77300000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.48399999999999999,"15min":0.46500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.76300000000000001},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.872,"5min":1.046,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.39900000000000002},"max":{"1min":0.92800000000000005,"5min":0.94199999999999995,"15min":1.018},"last":0.754}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64600000000000002,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83499999999999996,"5min":1.038,"15min":1.133},"last":0.63},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93999999999999995,"5min":1.016,"15min":1.042},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.93999999999999995,"5min":1.0820000000000001,"15min":1.196},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0980000000000001,"15min":1.2090000000000001},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.93300000000000005},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":6.8019999999999996},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.96099999999999997},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96999999999999997,"5min":1.0980000000000001,"15min":7.2329999999999997},"last":0.88600000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":1.022},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91000000000000003,"5min":1.591,"15min":7.5640000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76000000000000001,"15min":0.92400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.70299999999999996}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.93400000000000005},"min":{"1min":0.46000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":6.7530000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70999999999999996,"15min":1.056},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.544,"15min":7.7789999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.79700000000000004,"15min":1.089},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":0.86899999999999999,"5min":8.4039999999999999,"15min":8.7530000000000001},"last":0.94699999999999995}]},{"osd":4,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.88900000000000001,"15min":6.6879999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.99199999999999999},"min":{"1min":0.47299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.635,"15min":7.1680000000000001},"last":0.99399999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.85299999999999998},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70699999999999996,"15min":1.7669999999999999},"min":{"1min":0.5,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":24.623000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71299999999999997,"15min":1.1060000000000001},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.84399999999999997,"5min":1.679,"15min":7.6390000000000002},"last":1.02},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.80000000000000004,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99099999999999999,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.86299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.45300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79700000000000004,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65900000000000003}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.65100000000000002},"min":{"1min":0.52600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.629}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92400000000000004,"5min":1.218,"15min":1.218},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.51300000000000001},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.47499999999999998},"max":{"1min":0.90300000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.85099999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.50800000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.70299999999999996},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":1.238,"15min":1.238},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.91300000000000003,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.79900000000000004},"min":{"1min":0.52800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0900000000000001,"15min":1.095},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88900000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.81499999999999995},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96299999999999997,"5min":1.302,"15min":1.302},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.439},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32500000000000001}]},{"osd":1,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.99299999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.635,"5min":1.635,"15min":3.1970000000000001},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.659,"5min":1.659,"15min":3.2480000000000002},"last":0.498}]},{"osd":4,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.83699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92100000000000004,"5min":1.0289999999999999,"15min":3.4289999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.73399999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.86899999999999999},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.708,"5min":1.708,"15min":3.3210000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96699999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.745},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72499999999999998,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":3.2890000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68999999999999995,"15min":0.89400000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":1.0880000000000001,"15min":3.476},"last":0.626},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71899999999999997,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.442,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":2.056,"15min":2.056},"last":0.35499999999999998}]},{"osd":1,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60399999999999998,"5min":1.175,"15min":1.175},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.44600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73699999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.496}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93400000000000005,"5min":1.351,"15min":1.351},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96099999999999997,"5min":1.752,"15min":1.752},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90400000000000003,"5min":1.214,"15min":1.214},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.79200000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92600000000000005,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.74299999999999999,"15min":0.77700000000000002},"min":{"1min":0.59799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":1.421,"15min":1.421},"last":0.81100000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.56499999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91900000000000004,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.69999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39200000000000002,"15min":0.47799999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":0.752,"15min":2.5619999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.4159999999999999},"last":0.626}]},{"osd":2,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42999999999999999,"15min":0.498},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52400000000000002,"5min":0.68200000000000005,"15min":1.6140000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":2.6030000000000002},"last":0.501}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59799999999999998,"5min":0.752,"15min":2.6429999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61299999999999999,"5min":0.95199999999999996,"15min":1.7470000000000001},"last":0.52300000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96299999999999997,"5min":1.085,"15min":2.4049999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.034,"15min":1.329},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.01,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0880000000000001,"15min":2.5129999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.58999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.7070000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.3799999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.61299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":1.1279999999999999,"15min":1.173},"last":0.78600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.58599999999999997},"min":{"1min":0.26100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.747,"15min":4.3760000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.53000000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":2.5779999999999998},"last":0.43099999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.96099999999999997,"15min":2.415},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.68000000000000005},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60799999999999998,"5min":0.79000000000000004,"15min":5.234},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.57899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":0.85399999999999998,"15min":3.726},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.52300000000000002,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":5.1959999999999997},"last":0.45200000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.89700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91300000000000003,"5min":1.105,"15min":5.1639999999999997},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.69299999999999995,"15min":0.80200000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":1.1659999999999999,"15min":2.7530000000000001},"last":1.1120000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.81000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.238,"15min":2.835},"last":1.167},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.84899999999999998},"min":{"1min":0.55100000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85799999999999998,"5min":1.1080000000000001,"15min":3.3679999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71799999999999997,"15min":0.84899999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85399999999999998,"5min":1.1359999999999999,"15min":3.4700000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72599999999999998,"15min":0.82599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":1.1850000000000001,"15min":2.9940000000000002},"last":1.157}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72499999999999998,"15min":0.85399999999999998},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":1.1379999999999999,"15min":3.3300000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.2450000000000001,"15min":2.798},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:18.999 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-26T07:17:52.930561+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=26, tm_hour=7, tm_min=17, tm_sec=52, tm_wday=6, tm_yday=330, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=26, tm_hour=7, tm_min=24, tm_sec=13, tm_wday=6, tm_yday=330, tm_isdst=0) 2023-11-26T07:24:19.000 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-26T07:24:30.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:30.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:39.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-26T07:24:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.150+0000 7f076e86b640 1 Processor -- start 2023-11-26T07:24:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.150+0000 7f076e86b640 1 -- start start 2023-11-26T07:24:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f076e86b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0768143ac0 0x7f0768070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f076e86b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f07680708b0 0x7f07680cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f076e86b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680cc730 con 0x7f07680cf7c0 2023-11-26T07:24:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f076e86b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0768143ea0 con 0x7f07680708b0 2023-11-26T07:24:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f076e86b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07680cfbd0 con 0x7f0768143ac0 2023-11-26T07:24:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f07680708b0 0x7f07680cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f07680708b0 0x7f07680cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59602/0 (socket says 172.21.15.70:59602) 2023-11-26T07:24:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 -- 172.21.15.70:0/3164422286 learned_addr learned my addr 172.21.15.70:0/3164422286 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:39.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f0767fff640 1 --2- 172.21.15.70:0/3164422286 >> v2:172.21.15.120:3300/0 conn(0x7f0768143ac0 0x7f0768070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 -- 172.21.15.70:0/3164422286 >> v2:172.21.15.120:3300/0 conn(0x7f0768143ac0 msgr2=0x7f0768070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 --2- 172.21.15.70:0/3164422286 >> v2:172.21.15.120:3300/0 conn(0x7f0768143ac0 0x7f0768070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 -- 172.21.15.70:0/3164422286 >> v1:172.21.15.120:6789/0 conn(0x7f07680cf7c0 legacy=0x7f07680b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.154 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 -- 172.21.15.70:0/3164422286 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0768070ee0 con 0x7f07680708b0 2023-11-26T07:24:39.155 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.154+0000 7f07677fe640 1 --2- 172.21.15.70:0/3164422286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680708b0 0x7f07680cf280 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f076806dca0 tx=0x7f075c01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf132ad80aae0bf server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f0766ffd640 1 -- 172.21.15.70:0/3164422286 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c0a7c60 con 0x7f07680708b0 2023-11-26T07:24:39.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f0766ffd640 1 -- 172.21.15.70:0/3164422286 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c0a7dc0 con 0x7f07680708b0 2023-11-26T07:24:39.156 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f0766ffd640 1 -- 172.21.15.70:0/3164422286 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c0af660 con 0x7f07680708b0 2023-11-26T07:24:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 -- 172.21.15.70:0/3164422286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680708b0 msgr2=0x7f07680cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 --2- 172.21.15.70:0/3164422286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680708b0 0x7f07680cf280 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f076806dca0 tx=0x7f075c01eb90 comp rx=0 tx=0).stop 2023-11-26T07:24:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 -- 172.21.15.70:0/3164422286 shutdown_connections 2023-11-26T07:24:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 --2- 172.21.15.70:0/3164422286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07680708b0 0x7f07680cf280 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.157 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 --2- 172.21.15.70:0/3164422286 >> v2:172.21.15.120:3300/0 conn(0x7f0768143ac0 0x7f0768070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 -- 172.21.15.70:0/3164422286 >> 172.21.15.70:0/3164422286 conn(0x7f076806a890 msgr2=0x7f076806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 -- 172.21.15.70:0/3164422286 shutdown_connections 2023-11-26T07:24:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 -- 172.21.15.70:0/3164422286 wait complete. 2023-11-26T07:24:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 Processor -- start 2023-11-26T07:24:39.158 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.158+0000 7f076e86b640 1 -- start start 2023-11-26T07:24:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07680708b0 0x7f07680b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680cf7c0 0x7f076815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768143ac0 0x7f076815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680b1a40 con 0x7f0768143ac0 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681586b0 con 0x7f07680cf7c0 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0768158990 con 0x7f07680708b0 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076ce08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768143ac0 0x7f076815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f0767fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07680708b0 0x7f07680b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f0767fff640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07680708b0 0x7f07680b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3301/0 says I am v2:172.21.15.70:35430/0 (socket says 172.21.15.70:35430) 2023-11-26T07:24:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f0767fff640 1 -- 172.21.15.70:0/1470889564 learned_addr learned my addr 172.21.15.70:0/1470889564 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:39.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f07677fe640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680cf7c0 0x7f076815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076ce08640 1 -- 172.21.15.70:0/1470889564 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07680708b0 msgr2=0x7f07680b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076ce08640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07680708b0 0x7f07680b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076ce08640 1 -- 172.21.15.70:0/1470889564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680cf7c0 msgr2=0x7f076815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076ce08640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680cf7c0 0x7f076815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076ce08640 1 -- 172.21.15.70:0/1470889564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c00b770 con 0x7f0768143ac0 2023-11-26T07:24:39.162 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076ce08640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768143ac0 0x7f076815bcc0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f076000c780 tx=0x7f076000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.163 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f0764ff9640 1 -- 172.21.15.70:0/1470889564 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000aa50 con 0x7f0768143ac0 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f0764ff9640 1 -- 172.21.15.70:0/1470889564 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076000abb0 con 0x7f0768143ac0 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f0764ff9640 1 -- 172.21.15.70:0/1470889564 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000ce30 con 0x7f0768143ac0 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0768158c70 con 0x7f0768143ac0 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0768159230 con 0x7f0768143ac0 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0768159420 con 0x7f0768143ac0 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.162+0000 7f0764ff9640 1 -- 172.21.15.70:0/1470889564 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f0760012420 con 0x7f0768143ac0 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.166+0000 7f0764ff9640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0754066f20 0x7f07540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.166+0000 7f0764ff9640 1 -- 172.21.15.70:0/1470889564 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0760082b40 con 0x7f0768143ac0 2023-11-26T07:24:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.166+0000 7f0767fff640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0754066f20 0x7f07540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.166+0000 7f0767fff640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0754066f20 0x7f07540693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0758007a70 tx=0x7f0758008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.170+0000 7f0764ff9640 1 -- 172.21.15.70:0/1470889564 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0760051740 con 0x7f0768143ac0 2023-11-26T07:24:39.317 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.318+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 --> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0768158b00 con 0x7f0754066f20 2023-11-26T07:24:39.319 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.318+0000 7f0764ff9640 1 -- 172.21.15.70:0/1470889564 <== mgr.4104 v2:172.21.15.70:6832/2418872727 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50904 (secure 0 0 0) 0x7f0768158b00 con 0x7f0754066f20 2023-11-26T07:24:39.320 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:39.320 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2023-11-26T07:24:39.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0754066f20 msgr2=0x7f07540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.321 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0754066f20 0x7f07540693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0758007a70 tx=0x7f0758008040 comp rx=0 tx=0).stop 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768143ac0 msgr2=0x7f076815bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768143ac0 0x7f076815bcc0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f076000c780 tx=0x7f076000cc40 comp rx=0 tx=0).stop 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 shutdown_connections 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f0754066f20 0x7f07540693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0768143ac0 0x7f076815bcc0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f07680cf7c0 0x7f076815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 --2- 172.21.15.70:0/1470889564 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f07680708b0 0x7f07680b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.322 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 >> 172.21.15.70:0/1470889564 conn(0x7f076806a890 msgr2=0x7f076806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:39.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 shutdown_connections 2023-11-26T07:24:39.323 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.322+0000 7f076e86b640 1 -- 172.21.15.70:0/1470889564 wait complete. 2023-11-26T07:24:39.340 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-11-26T07:24:38.074490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":279376,"kb_used_data":9128,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754695344,"statfs":{"total":773094113280,"available":772808032256,"internally_reserved":0,"allocated":9347072,"data_stored":4668032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":276614705},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002677"},"pg_stats":[{"pgid":"1.0","version":"83'119","reported_seq":230,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-11-26T07:24:19.060058+0000","last_change":"2023-11-26T07:24:19.060086+0000","last_active":"2023-11-26T07:24:19.060058+0000","last_peered":"2023-11-26T07:24:19.060058+0000","last_clean":"2023-11-26T07:24:19.060058+0000","last_became_active":"2023-11-26T07:17:54.086835+0000","last_became_peered":"2023-11-26T07:17:54.086835+0000","last_unstale":"2023-11-26T07:24:19.060058+0000","last_undegraded":"2023-11-26T07:24:19.060058+0000","last_fullsized":"2023-11-26T07:24:19.060058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'119","last_scrub_stamp":"2023-11-26T07:24:19.059958+0000","last_deep_scrub":"83'119","last_deep_scrub_stamp":"2023-11-26T07:24:19.059958+0000","last_clean_scrub_stamp":"2023-11-26T07:24:19.059958+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-27T18:42:13.481401+0000","scrub_duration":0.0095271000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64100000000000001,"15min":0.621},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":0.627},"min":{"1min":0.46500000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.872,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70299999999999996}]},{"osd":1,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.64300000000000002},"min":{"1min":0.45400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.376,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63200000000000001,"15min":0.63800000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.028,"5min":1.028,"15min":1.6950000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68700000000000006,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.75800000000000001}]},{"osd":4,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.60899999999999999,"15min":0.64400000000000002},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.1139999999999999,"5min":4.1139999999999999,"15min":4.1139999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.63500000000000001,"15min":0.70499999999999996},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.36499999999999999},"max":{"1min":0.82099999999999995,"5min":0.88900000000000001,"15min":0.91500000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.66400000000000003},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1},"last":0.68100000000000005}]},{"osd":6,"last update":"Sun Nov 26 07:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.71399999999999997,"15min":0.76800000000000002},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84699999999999998,"5min":1.171,"15min":1.171},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65800000000000003,"15min":0.69799999999999995},"min":{"1min":0.504,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":1.093,"15min":1.093},"last":0.754}]},{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67800000000000005,"15min":0.73199999999999998},"min":{"1min":0.51900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.872,"5min":0.91900000000000004,"15min":1.1559999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65100000000000002,"15min":0.70199999999999996},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.69099999999999995},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.76200000000000001},"min":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92200000000000004,"5min":0.98899999999999999,"15min":1.089},"last":0.872}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.48399999999999999,"15min":0.46500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73599999999999999,"15min":0.76300000000000001},"min":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.872,"5min":1.046,"15min":1.0629999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.629,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90800000000000003,"5min":0.996,"15min":1.0189999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.623,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.39900000000000002},"max":{"1min":0.92800000000000005,"5min":0.94199999999999995,"15min":1.018},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64600000000000002,"15min":0.71599999999999997},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83499999999999996,"5min":1.038,"15min":1.133},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93999999999999995,"5min":1.016,"15min":1.042},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.77200000000000002},"min":{"1min":0.52900000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.93999999999999995,"5min":1.0820000000000001,"15min":1.196},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95599999999999996,"5min":1.0980000000000001,"15min":1.2090000000000001},"last":0.91800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64400000000000002,"15min":0.93300000000000005},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":6.8019999999999996},"last":0.75},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.96099999999999997},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96999999999999997,"5min":1.0980000000000001,"15min":7.2329999999999997},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70599999999999996,"15min":1.022},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91000000000000003,"5min":1.591,"15min":7.5640000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76000000000000001,"15min":0.92400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":8.2720000000000002,"15min":8.2720000000000002},"last":0.66600000000000004}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65500000000000003,"15min":0.93400000000000005},"min":{"1min":0.46000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":6.7530000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70999999999999996,"15min":1.056},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.022,"5min":1.544,"15min":7.7789999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.79700000000000004,"15min":1.089},"min":{"1min":0.51300000000000001,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":0.86899999999999999,"5min":8.4039999999999999,"15min":8.7530000000000001},"last":0.71399999999999997}]},{"osd":4,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55900000000000005,"15min":0.88600000000000001},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69699999999999995,"5min":0.88900000000000001,"15min":6.6879999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.99199999999999999},"min":{"1min":0.47299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.635,"15min":7.1680000000000001},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.76700000000000002,"15min":0.85299999999999998},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":8.3640000000000008,"15min":8.3640000000000008},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70699999999999996,"15min":1.7669999999999999},"min":{"1min":0.5,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":24.623000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71299999999999997,"15min":1.1060000000000001},"min":{"1min":0.44,"5min":0.433,"15min":0.433},"max":{"1min":0.84399999999999997,"5min":1.679,"15min":7.6390000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.80000000000000004,"15min":1.1120000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99099999999999999,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36336,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.45300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79700000000000004,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.65100000000000002},"min":{"1min":0.52600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.876,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82199999999999995}]},{"osd":2,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.69499999999999995,"15min":0.68799999999999994},"min":{"1min":0.51800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92400000000000004,"5min":1.218,"15min":1.218},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.52100000000000002,"15min":0.51300000000000001},"max":{"1min":0.88600000000000001,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.878}]},{"osd":3,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.47499999999999998},"max":{"1min":0.90300000000000002,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.85099999999999998,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67900000000000005,"15min":0.71099999999999997},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82199999999999995,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.70299999999999996},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":1.238,"15min":1.238},"last":0.746}]},{"osd":6,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.748},"min":{"1min":0.48299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.91300000000000003,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.79900000000000004},"min":{"1min":0.52800000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0900000000000001,"15min":1.095},"last":0.93700000000000006}]},{"osd":7,"last update":"Sun Nov 26 07:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88900000000000001,"5min":5.1520000000000001,"15min":5.1520000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.81499999999999995},"min":{"1min":0.47199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96299999999999997,"5min":1.302,"15min":1.302},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44,"15min":0.439},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.40000000000000002}]},{"osd":1,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.45700000000000002},"min":{"1min":0.29599999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.99299999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.635,"5min":1.635,"15min":3.1970000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48599999999999999,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.659,"5min":1.659,"15min":3.2480000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.83699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92100000000000004,"5min":1.0289999999999999,"15min":3.4289999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.73399999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.66300000000000003}]},{"osd":5,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.70999999999999996,"15min":0.86899999999999999},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.708,"5min":1.708,"15min":3.3210000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96699999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.745},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.72499999999999998,"15min":0.88600000000000001},"min":{"1min":0.54800000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":3.2890000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Sun Nov 26 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68999999999999995,"15min":0.89400000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90200000000000002,"5min":1.0880000000000001,"15min":3.476},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71899999999999997,"15min":0.77100000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.442,"15min":0.44},"min":{"1min":0.30499999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65300000000000002,"5min":2.056,"15min":2.056},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60399999999999998,"5min":1.175,"15min":1.175},"last":0.38},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.44600000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.73699999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.755}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93400000000000005,"5min":1.351,"15min":1.351},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.72999999999999998},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96099999999999997,"5min":1.752,"15min":1.752},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.90400000000000003,"5min":1.214,"15min":1.214},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.749,"15min":0.79200000000000004},"min":{"1min":0.497,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92600000000000005,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.74299999999999999,"15min":0.77700000000000002},"min":{"1min":0.59799999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91100000000000003,"5min":1.421,"15min":1.421},"last":0.65700000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.56499999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84299999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.78200000000000003},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91900000000000004,"5min":3.6989999999999998,"15min":3.6989999999999998},"last":0.96399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":435912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39200000000000002,"15min":0.47799999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":0.752,"15min":2.5619999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.44700000000000001,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.4159999999999999},"last":0.75800000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42999999999999999,"15min":0.498},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52400000000000002,"5min":0.68200000000000005,"15min":1.6140000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46700000000000003,"15min":0.54700000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":2.6030000000000002},"last":0.64000000000000001}]},{"osd":3,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.59799999999999998,"5min":0.752,"15min":2.6429999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49199999999999999,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61299999999999999,"5min":0.95199999999999996,"15min":1.7470000000000001},"last":0.67900000000000005}]},{"osd":4,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.442,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.872},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71799999999999997,"15min":0.80400000000000005},"min":{"1min":0.498,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96299999999999997,"5min":1.085,"15min":2.4049999999999998},"last":0.97599999999999998}]},{"osd":5,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":1.034,"15min":1.329},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.55300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.01,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.998}]},{"osd":6,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73699999999999999,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93200000000000005,"5min":1.0880000000000001,"15min":2.5129999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.81499999999999995},"min":{"1min":0.58999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.7070000000000001},"last":1.0940000000000001}]},{"osd":7,"last update":"Sun Nov 26 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.79700000000000004},"min":{"1min":0.54600000000000004,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.0940000000000001,"15min":1.3799999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.61299999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":1.1279999999999999,"15min":1.173},"last":1.075}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1613824,"data_stored":1026280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.58599999999999997},"min":{"1min":0.26100000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.65000000000000002,"5min":0.747,"15min":4.3760000000000003},"last":0.437},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.53000000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":2.5779999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.69399999999999995,"5min":0.96099999999999997,"15min":2.415},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.68000000000000005},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60799999999999998,"5min":0.79000000000000004,"15min":5.234},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.57899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.60299999999999998,"5min":0.85399999999999998,"15min":3.726},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.52300000000000002,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":5.1959999999999997},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68200000000000005,"15min":0.89700000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91300000000000003,"5min":1.105,"15min":5.1639999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.69299999999999995,"15min":0.80200000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":1.1659999999999999,"15min":2.7530000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.81000000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.238,"15min":2.835},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70899999999999996,"15min":0.84899999999999998},"min":{"1min":0.55100000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85799999999999998,"5min":1.1080000000000001,"15min":3.3679999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71799999999999997,"15min":0.84899999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85399999999999998,"5min":1.1359999999999999,"15min":3.4700000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72599999999999998,"15min":0.82599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":1.1850000000000001,"15min":2.9940000000000002},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Nov 26 07:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72499999999999998,"15min":0.85399999999999998},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":1.1379999999999999,"15min":3.3300000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72199999999999998,"15min":0.83499999999999996},"min":{"1min":0.54300000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97799999999999998,"5min":1.2450000000000001,"15min":2.798},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-26T07:24:39.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-26T07:24:39.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f79329a1640 1 Processor -- start 2023-11-26T07:24:39.477 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f79329a1640 1 -- start start 2023-11-26T07:24:39.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f79329a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f792c15d6e0 0x7f792c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f79329a1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c0cf0e0 con 0x7f792c0d1bc0 2023-11-26T07:24:39.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f79329a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c0ceb20 con 0x7f792c0b2160 2023-11-26T07:24:39.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f79329a1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c15dac0 con 0x7f792c15d6e0 2023-11-26T07:24:39.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f7930f3e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f792c0d1bc0 0x7f792c0b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60796/0 (socket says 172.21.15.70:60796) 2023-11-26T07:24:39.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f7930f3e640 1 -- 172.21.15.70:0/3359945852 learned_addr learned my addr 172.21.15.70:0/3359945852 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:39.479 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792bfff640 1 --2- 172.21.15.70:0/3359945852 >> v2:172.21.15.120:3300/0 conn(0x7f792c15d6e0 0x7f792c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376327774 0 0) 0x7f792c0cf0e0 con 0x7f792c0d1bc0 2023-11-26T07:24:39.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7914003530 con 0x7f792c0d1bc0 2023-11-26T07:24:39.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3564290298 0 0) 0x7f7914003530 con 0x7f792c0d1bc0 2023-11-26T07:24:39.481 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 >> v2:172.21.15.120:3300/0 conn(0x7f792c15d6e0 msgr2=0x7f792c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 --2- 172.21.15.70:0/3359945852 >> v2:172.21.15.120:3300/0 conn(0x7f792c15d6e0 0x7f792c0d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 >> v1:172.21.15.120:6789/0 conn(0x7f792c0b2160 legacy=0x7f792c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0cee00 con 0x7f792c0d1bc0 2023-11-26T07:24:39.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f7924001a00 con 0x7f792c0d1bc0 2023-11-26T07:24:39.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.478+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 >> v1:172.21.15.70:6789/0 conn(0x7f792c0d1bc0 legacy=0x7f792c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914003980 0x7f7914003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.482 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79140047d0 0x7f7914004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914005190 0x7f791400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c15dac0 con 0x7f7914005190 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791400c030 con 0x7f7914003980 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791400c1f0 con 0x7f79140047d0 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914005190 0x7f791400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792bfff640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914003980 0x7f7914003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792b7fe640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79140047d0 0x7f7914004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 -- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79140047d0 msgr2=0x7f7914004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f79140047d0 0x7f7914004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 -- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914003980 msgr2=0x7f7914003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914003980 0x7f7914003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.484 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 -- 172.21.15.70:0/3359945852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914003530 con 0x7f7914005190 2023-11-26T07:24:39.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 -- 172.21.15.70:0/3359945852 reap_dead start 2023-11-26T07:24:39.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f7930f3e640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914005190 0x7f791400b990 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f792400a800 tx=0x7f792401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcff30e13803011 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240072d0 con 0x7f7914005190 2023-11-26T07:24:39.485 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79240a8070 con 0x7f7914005190 2023-11-26T07:24:39.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.482+0000 7f792affd640 1 -- 172.21.15.70:0/3359945852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924007670 con 0x7f7914005190 2023-11-26T07:24:39.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- 172.21.15.70:0/3359945852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914005190 msgr2=0x7f791400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914005190 0x7f791400b990 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f792400a800 tx=0x7f792401d300 comp rx=0 tx=0).stop 2023-11-26T07:24:39.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- 172.21.15.70:0/3359945852 shutdown_connections 2023-11-26T07:24:39.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 --2- 172.21.15.70:0/3359945852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914005190 0x7f791400b990 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- 172.21.15.70:0/3359945852 >> 172.21.15.70:0/3359945852 conn(0x7f792c09c550 msgr2=0x7f792c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:39.486 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- 172.21.15.70:0/3359945852 shutdown_connections 2023-11-26T07:24:39.487 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- 172.21.15.70:0/3359945852 wait complete. 2023-11-26T07:24:39.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 Processor -- start 2023-11-26T07:24:39.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- start start 2023-11-26T07:24:39.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914005190 0x7f792c1f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f792c14dc30 0x7f792c0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f792c0b81b0 0x7f792c0b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0b6690 con 0x7f792c0b81b0 2023-11-26T07:24:39.489 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c1f6810 con 0x7f7914005190 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f79329a1640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0b6350 con 0x7f792c14dc30 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f7930f3e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f792c0b81b0 0x7f792c0b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f7930f3e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f792c0b81b0 0x7f792c0b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59608/0 (socket says 172.21.15.70:59608) 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f7930f3e640 1 -- 172.21.15.70:0/3847237277 learned_addr learned my addr 172.21.15.70:0/3847237277 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f792bfff640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914005190 0x7f792c1f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f792b7fe640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f792c14dc30 0x7f792c0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.486+0000 7f7930f3e640 1 -- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f792c14dc30 msgr2=0x7f792c0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7930f3e640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f792c14dc30 0x7f792c0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7930f3e640 1 -- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914005190 msgr2=0x7f792c1f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7930f3e640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914005190 0x7f792c1f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7930f3e640 1 -- 172.21.15.70:0/3847237277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0ce990 con 0x7f792c0b81b0 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7930f3e640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f792c0b81b0 0x7f792c0b8640 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f7924007040 tx=0x7f7914005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240b8460 con 0x7f792c0b81b0 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79240b85c0 con 0x7f792c0b81b0 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240b8970 con 0x7f792c0b81b0 2023-11-26T07:24:39.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c0b3940 con 0x7f792c0b81b0 2023-11-26T07:24:39.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c0b6bc0 con 0x7f792c0b81b0 2023-11-26T07:24:39.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c067680 con 0x7f792c0b81b0 2023-11-26T07:24:39.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f79240aa070 con 0x7f792c0b81b0 2023-11-26T07:24:39.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7928ff9640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7918066f50 0x7f7918069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f792411bf40 con 0x7f792c0b81b0 2023-11-26T07:24:39.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.490+0000 7f792bfff640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7918066f50 0x7f7918069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.493 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.494+0000 7f792bfff640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7918066f50 0x7f7918069410 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f791c009b60 tx=0x7f791c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.495 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.494+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79240eac60 con 0x7f792c0b81b0 2023-11-26T07:24:39.645 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.646+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f792c15ea60 con 0x7f792c0b81b0 2023-11-26T07:24:39.649 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.650+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v26)=0 v26) v1 ==== 123+0+0 (secure 0 0 0) 0x7f79240ee280 con 0x7f792c0b81b0 2023-11-26T07:24:39.650 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.650+0000 7f7928ff9640 1 -- 172.21.15.70:0/3847237277 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f792411c150 con 0x7f792c0b81b0 2023-11-26T07:24:39.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7918066f50 msgr2=0x7f7918069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7918066f50 0x7f7918069410 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f791c009b60 tx=0x7f791c009190 comp rx=0 tx=0).stop 2023-11-26T07:24:39.652 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f792c0b81b0 msgr2=0x7f792c0b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f792c0b81b0 0x7f792c0b8640 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f7924007040 tx=0x7f7914005800 comp rx=0 tx=0).stop 2023-11-26T07:24:39.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 shutdown_connections 2023-11-26T07:24:39.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f7918066f50 0x7f7918069410 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f792c0b81b0 0x7f792c0b8640 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f792c14dc30 0x7f792c0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 --2- 172.21.15.70:0/3847237277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7914005190 0x7f792c1f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 >> 172.21.15.70:0/3847237277 conn(0x7f792c09c550 msgr2=0x7f792c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:39.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 shutdown_connections 2023-11-26T07:24:39.654 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.654+0000 7f79329a1640 1 -- 172.21.15.70:0/3847237277 wait complete. 2023-11-26T07:24:39.672 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-26T07:24:39.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-26T07:24:39.809 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170e31c640 1 Processor -- start 2023-11-26T07:24:39.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170e31c640 1 -- start start 2023-11-26T07:24:39.810 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170e31c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1708143ac0 0x7f1708070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.811 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170e31c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 0x7f17080cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170e31c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17080cfbf0 con 0x7f17080cf7c0 2023-11-26T07:24:39.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170e31c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1708143ea0 con 0x7f1708143ac0 2023-11-26T07:24:39.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170e31c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17080cc730 con 0x7f17080708b0 2023-11-26T07:24:39.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170c8b9640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f17080cf7c0 0x7f17080b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60804/0 (socket says 172.21.15.70:60804) 2023-11-26T07:24:39.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f170c8b9640 1 -- 172.21.15.70:0/2428388735 learned_addr learned my addr 172.21.15.70:0/2428388735 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-26T07:24:39.813 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f17077fe640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 0x7f17080cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f1707fff640 1 --2- 172.21.15.70:0/2428388735 >> v2:172.21.15.120:3300/0 conn(0x7f1708143ac0 0x7f1708070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.810+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854278488 0 0) 0x7f17080cfbf0 con 0x7f17080cf7c0 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16f0003530 con 0x7f17080cf7c0 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1938538511 0 0) 0x7f16f0003530 con 0x7f17080cf7c0 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 msgr2=0x7f17080cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 0x7f17080cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 >> v2:172.21.15.120:3300/0 conn(0x7f1708143ac0 msgr2=0x7f1708070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.814 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 --2- 172.21.15.70:0/2428388735 >> v2:172.21.15.120:3300/0 conn(0x7f1708143ac0 0x7f1708070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708070ee0 con 0x7f17080cf7c0 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3953033169 0 0) 0x7f1700001a20 con 0x7f17080cf7c0 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 >> v1:172.21.15.70:6789/0 conn(0x7f17080cf7c0 legacy=0x7f17080b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0003980 0x7f16f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 0x7f16f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f16f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17080cc730 con 0x7f16f0004d10 2023-11-26T07:24:39.815 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f000dba0 con 0x7f16f0003980 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f000dce0 con 0x7f17080708b0 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f170c8b9640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f16f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f17077fe640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 0x7f16f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f1707fff640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0003980 0x7f16f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f170c8b9640 1 -- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 msgr2=0x7f16f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f170c8b9640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17080708b0 0x7f16f00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f170c8b9640 1 -- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0003980 msgr2=0x7f16f0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-26T07:24:39.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f170c8b9640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16f0003980 0x7f16f0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.817 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.814+0000 7f170c8b9640 1 -- 172.21.15.70:0/2428388735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0003530 con 0x7f16f0004d10 2023-11-26T07:24:39.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170c8b9640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f16f0005190 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f170000a850 tx=0x7f170001d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18b0cc2f9bc3cac server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000ad630 con 0x7f16f0004d10 2023-11-26T07:24:39.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f17000a8070 con 0x7f16f0004d10 2023-11-26T07:24:39.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f1706ffd640 1 -- 172.21.15.70:0/2428388735 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000ad9f0 con 0x7f16f0004d10 2023-11-26T07:24:39.818 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 -- 172.21.15.70:0/2428388735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 msgr2=0x7f16f0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 --2- 172.21.15.70:0/2428388735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f16f0005190 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f170000a850 tx=0x7f170001d320 comp rx=0 tx=0).stop 2023-11-26T07:24:39.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170c8b9640 1 -- 172.21.15.70:0/2428388735 reap_dead start 2023-11-26T07:24:39.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 -- 172.21.15.70:0/2428388735 shutdown_connections 2023-11-26T07:24:39.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 -- 172.21.15.70:0/2428388735 >> 172.21.15.70:0/2428388735 conn(0x7f170806a890 msgr2=0x7f170806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:39.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 -- 172.21.15.70:0/2428388735 shutdown_connections 2023-11-26T07:24:39.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 -- 172.21.15.70:0/2428388735 wait complete. 2023-11-26T07:24:39.819 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 Processor -- start 2023-11-26T07:24:39.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 -- start start 2023-11-26T07:24:39.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f17080add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.818+0000 7f170e31c640 1 --2- >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17081f2630 0x7f17080af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170e31c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17080b2db0 0x7f17080b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170e31c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17080b37a0 con 0x7f16f0004d10 2023-11-26T07:24:39.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170e31c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17081ee3c0 con 0x7f17080b2db0 2023-11-26T07:24:39.822 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170e31c640 1 -- --> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170815b780 con 0x7f17081f2630 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f17080add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f17080add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59634/0 (socket says 172.21.15.70:59634) 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 -- 172.21.15.70:0/4275279658 learned_addr learned my addr 172.21.15.70:0/4275279658 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f17077fe640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17081f2630 0x7f17080af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170c8b9640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17080b2db0 0x7f17080b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 -- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17081f2630 msgr2=0x7f17080af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17081f2630 0x7f17080af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 -- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17080b2db0 msgr2=0x7f17080b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17080b2db0 0x7f17080b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 -- 172.21.15.70:0/4275279658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080afda0 con 0x7f16f0004d10 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1707fff640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f17080add70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f16f8011a00 tx=0x7f16f8011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1704ff9640 1 -- 172.21.15.70:0/4275279658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800fb50 con 0x7f16f0004d10 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1704ff9640 1 -- 172.21.15.70:0/4275279658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16f800fcb0 con 0x7f16f0004d10 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17080b0080 con 0x7f16f0004d10 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1704ff9640 1 -- 172.21.15.70:0/4275279658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8014440 con 0x7f16f0004d10 2023-11-26T07:24:39.824 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17080b0640 con 0x7f16f0004d10 2023-11-26T07:24:39.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17080b1b20 con 0x7f16f0004d10 2023-11-26T07:24:39.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1704ff9640 1 -- 172.21.15.70:0/4275279658 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) v1 ==== 86821+0+0 (secure 0 0 0) 0x7f16f80145a0 con 0x7f16f0004d10 2023-11-26T07:24:39.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.822+0000 7f1704ff9640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16f4066f50 0x7f16f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-26T07:24:39.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.826+0000 7f1704ff9640 1 -- 172.21.15.70:0/4275279658 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f16f8083340 con 0x7f16f0004d10 2023-11-26T07:24:39.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.826+0000 7f17077fe640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16f4066f50 0x7f16f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-26T07:24:39.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.826+0000 7f17077fe640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16f4066f50 0x7f16f4069410 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f170815ae70 tx=0x7f16fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-26T07:24:39.827 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:39.826+0000 7f1704ff9640 1 -- 172.21.15.70:0/4275279658 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16f80520a0 con 0x7f16f0004d10 2023-11-26T07:24:40.010 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.010+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f170813b0f0 con 0x7f16f0004d10 2023-11-26T07:24:40.011 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.010+0000 7f1704ff9640 1 -- 172.21.15.70:0/4275279658 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f16f80556c0 con 0x7f16f0004d10 2023-11-26T07:24:40.011 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-26T07:24:40.012 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6559,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/162502503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":162502503},{"type":"v1","addr":"172.21.15.120:6835","nonce":162502503}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6864,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/3659422844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":3659422844},{"type":"v1","addr":"172.21.15.70:6835","nonce":3659422844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2807806185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2807806185},{"type":"v1","addr":"172.21.15.70:6837","nonce":2807806185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/2476461204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2476461204},{"type":"v1","addr":"172.21.15.120:6834","nonce":2476461204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":50}],"filesystems":[]} 2023-11-26T07:24:40.012 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 50 2023-11-26T07:24:40.013 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16f4066f50 msgr2=0x7f16f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:40.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16f4066f50 0x7f16f4069410 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f170815ae70 tx=0x7f16fc008040 comp rx=0 tx=0).stop 2023-11-26T07:24:40.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 msgr2=0x7f17080add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-26T07:24:40.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f17080add70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f16f8011a00 tx=0x7f16f8011ec0 comp rx=0 tx=0).stop 2023-11-26T07:24:40.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 shutdown_connections 2023-11-26T07:24:40.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17080b2db0 0x7f17080b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:40.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f17081f2630 0x7f17080af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:40.014 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:6832/2418872727,v1:172.21.15.70:6833/2418872727] conn(0x7f16f4066f50 0x7f16f4069410 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:40.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 --2- 172.21.15.70:0/4275279658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f0004d10 0x7f17080add70 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-26T07:24:40.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 >> 172.21.15.70:0/4275279658 conn(0x7f170806a890 msgr2=0x7f17080cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-26T07:24:40.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 shutdown_connections 2023-11-26T07:24:40.015 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-26T07:24:40.014+0000 7f170e31c640 1 -- 172.21.15.70:0/4275279658 wait complete. 2023-11-26T07:24:40.033 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-26T07:24:40.033 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-26T07:24:40.034 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-26T07:24:40.034 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:40.045 INFO:tasks.ceph.mds.a:Stopped 2023-11-26T07:24:40.045 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-26T07:24:40.045 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:40.099 INFO:tasks.ceph.mds.c:Stopped 2023-11-26T07:24:40.099 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-26T07:24:40.099 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:40.113 INFO:tasks.ceph.mds.b:Stopped 2023-11-26T07:24:40.113 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-26T07:24:40.113 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:40.169 INFO:tasks.ceph.mds.d:Stopped 2023-11-26T07:24:40.170 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-26T07:24:40.170 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-26T07:24:40.170 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:40.244 INFO:tasks.ceph.osd.0:Stopped 2023-11-26T07:24:40.245 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-26T07:24:40.245 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:40.333 INFO:tasks.ceph.osd.1:Stopped 2023-11-26T07:24:40.333 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-26T07:24:40.333 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:40.424 INFO:tasks.ceph.osd.2:Stopped 2023-11-26T07:24:40.425 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-26T07:24:40.425 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:45.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-26T07:24:46.526 INFO:tasks.ceph.osd.3:Stopped 2023-11-26T07:24:46.527 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-26T07:24:46.527 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:46.604 INFO:tasks.ceph.osd.4:Stopped 2023-11-26T07:24:46.604 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-26T07:24:46.604 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:46.695 INFO:tasks.ceph.osd.5:Stopped 2023-11-26T07:24:46.695 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-26T07:24:46.695 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:46.785 INFO:tasks.ceph.osd.6:Stopped 2023-11-26T07:24:46.785 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-26T07:24:46.785 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:46.854 INFO:tasks.ceph.osd.7:Stopped 2023-11-26T07:24:46.854 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-26T07:24:46.855 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-26T07:24:46.855 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:46.935 INFO:tasks.ceph.mgr.y:Stopped 2023-11-26T07:24:46.935 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-26T07:24:46.935 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:46.986 INFO:tasks.ceph.mgr.x:Stopped 2023-11-26T07:24:46.986 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-26T07:24:46.986 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-26T07:24:46.986 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:47.005 INFO:tasks.ceph.mon.a:Stopped 2023-11-26T07:24:47.005 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-26T07:24:47.005 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:47.021 INFO:tasks.ceph.mon.b:Stopped 2023-11-26T07:24:47.021 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-26T07:24:47.021 INFO:teuthology.orchestra.run:waiting for 300 2023-11-26T07:24:47.083 INFO:tasks.ceph.mon.c:Stopped 2023-11-26T07:24:47.083 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-26T07:24:47.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-26T07:24:47.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:24:47.118 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-26T07:24:47.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:24:47.802 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-26T07:24:48.024 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:24:48.024 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-26T07:24:48.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:24:48.215 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-26T07:24:48.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:24:48.414 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-26T07:24:48.647 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:24:48.647 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-26T07:24:48.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:24:48.887 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-26T07:24:49.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:24:49.058 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-26T07:24:49.217 INFO:tasks.ceph:Archiving mon data... 2023-11-26T07:24:49.219 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/data/mon.a.tgz 2023-11-26T07:24:49.219 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2023-11-26T07:24:49.228 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.UTCPaytetD 2023-11-26T07:24:49.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UTCPaytetD 2023-11-26T07:24:49.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.UTCPaytetD 2023-11-26T07:24:49.487 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.UTCPaytetD is 691KB 2023-11-26T07:24:49.558 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.UTCPaytetD 2023-11-26T07:24:49.566 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/data/mon.b.tgz 2023-11-26T07:24:49.566 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2023-11-26T07:24:49.576 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.R7Dmf5RpFh 2023-11-26T07:24:49.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.R7Dmf5RpFh 2023-11-26T07:24:49.763 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.R7Dmf5RpFh 2023-11-26T07:24:49.836 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.R7Dmf5RpFh is 693KB 2023-11-26T07:24:49.906 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.R7Dmf5RpFh 2023-11-26T07:24:49.915 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/data/mon.c.tgz 2023-11-26T07:24:49.915 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2023-11-26T07:24:49.963 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.Wbmm386BqK 2023-11-26T07:24:49.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Wbmm386BqK 2023-11-26T07:24:50.138 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.Wbmm386BqK 2023-11-26T07:24:50.216 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.Wbmm386BqK is 693KB 2023-11-26T07:24:50.286 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.Wbmm386BqK 2023-11-26T07:24:50.295 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-26T07:24:50.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-26T07:24:50.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-26T07:24:50.359 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-26T07:24:50.359 DEBUG:teuthology.orchestra.run.smithi070:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-26T07:24:50.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-26T07:24:50.392 INFO:teuthology.orchestra.run.smithi070.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-26T07:24:50.430 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-26T07:24:50.437 INFO:tasks.ceph:Archiving crash dumps... 2023-11-26T07:24:50.439 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/remote/smithi070/crash 2023-11-26T07:24:50.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-26T07:24:50.463 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/remote/smithi120/crash 2023-11-26T07:24:50.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-26T07:24:50.498 INFO:tasks.ceph:Shutting down logrotate 2023-11-26T07:24:50.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:50.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:50.582 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:50.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-26T07:24:50.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-26T07:24:50.642 INFO:tasks.ceph:Compressing logs... 2023-11-26T07:24:50.643 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-26T07:24:50.646 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-26T07:24:50.677 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52514.log 2023-11-26T07:24:50.678 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49339.log 2023-11-26T07:24:50.680 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54595.log 2023-11-26T07:24:50.680 INFO:teuthology.orchestra.run.smithi070.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52514.log.gz 2023-11-26T07:24:50.681 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48849.log 2023-11-26T07:24:50.681 INFO:teuthology.orchestra.run.smithi070.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49339.log.gz 2023-11-26T07:24:50.682 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56740.log 2023-11-26T07:24:50.682 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54595.log.gz 2023-11-26T07:24:50.683 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48849.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48849.log.gz 2023-11-26T07:24:50.683 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2023-11-26T07:24:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54263.log 2023-11-26T07:24:50.684 INFO:teuthology.orchestra.run.smithi070.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56740.log.gz 2023-11-26T07:24:50.685 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54786.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2023-11-26T07:24:50.685 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56604.log 2023-11-26T07:24:50.686 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2023-11-26T07:24:50.686 INFO:teuthology.orchestra.run.smithi070.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54263.log.gz 2023-11-26T07:24:50.687 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56604.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.56604.log.gz 2023-11-26T07:24:50.687 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55148.log 2023-11-26T07:24:50.688 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53880.log 2023-11-26T07:24:50.688 INFO:teuthology.orchestra.run.smithi070.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2023-11-26T07:24:50.689 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55148.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55148.log.gz 2023-11-26T07:24:50.689 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48284.log 2023-11-26T07:24:50.690 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55535.log 2023-11-26T07:24:50.690 INFO:teuthology.orchestra.run.smithi070.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53880.log.gz 2023-11-26T07:24:50.691 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46925.log 2023-11-26T07:24:50.691 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48284.log.gz 2023-11-26T07:24:50.692 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55535.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55535.log.gz 2023-11-26T07:24:50.692 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48524.log 2023-11-26T07:24:50.693 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46925.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46925.log.gz 2023-11-26T07:24:50.693 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2023-11-26T07:24:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45752.log 2023-11-26T07:24:50.694 INFO:teuthology.orchestra.run.smithi070.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48524.log.gz 2023-11-26T07:24:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48714.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2023-11-26T07:24:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49112.log 2023-11-26T07:24:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45752.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.45752.log.gz 2023-11-26T07:24:50.696 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.42616.log 2023-11-26T07:24:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43643.log 2023-11-26T07:24:50.697 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49112.log.gz 2023-11-26T07:24:50.698 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57527.log 2023-11-26T07:24:50.698 INFO:teuthology.orchestra.run.smithi070.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2023-11-26T07:24:50.699 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54103.log 2023-11-26T07:24:50.699 INFO:teuthology.orchestra.run.smithi070.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43643.log.gz 2023-11-26T07:24:50.700 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57527.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-26T07:24:50.700 INFO:teuthology.orchestra.run.smithi070.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57527.log.gz 2023-11-26T07:24:50.701 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54103.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.54103.log.gz 2023-11-26T07:24:50.701 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.44040.log 2023-11-26T07:24:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57761.log 2023-11-26T07:24:50.703 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44040.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2023-11-26T07:24:50.703 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46691.log 2023-11-26T07:24:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51568.log 2023-11-26T07:24:50.704 INFO:teuthology.orchestra.run.smithi070.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57761.log.gz 2023-11-26T07:24:50.705 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46691.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46691.log.gz 2023-11-26T07:24:50.705 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51805.log 2023-11-26T07:24:50.706 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51568.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2023-11-26T07:24:50.706 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.48823.log 2023-11-26T07:24:50.707 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54445.log 2023-11-26T07:24:50.707 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51805.log.gz 2023-11-26T07:24:50.710 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48823.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48823.log.gz 2023-11-26T07:24:50.710 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52802.log 2023-11-26T07:24:50.711 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54315.log 2023-11-26T07:24:50.711 INFO:teuthology.orchestra.run.smithi070.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54445.log.gz 2023-11-26T07:24:50.711 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52802.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52802.log.gz 2023-11-26T07:24:50.711 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.42896.log 2023-11-26T07:24:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45987.log 2023-11-26T07:24:50.712 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54315.log.gz 2023-11-26T07:24:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42896.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42896.log.gz 2023-11-26T07:24:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58023.log 2023-11-26T07:24:50.714 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57813.log 2023-11-26T07:24:50.714 INFO:teuthology.orchestra.run.smithi070.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45987.log.gz 2023-11-26T07:24:50.714 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52398.log 2023-11-26T07:24:50.714 INFO:teuthology.orchestra.run.smithi070.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58023.log.gz 2023-11-26T07:24:50.715 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52488.log 2023-11-26T07:24:50.715 INFO:teuthology.orchestra.run.smithi070.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57813.log.gz 2023-11-26T07:24:50.716 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38280.log 2023-11-26T07:24:50.716 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2023-11-26T07:24:50.717 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52398.log.gz 2023-11-26T07:24:50.717 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49770.log 2023-11-26T07:24:50.717 INFO:teuthology.orchestra.run.smithi070.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52488.log.gz 2023-11-26T07:24:50.719 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43899.log 2023-11-26T07:24:50.719 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44175.log 2023-11-26T07:24:50.719 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38280.log.gz 2023-11-26T07:24:50.719 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.1.43899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44329.log 2023-11-26T07:24:50.720 INFO:teuthology.orchestra.run.smithi120.stderr: 90.1%/var/log/ceph/ceph-client.1.44175.log: -- replaced with /var/log/ceph/ceph-client.1.43899.log.gz 2023-11-26T07:24:50.720 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2023-11-26T07:24:50.721 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2023-11-26T07:24:50.721 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46435.log 2023-11-26T07:24:50.721 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49770.log.gz 2023-11-26T07:24:50.721 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44879.log 2023-11-26T07:24:50.721 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2023-11-26T07:24:50.721 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46435.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46435.log.gz -5 2023-11-26T07:24:50.721 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56281.log 2023-11-26T07:24:50.724 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48688.log 2023-11-26T07:24:50.724 INFO:teuthology.orchestra.run.smithi070.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44879.log.gz 2023-11-26T07:24:50.724 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2023-11-26T07:24:50.724 INFO:teuthology.orchestra.run.smithi070.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56281.log.gz 2023-11-26T07:24:50.724 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49443.log 2023-11-26T07:24:50.725 INFO:teuthology.orchestra.run.smithi070.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48688.log.gz 2023-11-26T07:24:50.725 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38304.log 2023-11-26T07:24:50.726 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.1.44329.log: 93.2% -- replaced with /var/log/ceph/ceph-client.1.44175.log.gz 2023-11-26T07:24:50.726 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-26T07:24:50.726 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38304.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.38304.log.gz 2023-11-26T07:24:50.726 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-26T07:24:50.726 INFO:teuthology.orchestra.run.smithi120.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.44329.log.gz 2023-11-26T07:24:50.726 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-26T07:24:50.726 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-26T07:24:50.727 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-26T07:24:50.728 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38256.log 2023-11-26T07:24:50.728 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-26T07:24:50.729 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46122.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2023-11-26T07:24:50.730 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2023-11-26T07:24:50.730 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2023-11-26T07:24:50.730 INFO:teuthology.orchestra.run.smithi070.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49443.log.gz 2023-11-26T07:24:50.730 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43884.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2023-11-26T07:24:50.730 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-26T07:24:50.730 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2023-11-26T07:24:50.730 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz 2023-11-26T07:24:50.731 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42515.log 2023-11-26T07:24:50.731 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2023-11-26T07:24:50.731 INFO:teuthology.orchestra.run.smithi070.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2023-11-26T07:24:50.732 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44481.log 2023-11-26T07:24:50.733 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38256.log.gz 2023-11-26T07:24:50.733 INFO:teuthology.orchestra.run.smithi120.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-26T07:24:50.733 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44641.log 2023-11-26T07:24:50.733 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.1.44481.log: 93.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-26T07:24:50.733 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38328.log 2023-11-26T07:24:50.734 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42515.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42515.log.gz 2023-11-26T07:24:50.734 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45061.log 2023-11-26T07:24:50.734 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47119.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2023-11-26T07:24:50.734 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2023-11-26T07:24:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45061.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45061.log.gz 2023-11-26T07:24:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48442.log 2023-11-26T07:24:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45909.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2023-11-26T07:24:50.735 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57735.log 2023-11-26T07:24:50.737 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.1.44641.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-26T07:24:50.737 INFO:teuthology.orchestra.run.smithi120.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.1.44481.log.gz 2023-11-26T07:24:50.737 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38328.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38328.log.gz 2023-11-26T07:24:50.737 INFO:teuthology.orchestra.run.smithi120.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.1.44641.log.gz 2023-11-26T07:24:50.737 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-26T07:24:50.738 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38192.log 2023-11-26T07:24:50.738 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48442.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48442.log.gz 2023-11-26T07:24:50.738 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46513.log 2023-11-26T07:24:50.738 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57735.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57735.log.gz 2023-11-26T07:24:50.738 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43156.log 2023-11-26T07:24:50.740 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46513.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46513.log.gzgzip 2023-11-26T07:24:50.741 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2023-11-26T07:24:50.741 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43156.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43156.log.gz 2023-11-26T07:24:50.741 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2023-11-26T07:24:50.741 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45407.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz /var/log/ceph/ceph-client.admin.48662.log 2023-11-26T07:24:50.741 INFO:teuthology.orchestra.run.smithi070.stderr: 2023-11-26T07:24:50.741 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38168.log 2023-11-26T07:24:50.742 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38192.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38192.log.gz 2023-11-26T07:24:50.742 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-26T07:24:50.742 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38168.log: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-26T07:24:50.742 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38168.log.gz 2023-11-26T07:24:50.742 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-26T07:24:50.743 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44005.log 2023-11-26T07:24:50.744 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gz 2023-11-26T07:24:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2023-11-26T07:24:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48662.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2023-11-26T07:24:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51542.log 2023-11-26T07:24:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55380.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2023-11-26T07:24:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57218.log 2023-11-26T07:24:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51542.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51542.log.gz 2023-11-26T07:24:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2023-11-26T07:24:50.747 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-26T07:24:50.747 INFO:teuthology.orchestra.run.smithi120.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-26T07:24:50.747 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.3.44005.log: 90.7% -- replaced with /var/log/ceph/ceph-client.3.44005.log.gz 2023-11-26T07:24:50.747 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38352.log 2023-11-26T07:24:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57218.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57218.log.gz 2023-11-26T07:24:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51623.log 2023-11-26T07:24:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51980.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2023-11-26T07:24:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55016.log 2023-11-26T07:24:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51623.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51623.log.gz 2023-11-26T07:24:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47251.log 2023-11-26T07:24:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55016.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55016.log.gz 2023-11-26T07:24:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2023-11-26T07:24:50.750 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47251.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47251.log.gz 2023-11-26T07:24:50.750 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48982.log 2023-11-26T07:24:50.751 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38352.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38352.log.gz 2023-11-26T07:24:50.751 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38232.log 2023-11-26T07:24:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47586.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2023-11-26T07:24:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57501.log 2023-11-26T07:24:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48982.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48982.log.gz 2023-11-26T07:24:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49391.log 2023-11-26T07:24:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57501.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57501.log.gz 2023-11-26T07:24:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56630.log 2023-11-26T07:24:50.753 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38232.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38232.log.gz 2023-11-26T07:24:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49391.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49391.log.gz 2023-11-26T07:24:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55278.log 2023-11-26T07:24:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56630.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56630.log.gz 2023-11-26T07:24:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55070.log 2023-11-26T07:24:50.756 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55278.log.gz 2023-11-26T07:24:50.756 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45568.log 2023-11-26T07:24:50.757 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55070.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55070.log.gz 2023-11-26T07:24:50.757 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46409.log 2023-11-26T07:24:50.758 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45568.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45568.log.gz 2023-11-26T07:24:50.758 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57244.log 2023-11-26T07:24:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46409.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46409.log.gz 2023-11-26T07:24:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2023-11-26T07:24:50.760 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57244.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57244.log.gz 2023-11-26T07:24:50.760 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56688.log 2023-11-26T07:24:50.761 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44066.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2023-11-26T07:24:50.761 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45381.log 2023-11-26T07:24:50.762 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56688.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56688.log.gz 2023-11-26T07:24:50.762 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45883.log 2023-11-26T07:24:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45381.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45381.log.gz 2023-11-26T07:24:50.763 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53676.log 2023-11-26T07:24:50.764 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45883.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45883.log.gz 2023-11-26T07:24:50.764 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45009.log 2023-11-26T07:24:50.765 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53676.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53676.log.gz 2023-11-26T07:24:50.765 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45778.log 2023-11-26T07:24:50.766 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45009.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45009.log.gz 2023-11-26T07:24:50.766 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2023-11-26T07:24:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45778.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45778.log.gz 2023-11-26T07:24:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2023-11-26T07:24:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47093.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2023-11-26T07:24:50.769 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57449.log 2023-11-26T07:24:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51097.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2023-11-26T07:24:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49599.log 2023-11-26T07:24:50.771 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57449.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57449.log.gz 2023-11-26T07:24:50.771 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53816.log 2023-11-26T07:24:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49599.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49599.log.gz 2023-11-26T07:24:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49954.log 2023-11-26T07:24:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53816.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53816.log.gz 2023-11-26T07:24:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49060.log 2023-11-26T07:24:50.774 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49954.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49954.log.gz 2023-11-26T07:24:50.774 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42948.log 2023-11-26T07:24:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49060.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49060.log.gz 2023-11-26T07:24:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51727.log 2023-11-26T07:24:50.776 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42948.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42948.log.gz 2023-11-26T07:24:50.776 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56825.log 2023-11-26T07:24:50.777 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51727.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51727.log.gz 2023-11-26T07:24:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45542.log 2023-11-26T07:24:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56825.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56825.log.gz 2023-11-26T07:24:50.779 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-26T07:24:50.779 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45542.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45542.log.gz 2023-11-26T07:24:50.780 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43078.log 2023-11-26T07:24:50.781 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45433.log 2023-11-26T07:24:50.782 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43078.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43078.log.gz 2023-11-26T07:24:50.782 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53842.log 2023-11-26T07:24:50.783 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45433.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2023-11-26T07:24:50.784 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52646.log 2023-11-26T07:24:50.785 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 2023-11-26T07:24:50.786 INFO:teuthology.orchestra.run.smithi070.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53842.log.gz 2023-11-26T07:24:50.786 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52646.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52646.log.gz 2023-11-26T07:24:50.787 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51594.log 2023-11-26T07:24:50.788 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46174.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz 2023-11-26T07:24:50.788 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48875.log 2023-11-26T07:24:50.789 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56958.log 2023-11-26T07:24:50.790 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51594.log.gz 2023-11-26T07:24:50.791 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48875.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48875.log.gz 2023-11-26T07:24:50.791 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46044.log 2023-11-26T07:24:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56958.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56958.log.gz 2023-11-26T07:24:50.792 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50211.log 2023-11-26T07:24:50.793 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56447.log 2023-11-26T07:24:50.794 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46044.log.gz 2023-11-26T07:24:50.795 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50211.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50211.log.gz 2023-11-26T07:24:50.795 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2023-11-26T07:24:50.796 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56447.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56447.log.gz 2023-11-26T07:24:50.796 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49313.log 2023-11-26T07:24:50.798 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2023-11-26T07:24:50.798 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2023-11-26T07:24:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49313.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz 2023-11-26T07:24:50.799 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-26T07:24:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44092.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2023-11-26T07:24:50.801 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46743.log 2023-11-26T07:24:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54046.log 2023-11-26T07:24:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46743.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46743.log.gz 2023-11-26T07:24:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52293.log 2023-11-26T07:24:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54046.log: gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.54046.log.gz -- 2023-11-26T07:24:50.805 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.45672.log 2023-11-26T07:24:50.806 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52293.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52293.log.gz -5 2023-11-26T07:24:50.806 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2023-11-26T07:24:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49235.log 2023-11-26T07:24:50.808 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45672.log.gz 2023-11-26T07:24:50.809 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42974.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz 2023-11-26T07:24:50.809 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2023-11-26T07:24:50.810 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2023-11-26T07:24:50.811 INFO:teuthology.orchestra.run.smithi070.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49235.log.gz 2023-11-26T07:24:50.812 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46821.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2023-11-26T07:24:50.812 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43130.log 2023-11-26T07:24:50.813 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51201.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2023-11-26T07:24:50.813 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43832.log 2023-11-26T07:24:50.814 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48904.log 2023-11-26T07:24:50.814 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43130.log.gz 2023-11-26T07:24:50.815 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43832.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43832.log.gz 2023-11-26T07:24:50.816 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42840.log 2023-11-26T07:24:50.817 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48904.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48904.log.gz 2023-11-26T07:24:50.818 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43443.log 2023-11-26T07:24:50.818 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42840.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42840.log.gz 2023-11-26T07:24:50.819 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49365.log 2023-11-26T07:24:50.820 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46899.log 2023-11-26T07:24:50.820 INFO:teuthology.orchestra.run.smithi070.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43443.log.gz 2023-11-26T07:24:50.821 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49365.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49365.log.gz 2023-11-26T07:24:50.822 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2023-11-26T07:24:50.822 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46899.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46899.log.gz 2023-11-26T07:24:50.823 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43026.log 2023-11-26T07:24:50.824 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55122.log 2023-11-26T07:24:50.824 INFO:teuthology.orchestra.run.smithi070.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2023-11-26T07:24:50.825 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43026.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43026.log.gz 2023-11-26T07:24:50.826 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44643.log 2023-11-26T07:24:50.826 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55122.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55122.log.gz 2023-11-26T07:24:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49822.log 2023-11-26T07:24:50.828 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49980.log 2023-11-26T07:24:50.828 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44643.log.gz 2023-11-26T07:24:50.829 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49822.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49822.log.gz 2023-11-26T07:24:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57553.log 2023-11-26T07:24:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49980.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49980.log.gz 2023-11-26T07:24:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2023-11-26T07:24:50.832 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57553.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57553.log.gz 2023-11-26T07:24:50.833 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52006.log 2023-11-26T07:24:50.834 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45087.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2023-11-26T07:24:50.834 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50327.log 2023-11-26T07:24:50.835 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52006.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52006.log.gz 2023-11-26T07:24:50.836 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57579.log 2023-11-26T07:24:50.837 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53740.log 2023-11-26T07:24:50.837 INFO:teuthology.orchestra.run.smithi070.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50327.log.gz 2023-11-26T07:24:50.839 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2023-11-26T07:24:50.839 INFO:teuthology.orchestra.run.smithi070.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57579.log.gz 2023-11-26T07:24:50.840 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56474.log 2023-11-26T07:24:50.840 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53740.log.gz 2023-11-26T07:24:50.842 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43182.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2023-11-26T07:24:50.842 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54367.log 2023-11-26T07:24:50.843 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57683.log 2023-11-26T07:24:50.843 INFO:teuthology.orchestra.run.smithi070.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56474.log.gz 2023-11-26T07:24:50.844 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54367.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54367.log.gz 2023-11-26T07:24:50.844 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42868.log 2023-11-26T07:24:50.845 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49902.log 2023-11-26T07:24:50.846 INFO:teuthology.orchestra.run.smithi070.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57683.log.gz 2023-11-26T07:24:50.847 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42868.log.gz 2023-11-26T07:24:50.847 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44827.log 2023-11-26T07:24:50.849 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49902.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49902.log.gz 2023-11-26T07:24:50.849 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57349.log 2023-11-26T07:24:50.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53906.log 2023-11-26T07:24:50.851 INFO:teuthology.orchestra.run.smithi070.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44827.log.gz 2023-11-26T07:24:50.851 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57349.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57349.log.gz 2023-11-26T07:24:50.852 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38194.log 2023-11-26T07:24:50.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43434.log 2023-11-26T07:24:50.853 INFO:teuthology.orchestra.run.smithi070.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53906.log.gz 2023-11-26T07:24:50.854 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38194.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38194.log.gz 2023-11-26T07:24:50.855 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55096.log 2023-11-26T07:24:50.855 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43434.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43434.log.gz 2023-11-26T07:24:50.856 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54673.log 2023-11-26T07:24:50.857 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55096.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55096.log.gz 2023-11-26T07:24:50.858 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47067.log 2023-11-26T07:24:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54673.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54673.log.gz 2023-11-26T07:24:50.860 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2023-11-26T07:24:50.860 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47067.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47067.log.gz 2023-11-26T07:24:50.861 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57865.log 2023-11-26T07:24:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49625.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2023-11-26T07:24:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2023-11-26T07:24:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57865.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57865.log.gz 2023-11-26T07:24:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57323.log 2023-11-26T07:24:50.865 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46617.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2023-11-26T07:24:50.865 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53702.log 2023-11-26T07:24:50.867 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57323.log.gz 2023-11-26T07:24:50.867 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43436.log 2023-11-26T07:24:50.868 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53702.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53702.log.gz 2023-11-26T07:24:50.869 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46795.log 2023-11-26T07:24:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43436.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43436.log.gz 2023-11-26T07:24:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52957.log 2023-11-26T07:24:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52752.log 2023-11-26T07:24:50.872 INFO:teuthology.orchestra.run.smithi070.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46795.log.gz 2023-11-26T07:24:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52957.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52957.log.gz 2023-11-26T07:24:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50185.log 2023-11-26T07:24:50.874 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48468.log 2023-11-26T07:24:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50185.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52752.log.gz 2023-11-26T07:24:50.875 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2023-11-26T07:24:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43228.log 2023-11-26T07:24:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48468.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48468.log.gz 2023-11-26T07:24:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2023-11-26T07:24:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43228.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43228.log.gz 2023-11-26T07:24:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49573.log 2023-11-26T07:24:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50957.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2023-11-26T07:24:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55044.log 2023-11-26T07:24:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49573.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49573.log.gz 2023-11-26T07:24:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51831.log 2023-11-26T07:24:50.883 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46487.log 2023-11-26T07:24:50.883 INFO:teuthology.orchestra.run.smithi070.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55044.log.gz 2023-11-26T07:24:50.884 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43651.log 2023-11-26T07:24:50.885 INFO:teuthology.orchestra.run.smithi070.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51831.log.gz 2023-11-26T07:24:50.886 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44853.log 2023-11-26T07:24:50.886 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46487.log.gz 2023-11-26T07:24:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43651.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43651.log.gz 2023-11-26T07:24:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48258.log 2023-11-26T07:24:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44853.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44853.log.gz 2023-11-26T07:24:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54988.log 2023-11-26T07:24:50.891 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48258.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48258.log.gz 2023-11-26T07:24:50.891 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42788.log 2023-11-26T07:24:50.892 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54988.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54988.log.gz 2023-11-26T07:24:50.892 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44801.log 2023-11-26T07:24:50.893 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log 2023-11-26T07:24:50.894 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42788.log.gz 2023-11-26T07:24:50.894 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44801.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2023-11-26T07:24:50.895 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48930.log 2023-11-26T07:24:50.896 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46070.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-26T07:24:50.896 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2023-11-26T07:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48930.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48930.log.gz 2023-11-26T07:24:50.897 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2023-11-26T07:24:50.898 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51753.log 2023-11-26T07:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43910.log 2023-11-26T07:24:50.900 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2023-11-26T07:24:50.901 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51753.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51753.log.gz 2023-11-26T07:24:50.902 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43910.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43910.log.gz 2023-11-26T07:24:50.903 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46356.log 2023-11-26T07:24:50.904 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56877.log 2023-11-26T07:24:50.905 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46356.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46356.log.gz 2023-11-26T07:24:50.906 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43000.log 2023-11-26T07:24:50.907 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56877.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56877.log.gz 2023-11-26T07:24:50.907 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53942.log 2023-11-26T07:24:50.909 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43000.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43000.log.gzgzip 2023-11-26T07:24:50.909 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42922.log 2023-11-26T07:24:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47225.log 2023-11-26T07:24:50.910 INFO:teuthology.orchestra.run.smithi070.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53942.log.gz 2023-11-26T07:24:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48550.log 2023-11-26T07:24:50.912 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42922.log.gz 2023-11-26T07:24:50.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57839.log 2023-11-26T07:24:50.913 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47225.log.gz 2023-11-26T07:24:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48550.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48550.log.gz 2023-11-26T07:24:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56319.log 2023-11-26T07:24:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57839.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57839.log.gz 2023-11-26T07:24:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2023-11-26T07:24:50.917 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56319.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56319.log.gz 2023-11-26T07:24:50.918 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54647.log 2023-11-26T07:24:50.919 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43652.log: gzip -5 88.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz /var/log/ceph/ceph-client.admin.52620.log 2023-11-26T07:24:50.920 INFO:teuthology.orchestra.run.smithi070.stderr: 2023-11-26T07:24:50.920 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54647.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54647.log.gz 2023-11-26T07:24:50.922 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52620.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52620.log.gz 2023-11-26T07:24:50.923 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45490.log 2023-11-26T07:24:50.924 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44541.log 2023-11-26T07:24:50.925 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45490.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45490.log.gz 2023-11-26T07:24:50.925 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52195.log 2023-11-26T07:24:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.2.44541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43234.log 2023-11-26T07:24:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52195.log: 91.0% -- replaced with /var/log/ceph/ceph-client.2.44541.log.gz 2023-11-26T07:24:50.928 INFO:teuthology.orchestra.run.smithi070.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52195.log.gz 2023-11-26T07:24:50.930 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43234.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43234.log.gz 2023-11-26T07:24:50.930 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45935.log 2023-11-26T07:24:50.931 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53009.log 2023-11-26T07:24:50.933 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45935.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45935.log.gz 2023-11-26T07:24:50.933 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45698.log 2023-11-26T07:24:50.934 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53009.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53009.log.gz 2023-11-26T07:24:50.934 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43052.log 2023-11-26T07:24:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45698.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45698.log.gz 2023-11-26T07:24:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2023-11-26T07:24:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43052.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43052.log.gz 2023-11-26T07:24:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54129.log 2023-11-26T07:24:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44277.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2023-11-26T07:24:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2023-11-26T07:24:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54129.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54129.log.gz 2023-11-26T07:24:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56929.log 2023-11-26T07:24:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44144.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2023-11-26T07:24:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2023-11-26T07:24:50.944 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46769.log 2023-11-26T07:24:50.944 INFO:teuthology.orchestra.run.smithi070.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56929.log.gz 2023-11-26T07:24:50.946 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44170.log 2023-11-26T07:24:50.946 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2023-11-26T07:24:50.947 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51701.log 2023-11-26T07:24:50.947 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46769.log.gz 2023-11-26T07:24:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44170.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44170.log.gz 2023-11-26T07:24:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54543.log 2023-11-26T07:24:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51701.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51701.log.gz 2023-11-26T07:24:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51490.log 2023-11-26T07:24:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54543.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54543.log.gz 2023-11-26T07:24:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46278.log 2023-11-26T07:24:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51490.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51490.log.gz 2023-11-26T07:24:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56903.log 2023-11-26T07:24:50.955 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46278.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46278.log.gz 2023-11-26T07:24:50.955 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46330.log 2023-11-26T07:24:50.956 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50032.log 2023-11-26T07:24:50.957 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56903.log.gz 2023-11-26T07:24:50.958 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45804.log 2023-11-26T07:24:50.958 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46330.log.gz 2023-11-26T07:24:50.960 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2023-11-26T07:24:50.960 INFO:teuthology.orchestra.run.smithi070.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50032.log.gz 2023-11-26T07:24:50.961 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45804.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-26T07:24:50.961 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45804.log.gz 2023-11-26T07:24:50.962 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45830.log 2023-11-26T07:24:50.962 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2023-11-26T07:24:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.45830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57114.log 2023-11-26T07:24:50.965 INFO:teuthology.orchestra.run.smithi070.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45830.log.gz 2023-11-26T07:24:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48600.log 2023-11-26T07:24:50.968 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57114.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57114.log.gz 2023-11-26T07:24:50.968 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52110.log 2023-11-26T07:24:50.969 INFO:teuthology.orchestra.run.smithi120.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-26T07:24:50.969 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48600.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48600.log.gz 2023-11-26T07:24:50.970 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54497.log 2023-11-26T07:24:50.971 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52110.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52110.log.gz 2023-11-26T07:24:50.972 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57375.log 2023-11-26T07:24:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54497.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54497.log.gz 2023-11-26T07:24:50.973 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52084.log 2023-11-26T07:24:50.975 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57375.log.gz 2023-11-26T07:24:50.976 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51405.log 2023-11-26T07:24:50.976 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52084.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52084.log.gz 2023-11-26T07:24:50.977 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2023-11-26T07:24:50.979 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51405.log.gz 2023-11-26T07:24:50.979 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45224.log 2023-11-26T07:24:50.980 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54155.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 2023-11-26T07:24:50.981 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2023-11-26T07:24:50.982 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45224.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45224.log.gz 2023-11-26T07:24:50.983 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57140.log 2023-11-26T07:24:50.983 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44775.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2023-11-26T07:24:50.984 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51909.log 2023-11-26T07:24:50.986 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57140.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57140.log.gz 2023-11-26T07:24:50.987 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51909.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51909.log.gz 2023-11-26T07:24:50.987 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56984.log 2023-11-26T07:24:50.989 INFO:teuthology.orchestra.run.smithi120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-26T07:24:50.989 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50137.log 2023-11-26T07:24:50.990 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56984.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56984.log.gz 2023-11-26T07:24:50.991 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44931.log 2023-11-26T07:24:50.994 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.50137.log: /var/log/ceph/ceph-client.admin.44931.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44931.log.gz 2023-11-26T07:24:50.995 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51071.log 2023-11-26T07:24:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51071.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51071.log.gz 2023-11-26T07:24:50.998 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57270.log 2023-11-26T07:24:51.001 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57270.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57270.log.gz 2023-11-26T07:24:51.001 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45139.log 2023-11-26T07:24:51.004 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46565.log 2023-11-26T07:24:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46565.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46565.log.gz 2023-11-26T07:24:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45139.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45139.log.gz 2023-11-26T07:24:51.008 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54237.log 2023-11-26T07:24:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54237.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54237.log.gz 2023-11-26T07:24:51.011 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56500.log 2023-11-26T07:24:51.015 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56500.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56500.log.gz 2023-11-26T07:24:51.015 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51317.log 2023-11-26T07:24:51.018 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51317.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51317.log.gz 2023-11-26T07:24:51.018 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56369.log 2023-11-26T07:24:51.021 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56369.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56369.log.gz 2023-11-26T07:24:51.022 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48771.log 2023-11-26T07:24:51.023 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47033.log 2023-11-26T07:24:51.028 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47033.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47033.log.gz 2023-11-26T07:24:51.028 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48771.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48771.log.gz 2023-11-26T07:24:51.028 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56421.log 2023-11-26T07:24:51.031 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56421.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56421.log.gz 2023-11-26T07:24:51.032 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57891.log 2023-11-26T07:24:51.035 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57891.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57891.log.gz 2023-11-26T07:24:51.035 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56255.log 2023-11-26T07:24:51.038 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56255.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56255.log.gz 2023-11-26T07:24:51.038 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54753.log 2023-11-26T07:24:51.042 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54753.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54753.log.gz 2023-11-26T07:24:51.042 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53968.log 2023-11-26T07:24:51.045 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53968.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53968.log.gz 2023-11-26T07:24:51.045 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33223.log 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52247.log 2023-11-26T07:24:51.048 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.33223.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33223.log.gz 2023-11-26T07:24:51.051 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52247.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52247.log.gz 2023-11-26T07:24:51.052 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45328.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2023-11-26T07:24:51.055 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48310.log 2023-11-26T07:24:51.058 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48310.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48310.log.gz 2023-11-26T07:24:51.059 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42583.log 2023-11-26T07:24:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42583.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42583.log.gz 2023-11-26T07:24:51.062 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51431.log 2023-11-26T07:24:51.065 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51431.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51431.log.gz 2023-11-26T07:24:51.065 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-26T07:24:51.070 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-26T07:24:51.070 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53994.log 2023-11-26T07:24:51.073 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52454.log 2023-11-26T07:24:51.074 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53994.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53994.log.gz 2023-11-26T07:24:51.077 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52454.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52454.log.gz 2023-11-26T07:24:51.077 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2023-11-26T07:24:51.080 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43432.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2023-11-26T07:24:51.080 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43650.log 2023-11-26T07:24:51.083 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43650.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43650.log.gz 2023-11-26T07:24:51.084 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57423.log 2023-11-26T07:24:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57423.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57423.log.gz 2023-11-26T07:24:51.087 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52698.log 2023-11-26T07:24:51.090 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52698.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52698.log.gz 2023-11-26T07:24:51.090 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54020.log 2023-11-26T07:24:51.093 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54020.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54020.log.gz 2023-11-26T07:24:51.093 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44669.log 2023-11-26T07:24:51.096 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54393.log 2023-11-26T07:24:51.098 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44669.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44669.log.gz 2023-11-26T07:24:51.101 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47173.log 2023-11-26T07:24:51.101 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54393.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54393.log.gz 2023-11-26T07:24:51.104 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47173.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47173.log.gz 2023-11-26T07:24:51.104 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57605.log 2023-11-26T07:24:51.107 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57605.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57605.log.gz 2023-11-26T07:24:51.107 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2023-11-26T07:24:51.110 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44695.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2023-11-26T07:24:51.111 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46951.log 2023-11-26T07:24:51.114 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46951.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46951.log.gz 2023-11-26T07:24:51.114 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45646.log 2023-11-26T07:24:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45646.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45646.log.gz 2023-11-26T07:24:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2023-11-26T07:24:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45250.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2023-11-26T07:24:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2023-11-26T07:24:51.124 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49086.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2023-11-26T07:24:51.124 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49796.log 2023-11-26T07:24:51.128 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49796.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49796.log.gz 2023-11-26T07:24:51.128 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44905.log 2023-11-26T07:24:51.131 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44905.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44905.log.gz 2023-11-26T07:24:51.131 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53047.log 2023-11-26T07:24:51.134 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53047.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53047.log.gz 2023-11-26T07:24:51.134 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49164.log 2023-11-26T07:24:51.137 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49164.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49164.log.gz 2023-11-26T07:24:51.138 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2023-11-26T07:24:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44118.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2023-11-26T07:24:51.141 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2023-11-26T07:24:51.144 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2023-11-26T07:24:51.144 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45276.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2023-11-26T07:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48740.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2023-11-26T07:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54077.log 2023-11-26T07:24:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54077.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54077.log.gz 2023-11-26T07:24:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56851.log 2023-11-26T07:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56851.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56851.log.gz 2023-11-26T07:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2023-11-26T07:24:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49850.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gz 2023-11-26T07:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46018.log 2023-11-26T07:24:51.161 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46018.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46018.log.gz 2023-11-26T07:24:51.161 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56526.log 2023-11-26T07:24:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56526.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56526.log.gz 2023-11-26T07:24:51.164 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57297.log 2023-11-26T07:24:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57297.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57297.log.gz 2023-11-26T07:24:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56552.log 2023-11-26T07:24:51.171 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56552.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56552.log.gz 2023-11-26T07:24:51.171 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51779.log 2023-11-26T07:24:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51779.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51779.log.gz 2023-11-26T07:24:51.174 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50983.log 2023-11-26T07:24:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50983.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50983.log.gz 2023-11-26T07:24:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51021.log 2023-11-26T07:24:51.181 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51021.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51021.log.gz 2023-11-26T07:24:51.181 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2023-11-26T07:24:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2023-11-26T07:24:51.185 INFO:teuthology.orchestra.run.smithi070.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2023-11-26T07:24:51.186 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-26T07:24:51.186 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52346.log 2023-11-26T07:24:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46873.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gz 2023-11-26T07:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52346.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52346.log.gz 2023-11-26T07:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2023-11-26T07:24:51.195 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51883.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2023-11-26T07:24:51.195 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49034.log 2023-11-26T07:24:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49034.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49034.log.gz 2023-11-26T07:24:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43936.log 2023-11-26T07:24:51.202 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43936.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43936.log.gz 2023-11-26T07:24:51.202 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 2023-11-26T07:24:51.204 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2023-11-26T07:24:51.206 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50237.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2023-11-26T07:24:51.209 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46539.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2023-11-26T07:24:51.209 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52726.log 2023-11-26T07:24:51.212 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52726.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52726.log.gz 2023-11-26T07:24:51.212 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46304.log 2023-11-26T07:24:51.215 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46304.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46304.log.gz 2023-11-26T07:24:51.216 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52931.log 2023-11-26T07:24:51.219 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52931.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52931.log.gz 2023-11-26T07:24:51.219 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2023-11-26T07:24:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43640.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2023-11-26T07:24:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57475.log 2023-11-26T07:24:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57475.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57475.log.gz 2023-11-26T07:24:51.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44983.log 2023-11-26T07:24:51.227 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57657.log 2023-11-26T07:24:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57657.log.gz 2023-11-26T07:24:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44983.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44983.log.gz 2023-11-26T07:24:51.232 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38078.log 2023-11-26T07:24:51.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38078.log: 92.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.38078.log.gz -5 2023-11-26T07:24:51.235 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2023-11-26T07:24:51.239 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43222.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2023-11-26T07:24:51.239 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46252.log 2023-11-26T07:24:51.242 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46252.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46252.log.gz 2023-11-26T07:24:51.242 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2023-11-26T07:24:51.243 INFO:teuthology.orchestra.run.smithi120.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-26T07:24:51.245 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2023-11-26T07:24:51.245 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43220.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2023-11-26T07:24:51.248 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46717.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2023-11-26T07:24:51.249 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52983.log 2023-11-26T07:24:51.252 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52983.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52983.log.gz 2023-11-26T07:24:51.252 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2023-11-26T07:24:51.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54181.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gz 2023-11-26T07:24:51.255 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51675.log 2023-11-26T07:24:51.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51675.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51675.log.gz 2023-11-26T07:24:51.259 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2023-11-26T07:24:51.262 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43624.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2023-11-26T07:24:51.262 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47005.log 2023-11-26T07:24:51.266 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47005.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47005.log.gz 2023-11-26T07:24:51.266 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50289.log 2023-11-26T07:24:51.268 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2023-11-26T07:24:51.270 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50289.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50289.log.gz 2023-11-26T07:24:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46382.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2023-11-26T07:24:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48636.log 2023-11-26T07:24:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48636.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48636.log.gz 2023-11-26T07:24:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52857.log 2023-11-26T07:24:51.281 INFO:teuthology.orchestra.run.smithi120.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-26T07:24:51.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.52857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57631.log 2023-11-26T07:24:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48415.log 2023-11-26T07:24:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57631.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57631.log.gz 2023-11-26T07:24:51.291 INFO:teuthology.orchestra.run.smithi070.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-26T07:24:51.292 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54569.log 2023-11-26T07:24:51.294 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48415.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48415.log.gz 2023-11-26T07:24:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54569.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54569.log.gz 2023-11-26T07:24:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:gzip 93.8% -- replaced with /var/log/ceph/ceph-client.0.50137.log.gz 2023-11-26T07:24:51.298 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55174.log 2023-11-26T07:24:51.300 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2023-11-26T07:24:51.301 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55174.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55174.log.gz 2023-11-26T07:24:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43444.log 2023-11-26T07:24:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47534.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz 2023-11-26T07:24:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51857.log 2023-11-26T07:24:51.308 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43444.log.gz 2023-11-26T07:24:51.309 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45620.log 2023-11-26T07:24:51.311 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2023-11-26T07:24:51.313 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45620.log: 88.4% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45620.log.gz 2023-11-26T07:24:51.313 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51857.log.gz 2023-11-26T07:24:51.314 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2023-11-26T07:24:51.317 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43423.log: 88.2%gzip -5/var/log/ceph/ceph-client.admin.52372.log: --verbose -- /var/log/ceph/ceph-client.admin.48956.log 2023-11-26T07:24:51.317 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz 2023-11-26T07:24:51.317 INFO:teuthology.orchestra.run.smithi070.stderr: 2023-11-26T07:24:51.321 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48956.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48956.log.gz 2023-11-26T07:24:51.321 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57166.log 2023-11-26T07:24:51.322 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44450.log 2023-11-26T07:24:51.324 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57166.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57166.log.gz 2023-11-26T07:24:51.327 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57062.log 2023-11-26T07:24:51.328 INFO:teuthology.orchestra.run.smithi070.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44450.log.gz 2023-11-26T07:24:51.329 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2023-11-26T07:24:51.330 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57062.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57062.log.gz 2023-11-26T07:24:51.332 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51175.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2023-11-26T07:24:51.332 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2023-11-26T07:24:51.334 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2023-11-26T07:24:51.335 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47277.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2023-11-26T07:24:51.336 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43858.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2023-11-26T07:24:51.337 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57088.log 2023-11-26T07:24:51.339 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44957.log 2023-11-26T07:24:51.340 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57088.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57088.log.gz 2023-11-26T07:24:51.341 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44957.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44957.log.gz 2023-11-26T07:24:51.342 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47482.log 2023-11-26T07:24:51.343 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-26T07:24:51.345 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47482.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47482.log.gz 2023-11-26T07:24:51.347 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-26T07:24:51.351 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48389.log 2023-11-26T07:24:51.351 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56395.log 2023-11-26T07:24:51.351 INFO:teuthology.orchestra.run.smithi070.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-26T07:24:51.353 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48389.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48389.log.gz 2023-11-26T07:24:51.355 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49190.log 2023-11-26T07:24:51.358 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49190.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49190.log.gz 2023-11-26T07:24:51.359 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51954.log 2023-11-26T07:24:51.360 INFO:teuthology.orchestra.run.smithi070.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56395.log.gz 2023-11-26T07:24:51.363 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-26T07:24:51.363 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47508.log 2023-11-26T07:24:51.367 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47508.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47508.log.gz 2023-11-26T07:24:51.367 INFO:teuthology.orchestra.run.smithi070.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51954.log.gz 2023-11-26T07:24:51.368 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-26T07:24:51.371 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52032.log 2023-11-26T07:24:51.377 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2023-11-26T07:24:51.378 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52032.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52032.log.gz 2023-11-26T07:24:51.381 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43427.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2023-11-26T07:24:51.382 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43988.log 2023-11-26T07:24:51.386 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43988.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43988.log.gz 2023-11-26T07:24:51.387 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44196.log 2023-11-26T07:24:51.394 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44196.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44196.log.gz 2023-11-26T07:24:51.394 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54727.log 2023-11-26T07:24:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51379.log 2023-11-26T07:24:51.402 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54727.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54727.log.gz 2023-11-26T07:24:51.407 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51379.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51379.log.gz 2023-11-26T07:24:51.407 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50082.log 2023-11-26T07:24:51.412 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49261.log 2023-11-26T07:24:51.414 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50082.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50082.log.gz 2023-11-26T07:24:51.415 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-26T07:24:51.416 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2023-11-26T07:24:51.418 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49261.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49261.log.gz 2023-11-26T07:24:51.420 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55587.log 2023-11-26T07:24:51.421 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49138.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2023-11-26T07:24:51.423 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46461.log 2023-11-26T07:24:51.427 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55587.log: gzip/var/log/ceph/ceph-client.admin.46461.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46461.log.gz 2023-11-26T07:24:51.428 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54936.log 2023-11-26T07:24:51.428 INFO:teuthology.orchestra.run.smithi070.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55587.log.gz 2023-11-26T07:24:51.430 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52320.log 2023-11-26T07:24:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54936.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54936.log.gz 2023-11-26T07:24:51.431 INFO:teuthology.orchestra.run.smithi070.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-26T07:24:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52540.log 2023-11-26T07:24:51.433 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52320.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52320.log.gz 2023-11-26T07:24:51.433 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2023-11-26T07:24:51.435 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55509.log 2023-11-26T07:24:51.435 INFO:teuthology.orchestra.run.smithi070.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52540.log.gz 2023-11-26T07:24:51.436 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45459.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2023-11-26T07:24:51.437 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45191.log 2023-11-26T07:24:51.438 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55509.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55509.log.gz 2023-11-26T07:24:51.439 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54341.log 2023-11-26T07:24:51.440 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45191.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45191.log.gz 2023-11-26T07:24:51.441 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49508.log 2023-11-26T07:24:51.442 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54341.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54341.log.gz 2023-11-26T07:24:51.442 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57917.log 2023-11-26T07:24:51.444 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49508.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49508.log.gz 2023-11-26T07:24:51.444 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47434.log 2023-11-26T07:24:51.446 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57917.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57917.log.gz 2023-11-26T07:24:51.447 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52905.log 2023-11-26T07:24:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.47434.log: /var/log/ceph/ceph-client.admin.52905.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52905.log.gz 2023-11-26T07:24:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2023-11-26T07:24:51.453 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47147.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2023-11-26T07:24:51.454 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51649.log 2023-11-26T07:24:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51649.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51649.log.gz 2023-11-26T07:24:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51353.log 2023-11-26T07:24:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51353.log.gz 2023-11-26T07:24:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56766.log 2023-11-26T07:24:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56766.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56766.log.gz 2023-11-26T07:24:51.464 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54818.log 2023-11-26T07:24:51.467 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54818.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54818.log.gz 2023-11-26T07:24:51.467 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55561.log 2023-11-26T07:24:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55561.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55561.log.gz 2023-11-26T07:24:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55200.log 2023-11-26T07:24:51.473 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55200.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55200.log.gz 2023-11-26T07:24:51.474 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2023-11-26T07:24:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49736.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2023-11-26T07:24:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46847.log 2023-11-26T07:24:51.480 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44721.log 2023-11-26T07:24:51.484 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44721.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44721.log.gz 2023-11-26T07:24:51.484 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2023-11-26T07:24:51.484 INFO:teuthology.orchestra.run.smithi070.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46847.log.gz 2023-11-26T07:24:51.487 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43218.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2023-11-26T07:24:51.487 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2023-11-26T07:24:51.490 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47628.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2023-11-26T07:24:51.490 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53790.log 2023-11-26T07:24:51.494 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53790.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53790.log.gz 2023-11-26T07:24:51.494 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54621.log 2023-11-26T07:24:51.497 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54621.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54621.log.gz 2023-11-26T07:24:51.497 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48797.log 2023-11-26T07:24:51.500 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52426.log 2023-11-26T07:24:51.501 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48797.log.gz 2023-11-26T07:24:51.502 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49417.log 2023-11-26T07:24:51.507 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49417.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49417.log.gz 2023-11-26T07:24:51.507 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52426.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52426.log.gz 2023-11-26T07:24:51.508 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43962.log 2023-11-26T07:24:51.511 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43962.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43962.log.gz 2023-11-26T07:24:51.511 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52594.log 2023-11-26T07:24:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52594.log.gz 2023-11-26T07:24:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46200.log 2023-11-26T07:24:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46200.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46200.log.gz 2023-11-26T07:24:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2023-11-26T07:24:51.521 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51516.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2023-11-26T07:24:51.521 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54289.log 2023-11-26T07:24:51.525 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54289.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54289.log.gz 2023-11-26T07:24:51.525 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43104.log 2023-11-26T07:24:51.527 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54471.log 2023-11-26T07:24:51.529 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43104.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43104.log.gz 2023-11-26T07:24:51.531 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51253.log 2023-11-26T07:24:51.532 INFO:teuthology.orchestra.run.smithi070.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54471.log.gz 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51253.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51253.log.gz 2023-11-26T07:24:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2023-11-26T07:24:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51123.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2023-11-26T07:24:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57943.log 2023-11-26T07:24:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57943.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57943.log.gz 2023-11-26T07:24:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57036.log 2023-11-26T07:24:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57036.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57036.log.gz 2023-11-26T07:24:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2023-11-26T07:24:51.549 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52672.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2023-11-26T07:24:51.549 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2023-11-26T07:24:51.552 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43235.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2023-11-26T07:24:51.552 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2023-11-26T07:24:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45594.log 2023-11-26T07:24:51.555 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43636.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2023-11-26T07:24:51.558 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45516.log 2023-11-26T07:24:51.559 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45594.log.gz 2023-11-26T07:24:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45516.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45516.log.gz 2023-11-26T07:24:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2023-11-26T07:24:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49476.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2023-11-26T07:24:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43430.log 2023-11-26T07:24:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43430.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43430.log.gz 2023-11-26T07:24:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57192.log 2023-11-26T07:24:51.572 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2023-11-26T07:24:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57192.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57192.log.gz 2023-11-26T07:24:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47560.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2023-11-26T07:24:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47329.log 2023-11-26T07:24:51.580 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47329.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47329.log.gz 2023-11-26T07:24:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2023-11-26T07:24:51.584 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2023-11-26T07:24:51.584 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49680.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2023-11-26T07:24:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47199.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2023-11-26T07:24:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50263.log 2023-11-26T07:24:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50263.log: 93.8% -- replaced with /var/log/ceph/ceph-client.0.52857.log.gz 2023-11-26T07:24:51.590 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50263.log.gz 2023-11-26T07:24:51.590 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49928.log 2023-11-26T07:24:51.591 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44403.log 2023-11-26T07:24:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49928.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49928.log.gz 2023-11-26T07:24:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2023-11-26T07:24:51.595 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.44403.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.44403.log.gz 2023-11-26T07:24:51.596 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54419.log 2023-11-26T07:24:51.598 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42762.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2023-11-26T07:24:51.598 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.54419.log: /var/log/ceph/ceph-client.admin.45724.log 2023-11-26T07:24:51.599 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54419.log.gz 2023-11-26T07:24:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45724.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45724.log.gz 2023-11-26T07:24:51.601 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51291.log 2023-11-26T07:24:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54884.log 2023-11-26T07:24:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51291.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51291.log.gz 2023-11-26T07:24:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54884.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54884.log.gz 2023-11-26T07:24:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48363.log 2023-11-26T07:24:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55330.log 2023-11-26T07:24:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48363.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48363.log.gz 2023-11-26T07:24:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55330.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55330.log.gz 2023-11-26T07:24:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55304.log 2023-11-26T07:24:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49876.log 2023-11-26T07:24:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55304.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55304.log.gz 2023-11-26T07:24:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52568.log 2023-11-26T07:24:51.616 INFO:teuthology.orchestra.run.smithi070.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49876.log.gz 2023-11-26T07:24:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45165.log 2023-11-26T07:24:51.619 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52568.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52568.log.gz 2023-11-26T07:24:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45165.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45165.log.gz 2023-11-26T07:24:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57787.log 2023-11-26T07:24:51.622 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45035.log 2023-11-26T07:24:51.623 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57787.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57787.log.gz 2023-11-26T07:24:51.624 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45035.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45035.log.gz 2023-11-26T07:24:51.625 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51227.log 2023-11-26T07:24:51.627 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57010.log 2023-11-26T07:24:51.628 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51227.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51227.log.gz 2023-11-26T07:24:51.629 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57010.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57010.log.gz 2023-11-26T07:24:51.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2023-11-26T07:24:51.631 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2023-11-26T07:24:51.633 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45113.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2023-11-26T07:24:51.634 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44014.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-26T07:24:51.634 INFO:teuthology.orchestra.run.smithi070.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2023-11-26T07:24:51.635 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57997.log 2023-11-26T07:24:51.636 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45961.log 2023-11-26T07:24:51.638 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52058.log 2023-11-26T07:24:51.638 INFO:teuthology.orchestra.run.smithi070.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57997.log.gz 2023-11-26T07:24:51.639 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49654.log 2023-11-26T07:24:51.639 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45961.log.gz 2023-11-26T07:24:51.641 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55226.log 2023-11-26T07:24:51.641 INFO:teuthology.orchestra.run.smithi070.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52058.log.gz 2023-11-26T07:24:51.642 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55435.log 2023-11-26T07:24:51.642 INFO:teuthology.orchestra.run.smithi070.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49654.log.gz 2023-11-26T07:24:51.644 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55226.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55226.log.gz 2023-11-26T07:24:51.644 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56792.log 2023-11-26T07:24:51.645 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.55435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2023-11-26T07:24:51.647 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56792.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56792.log.gz 2023-11-26T07:24:51.648 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45302.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2023-11-26T07:24:51.648 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54210.log 2023-11-26T07:24:51.650 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51457.log 2023-11-26T07:24:51.651 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54210.log: 93.9% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54210.log.gz 2023-11-26T07:24:51.652 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-26T07:24:51.653 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51457.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51457.log.gz 2023-11-26T07:24:51.653 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2023-11-26T07:24:51.655 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56714.log 2023-11-26T07:24:51.656 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57709.log 2023-11-26T07:24:51.656 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2023-11-26T07:24:51.658 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50006.log 2023-11-26T07:24:51.658 INFO:teuthology.orchestra.run.smithi070.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56714.log.gz 2023-11-26T07:24:51.659 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52136.log 2023-11-26T07:24:51.659 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57709.log.gz 2023-11-26T07:24:51.660 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42681.log 2023-11-26T07:24:51.661 INFO:teuthology.orchestra.run.smithi070.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50006.log.gz 2023-11-26T07:24:51.661 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52136.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52136.log.gz 2023-11-26T07:24:51.663 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42681.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42681.log.gz 2023-11-26T07:24:51.664 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57973.log 2023-11-26T07:24:51.665 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44585.log 2023-11-26T07:24:51.667 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46096.log 2023-11-26T07:24:51.667 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57973.log.gz 2023-11-26T07:24:51.668 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46148.log 2023-11-26T07:24:51.668 INFO:teuthology.orchestra.run.smithi070.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44585.log.gz 2023-11-26T07:24:51.669 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2023-11-26T07:24:51.670 INFO:teuthology.orchestra.run.smithi070.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46096.log.gz 2023-11-26T07:24:51.671 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42814.log 2023-11-26T07:24:51.671 INFO:teuthology.orchestra.run.smithi070.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46148.log.gz 2023-11-26T07:24:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45355.log 2023-11-26T07:24:51.673 INFO:teuthology.orchestra.run.smithi070.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2023-11-26T07:24:51.673 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42814.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42814.log.gz 2023-11-26T07:24:51.675 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45355.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45355.log.gz 2023-11-26T07:24:51.675 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54910.log 2023-11-26T07:24:51.677 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52162.log 2023-11-26T07:24:51.679 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46977.log 2023-11-26T07:24:51.679 INFO:teuthology.orchestra.run.smithi070.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54910.log.gz 2023-11-26T07:24:51.681 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56656.log 2023-11-26T07:24:51.681 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52162.log.gz 2023-11-26T07:24:51.681 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46977.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46977.log.gz 2023-11-26T07:24:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56656.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.56656.log.gz 2023-11-26T07:24:51.683 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54701.log 2023-11-26T07:24:51.685 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55252.log 2023-11-26T07:24:51.686 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43236.log 2023-11-26T07:24:51.687 INFO:teuthology.orchestra.run.smithi070.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54701.log.gz 2023-11-26T07:24:51.687 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55252.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55252.log.gz 2023-11-26T07:24:51.689 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.43236.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43236.log.gz 2023-11-26T07:24:51.690 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55625.log 2023-11-26T07:24:51.691 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42707.log 2023-11-26T07:24:51.693 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56578.log 2023-11-26T07:24:51.693 INFO:teuthology.orchestra.run.smithi070.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55625.log.gz 2023-11-26T07:24:51.694 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55483.log 2023-11-26T07:24:51.694 INFO:teuthology.orchestra.run.smithi070.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2023-11-26T07:24:51.695 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56578.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.56578.log.gz -5 2023-11-26T07:24:51.696 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45856.log 2023-11-26T07:24:51.697 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2023-11-26T07:24:51.697 INFO:teuthology.orchestra.run.smithi070.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55483.log.gz 2023-11-26T07:24:51.698 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2023-11-26T07:24:51.699 INFO:teuthology.orchestra.run.smithi070.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45856.log.gz 2023-11-26T07:24:51.700 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46591.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2023-11-26T07:24:51.701 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51149.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2023-11-26T07:24:51.702 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54962.log 2023-11-26T07:24:51.704 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54962.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54962.log.gz 2023-11-26T07:24:51.711 INFO:teuthology.orchestra.run.smithi120.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-26T07:24:51.713 INFO:teuthology.orchestra.run.smithi120.stderr: 2023-11-26T07:24:51.713 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m1.023s 2023-11-26T07:24:51.713 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m3.422s 2023-11-26T07:24:51.713 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m0.309s 2023-11-26T07:24:51.744 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.47434.log.gz 2023-11-26T07:24:51.871 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.55435.log.gz 2023-11-26T07:24:51.967 INFO:teuthology.orchestra.run.smithi070.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-26T07:24:52.459 INFO:teuthology.orchestra.run.smithi070.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-26T07:24:53.189 INFO:teuthology.orchestra.run.smithi070.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-26T07:24:53.191 INFO:teuthology.orchestra.run.smithi070.stderr: 2023-11-26T07:24:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m2.542s 2023-11-26T07:24:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m8.397s 2023-11-26T07:24:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m1.597s 2023-11-26T07:24:53.193 INFO:tasks.ceph:Archiving logs... 2023-11-26T07:24:53.193 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/remote/smithi070/log 2023-11-26T07:24:53.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-26T07:24:54.382 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/remote/smithi120/log 2023-11-26T07:24:54.383 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-26T07:24:54.744 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-26T07:24:54.752 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-26T07:24:54.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-26T07:24:54.757 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-26T07:24:54.848 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-26T07:24:54.857 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-26T07:24:54.857 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:24:54.861 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-26T07:24:54.874 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2023-11-26T07:24:54.874 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2023-11-26T07:24:54.874 INFO:teuthology.orchestra.run.smithi070.stdout:*hv01.front.sepi 44.4.53.2 2 u 15 64 377 0.056 -5.591 2.215 2023-11-26T07:24:54.874 INFO:teuthology.orchestra.run.smithi070.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 377 0.070 -0.607 1.688 2023-11-26T07:24:54.874 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.066 -1.410 1.718 2023-11-26T07:24:54.874 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2023-11-26T07:24:54.876 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2023-11-26T07:24:54.876 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2023-11-26T07:24:54.877 INFO:teuthology.orchestra.run.smithi120.stdout:*hv01.front.sepi 44.4.53.2 2 u 9 64 377 0.096 -2.321 1.429 2023-11-26T07:24:54.877 INFO:teuthology.orchestra.run.smithi120.stdout:+hv02.front.sepi 63.231.80.2 3 u 17 64 377 0.101 -0.020 1.425 2023-11-26T07:24:54.877 INFO:teuthology.orchestra.run.smithi120.stdout:+hv03.front.sepi 74.6.168.72 3 u 11 64 377 0.080 -0.883 1.403 2023-11-26T07:24:54.877 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2023-11-26T07:24:54.878 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-26T07:24:54.886 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-26T07:24:54.886 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-26T07:24:54.907 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-26T07:24:54.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-26T07:24:54.930 INFO:teuthology.task.internal:Duration was 1197.909754 seconds 2023-11-26T07:24:54.930 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-26T07:24:54.939 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-26T07:24:54.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-26T07:24:54.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-26T07:24:55.054 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-26T07:24:55.054 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2023-11-26T07:24:55.054 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-26T07:24:55.076 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2023-11-26T07:24:55.076 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-26T07:24:55.098 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-26T07:24:55.098 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-26T07:24:55.126 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-26T07:24:55.177 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-26T07:24:55.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-26T07:24:55.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-26T07:24:55.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-26T07:24:55.297 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-26T07:24:55.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-26T07:24:55.318 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-26T07:24:55.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-26T07:24:55.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:24:55.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:24:55.376 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2023-11-26T07:24:55.397 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2023-11-26T07:24:55.416 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:24:55.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:24:55.442 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-26T07:24:55.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-26T07:24:55.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-26T07:24:55.477 INFO:teuthology.task.internal:Transferring archived files... 2023-11-26T07:24:55.477 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/remote/smithi070 2023-11-26T07:24:55.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-26T07:24:55.507 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346/remote/smithi120 2023-11-26T07:24:55.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-26T07:24:55.531 INFO:teuthology.task.internal:Removing archive directory... 2023-11-26T07:24:55.531 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-26T07:24:55.553 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-26T07:24:55.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-26T07:24:55.596 INFO:teuthology.task.internal:Not uploading archives. 2023-11-26T07:24:55.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-26T07:24:55.607 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-26T07:24:55.607 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-26T07:24:55.611 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-26T07:24:55.616 INFO:teuthology.orchestra.run.smithi070.stdout: 658039 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 26 07:24 /home/ubuntu/cephtest 2023-11-26T07:24:55.640 INFO:teuthology.orchestra.run.smithi120.stdout: 658043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 26 07:24 /home/ubuntu/cephtest 2023-11-26T07:24:55.641 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-26T07:24:55.652 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-26T07:24:55.672 INFO:teuthology.nuke:Checking targets against current locks 2023-11-26T07:24:55.697 DEBUG:teuthology.nuke:shortname: smithi070 2023-11-26T07:24:55.697 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T07:24:55.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:35.584132', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwGcDeN5UlXSGnqynym5VAsLTSHUH7LxShj1NoMs32gDEDwy0kTaxFiO9TjtltR60M1fHcQeIvGsH2+9g7R0cM='} 2023-11-26T07:24:55.723 DEBUG:teuthology.nuke:shortname: smithi120 2023-11-26T07:24:55.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-26T07:24:55.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-26_06:51:12-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7467346', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-26 06:52:35.585493', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKiQk+cQB//La6reCq57mDNs3AvdXVORTXZhFOX0jQrLpZSdY63aoFJdfUBYt3XMQg67xHjNFJN/Y62QPaX7hs0='} 2023-11-26T07:24:55.775 INFO:teuthology.orchestra.console.smithi070:Power off 2023-11-26T07:24:55.775 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-26T07:24:55.798 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-11-26T07:24:55.798 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:24:55.813 INFO:teuthology.orchestra.console.smithi120:Power off 2023-11-26T07:24:55.814 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-26T07:24:55.825 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-26T07:24:55.835 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2023-11-26T07:24:55.835 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:24:55.857 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-11-26T07:24:59.827 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:24:59.858 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:24:59.939 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-11-26T07:24:59.969 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-11-26T07:25:03.943 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:03.970 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-26T07:25:04.055 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-11-26T07:25:04.110 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-11-26T07:25:04.209 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-11-26T07:25:04.211 INFO:teuthology.orchestra.console.smithi120:Power off completed 2023-11-26T07:25:04.316 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} duration: 1197.909754037857 failure_reason: 'Test failure: test_clone_failure_status_pending_in_progress_complete (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)' flavor: default mon.a-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 mon.b-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=efd03f8ae89c4bee9e5d844142555bf5 status: fail success: false 2023-11-26T07:25:04.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-26T07:25:04.466 INFO:teuthology.run:FAIL